2024-04-26T11:31:40.038 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T11:31:40.039 DEBUG:teuthology.run:Teuthology command: teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_20.04 tasks/cfuse_workunit_suites_fsstress thrashosds-health} --owner scheduled_teuthology@teuthology --verbose --archive /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172 --name teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/orig.config.yaml 2024-04-26T11:31:40.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T11:31:40.155 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_20.04 tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674172' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: reef ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dc093b5e41f728edab6e0330295fdf9156d31664 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: dc093b5e41f728edab6e0330295fdf9156d31664 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 1136 sha1: dc093b5e41f728edab6e0330295fdf9156d31664 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T11:31:40.156 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa; will attempt to use it 2024-04-26T11:31:40.156 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa/tasks 2024-04-26T11:31:40.156 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T11:31:40.158 INFO:teuthology.task.internal:Checking packages... 2024-04-26T11:31:40.181 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'dc093b5e41f728edab6e0330295fdf9156d31664' 2024-04-26T11:31:40.181 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T11:31:40.181 INFO:teuthology.packaging:ref: None 2024-04-26T11:31:40.181 INFO:teuthology.packaging:tag: None 2024-04-26T11:31:40.181 INFO:teuthology.packaging:branch: reef 2024-04-26T11:31:40.181 INFO:teuthology.packaging:sha1: dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:31:40.181 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=reef 2024-04-26T11:31:40.600 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258-g7d2137f0-1focal 2024-04-26T11:31:40.601 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T11:31:40.612 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T11:31:40.613 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T11:31:40.684 INFO:teuthology.task.internal:Saving configuration 2024-04-26T11:31:40.698 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T11:31:40.706 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T11:31:40.731 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:24:00.064184', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-26T11:31:40.752 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:24:00.065513', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-26T11:31:40.775 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:24:00.062649', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-26T11:31:40.797 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:24:00.061017', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-26T11:31:40.797 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T11:31:40.805 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-26T11:31:40.805 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['osd.0'] 2024-04-26T11:31:40.805 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['osd.1'] 2024-04-26T11:31:40.805 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['osd.2'] 2024-04-26T11:31:40.805 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T11:31:40.940 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efc6c99d280>, signals=[15]) 2024-04-26T11:31:40.940 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T11:31:40.947 INFO:teuthology.task.internal:Opening connections... 2024-04-26T11:31:40.947 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T11:31:40.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:31:41.050 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:31:41.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:31:41.146 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:31:41.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:31:41.233 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-04-26T11:31:41.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:31:41.325 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T11:31:41.334 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-04-26T11:31:41.341 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-04-26T11:31:41.341 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-26T11:31:41.390 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu" 2024-04-26T11:31:41.390 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-26T11:31:41.390 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu 2024-04-26T11:31:41.390 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian 2024-04-26T11:31:41.390 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-26T11:31:41.390 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="20.04" 2024-04-26T11:31:41.390 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T11:31:41.390 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T11:31:41.390 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T11:31:41.390 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T11:31:41.391 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=focal 2024-04-26T11:31:41.391 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=focal 2024-04-26T11:31:41.391 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-26T11:31:41.416 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-04-26T11:31:41.424 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-04-26T11:31:41.424 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-04-26T11:31:41.472 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2024-04-26T11:31:41.472 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-26T11:31:41.472 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2024-04-26T11:31:41.472 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2024-04-26T11:31:41.472 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-26T11:31:41.473 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="20.04" 2024-04-26T11:31:41.473 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T11:31:41.473 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T11:31:41.473 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T11:31:41.473 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T11:31:41.473 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=focal 2024-04-26T11:31:41.473 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=focal 2024-04-26T11:31:41.473 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-04-26T11:31:41.491 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-04-26T11:31:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-04-26T11:31:41.498 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-04-26T11:31:41.547 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu" 2024-04-26T11:31:41.547 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-26T11:31:41.547 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu 2024-04-26T11:31:41.547 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian 2024-04-26T11:31:41.547 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-26T11:31:41.548 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="20.04" 2024-04-26T11:31:41.548 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T11:31:41.548 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T11:31:41.548 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T11:31:41.548 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T11:31:41.548 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=focal 2024-04-26T11:31:41.548 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=focal 2024-04-26T11:31:41.548 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-04-26T11:31:41.574 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-04-26T11:31:41.581 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-04-26T11:31:41.581 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-26T11:31:41.629 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Ubuntu" 2024-04-26T11:31:41.629 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-26T11:31:41.629 INFO:teuthology.orchestra.run.smithi122.stdout:ID=ubuntu 2024-04-26T11:31:41.629 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE=debian 2024-04-26T11:31:41.629 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-26T11:31:41.629 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="20.04" 2024-04-26T11:31:41.629 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T11:31:41.629 INFO:teuthology.orchestra.run.smithi122.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T11:31:41.629 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T11:31:41.630 INFO:teuthology.orchestra.run.smithi122.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T11:31:41.630 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_CODENAME=focal 2024-04-26T11:31:41.630 INFO:teuthology.orchestra.run.smithi122.stdout:UBUNTU_CODENAME=focal 2024-04-26T11:31:41.630 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-26T11:31:41.649 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T11:31:41.660 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T11:31:41.666 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T11:31:41.667 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:31:41.669 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:31:41.671 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:31:41.673 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:31:41.679 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T11:31:41.687 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T11:31:41.687 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:31:41.717 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:31:41.719 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:31:41.722 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:31:41.762 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T11:31:41.858 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T11:31:41.876 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T11:31:41.876 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T11:31:41.876 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:31:41.877 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:31:41.877 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:31:41.877 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:31:41.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:31:41.884 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-04-26T11:31:41.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:31:41.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:31:41.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:31:41.886 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-04-26T11:31:41.887 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-26T11:31:41.887 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-26T11:31:41.894 INFO:teuthology.orchestra.run.smithi082.stdout:5.4.0-124-generic 2024-04-26T11:31:41.894 INFO:teuthology.orchestra.run.smithi029.stdout:5.4.0-124-generic 2024-04-26T11:31:41.894 INFO:teuthology.task.kernel:Running kernel on smithi082: 5.4.0-124-generic 2024-04-26T11:31:41.894 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get clean 2024-04-26T11:31:41.895 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.4.0-124-generic 2024-04-26T11:31:41.895 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get clean 2024-04-26T11:31:41.896 INFO:teuthology.orchestra.run.smithi072.stdout:5.4.0-124-generic 2024-04-26T11:31:41.896 INFO:teuthology.task.kernel:Running kernel on smithi072: 5.4.0-124-generic 2024-04-26T11:31:41.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2024-04-26T11:31:41.933 INFO:teuthology.orchestra.run.smithi122.stdout:5.4.0-124-generic 2024-04-26T11:31:41.933 INFO:teuthology.task.kernel:Running kernel on smithi122: 5.4.0-124-generic 2024-04-26T11:31:41.933 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get clean 2024-04-26T11:31:42.042 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get update 2024-04-26T11:31:42.046 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-04-26T11:31:42.053 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2024-04-26T11:31:42.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-04-26T11:31:42.215 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:31:42.223 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:31:42.231 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-26T11:31:42.237 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:31:42.239 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-26T11:31:42.240 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:31:42.244 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-26T11:31:42.244 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-26T11:31:42.244 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-26T11:31:42.244 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-26T11:31:42.306 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-26T11:31:42.311 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-26T11:31:42.315 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-26T11:31:42.321 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-26T11:31:42.332 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-26T11:31:42.337 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-26T11:31:42.598 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [968 kB] 2024-04-26T11:31:42.604 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,270 kB] 2024-04-26T11:31:42.655 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,891 kB] 2024-04-26T11:31:42.658 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [743 kB] 2024-04-26T11:31:42.710 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,270 kB] 2024-04-26T11:31:42.756 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-26T11:31:42.762 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-26T11:31:42.762 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-26T11:31:42.762 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-26T11:31:42.783 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [968 kB] 2024-04-26T11:31:42.801 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-26T11:31:42.804 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-26T11:31:42.805 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-26T11:31:42.811 INFO:teuthology.orchestra.run.smithi122.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-26T11:31:42.813 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,891 kB] 2024-04-26T11:31:42.828 INFO:teuthology.orchestra.run.smithi122.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T11:31:42.828 INFO:teuthology.orchestra.run.smithi122.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,182 kB] 2024-04-26T11:31:42.837 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,270 kB] 2024-04-26T11:31:42.842 INFO:teuthology.orchestra.run.smithi122.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-26T11:31:42.846 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,270 kB] 2024-04-26T11:31:42.851 INFO:teuthology.orchestra.run.smithi122.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-26T11:31:42.859 INFO:teuthology.orchestra.run.smithi122.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-26T11:31:42.864 INFO:teuthology.orchestra.run.smithi122.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-26T11:31:42.865 INFO:teuthology.orchestra.run.smithi122.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-26T11:31:42.865 INFO:teuthology.orchestra.run.smithi122.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-26T11:31:42.876 INFO:teuthology.orchestra.run.smithi082.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-26T11:31:42.876 INFO:teuthology.orchestra.run.smithi082.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-26T11:31:42.876 INFO:teuthology.orchestra.run.smithi082.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T11:31:42.876 INFO:teuthology.orchestra.run.smithi082.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-26T11:31:42.879 INFO:teuthology.orchestra.run.smithi082.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,182 kB] 2024-04-26T11:31:42.893 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [743 kB] 2024-04-26T11:31:42.902 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [435 kB] 2024-04-26T11:31:42.907 INFO:teuthology.orchestra.run.smithi122.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [743 kB] 2024-04-26T11:31:42.907 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-26T11:31:42.908 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-26T11:31:42.908 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,772 kB] 2024-04-26T11:31:42.919 INFO:teuthology.orchestra.run.smithi082.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-26T11:31:42.921 INFO:teuthology.orchestra.run.smithi122.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-26T11:31:42.922 INFO:teuthology.orchestra.run.smithi122.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-26T11:31:42.922 INFO:teuthology.orchestra.run.smithi122.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-26T11:31:42.923 INFO:teuthology.orchestra.run.smithi122.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-26T11:31:42.923 INFO:teuthology.orchestra.run.smithi122.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-26T11:31:42.925 INFO:teuthology.orchestra.run.smithi122.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-26T11:31:42.926 INFO:teuthology.orchestra.run.smithi122.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-26T11:31:42.926 INFO:teuthology.orchestra.run.smithi082.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-26T11:31:42.927 INFO:teuthology.orchestra.run.smithi082.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-26T11:31:42.927 INFO:teuthology.orchestra.run.smithi082.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-26T11:31:42.941 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [435 kB] 2024-04-26T11:31:42.946 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-26T11:31:42.946 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,772 kB] 2024-04-26T11:31:42.957 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [387 kB] 2024-04-26T11:31:42.958 INFO:teuthology.orchestra.run.smithi082.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [743 kB] 2024-04-26T11:31:42.959 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T11:31:42.959 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [957 kB] 2024-04-26T11:31:42.962 INFO:teuthology.orchestra.run.smithi082.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-26T11:31:42.963 INFO:teuthology.orchestra.run.smithi082.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-26T11:31:42.963 INFO:teuthology.orchestra.run.smithi082.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-26T11:31:42.964 INFO:teuthology.orchestra.run.smithi082.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-26T11:31:42.964 INFO:teuthology.orchestra.run.smithi082.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-26T11:31:42.966 INFO:teuthology.orchestra.run.smithi082.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-26T11:31:42.976 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-26T11:31:42.986 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-26T11:31:42.988 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-26T11:31:42.991 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-26T11:31:42.991 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-26T11:31:42.991 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-26T11:31:42.994 INFO:teuthology.orchestra.run.smithi082.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-26T11:31:42.995 INFO:teuthology.orchestra.run.smithi082.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-26T11:31:43.008 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-26T11:31:43.008 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [387 kB] 2024-04-26T11:31:43.013 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T11:31:43.013 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-26T11:31:43.014 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-26T11:31:43.022 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [957 kB] 2024-04-26T11:31:43.033 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-26T11:31:43.036 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-26T11:31:43.036 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-26T11:31:43.036 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-26T11:31:43.091 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [968 kB] 2024-04-26T11:31:43.095 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-26T11:31:43.095 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-26T11:31:43.101 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-26T11:31:43.106 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-26T11:31:43.107 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-26T11:31:43.107 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [968 kB] 2024-04-26T11:31:43.122 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-26T11:31:43.128 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-26T11:31:43.128 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-26T11:31:43.156 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-26T11:31:43.156 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-26T11:31:43.162 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T11:31:43.162 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,182 kB] 2024-04-26T11:31:43.180 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-26T11:31:43.180 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-26T11:31:43.185 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T11:31:43.185 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,182 kB] 2024-04-26T11:31:43.186 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-26T11:31:43.200 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-26T11:31:43.204 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-26T11:31:43.204 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-26T11:31:43.205 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-26T11:31:43.207 INFO:teuthology.orchestra.run.smithi029.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-26T11:31:43.215 INFO:teuthology.orchestra.run.smithi029.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-26T11:31:43.218 INFO:teuthology.orchestra.run.smithi029.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-26T11:31:43.219 INFO:teuthology.orchestra.run.smithi029.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-26T11:31:43.219 INFO:teuthology.orchestra.run.smithi029.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-26T11:31:43.222 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-26T11:31:43.222 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-26T11:31:43.223 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-26T11:31:43.223 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-26T11:31:43.224 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-26T11:31:43.224 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-26T11:31:43.236 INFO:teuthology.orchestra.run.smithi029.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-26T11:31:43.236 INFO:teuthology.orchestra.run.smithi029.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-26T11:31:43.237 INFO:teuthology.orchestra.run.smithi029.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-26T11:31:43.237 INFO:teuthology.orchestra.run.smithi029.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-26T11:31:43.238 INFO:teuthology.orchestra.run.smithi029.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-26T11:31:43.238 INFO:teuthology.orchestra.run.smithi029.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-26T11:31:43.243 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-26T11:31:43.244 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-26T11:31:43.244 INFO:teuthology.orchestra.run.smithi122.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,891 kB] 2024-04-26T11:31:43.256 INFO:teuthology.orchestra.run.smithi029.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-26T11:31:43.257 INFO:teuthology.orchestra.run.smithi029.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-26T11:31:43.326 INFO:teuthology.orchestra.run.smithi082.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,891 kB] 2024-04-26T11:31:43.437 INFO:teuthology.orchestra.run.smithi122.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [435 kB] 2024-04-26T11:31:43.451 INFO:teuthology.orchestra.run.smithi122.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-26T11:31:43.451 INFO:teuthology.orchestra.run.smithi122.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-26T11:31:43.452 INFO:teuthology.orchestra.run.smithi122.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,772 kB] 2024-04-26T11:31:43.526 INFO:teuthology.orchestra.run.smithi122.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [387 kB] 2024-04-26T11:31:43.536 INFO:teuthology.orchestra.run.smithi122.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T11:31:43.536 INFO:teuthology.orchestra.run.smithi122.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-26T11:31:43.564 INFO:teuthology.orchestra.run.smithi122.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [957 kB] 2024-04-26T11:31:43.666 INFO:teuthology.orchestra.run.smithi082.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [435 kB] 2024-04-26T11:31:43.678 INFO:teuthology.orchestra.run.smithi082.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-26T11:31:43.679 INFO:teuthology.orchestra.run.smithi082.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-26T11:31:43.680 INFO:teuthology.orchestra.run.smithi082.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,772 kB] 2024-04-26T11:31:43.746 INFO:teuthology.orchestra.run.smithi122.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-26T11:31:43.759 INFO:teuthology.orchestra.run.smithi082.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [387 kB] 2024-04-26T11:31:43.764 INFO:teuthology.orchestra.run.smithi082.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T11:31:43.765 INFO:teuthology.orchestra.run.smithi082.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-26T11:31:43.799 INFO:teuthology.orchestra.run.smithi082.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [957 kB] 2024-04-26T11:31:43.991 INFO:teuthology.orchestra.run.smithi082.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-26T11:31:44.180 INFO:teuthology.orchestra.run.smithi122.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-26T11:31:44.185 INFO:teuthology.orchestra.run.smithi122.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-26T11:31:44.191 INFO:teuthology.orchestra.run.smithi122.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-26T11:31:44.193 INFO:teuthology.orchestra.run.smithi122.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-26T11:31:44.196 INFO:teuthology.orchestra.run.smithi122.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-26T11:31:44.561 INFO:teuthology.orchestra.run.smithi082.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-26T11:31:44.571 INFO:teuthology.orchestra.run.smithi082.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-26T11:31:44.574 INFO:teuthology.orchestra.run.smithi082.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-26T11:31:44.588 INFO:teuthology.orchestra.run.smithi082.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-26T11:31:44.607 INFO:teuthology.orchestra.run.smithi082.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-26T11:31:46.838 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 20.0 MB in 3s (7,117 kB/s) 2024-04-26T11:31:46.886 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 20.0 MB in 3s (6,913 kB/s) 2024-04-26T11:31:47.071 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 20.0 MB in 3s (6,796 kB/s) 2024-04-26T11:31:47.334 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 20.0 MB in 3s (6,491 kB/s) 2024-04-26T11:31:48.349 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-04-26T11:31:48.358 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-26T11:31:48.375 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:31:48.386 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:31:48.442 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-04-26T11:31:48.463 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-26T11:31:48.653 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2024-04-26T11:31:48.653 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2024-04-26T11:31:48.679 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-04-26T11:31:48.680 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-04-26T11:31:48.853 INFO:teuthology.orchestra.run.smithi082.stdout:The following additional packages will be installed: 2024-04-26T11:31:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T11:31:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-26T11:31:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-26T11:31:48.855 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2024-04-26T11:31:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-26T11:31:48.855 INFO:teuthology.orchestra.run.smithi082.stdout:Recommended packages: 2024-04-26T11:31:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: thermald 2024-04-26T11:31:48.889 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-04-26T11:31:48.889 INFO:teuthology.orchestra.run.smithi122.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T11:31:48.889 INFO:teuthology.orchestra.run.smithi122.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-26T11:31:48.890 INFO:teuthology.orchestra.run.smithi122.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-26T11:31:48.890 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-04-26T11:31:48.891 INFO:teuthology.orchestra.run.smithi122.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-26T11:31:48.891 INFO:teuthology.orchestra.run.smithi122.stdout:Recommended packages: 2024-04-26T11:31:48.891 INFO:teuthology.orchestra.run.smithi122.stdout: thermald 2024-04-26T11:31:48.910 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2024-04-26T11:31:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T11:31:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-26T11:31:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-26T11:31:48.911 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages will be upgraded: 2024-04-26T11:31:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T11:31:48.953 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-04-26T11:31:48.953 INFO:teuthology.orchestra.run.smithi122.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T11:31:48.953 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-26T11:31:48.953 INFO:teuthology.orchestra.run.smithi122.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-26T11:31:48.954 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages will be upgraded: 2024-04-26T11:31:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T11:31:49.095 INFO:teuthology.orchestra.run.smithi082.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T11:31:49.095 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 77.1 MB of archives. 2024-04-26T11:31:49.096 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-26T11:31:49.096 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-26T11:31:49.138 INFO:teuthology.orchestra.run.smithi122.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T11:31:49.138 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 77.1 MB of archives. 2024-04-26T11:31:49.138 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-26T11:31:49.139 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-26T11:31:49.172 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T11:31:49.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:31:49.282 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T11:31:49.478 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T11:31:49.494 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-04-26T11:31:49.494 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-04-26T11:31:49.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:31:49.597 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T11:31:49.682 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-04-26T11:31:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T11:31:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-26T11:31:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-26T11:31:49.684 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-04-26T11:31:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-26T11:31:49.684 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2024-04-26T11:31:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: thermald 2024-04-26T11:31:49.742 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-04-26T11:31:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T11:31:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-26T11:31:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-26T11:31:49.744 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages will be upgraded: 2024-04-26T11:31:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T11:31:49.814 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-04-26T11:31:49.814 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-04-26T11:31:49.928 INFO:teuthology.orchestra.run.smithi072.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T11:31:49.928 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 77.1 MB of archives. 2024-04-26T11:31:49.928 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-26T11:31:49.928 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-26T11:31:50.019 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2024-04-26T11:31:50.019 INFO:teuthology.orchestra.run.smithi029.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T11:31:50.019 INFO:teuthology.orchestra.run.smithi029.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-26T11:31:50.019 INFO:teuthology.orchestra.run.smithi029.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-26T11:31:50.020 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2024-04-26T11:31:50.020 INFO:teuthology.orchestra.run.smithi029.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-26T11:31:50.021 INFO:teuthology.orchestra.run.smithi029.stdout:Recommended packages: 2024-04-26T11:31:50.021 INFO:teuthology.orchestra.run.smithi029.stdout: thermald 2024-04-26T11:31:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2024-04-26T11:31:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T11:31:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-26T11:31:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-26T11:31:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages will be upgraded: 2024-04-26T11:31:50.077 INFO:teuthology.orchestra.run.smithi029.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T11:31:50.194 INFO:teuthology.orchestra.run.smithi029.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T11:31:50.195 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 77.1 MB of archives. 2024-04-26T11:31:50.195 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-26T11:31:50.195 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-26T11:31:50.217 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-26T11:31:50.302 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-26T11:31:50.487 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-26T11:31:50.621 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-26T11:31:50.995 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-26T11:31:51.065 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-26T11:31:51.150 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-26T11:31:51.336 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-26T11:31:51.821 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-26T11:31:51.821 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-26T11:31:51.822 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-26T11:31:51.927 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-26T11:31:51.928 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-26T11:31:51.928 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-26T11:31:51.997 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-26T11:31:52.122 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-26T11:31:52.163 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-26T11:31:52.164 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-26T11:31:52.164 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-26T11:31:52.218 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-26T11:31:52.245 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-26T11:31:52.318 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-26T11:31:52.333 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-26T11:31:52.729 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-26T11:31:52.729 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-26T11:31:52.729 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-26T11:31:52.869 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 77.1 MB in 3s (23.8 MB/s) 2024-04-26T11:31:52.937 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 77.1 MB in 3s (23.5 MB/s) 2024-04-26T11:31:53.052 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-26T11:31:53.085 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-26T11:31:53.095 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-26T11:31:53.121 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-26T11:31:53.310 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 77.1 MB in 2s (34.3 MB/s) 2024-04-26T11:31:53.528 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-26T11:31:53.803 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 77.1 MB in 3s (23.1 MB/s) 2024-04-26T11:31:54.059 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-26T11:31:54.801 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-26T11:31:54.805 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:54.848 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-26T11:31:54.853 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:54.906 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:31:54.935 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:31:55.999 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-26T11:31:56.004 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:56.068 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:31:56.553 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-26T11:31:56.557 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:56.616 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:31:56.831 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-26T11:31:56.847 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:56.852 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-26T11:31:56.868 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:56.959 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:31:56.971 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:31:58.063 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-26T11:31:58.075 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-26T11:31:58.076 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:58.090 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:58.113 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:31:58.130 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-26T11:31:58.133 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:31:58.145 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:58.258 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:31:58.577 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-26T11:31:58.591 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:58.684 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:31:59.462 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-26T11:31:59.476 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:59.521 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:31:59.868 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-26T11:31:59.881 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:31:59.926 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:02.868 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:02.993 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:03.055 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:03.182 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:03.314 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:03.525 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:03.654 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:03.726 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:04.005 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-26T11:32:04.019 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-26T11:32:04.072 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T11:32:04.082 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-26T11:32:04.100 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-26T11:32:04.140 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T11:32:04.290 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:04.621 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:04.749 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:04.805 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:04.934 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:05.101 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:05.231 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:05.314 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-26T11:32:05.329 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-26T11:32:05.372 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T11:32:05.604 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-26T11:32:05.619 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-26T11:32:05.663 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T11:32:09.512 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-26T11:32:09.534 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:32:09.570 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-26T11:32:09.731 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:32:09.782 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:11.354 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-26T11:32:11.377 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:32:11.420 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:12.192 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:12.228 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-26T11:32:12.251 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T11:32:12.294 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:12.313 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:12.526 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:12.646 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:12.669 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:13.003 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:13.846 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T11:32:13.972 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:14.482 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:14.697 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:14.820 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:14.883 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T11:32:15.009 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:15.813 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T11:32:15.940 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T11:32:16.287 INFO:teuthology.orchestra.run.smithi082.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:16.287 INFO:teuthology.orchestra.run.smithi082.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:16.314 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:16.410 INFO:teuthology.orchestra.run.smithi122.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:16.410 INFO:teuthology.orchestra.run.smithi122.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:16.428 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-26T11:32:16.545 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-26T11:32:16.554 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:16.671 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:17.077 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:17.571 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T11:32:17.698 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:17.781 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-26T11:32:17.860 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:17.880 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-26T11:32:17.907 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-26T11:32:18.006 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-26T11:32:18.058 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:18.133 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:18.135 INFO:teuthology.orchestra.run.smithi082.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T11:32:18.136 INFO:teuthology.orchestra.run.smithi082.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:18.205 INFO:teuthology.orchestra.run.smithi122.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T11:32:18.205 INFO:teuthology.orchestra.run.smithi122.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:18.304 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T11:32:18.431 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:18.558 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:19.045 INFO:teuthology.orchestra.run.smithi029.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:19.045 INFO:teuthology.orchestra.run.smithi029.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:19.188 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-26T11:32:19.315 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:19.696 INFO:teuthology.orchestra.run.smithi072.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:19.696 INFO:teuthology.orchestra.run.smithi072.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:19.830 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-26T11:32:19.965 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:21.126 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-26T11:32:21.253 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-26T11:32:21.382 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:21.452 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T11:32:21.452 INFO:teuthology.orchestra.run.smithi072.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:22.062 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-26T11:32:22.188 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-26T11:32:22.316 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T11:32:22.383 INFO:teuthology.orchestra.run.smithi029.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T11:32:22.383 INFO:teuthology.orchestra.run.smithi029.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:39.881 INFO:teuthology.orchestra.run.smithi082.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T11:32:39.881 INFO:teuthology.orchestra.run.smithi082.stdout:Sourcing file `/etc/default/grub' 2024-04-26T11:32:39.893 INFO:teuthology.orchestra.run.smithi082.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:32:39.914 INFO:teuthology.orchestra.run.smithi082.stdout:Generating grub configuration file ... 2024-04-26T11:32:39.992 INFO:teuthology.orchestra.run.smithi122.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T11:32:39.993 INFO:teuthology.orchestra.run.smithi122.stdout:Sourcing file `/etc/default/grub' 2024-04-26T11:32:40.012 INFO:teuthology.orchestra.run.smithi122.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:32:40.032 INFO:teuthology.orchestra.run.smithi122.stdout:Generating grub configuration file ... 2024-04-26T11:32:40.276 INFO:teuthology.orchestra.run.smithi082.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:40.295 INFO:teuthology.orchestra.run.smithi082.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:40.330 INFO:teuthology.orchestra.run.smithi122.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:40.354 INFO:teuthology.orchestra.run.smithi122.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:40.718 INFO:teuthology.orchestra.run.smithi122.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T11:32:40.730 INFO:teuthology.orchestra.run.smithi122.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T11:32:40.773 INFO:teuthology.orchestra.run.smithi082.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T11:32:40.785 INFO:teuthology.orchestra.run.smithi082.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T11:32:42.728 INFO:teuthology.orchestra.run.smithi122.stdout:done 2024-04-26T11:32:42.770 INFO:teuthology.orchestra.run.smithi082.stdout:done 2024-04-26T11:32:43.124 DEBUG:teuthology.orchestra.run.smithi122:> dpkg -s linux-image-generic 2024-04-26T11:32:43.173 INFO:teuthology.orchestra.run.smithi122.stdout:Package: linux-image-generic 2024-04-26T11:32:43.173 INFO:teuthology.orchestra.run.smithi122.stdout:Status: install ok installed 2024-04-26T11:32:43.173 INFO:teuthology.orchestra.run.smithi122.stdout:Priority: optional 2024-04-26T11:32:43.173 INFO:teuthology.orchestra.run.smithi122.stdout:Section: kernel 2024-04-26T11:32:43.173 INFO:teuthology.orchestra.run.smithi122.stdout:Installed-Size: 20 2024-04-26T11:32:43.173 INFO:teuthology.orchestra.run.smithi122.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:32:43.173 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: amd64 2024-04-26T11:32:43.173 INFO:teuthology.orchestra.run.smithi122.stdout:Source: linux-meta 2024-04-26T11:32:43.173 INFO:teuthology.orchestra.run.smithi122.stdout:Version: 5.4.0.177.175 2024-04-26T11:32:43.174 INFO:teuthology.orchestra.run.smithi122.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T11:32:43.174 INFO:teuthology.orchestra.run.smithi122.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:32:43.174 INFO:teuthology.orchestra.run.smithi122.stdout:Recommends: thermald 2024-04-26T11:32:43.174 INFO:teuthology.orchestra.run.smithi122.stdout:Description: Generic Linux kernel image 2024-04-26T11:32:43.174 INFO:teuthology.orchestra.run.smithi122.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:32:43.174 INFO:teuthology.orchestra.run.smithi122.stdout: available. 2024-04-26T11:32:43.174 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-26T11:32:43.174 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:32:43.174 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:32:43.175 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-26T11:32:43.175 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:32:43.175 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get clean 2024-04-26T11:32:43.205 DEBUG:teuthology.orchestra.run.smithi082:> dpkg -s linux-image-generic 2024-04-26T11:32:43.261 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-04-26T11:32:43.270 INFO:teuthology.orchestra.run.smithi082.stdout:Package: linux-image-generic 2024-04-26T11:32:43.270 INFO:teuthology.orchestra.run.smithi082.stdout:Status: install ok installed 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout:Priority: optional 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout:Section: kernel 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout:Installed-Size: 20 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: amd64 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout:Source: linux-meta 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout:Version: 5.4.0.177.175 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout:Recommends: thermald 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout:Description: Generic Linux kernel image 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:32:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: available. 2024-04-26T11:32:43.272 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-26T11:32:43.272 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:32:43.272 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:32:43.272 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-26T11:32:43.272 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:32:43.273 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get clean 2024-04-26T11:32:43.356 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get update 2024-04-26T11:32:43.418 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:32:43.418 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T11:32:43.427 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T11:32:43.447 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T11:32:43.491 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:32:43.491 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T11:32:43.500 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T11:32:43.521 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T11:32:44.935 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T11:32:44.935 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub' 2024-04-26T11:32:44.957 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:32:44.982 INFO:teuthology.orchestra.run.smithi072.stdout:Generating grub configuration file ... 2024-04-26T11:32:45.201 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-26T11:32:45.227 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:32:45.276 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-04-26T11:32:45.295 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-26T11:32:45.300 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:32:45.333 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:45.369 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-04-26T11:32:45.385 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:45.481 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-04-26T11:32:45.482 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-04-26T11:32:45.579 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2024-04-26T11:32:45.580 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2024-04-26T11:32:45.701 INFO:teuthology.orchestra.run.smithi122.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-26T11:32:45.701 INFO:teuthology.orchestra.run.smithi122.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T11:32:45.703 DEBUG:teuthology.orchestra.run.smithi122:> dpkg -s linux-image-generic 2024-04-26T11:32:45.724 INFO:teuthology.orchestra.run.smithi122.stdout:Package: linux-image-generic 2024-04-26T11:32:45.724 INFO:teuthology.orchestra.run.smithi122.stdout:Status: install ok installed 2024-04-26T11:32:45.724 INFO:teuthology.orchestra.run.smithi122.stdout:Priority: optional 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout:Section: kernel 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout:Installed-Size: 20 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: amd64 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout:Source: linux-meta 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout:Version: 5.4.0.177.175 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout:Recommends: thermald 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout:Description: Generic Linux kernel image 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:32:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: available. 2024-04-26T11:32:45.726 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-04-26T11:32:45.773 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.9WVI9x12yH 2024-04-26T11:32:45.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9WVI9x12yH 2024-04-26T11:32:45.796 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.9WVI9x12yH 2024-04-26T11:32:45.807 INFO:teuthology.orchestra.run.smithi082.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-26T11:32:45.808 INFO:teuthology.orchestra.run.smithi082.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T11:32:45.810 DEBUG:teuthology.orchestra.run.smithi082:> dpkg -s linux-image-generic 2024-04-26T11:32:45.833 INFO:teuthology.orchestra.run.smithi082.stdout:Package: linux-image-generic 2024-04-26T11:32:45.833 INFO:teuthology.orchestra.run.smithi082.stdout:Status: install ok installed 2024-04-26T11:32:45.833 INFO:teuthology.orchestra.run.smithi082.stdout:Priority: optional 2024-04-26T11:32:45.833 INFO:teuthology.orchestra.run.smithi082.stdout:Section: kernel 2024-04-26T11:32:45.833 INFO:teuthology.orchestra.run.smithi082.stdout:Installed-Size: 20 2024-04-26T11:32:45.833 INFO:teuthology.orchestra.run.smithi082.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:32:45.833 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: amd64 2024-04-26T11:32:45.833 INFO:teuthology.orchestra.run.smithi082.stdout:Source: linux-meta 2024-04-26T11:32:45.833 INFO:teuthology.orchestra.run.smithi082.stdout:Version: 5.4.0.177.175 2024-04-26T11:32:45.833 INFO:teuthology.orchestra.run.smithi082.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T11:32:45.833 INFO:teuthology.orchestra.run.smithi082.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:32:45.834 INFO:teuthology.orchestra.run.smithi082.stdout:Recommends: thermald 2024-04-26T11:32:45.834 INFO:teuthology.orchestra.run.smithi082.stdout:Description: Generic Linux kernel image 2024-04-26T11:32:45.834 INFO:teuthology.orchestra.run.smithi082.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:32:45.834 INFO:teuthology.orchestra.run.smithi082.stdout: available. 2024-04-26T11:32:45.834 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-04-26T11:32:45.839 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.ru4djPROKr 2024-04-26T11:32:45.839 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ru4djPROKr 2024-04-26T11:32:45.840 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.9WVI9x12yH is 9KB 2024-04-26T11:32:45.854 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.9WVI9x12yH 2024-04-26T11:32:45.860 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T11:32:45.895 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.ru4djPROKr 2024-04-26T11:32:45.916 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:32:45.916 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T11:32:45.916 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T11:32:45.929 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T11:32:45.941 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T11:32:45.951 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.ru4djPROKr is 9KB 2024-04-26T11:32:45.954 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-26T11:32:45.954 DEBUG:teuthology.orchestra.run.smithi122:> sudo update-grub 2024-04-26T11:32:45.966 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.ru4djPROKr 2024-04-26T11:32:45.972 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T11:32:46.028 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:32:46.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T11:32:46.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T11:32:46.071 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-26T11:32:46.071 DEBUG:teuthology.orchestra.run.smithi082:> sudo update-grub 2024-04-26T11:32:46.350 INFO:teuthology.orchestra.run.smithi029.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T11:32:46.350 INFO:teuthology.orchestra.run.smithi029.stdout:Sourcing file `/etc/default/grub' 2024-04-26T11:32:46.368 INFO:teuthology.orchestra.run.smithi029.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:32:46.397 INFO:teuthology.orchestra.run.smithi029.stdout:Generating grub configuration file ... 2024-04-26T11:32:46.736 INFO:teuthology.orchestra.run.smithi029.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:46.773 INFO:teuthology.orchestra.run.smithi029.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:47.157 INFO:teuthology.orchestra.run.smithi029.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T11:32:47.169 INFO:teuthology.orchestra.run.smithi029.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T11:32:47.230 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub' 2024-04-26T11:32:47.234 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:32:47.248 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-04-26T11:32:47.444 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub' 2024-04-26T11:32:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:32:47.466 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-04-26T11:32:47.545 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:47.557 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:47.720 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:47.732 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T11:32:47.927 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T11:32:48.123 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T11:32:48.135 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T11:32:48.221 INFO:teuthology.orchestra.run.smithi072.stdout:done 2024-04-26T11:32:48.680 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2024-04-26T11:32:48.739 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2024-04-26T11:32:48.739 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2024-04-26T11:32:48.739 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2024-04-26T11:32:48.739 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2024-04-26T11:32:48.739 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 20 2024-04-26T11:32:48.739 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:32:48.739 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2024-04-26T11:32:48.740 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2024-04-26T11:32:48.740 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.4.0.177.175 2024-04-26T11:32:48.740 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T11:32:48.740 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:32:48.740 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2024-04-26T11:32:48.740 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2024-04-26T11:32:48.740 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:32:48.740 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2024-04-26T11:32:48.740 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-26T11:32:48.740 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:32:48.740 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:32:48.741 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-26T11:32:48.741 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:32:48.741 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2024-04-26T11:32:48.853 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-04-26T11:32:48.910 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-04-26T11:32:48.912 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2024-04-26T11:32:48.989 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:32:49.000 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T11:32:49.021 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T11:32:49.101 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T11:32:49.120 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-04-26T11:32:49.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-04-26T11:32:49.203 INFO:teuthology.orchestra.run.smithi029.stdout:done 2024-04-26T11:32:49.660 DEBUG:teuthology.orchestra.run.smithi029:> dpkg -s linux-image-generic 2024-04-26T11:32:49.711 INFO:teuthology.orchestra.run.smithi029.stdout:Package: linux-image-generic 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Status: install ok installed 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Priority: optional 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Section: kernel 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Installed-Size: 20 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: amd64 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Source: linux-meta 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Version: 5.4.0.177.175 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Recommends: thermald 2024-04-26T11:32:49.712 INFO:teuthology.orchestra.run.smithi029.stdout:Description: Generic Linux kernel image 2024-04-26T11:32:49.713 INFO:teuthology.orchestra.run.smithi029.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:32:49.713 INFO:teuthology.orchestra.run.smithi029.stdout: available. 2024-04-26T11:32:49.713 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-26T11:32:49.714 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:32:49.714 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:32:49.714 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-26T11:32:49.714 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:32:49.714 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get clean 2024-04-26T11:32:49.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2024-04-26T11:32:49.930 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:32:49.940 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T11:32:49.962 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T11:32:50.040 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T11:32:50.805 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T11:32:50.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:32:50.898 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T11:32:51.109 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-04-26T11:32:51.110 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-04-26T11:32:51.345 INFO:teuthology.orchestra.run.smithi072.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-26T11:32:51.346 INFO:teuthology.orchestra.run.smithi072.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T11:32:51.348 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2024-04-26T11:32:51.364 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2024-04-26T11:32:51.364 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2024-04-26T11:32:51.364 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2024-04-26T11:32:51.364 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2024-04-26T11:32:51.364 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 20 2024-04-26T11:32:51.364 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:32:51.364 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2024-04-26T11:32:51.364 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2024-04-26T11:32:51.364 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.4.0.177.175 2024-04-26T11:32:51.364 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T11:32:51.365 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:32:51.365 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2024-04-26T11:32:51.365 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2024-04-26T11:32:51.365 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:32:51.365 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2024-04-26T11:32:51.365 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-04-26T11:32:51.371 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.9wSFvH312Q 2024-04-26T11:32:51.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9wSFvH312Q 2024-04-26T11:32:51.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.9wSFvH312Q 2024-04-26T11:32:51.432 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.9wSFvH312Q is 9KB 2024-04-26T11:32:51.446 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.9wSFvH312Q 2024-04-26T11:32:51.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T11:32:51.509 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:32:51.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T11:32:51.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T11:32:51.541 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-26T11:32:51.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo update-grub 2024-04-26T11:32:51.788 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T11:32:51.815 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:32:51.889 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T11:32:52.106 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-04-26T11:32:52.107 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-04-26T11:32:52.351 INFO:teuthology.orchestra.run.smithi029.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-26T11:32:52.351 INFO:teuthology.orchestra.run.smithi029.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T11:32:52.353 DEBUG:teuthology.orchestra.run.smithi029:> dpkg -s linux-image-generic 2024-04-26T11:32:52.372 INFO:teuthology.orchestra.run.smithi029.stdout:Package: linux-image-generic 2024-04-26T11:32:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Status: install ok installed 2024-04-26T11:32:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Priority: optional 2024-04-26T11:32:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Section: kernel 2024-04-26T11:32:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Installed-Size: 20 2024-04-26T11:32:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:32:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: amd64 2024-04-26T11:32:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Source: linux-meta 2024-04-26T11:32:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Version: 5.4.0.177.175 2024-04-26T11:32:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T11:32:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:32:52.373 INFO:teuthology.orchestra.run.smithi029.stdout:Recommends: thermald 2024-04-26T11:32:52.374 INFO:teuthology.orchestra.run.smithi029.stdout:Description: Generic Linux kernel image 2024-04-26T11:32:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:32:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: available. 2024-04-26T11:32:52.374 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-26T11:32:52.380 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.NKgKMhGFa7 2024-04-26T11:32:52.380 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NKgKMhGFa7 2024-04-26T11:32:52.404 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.NKgKMhGFa7 2024-04-26T11:32:52.505 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.NKgKMhGFa7 is 9KB 2024-04-26T11:32:52.519 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.NKgKMhGFa7 2024-04-26T11:32:52.525 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T11:32:52.583 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:32:52.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T11:32:52.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T11:32:52.615 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-26T11:32:52.615 DEBUG:teuthology.orchestra.run.smithi029:> sudo update-grub 2024-04-26T11:32:53.600 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub' 2024-04-26T11:32:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:32:53.631 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2024-04-26T11:32:53.949 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:53.961 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:54.328 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T11:32:54.339 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T11:32:54.867 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub' 2024-04-26T11:32:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:32:54.904 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-04-26T11:32:55.197 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T11:32:55.210 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T11:32:55.338 INFO:teuthology.orchestra.run.smithi072.stderr:done 2024-04-26T11:32:55.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2024-04-26T11:32:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T11:32:55.583 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T11:32:56.346 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-04-26T11:32:56.347 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-04-26T11:33:18.934 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-26T11:33:18.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:33:18.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:33:19.124 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-26T11:33:19.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:33:19.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:33:25.346 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-26T11:33:25.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:33:25.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:33:26.350 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T11:33:26.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:33:26.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:33:53.567 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-26T11:33:59.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-26T11:34:02.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:34:02.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:34:08.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:34:08.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:34:19.134 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T11:34:20.958 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-26T11:34:26.354 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T11:34:27.358 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-26T11:34:28.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:34:28.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:34:28.530 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-26T11:34:29.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:34:29.678 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.4.0-177-generic"... 2024-04-26T11:34:29.678 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-04-26T11:34:29.684 INFO:teuthology.orchestra.run.smithi082.stdout:5.4.0-177-generic 2024-04-26T11:34:29.685 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-26T11:34:29.685 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:34:29.685 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T11:34:30.686 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-26T11:34:30.686 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:34:30.873 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2024-04-26T11:34:30.897 DEBUG:teuthology.parallel:result is None 2024-04-26T11:34:32.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:34:32.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:34:33.374 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-26T11:34:34.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:34:34.500 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.4.0-177-generic"... 2024-04-26T11:34:34.500 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-04-26T11:34:34.506 INFO:teuthology.orchestra.run.smithi122.stdout:5.4.0-177-generic 2024-04-26T11:34:34.507 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-26T11:34:34.507 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:34:34.507 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T11:34:35.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:34:35.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:34:35.507 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-26T11:34:35.508 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:34:35.601 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2024-04-26T11:34:35.621 DEBUG:teuthology.parallel:result is None 2024-04-26T11:34:38.399 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-26T11:34:39.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:34:39.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:34:40.075 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-26T11:34:41.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:34:41.336 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.4.0-177-generic"... 2024-04-26T11:34:41.336 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-26T11:34:41.343 INFO:teuthology.orchestra.run.smithi072.stdout:5.4.0-177-generic 2024-04-26T11:34:41.343 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-26T11:34:41.343 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:34:41.343 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T11:34:42.344 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-26T11:34:42.345 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:34:42.517 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2024-04-26T11:34:42.540 DEBUG:teuthology.parallel:result is None 2024-04-26T11:34:50.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:34:50.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:34:50.641 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-26T11:34:51.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:34:51.333 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-177-generic"... 2024-04-26T11:34:51.334 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-26T11:34:51.382 INFO:teuthology.orchestra.run.smithi029.stdout:5.4.0-177-generic 2024-04-26T11:34:51.383 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-26T11:34:51.383 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:34:51.383 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T11:34:52.384 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T11:34:52.384 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:34:52.540 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2024-04-26T11:34:52.567 DEBUG:teuthology.parallel:result is None 2024-04-26T11:34:52.568 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T11:34:52.575 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T11:34:52.575 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:34:52.577 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:34:52.580 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:34:52.582 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:34:52.589 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T11:34:52.596 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T11:34:52.602 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T11:34:52.602 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:34:52.626 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:34:52.628 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:34:52.632 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:34:52.659 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T11:34:52.665 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T11:34:52.666 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:34:52.668 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:34:52.670 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:34:52.672 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:34:52.689 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:34:52.691 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:34:52.697 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:34:52.699 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:34:52.701 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:34:52.710 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:34:52.720 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:34:52.730 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:34:52.732 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T11:34:52.740 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T11:34:52.740 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:34:52.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:34:52.748 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:34:52.751 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:34:52.766 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T11:34:52.775 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T11:34:52.775 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:34:52.777 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:34:52.779 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:34:52.808 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:34:52.815 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:34:52.822 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:34:52.871 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:34:52.871 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:34:52.892 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:34:52.899 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:34:52.906 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:34:52.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:34:52.926 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:34:52.934 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:34:52.941 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:34:52.941 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:34:53.016 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:34:53.023 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:34:53.030 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:34:53.031 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:34:53.061 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-04-26T11:34:53.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-04-26T11:34:53.066 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-04-26T11:34:53.068 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-04-26T11:34:53.156 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T11:34:53.163 INFO:teuthology.task.internal:Starting timer... 2024-04-26T11:34:53.164 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T11:34:53.173 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T11:34:53.181 DEBUG:teuthology.task.selinux:Excluding smithi029: OS 'ubuntu' does not support SELinux 2024-04-26T11:34:53.181 DEBUG:teuthology.task.selinux:Excluding smithi072: OS 'ubuntu' does not support SELinux 2024-04-26T11:34:53.181 DEBUG:teuthology.task.selinux:Excluding smithi082: OS 'ubuntu' does not support SELinux 2024-04-26T11:34:53.181 DEBUG:teuthology.task.selinux:Excluding smithi122: OS 'ubuntu' does not support SELinux 2024-04-26T11:34:53.182 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T11:34:53.182 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T11:34:53.182 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T11:34:53.182 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T11:34:53.191 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T11:34:53.209 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T11:34:53.210 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi072.front.sepia.ceph.com,smithi082.front.sepia.ceph.com,smithi122.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T11:40:42.179 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com')] 2024-04-26T11:40:42.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:40:42.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:40:42.271 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-26T11:40:42.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:40:42.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:40:42.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:40:42.493 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-26T11:40:42.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:40:42.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:40:42.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:40:42.706 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-26T11:40:42.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:40:42.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:40:42.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:40:42.925 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-26T11:40:43.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:40:43.057 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T11:40:43.070 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T11:40:43.070 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:40:43.070 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:40:43.073 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:40:43.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:40:43.075 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:40:43.075 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:40:43.077 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:40:43.077 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:40:43.108 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-26T11:40:43.108 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: Command line: ntpd -gq 2024-04-26T11:40:43.109 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: proto: precision = 0.290 usec (-22) 2024-04-26T11:40:43.110 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-26T11:40:43.110 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: Command line: ntpd -gq 2024-04-26T11:40:43.110 INFO:teuthology.orchestra.run.smithi029.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:40:43.110 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:40:43.111 INFO:teuthology.orchestra.run.smithi029.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:40:43.112 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:40:43.112 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T11:40:43.112 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T11:40:43.112 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T11:40:43.112 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: Listen normally on 3 ens1f0 172.21.15.29:123 2024-04-26T11:40:43.112 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: Listen normally on 4 lo [::1]:123 2024-04-26T11:40:43.112 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:125a%4]:123 2024-04-26T11:40:43.112 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:43 ntpd[12946]: Listening on routing socket on fd #22 for interface updates 2024-04-26T11:40:43.114 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: proto: precision = 0.065 usec (-24) 2024-04-26T11:40:43.114 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-26T11:40:43.114 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: Command line: ntpd -gq 2024-04-26T11:40:43.114 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: proto: precision = 0.064 usec (-24) 2024-04-26T11:40:43.115 INFO:teuthology.orchestra.run.smithi072.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:40:43.115 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-26T11:40:43.115 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: Command line: ntpd -gq 2024-04-26T11:40:43.115 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: proto: precision = 0.116 usec (-23) 2024-04-26T11:40:43.115 INFO:teuthology.orchestra.run.smithi122.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:40:43.115 INFO:teuthology.orchestra.run.smithi082.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:40:43.116 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:40:43.116 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:40:43.116 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:40:43.117 INFO:teuthology.orchestra.run.smithi072.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:40:43.117 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:40:43.117 INFO:teuthology.orchestra.run.smithi122.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:40:43.117 INFO:teuthology.orchestra.run.smithi082.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: Listen normally on 3 enp3s0f1 172.21.15.122:123 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: Listen normally on 4 lo [::1]:123 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d515%5]:123 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:43 ntpd[13068]: Listening on routing socket on fd #22 for interface updates 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T11:40:43.120 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: Listen normally on 3 enp3s0f1 172.21.15.72:123 2024-04-26T11:40:43.121 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: Listen normally on 4 lo [::1]:123 2024-04-26T11:40:43.121 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:b765%5]:123 2024-04-26T11:40:43.121 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:43 ntpd[13030]: Listening on routing socket on fd #22 for interface updates 2024-04-26T11:40:43.121 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:40:43.121 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T11:40:43.121 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T11:40:43.121 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T11:40:43.121 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: Listen normally on 3 enp3s0f1 172.21.15.82:123 2024-04-26T11:40:43.121 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: Listen normally on 4 lo [::1]:123 2024-04-26T11:40:43.121 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3ff%5]:123 2024-04-26T11:40:43.121 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:43 ntpd[13006]: Listening on routing socket on fd #22 for interface updates 2024-04-26T11:40:44.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:44 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:44.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:44 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:44.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:44 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:44.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:44 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:44.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:44 ntpd[13030]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:44.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:44 ntpd[13030]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:44.111 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:44 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:44.111 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:44 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:44 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:44 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:44 ntpd[13068]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:44 ntpd[13068]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:44.113 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:44.113 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:44 ntpd[13006]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:45.109 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:45.109 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:45 ntpd[12946]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:45.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:45 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:45.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:45 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:45.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:45 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:45.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:45 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:45.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:45 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:45.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:45 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:45.112 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:45 ntpd[13030]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:45.112 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:45 ntpd[13030]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:46 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:46 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:46 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:46 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:46 ntpd[13030]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:46.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:46 ntpd[13030]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:46.111 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:46 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:46.111 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:46 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:46.111 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:46 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:46.112 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:46 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:46.112 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:46 ntpd[13068]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:46.112 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:46 ntpd[13068]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:46.116 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:46 ntpd[13006]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:47.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:47.112 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:47.112 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.112 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.112 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:47.112 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:47 ntpd[12946]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:47 ntpd[13030]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.115 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:47.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:47 ntpd[13068]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:48.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:48 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:48.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:48 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:48.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:48 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:48.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:48 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:48.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:48 ntpd[13030]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:48.110 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:48 ntpd[13030]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:48.111 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:48 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:48.111 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:48 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:48.111 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:48 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:48.112 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:48 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:48.112 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:48 ntpd[13068]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:48.112 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:48 ntpd[13068]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:48.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:48.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:48.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:48.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:48.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:48.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:48.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:48.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:48.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:48.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:48.114 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:48.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:48.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:48.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:48.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:48.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:48.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:48.115 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:48 ntpd[13006]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:49.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:49 ntpd[12946]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:49.113 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:49 ntpd[13068]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:49 ntpd[13030]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:50.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:50 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:50.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:50 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:50.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:50 ntpd[13030]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:50.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:50 ntpd[13030]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:50.111 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:50 ntpd[13030]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:50.112 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:50 ntpd[13030]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:50.112 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 11:40:50 ntpd[13030]: ntpd: time slew +0.000283 s 2024-04-26T11:40:50.112 INFO:teuthology.orchestra.run.smithi072.stdout:ntpd: time slew +0.000283s 2024-04-26T11:40:50.113 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:50 ntpd[13030]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T11:40:50.113 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 11:40:50 ntpd[13030]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T11:40:50.116 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:50 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:50.117 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:50 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:50.117 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:50 ntpd[13068]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:50.117 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:50 ntpd[13068]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:50.117 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:50 ntpd[13068]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:50.118 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:50 ntpd[13068]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:50.118 INFO:teuthology.orchestra.run.smithi122.stdout:26 Apr 11:40:50 ntpd[13068]: ntpd: time slew +0.001434 s 2024-04-26T11:40:50.119 INFO:teuthology.orchestra.run.smithi122.stdout:ntpd: time slew +0.001434s 2024-04-26T11:40:50.120 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:50.120 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:50.120 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:50.120 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:50.120 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:50.121 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:50.121 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:50.121 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:50.121 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:50.121 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:50.121 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:50 ntpd[13068]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T11:40:50.122 INFO:teuthology.orchestra.run.smithi122.stderr:26 Apr 11:40:50 ntpd[13068]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T11:40:50.122 INFO:teuthology.orchestra.run.smithi082.stdout:26 Apr 11:40:50 ntpd[13006]: ntpd: time slew +0.000073 s 2024-04-26T11:40:50.122 INFO:teuthology.orchestra.run.smithi082.stdout:ntpd: time slew +0.000073s 2024-04-26T11:40:50.123 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T11:40:50.123 INFO:teuthology.orchestra.run.smithi082.stderr:26 Apr 11:40:50 ntpd[13006]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T11:40:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:40:50.186 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================== 2024-04-26T11:40:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:50.189 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:40:50.189 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2024-04-26T11:40:50.189 INFO:teuthology.orchestra.run.smithi072.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:50.190 INFO:teuthology.orchestra.run.smithi072.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:50.190 INFO:teuthology.orchestra.run.smithi072.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:50.190 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:50.190 INFO:teuthology.orchestra.run.smithi122.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:40:50.190 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================== 2024-04-26T11:40:50.192 INFO:teuthology.orchestra.run.smithi122.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:50.192 INFO:teuthology.orchestra.run.smithi122.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:50.192 INFO:teuthology.orchestra.run.smithi122.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:50.192 INFO:teuthology.orchestra.run.smithi122.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:40:51.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:40:51.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:40:51.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:40:51.111 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 11:40:51 ntpd[12946]: ntpd: time slew +0.003634 s 2024-04-26T11:40:51.111 INFO:teuthology.orchestra.run.smithi029.stdout:ntpd: time slew +0.003634s 2024-04-26T11:40:51.111 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T11:40:51.112 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 11:40:51 ntpd[12946]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T11:40:51.197 INFO:teuthology.orchestra.run.smithi029.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:40:51.197 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================== 2024-04-26T11:40:51.197 INFO:teuthology.orchestra.run.smithi029.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:51.197 INFO:teuthology.orchestra.run.smithi029.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:51.197 INFO:teuthology.orchestra.run.smithi029.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:51.197 INFO:teuthology.orchestra.run.smithi029.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:40:51.198 INFO:teuthology.run_tasks:Running task install... 2024-04-26T11:40:51.210 DEBUG:teuthology.task.install:project ceph 2024-04-26T11:40:51.210 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}} 2024-04-26T11:40:51.210 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'} 2024-04-26T11:40:51.210 INFO:teuthology.task.install:Using flavor: default 2024-04-26T11:40:51.216 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T11:40:51.216 INFO:teuthology.task.install:extra packages: [] 2024-04-26T11:40:51.216 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-key list | grep Ceph 2024-04-26T11:40:51.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-key list | grep Ceph 2024-04-26T11:40:51.217 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-key list | grep Ceph 2024-04-26T11:40:51.218 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-key list | grep Ceph 2024-04-26T11:40:51.312 INFO:teuthology.orchestra.run.smithi072.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-26T11:40:51.315 INFO:teuthology.orchestra.run.smithi122.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-26T11:40:51.320 INFO:teuthology.orchestra.run.smithi029.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-26T11:40:51.321 INFO:teuthology.orchestra.run.smithi082.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-26T11:40:51.368 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T11:40:51.368 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T11:40:51.369 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T11:40:51.370 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T11:40:51.370 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:40:51.375 INFO:teuthology.orchestra.run.smithi122.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T11:40:51.375 INFO:teuthology.orchestra.run.smithi122.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T11:40:51.376 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T11:40:51.376 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T11:40:51.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:40:51.381 INFO:teuthology.orchestra.run.smithi082.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T11:40:51.382 INFO:teuthology.orchestra.run.smithi082.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T11:40:51.382 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T11:40:51.383 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T11:40:51.383 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:40:51.386 INFO:teuthology.orchestra.run.smithi029.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T11:40:51.386 INFO:teuthology.orchestra.run.smithi029.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T11:40:51.386 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T11:40:51.386 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T11:40:51.387 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:40:51.598 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default/ 2024-04-26T11:40:51.598 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:40:51.602 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default/ 2024-04-26T11:40:51.602 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:40:51.614 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default/ 2024-04-26T11:40:51.614 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:40:51.620 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default/ 2024-04-26T11:40:51.620 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:40:51.715 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:40:51.715 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T11:40:51.728 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:40:51.728 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T11:40:51.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-04-26T11:40:51.745 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get update 2024-04-26T11:40:51.767 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:40:51.767 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T11:40:51.783 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-04-26T11:40:51.878 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:40:51.878 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T11:40:51.889 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T11:40:51.910 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T11:40:51.921 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal InRelease 2024-04-26T11:40:51.929 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:40:51.929 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T11:40:51.938 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T11:40:51.938 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T11:40:51.943 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-26T11:40:51.959 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T11:40:51.965 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release.gpg 2024-04-26T11:40:51.987 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main i386 Packages [3,424 B] 2024-04-26T11:40:52.027 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-04-26T11:40:52.040 INFO:teuthology.orchestra.run.smithi122.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal InRelease 2024-04-26T11:40:52.048 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:40:52.056 INFO:teuthology.orchestra.run.smithi082.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal InRelease 2024-04-26T11:40:52.080 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-26T11:40:52.093 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-26T11:40:52.118 INFO:teuthology.orchestra.run.smithi122.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release.gpg 2024-04-26T11:40:52.130 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T11:40:52.159 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main i386 Packages [3,424 B] 2024-04-26T11:40:52.213 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-04-26T11:40:52.218 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T11:40:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release.gpg 2024-04-26T11:40:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main i386 Packages [3,424 B] 2024-04-26T11:40:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-04-26T11:40:52.526 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 28.7 kB in 1s (45.4 kB/s) 2024-04-26T11:40:52.583 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 28.7 kB in 1s (45.4 kB/s) 2024-04-26T11:40:52.599 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 28.7 kB in 1s (44.7 kB/s) 2024-04-26T11:40:52.810 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:40:52.810 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T11:40:52.827 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2024-04-26T11:40:53.030 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T11:40:53.137 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T11:40:53.138 INFO:teuthology.orchestra.run.smithi029.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal InRelease 2024-04-26T11:40:53.175 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-26T11:40:53.214 INFO:teuthology.orchestra.run.smithi029.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release.gpg 2024-04-26T11:40:53.219 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T11:40:53.255 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main i386 Packages [3,424 B] 2024-04-26T11:40:53.300 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-04-26T11:40:53.301 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T11:40:53.630 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T11:40:53.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1focal cephadm=18.2.2-1256-gdc093b5e-1focal ceph-mds=18.2.2-1256-gdc093b5e-1focal ceph-mgr=18.2.2-1256-gdc093b5e-1focal ceph-common=18.2.2-1256-gdc093b5e-1focal ceph-fuse=18.2.2-1256-gdc093b5e-1focal ceph-test=18.2.2-1256-gdc093b5e-1focal ceph-volume=18.2.2-1256-gdc093b5e-1focal radosgw=18.2.2-1256-gdc093b5e-1focal python3-rados=18.2.2-1256-gdc093b5e-1focal python3-rgw=18.2.2-1256-gdc093b5e-1focal python3-cephfs=18.2.2-1256-gdc093b5e-1focal python3-rbd=18.2.2-1256-gdc093b5e-1focal libcephfs2=18.2.2-1256-gdc093b5e-1focal libcephfs-dev=18.2.2-1256-gdc093b5e-1focal librados2=18.2.2-1256-gdc093b5e-1focal librbd1=18.2.2-1256-gdc093b5e-1focal rbd-fuse=18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:40:53.694 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 28.7 kB in 1s (44.1 kB/s) 2024-04-26T11:40:53.711 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-04-26T11:40:53.730 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T11:40:53.738 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1focal cephadm=18.2.2-1256-gdc093b5e-1focal ceph-mds=18.2.2-1256-gdc093b5e-1focal ceph-mgr=18.2.2-1256-gdc093b5e-1focal ceph-common=18.2.2-1256-gdc093b5e-1focal ceph-fuse=18.2.2-1256-gdc093b5e-1focal ceph-test=18.2.2-1256-gdc093b5e-1focal ceph-volume=18.2.2-1256-gdc093b5e-1focal radosgw=18.2.2-1256-gdc093b5e-1focal python3-rados=18.2.2-1256-gdc093b5e-1focal python3-rgw=18.2.2-1256-gdc093b5e-1focal python3-cephfs=18.2.2-1256-gdc093b5e-1focal python3-rbd=18.2.2-1256-gdc093b5e-1focal libcephfs2=18.2.2-1256-gdc093b5e-1focal libcephfs-dev=18.2.2-1256-gdc093b5e-1focal librados2=18.2.2-1256-gdc093b5e-1focal librbd1=18.2.2-1256-gdc093b5e-1focal rbd-fuse=18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:40:53.788 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-26T11:40:53.806 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-04-26T11:40:53.813 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1focal cephadm=18.2.2-1256-gdc093b5e-1focal ceph-mds=18.2.2-1256-gdc093b5e-1focal ceph-mgr=18.2.2-1256-gdc093b5e-1focal ceph-common=18.2.2-1256-gdc093b5e-1focal ceph-fuse=18.2.2-1256-gdc093b5e-1focal ceph-test=18.2.2-1256-gdc093b5e-1focal ceph-volume=18.2.2-1256-gdc093b5e-1focal radosgw=18.2.2-1256-gdc093b5e-1focal python3-rados=18.2.2-1256-gdc093b5e-1focal python3-rgw=18.2.2-1256-gdc093b5e-1focal python3-cephfs=18.2.2-1256-gdc093b5e-1focal python3-rbd=18.2.2-1256-gdc093b5e-1focal libcephfs2=18.2.2-1256-gdc093b5e-1focal libcephfs-dev=18.2.2-1256-gdc093b5e-1focal librados2=18.2.2-1256-gdc093b5e-1focal librbd1=18.2.2-1256-gdc093b5e-1focal rbd-fuse=18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:40:53.881 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-26T11:40:53.941 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-04-26T11:40:53.941 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-04-26T11:40:54.016 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2024-04-26T11:40:54.017 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2024-04-26T11:40:54.067 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-04-26T11:40:54.068 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-04-26T11:40:54.135 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:40:54.137 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T11:40:54.137 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:40:54.137 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-04-26T11:40:54.137 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T11:40:54.137 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-26T11:40:54.137 INFO:teuthology.orchestra.run.smithi072.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-26T11:40:54.137 INFO:teuthology.orchestra.run.smithi072.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-26T11:40:54.138 INFO:teuthology.orchestra.run.smithi072.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-26T11:40:54.139 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-26T11:40:54.139 INFO:teuthology.orchestra.run.smithi072.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-26T11:40:54.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2024-04-26T11:40:54.141 INFO:teuthology.orchestra.run.smithi072.stdout: btrfs-tools 2024-04-26T11:40:54.200 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:40:54.202 INFO:teuthology.orchestra.run.smithi082.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T11:40:54.202 INFO:teuthology.orchestra.run.smithi082.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:40:54.202 INFO:teuthology.orchestra.run.smithi082.stdout:The following additional packages will be installed: 2024-04-26T11:40:54.202 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T11:40:54.202 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-26T11:40:54.202 INFO:teuthology.orchestra.run.smithi082.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-26T11:40:54.202 INFO:teuthology.orchestra.run.smithi082.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-26T11:40:54.202 INFO:teuthology.orchestra.run.smithi082.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-26T11:40:54.203 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-26T11:40:54.203 INFO:teuthology.orchestra.run.smithi082.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-26T11:40:54.203 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-26T11:40:54.204 INFO:teuthology.orchestra.run.smithi082.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-26T11:40:54.205 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2024-04-26T11:40:54.205 INFO:teuthology.orchestra.run.smithi082.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-26T11:40:54.205 INFO:teuthology.orchestra.run.smithi082.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-26T11:40:54.205 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-26T11:40:54.205 INFO:teuthology.orchestra.run.smithi082.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-26T11:40:54.205 INFO:teuthology.orchestra.run.smithi082.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-26T11:40:54.205 INFO:teuthology.orchestra.run.smithi082.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-26T11:40:54.205 INFO:teuthology.orchestra.run.smithi082.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-26T11:40:54.205 INFO:teuthology.orchestra.run.smithi082.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T11:40:54.205 INFO:teuthology.orchestra.run.smithi082.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-26T11:40:54.206 INFO:teuthology.orchestra.run.smithi082.stdout:Recommended packages: 2024-04-26T11:40:54.206 INFO:teuthology.orchestra.run.smithi082.stdout: btrfs-tools 2024-04-26T11:40:54.249 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:40:54.251 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T11:40:54.251 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:40:54.251 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-04-26T11:40:54.251 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T11:40:54.251 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-26T11:40:54.251 INFO:teuthology.orchestra.run.smithi122.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-26T11:40:54.251 INFO:teuthology.orchestra.run.smithi122.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-26T11:40:54.251 INFO:teuthology.orchestra.run.smithi122.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-26T11:40:54.252 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-26T11:40:54.252 INFO:teuthology.orchestra.run.smithi122.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-26T11:40:54.252 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-26T11:40:54.252 INFO:teuthology.orchestra.run.smithi122.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-26T11:40:54.252 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-26T11:40:54.252 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-26T11:40:54.252 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T11:40:54.253 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T11:40:54.253 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:40:54.253 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T11:40:54.253 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T11:40:54.253 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T11:40:54.253 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-26T11:40:54.253 INFO:teuthology.orchestra.run.smithi122.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-26T11:40:54.253 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-26T11:40:54.253 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-26T11:40:54.253 INFO:teuthology.orchestra.run.smithi122.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-26T11:40:54.254 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-04-26T11:40:54.254 INFO:teuthology.orchestra.run.smithi122.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-26T11:40:54.254 INFO:teuthology.orchestra.run.smithi122.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-26T11:40:54.254 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-26T11:40:54.254 INFO:teuthology.orchestra.run.smithi122.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-26T11:40:54.254 INFO:teuthology.orchestra.run.smithi122.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-26T11:40:54.254 INFO:teuthology.orchestra.run.smithi122.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-26T11:40:54.254 INFO:teuthology.orchestra.run.smithi122.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-26T11:40:54.254 INFO:teuthology.orchestra.run.smithi122.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T11:40:54.254 INFO:teuthology.orchestra.run.smithi122.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-26T11:40:54.254 INFO:teuthology.orchestra.run.smithi122.stdout:Recommended packages: 2024-04-26T11:40:54.255 INFO:teuthology.orchestra.run.smithi122.stdout: btrfs-tools 2024-04-26T11:40:54.256 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-04-26T11:40:54.256 INFO:teuthology.orchestra.run.smithi072.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T11:40:54.256 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T11:40:54.256 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T11:40:54.258 INFO:teuthology.orchestra.run.smithi072.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T11:40:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T11:40:54.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-26T11:40:54.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-26T11:40:54.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T11:40:54.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-26T11:40:54.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-26T11:40:54.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-26T11:40:54.260 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet 2024-04-26T11:40:54.260 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages will be upgraded: 2024-04-26T11:40:54.260 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 librbd1 2024-04-26T11:40:54.324 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2024-04-26T11:40:54.324 INFO:teuthology.orchestra.run.smithi082.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T11:40:54.324 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T11:40:54.324 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T11:40:54.325 INFO:teuthology.orchestra.run.smithi082.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-26T11:40:54.325 INFO:teuthology.orchestra.run.smithi082.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-26T11:40:54.325 INFO:teuthology.orchestra.run.smithi082.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T11:40:54.325 INFO:teuthology.orchestra.run.smithi082.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-26T11:40:54.326 INFO:teuthology.orchestra.run.smithi082.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-26T11:40:54.326 INFO:teuthology.orchestra.run.smithi082.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-26T11:40:54.326 INFO:teuthology.orchestra.run.smithi082.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-26T11:40:54.326 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T11:40:54.326 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-26T11:40:54.326 INFO:teuthology.orchestra.run.smithi082.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-26T11:40:54.326 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T11:40:54.326 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T11:40:54.326 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:40:54.326 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T11:40:54.327 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T11:40:54.327 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-26T11:40:54.327 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-26T11:40:54.327 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T11:40:54.327 INFO:teuthology.orchestra.run.smithi082.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-26T11:40:54.327 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-26T11:40:54.327 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-26T11:40:54.327 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet 2024-04-26T11:40:54.328 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages will be upgraded: 2024-04-26T11:40:54.328 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 librbd1 2024-04-26T11:40:54.340 INFO:teuthology.orchestra.run.smithi072.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-26T11:40:54.340 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 198 MB of archives. 2024-04-26T11:40:54.340 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-26T11:40:54.340 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-26T11:40:54.375 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-04-26T11:40:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T11:40:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T11:40:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T11:40:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-26T11:40:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-26T11:40:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T11:40:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T11:40:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-26T11:40:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-26T11:40:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T11:40:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-26T11:40:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-26T11:40:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-26T11:40:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet 2024-04-26T11:40:54.378 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages will be upgraded: 2024-04-26T11:40:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 librbd1 2024-04-26T11:40:54.452 INFO:teuthology.orchestra.run.smithi122.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-26T11:40:54.452 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 198 MB of archives. 2024-04-26T11:40:54.453 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-26T11:40:54.453 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-26T11:40:54.460 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-26T11:40:54.465 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-26T11:40:54.492 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-26T11:40:54.496 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1focal [3,445 kB] 2024-04-26T11:40:54.520 INFO:teuthology.orchestra.run.smithi082.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-26T11:40:54.520 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 198 MB of archives. 2024-04-26T11:40:54.520 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-26T11:40:54.520 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-26T11:40:54.524 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1focal [3,445 kB] 2024-04-26T11:40:54.532 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1focal [3,445 kB] 2024-04-26T11:40:54.566 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-26T11:40:54.569 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-26T11:40:54.570 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-26T11:40:54.570 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-26T11:40:54.581 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-26T11:40:54.584 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-26T11:40:54.585 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-26T11:40:54.586 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-26T11:40:54.586 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-26T11:40:54.591 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-26T11:40:54.592 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-26T11:40:54.594 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-26T11:40:54.596 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-26T11:40:54.616 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-26T11:40:54.617 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-26T11:40:54.618 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-26T11:40:54.619 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T11:40:54.620 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-26T11:40:54.621 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-26T11:40:54.623 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-26T11:40:54.624 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-26T11:40:54.626 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-26T11:40:54.641 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-26T11:40:54.658 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-26T11:40:54.665 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-26T11:40:54.665 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-26T11:40:54.666 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-26T11:40:54.667 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-26T11:40:54.668 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-26T11:40:54.671 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-26T11:40:54.672 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-26T11:40:54.678 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-26T11:40:54.683 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-26T11:40:54.686 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-26T11:40:54.701 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-26T11:40:54.711 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-26T11:40:54.711 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-26T11:40:54.713 INFO:teuthology.orchestra.run.smithi122.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-26T11:40:54.713 INFO:teuthology.orchestra.run.smithi122.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-26T11:40:54.714 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-26T11:40:54.717 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-26T11:40:54.719 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-26T11:40:54.720 INFO:teuthology.orchestra.run.smithi122.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-26T11:40:54.721 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-26T11:40:54.721 INFO:teuthology.orchestra.run.smithi122.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-26T11:40:54.721 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-26T11:40:54.722 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-26T11:40:54.723 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-26T11:40:54.724 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-26T11:40:54.724 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-26T11:40:54.724 INFO:teuthology.orchestra.run.smithi122.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-26T11:40:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-26T11:40:54.751 INFO:teuthology.orchestra.run.smithi072.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T11:40:54.752 INFO:teuthology.orchestra.run.smithi122.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-26T11:40:54.753 INFO:teuthology.orchestra.run.smithi122.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-26T11:40:54.753 INFO:teuthology.orchestra.run.smithi122.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-26T11:40:54.755 INFO:teuthology.orchestra.run.smithi122.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T11:40:54.756 INFO:teuthology.orchestra.run.smithi122.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-26T11:40:54.757 INFO:teuthology.orchestra.run.smithi122.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-26T11:40:54.759 INFO:teuthology.orchestra.run.smithi122.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-26T11:40:54.760 INFO:teuthology.orchestra.run.smithi122.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-26T11:40:54.762 INFO:teuthology.orchestra.run.smithi122.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-26T11:40:54.773 INFO:teuthology.orchestra.run.smithi072.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-26T11:40:54.775 INFO:teuthology.orchestra.run.smithi072.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-26T11:40:54.777 INFO:teuthology.orchestra.run.smithi072.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-26T11:40:54.780 INFO:teuthology.orchestra.run.smithi072.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-26T11:40:54.780 INFO:teuthology.orchestra.run.smithi072.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-26T11:40:54.781 INFO:teuthology.orchestra.run.smithi072.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-26T11:40:54.789 INFO:teuthology.orchestra.run.smithi122.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-26T11:40:54.790 INFO:teuthology.orchestra.run.smithi122.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-26T11:40:54.803 INFO:teuthology.orchestra.run.smithi122.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-26T11:40:54.824 INFO:teuthology.orchestra.run.smithi122.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1focal [4,029 kB] 2024-04-26T11:40:54.831 INFO:teuthology.orchestra.run.smithi122.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-26T11:40:54.832 INFO:teuthology.orchestra.run.smithi122.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-26T11:40:54.833 INFO:teuthology.orchestra.run.smithi122.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-26T11:40:54.835 INFO:teuthology.orchestra.run.smithi122.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-26T11:40:54.839 INFO:teuthology.orchestra.run.smithi122.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-26T11:40:54.839 INFO:teuthology.orchestra.run.smithi122.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-26T11:40:54.843 INFO:teuthology.orchestra.run.smithi122.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-26T11:40:54.849 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T11:40:54.865 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1focal [4,029 kB] 2024-04-26T11:40:54.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1focal cephadm=18.2.2-1256-gdc093b5e-1focal ceph-mds=18.2.2-1256-gdc093b5e-1focal ceph-mgr=18.2.2-1256-gdc093b5e-1focal ceph-common=18.2.2-1256-gdc093b5e-1focal ceph-fuse=18.2.2-1256-gdc093b5e-1focal ceph-test=18.2.2-1256-gdc093b5e-1focal ceph-volume=18.2.2-1256-gdc093b5e-1focal radosgw=18.2.2-1256-gdc093b5e-1focal python3-rados=18.2.2-1256-gdc093b5e-1focal python3-rgw=18.2.2-1256-gdc093b5e-1focal python3-cephfs=18.2.2-1256-gdc093b5e-1focal python3-rbd=18.2.2-1256-gdc093b5e-1focal libcephfs2=18.2.2-1256-gdc093b5e-1focal libcephfs-dev=18.2.2-1256-gdc093b5e-1focal librados2=18.2.2-1256-gdc093b5e-1focal librbd1=18.2.2-1256-gdc093b5e-1focal rbd-fuse=18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:40:54.881 INFO:teuthology.orchestra.run.smithi122.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-26T11:40:54.884 INFO:teuthology.orchestra.run.smithi122.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-26T11:40:54.887 INFO:teuthology.orchestra.run.smithi122.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-26T11:40:54.924 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-26T11:40:54.933 INFO:teuthology.orchestra.run.smithi122.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-26T11:40:54.934 INFO:teuthology.orchestra.run.smithi122.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-26T11:40:54.935 INFO:teuthology.orchestra.run.smithi122.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-26T11:40:54.937 INFO:teuthology.orchestra.run.smithi122.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-26T11:40:54.938 INFO:teuthology.orchestra.run.smithi122.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-26T11:40:54.939 INFO:teuthology.orchestra.run.smithi122.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-26T11:40:54.939 INFO:teuthology.orchestra.run.smithi122.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-26T11:40:54.946 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T11:40:54.953 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-26T11:40:54.959 INFO:teuthology.orchestra.run.smithi072.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-26T11:40:54.987 INFO:teuthology.orchestra.run.smithi122.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T11:40:54.987 INFO:teuthology.orchestra.run.smithi122.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-26T11:40:54.990 INFO:teuthology.orchestra.run.smithi122.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-26T11:40:54.991 INFO:teuthology.orchestra.run.smithi072.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-26T11:40:54.993 INFO:teuthology.orchestra.run.smithi072.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-26T11:40:55.014 INFO:teuthology.orchestra.run.smithi072.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-26T11:40:55.014 INFO:teuthology.orchestra.run.smithi072.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-26T11:40:55.014 INFO:teuthology.orchestra.run.smithi072.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-26T11:40:55.015 INFO:teuthology.orchestra.run.smithi072.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-26T11:40:55.015 INFO:teuthology.orchestra.run.smithi072.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-26T11:40:55.015 INFO:teuthology.orchestra.run.smithi072.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-26T11:40:55.016 INFO:teuthology.orchestra.run.smithi122.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-26T11:40:55.017 INFO:teuthology.orchestra.run.smithi122.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-26T11:40:55.018 INFO:teuthology.orchestra.run.smithi122.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-26T11:40:55.019 INFO:teuthology.orchestra.run.smithi122.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-26T11:40:55.055 INFO:teuthology.orchestra.run.smithi072.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-26T11:40:55.056 INFO:teuthology.orchestra.run.smithi072.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-26T11:40:55.057 INFO:teuthology.orchestra.run.smithi072.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-26T11:40:55.071 INFO:teuthology.orchestra.run.smithi072.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-26T11:40:55.076 INFO:teuthology.orchestra.run.smithi072.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-26T11:40:55.078 INFO:teuthology.orchestra.run.smithi072.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-26T11:40:55.080 INFO:teuthology.orchestra.run.smithi072.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-26T11:40:55.081 INFO:teuthology.orchestra.run.smithi072.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-26T11:40:55.081 INFO:teuthology.orchestra.run.smithi122.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1focal [744 kB] 2024-04-26T11:40:55.118 INFO:teuthology.orchestra.run.smithi072.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-26T11:40:55.119 INFO:teuthology.orchestra.run.smithi122.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1focal [387 kB] 2024-04-26T11:40:55.122 INFO:teuthology.orchestra.run.smithi072.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-26T11:40:55.130 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-26T11:40:55.134 INFO:teuthology.orchestra.run.smithi122.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1focal [31.9 kB] 2024-04-26T11:40:55.135 INFO:teuthology.orchestra.run.smithi122.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1focal [200 kB] 2024-04-26T11:40:55.143 INFO:teuthology.orchestra.run.smithi122.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1focal [62.4 kB] 2024-04-26T11:40:55.145 INFO:teuthology.orchestra.run.smithi122.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1focal [365 kB] 2024-04-26T11:40:55.148 INFO:teuthology.orchestra.run.smithi072.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-26T11:40:55.151 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1focal [744 kB] 2024-04-26T11:40:55.161 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-04-26T11:40:55.162 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-04-26T11:40:55.176 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1focal [387 kB] 2024-04-26T11:40:55.184 INFO:teuthology.orchestra.run.smithi122.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1focal [6,590 kB] 2024-04-26T11:40:55.219 INFO:teuthology.orchestra.run.smithi072.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-26T11:40:55.220 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1focal [31.9 kB] 2024-04-26T11:40:55.221 INFO:teuthology.orchestra.run.smithi082.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1focal [200 kB] 2024-04-26T11:40:55.222 INFO:teuthology.orchestra.run.smithi072.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-26T11:40:55.227 INFO:teuthology.orchestra.run.smithi082.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1focal [62.4 kB] 2024-04-26T11:40:55.229 INFO:teuthology.orchestra.run.smithi082.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1focal [365 kB] 2024-04-26T11:40:55.240 INFO:teuthology.orchestra.run.smithi122.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-26T11:40:55.275 INFO:teuthology.orchestra.run.smithi082.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1focal [6,590 kB] 2024-04-26T11:40:55.277 INFO:teuthology.orchestra.run.smithi122.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-26T11:40:55.279 INFO:teuthology.orchestra.run.smithi122.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-26T11:40:55.312 INFO:teuthology.orchestra.run.smithi072.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-26T11:40:55.313 INFO:teuthology.orchestra.run.smithi072.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-26T11:40:55.313 INFO:teuthology.orchestra.run.smithi072.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-26T11:40:55.314 INFO:teuthology.orchestra.run.smithi072.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-26T11:40:55.328 INFO:teuthology.orchestra.run.smithi122.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-26T11:40:55.328 INFO:teuthology.orchestra.run.smithi122.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-26T11:40:55.329 INFO:teuthology.orchestra.run.smithi122.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-26T11:40:55.330 INFO:teuthology.orchestra.run.smithi122.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-26T11:40:55.331 INFO:teuthology.orchestra.run.smithi122.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-26T11:40:55.332 INFO:teuthology.orchestra.run.smithi122.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-26T11:40:55.332 INFO:teuthology.orchestra.run.smithi122.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-26T11:40:55.337 INFO:teuthology.orchestra.run.smithi072.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T11:40:55.338 INFO:teuthology.orchestra.run.smithi072.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-26T11:40:55.339 INFO:teuthology.orchestra.run.smithi072.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-26T11:40:55.340 INFO:teuthology.orchestra.run.smithi072.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-26T11:40:55.340 INFO:teuthology.orchestra.run.smithi122.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-26T11:40:55.340 INFO:teuthology.orchestra.run.smithi122.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-26T11:40:55.341 INFO:teuthology.orchestra.run.smithi072.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-26T11:40:55.361 INFO:teuthology.orchestra.run.smithi122.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-26T11:40:55.362 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:40:55.364 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T11:40:55.364 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:40:55.364 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2024-04-26T11:40:55.364 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T11:40:55.364 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-26T11:40:55.364 INFO:teuthology.orchestra.run.smithi029.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-26T11:40:55.365 INFO:teuthology.orchestra.run.smithi029.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-26T11:40:55.365 INFO:teuthology.orchestra.run.smithi029.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-26T11:40:55.365 INFO:teuthology.orchestra.run.smithi122.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-26T11:40:55.366 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-26T11:40:55.366 INFO:teuthology.orchestra.run.smithi029.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-26T11:40:55.366 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-26T11:40:55.366 INFO:teuthology.orchestra.run.smithi029.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-26T11:40:55.366 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-26T11:40:55.366 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-26T11:40:55.366 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T11:40:55.366 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T11:40:55.366 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:40:55.366 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T11:40:55.366 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T11:40:55.367 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T11:40:55.367 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-26T11:40:55.367 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-26T11:40:55.367 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-26T11:40:55.367 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-26T11:40:55.367 INFO:teuthology.orchestra.run.smithi029.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-26T11:40:55.367 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2024-04-26T11:40:55.367 INFO:teuthology.orchestra.run.smithi029.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-26T11:40:55.367 INFO:teuthology.orchestra.run.smithi029.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-26T11:40:55.367 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-26T11:40:55.368 INFO:teuthology.orchestra.run.smithi029.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-26T11:40:55.368 INFO:teuthology.orchestra.run.smithi029.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-26T11:40:55.368 INFO:teuthology.orchestra.run.smithi029.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-26T11:40:55.368 INFO:teuthology.orchestra.run.smithi029.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-26T11:40:55.368 INFO:teuthology.orchestra.run.smithi029.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T11:40:55.368 INFO:teuthology.orchestra.run.smithi029.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-26T11:40:55.368 INFO:teuthology.orchestra.run.smithi029.stdout:Recommended packages: 2024-04-26T11:40:55.368 INFO:teuthology.orchestra.run.smithi029.stdout: btrfs-tools 2024-04-26T11:40:55.368 INFO:teuthology.orchestra.run.smithi122.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-26T11:40:55.370 INFO:teuthology.orchestra.run.smithi122.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-26T11:40:55.372 INFO:teuthology.orchestra.run.smithi122.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-26T11:40:55.375 INFO:teuthology.orchestra.run.smithi122.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-26T11:40:55.377 INFO:teuthology.orchestra.run.smithi122.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-26T11:40:55.394 INFO:teuthology.orchestra.run.smithi082.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-26T11:40:55.400 INFO:teuthology.orchestra.run.smithi122.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-26T11:40:55.403 INFO:teuthology.orchestra.run.smithi082.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-26T11:40:55.403 INFO:teuthology.orchestra.run.smithi122.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-26T11:40:55.406 INFO:teuthology.orchestra.run.smithi122.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-26T11:40:55.431 INFO:teuthology.orchestra.run.smithi082.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-26T11:40:55.440 INFO:teuthology.orchestra.run.smithi082.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-26T11:40:55.441 INFO:teuthology.orchestra.run.smithi082.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-26T11:40:55.445 INFO:teuthology.orchestra.run.smithi082.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-26T11:40:55.447 INFO:teuthology.orchestra.run.smithi082.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-26T11:40:55.486 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2024-04-26T11:40:55.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T11:40:55.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T11:40:55.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T11:40:55.487 INFO:teuthology.orchestra.run.smithi029.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-26T11:40:55.487 INFO:teuthology.orchestra.run.smithi029.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-26T11:40:55.487 INFO:teuthology.orchestra.run.smithi029.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T11:40:55.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-26T11:40:55.489 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-26T11:40:55.489 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T11:40:55.489 INFO:teuthology.orchestra.run.smithi029.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-26T11:40:55.489 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-26T11:40:55.489 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-26T11:40:55.489 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet 2024-04-26T11:40:55.491 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages will be upgraded: 2024-04-26T11:40:55.491 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 librbd1 2024-04-26T11:40:55.491 INFO:teuthology.orchestra.run.smithi122.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-26T11:40:55.491 INFO:teuthology.orchestra.run.smithi122.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-26T11:40:55.492 INFO:teuthology.orchestra.run.smithi122.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-26T11:40:55.492 INFO:teuthology.orchestra.run.smithi122.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-26T11:40:55.513 INFO:teuthology.orchestra.run.smithi122.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T11:40:55.513 INFO:teuthology.orchestra.run.smithi122.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-26T11:40:55.515 INFO:teuthology.orchestra.run.smithi122.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-26T11:40:55.515 INFO:teuthology.orchestra.run.smithi122.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-26T11:40:55.515 INFO:teuthology.orchestra.run.smithi122.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-26T11:40:55.605 INFO:teuthology.orchestra.run.smithi122.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1focal [113 kB] 2024-04-26T11:40:55.610 INFO:teuthology.orchestra.run.smithi122.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1focal [476 kB] 2024-04-26T11:40:55.623 INFO:teuthology.orchestra.run.smithi082.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-26T11:40:55.626 INFO:teuthology.orchestra.run.smithi122.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1focal [25.1 MB] 2024-04-26T11:40:55.683 INFO:teuthology.orchestra.run.smithi029.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-26T11:40:55.683 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 198 MB of archives. 2024-04-26T11:40:55.683 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-26T11:40:55.683 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-26T11:40:55.731 INFO:teuthology.orchestra.run.smithi082.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1focal [113 kB] 2024-04-26T11:40:55.734 INFO:teuthology.orchestra.run.smithi082.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1focal [476 kB] 2024-04-26T11:40:55.782 INFO:teuthology.orchestra.run.smithi082.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1focal [25.1 MB] 2024-04-26T11:40:55.857 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1focal [3,445 kB] 2024-04-26T11:40:55.871 INFO:teuthology.orchestra.run.smithi082.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-26T11:40:56.042 INFO:teuthology.orchestra.run.smithi082.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-26T11:40:56.055 INFO:teuthology.orchestra.run.smithi082.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-26T11:40:56.062 INFO:teuthology.orchestra.run.smithi082.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-26T11:40:56.069 INFO:teuthology.orchestra.run.smithi082.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-26T11:40:56.088 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-26T11:40:56.096 INFO:teuthology.orchestra.run.smithi082.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T11:40:56.101 INFO:teuthology.orchestra.run.smithi082.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-26T11:40:56.102 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-26T11:40:56.105 INFO:teuthology.orchestra.run.smithi082.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-26T11:40:56.135 INFO:teuthology.orchestra.run.smithi082.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-26T11:40:56.143 INFO:teuthology.orchestra.run.smithi082.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-26T11:40:56.186 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-26T11:40:56.326 INFO:teuthology.orchestra.run.smithi082.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-26T11:40:56.430 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-26T11:40:56.440 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-26T11:40:56.468 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-26T11:40:56.477 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-26T11:40:56.478 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-26T11:40:56.481 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-26T11:40:56.483 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-26T11:40:56.648 INFO:teuthology.orchestra.run.smithi082.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-26T11:40:56.659 INFO:teuthology.orchestra.run.smithi082.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-26T11:40:56.659 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-26T11:40:56.843 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1focal [4,029 kB] 2024-04-26T11:40:56.897 INFO:teuthology.orchestra.run.smithi082.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-26T11:40:56.898 INFO:teuthology.orchestra.run.smithi082.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-26T11:40:56.904 INFO:teuthology.orchestra.run.smithi082.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-26T11:40:56.908 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-26T11:40:56.911 INFO:teuthology.orchestra.run.smithi082.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-26T11:40:56.927 INFO:teuthology.orchestra.run.smithi082.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-26T11:40:56.954 INFO:teuthology.orchestra.run.smithi082.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-26T11:40:56.957 INFO:teuthology.orchestra.run.smithi082.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-26T11:40:56.985 INFO:teuthology.orchestra.run.smithi082.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-26T11:40:57.079 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-26T11:40:57.092 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-26T11:40:57.100 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-26T11:40:57.107 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-26T11:40:57.134 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T11:40:57.139 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-26T11:40:57.142 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-26T11:40:57.153 INFO:teuthology.orchestra.run.smithi082.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-26T11:40:57.173 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-26T11:40:57.180 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-26T11:40:57.363 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-26T11:40:57.541 INFO:teuthology.orchestra.run.smithi082.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-26T11:40:57.579 INFO:teuthology.orchestra.run.smithi082.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-26T11:40:57.587 INFO:teuthology.orchestra.run.smithi082.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-26T11:40:57.600 INFO:teuthology.orchestra.run.smithi082.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-26T11:40:57.678 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-26T11:40:57.686 INFO:teuthology.orchestra.run.smithi082.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-26T11:40:57.690 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-26T11:40:57.700 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1focal [744 kB] 2024-04-26T11:40:57.736 INFO:teuthology.orchestra.run.smithi082.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-26T11:40:57.736 INFO:teuthology.orchestra.run.smithi082.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1focal [9,602 kB] 2024-04-26T11:40:57.736 INFO:teuthology.orchestra.run.smithi082.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-26T11:40:57.737 INFO:teuthology.orchestra.run.smithi082.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-26T11:40:57.738 INFO:teuthology.orchestra.run.smithi082.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-26T11:40:57.741 INFO:teuthology.orchestra.run.smithi082.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T11:40:57.752 INFO:teuthology.orchestra.run.smithi122.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1focal [9,602 kB] 2024-04-26T11:40:57.838 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1focal [387 kB] 2024-04-26T11:40:57.906 INFO:teuthology.orchestra.run.smithi082.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-26T11:40:57.913 INFO:teuthology.orchestra.run.smithi029.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1focal [31.9 kB] 2024-04-26T11:40:57.914 INFO:teuthology.orchestra.run.smithi029.stdout:Get:31 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1focal [200 kB] 2024-04-26T11:40:57.925 INFO:teuthology.orchestra.run.smithi029.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-26T11:40:57.926 INFO:teuthology.orchestra.run.smithi029.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-26T11:40:57.933 INFO:teuthology.orchestra.run.smithi029.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-26T11:40:57.939 INFO:teuthology.orchestra.run.smithi029.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-26T11:40:57.956 INFO:teuthology.orchestra.run.smithi029.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-26T11:40:57.983 INFO:teuthology.orchestra.run.smithi029.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-26T11:40:57.984 INFO:teuthology.orchestra.run.smithi029.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1focal [62.4 kB] 2024-04-26T11:40:57.987 INFO:teuthology.orchestra.run.smithi029.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-26T11:40:57.988 INFO:teuthology.orchestra.run.smithi029.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1focal [365 kB] 2024-04-26T11:40:58.013 INFO:teuthology.orchestra.run.smithi029.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-26T11:40:58.064 INFO:teuthology.orchestra.run.smithi029.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1focal [6,590 kB] 2024-04-26T11:40:58.182 INFO:teuthology.orchestra.run.smithi029.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-26T11:40:58.257 INFO:teuthology.orchestra.run.smithi082.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-26T11:40:58.315 INFO:teuthology.orchestra.run.smithi082.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-26T11:40:58.322 INFO:teuthology.orchestra.run.smithi082.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1focal [238 kB] 2024-04-26T11:40:58.330 INFO:teuthology.orchestra.run.smithi082.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1focal [148 kB] 2024-04-26T11:40:58.335 INFO:teuthology.orchestra.run.smithi082.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1focal [1,571 kB] 2024-04-26T11:40:58.380 INFO:teuthology.orchestra.run.smithi082.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-26T11:40:58.388 INFO:teuthology.orchestra.run.smithi082.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-26T11:40:58.403 INFO:teuthology.orchestra.run.smithi082.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-26T11:40:58.470 INFO:teuthology.orchestra.run.smithi082.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1focal [6,638 kB] 2024-04-26T11:40:58.522 INFO:teuthology.orchestra.run.smithi122.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1focal [238 kB] 2024-04-26T11:40:58.571 INFO:teuthology.orchestra.run.smithi029.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-26T11:40:58.578 INFO:teuthology.orchestra.run.smithi122.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1focal [148 kB] 2024-04-26T11:40:58.582 INFO:teuthology.orchestra.run.smithi122.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1focal [1,571 kB] 2024-04-26T11:40:58.610 INFO:teuthology.orchestra.run.smithi029.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-26T11:40:58.617 INFO:teuthology.orchestra.run.smithi029.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-26T11:40:58.631 INFO:teuthology.orchestra.run.smithi029.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-26T11:40:58.653 INFO:teuthology.orchestra.run.smithi029.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-26T11:40:58.664 INFO:teuthology.orchestra.run.smithi072.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1focal [4,029 kB] 2024-04-26T11:40:58.680 INFO:teuthology.orchestra.run.smithi029.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-26T11:40:58.682 INFO:teuthology.orchestra.run.smithi029.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-26T11:40:58.694 INFO:teuthology.orchestra.run.smithi029.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-26T11:40:58.701 INFO:teuthology.orchestra.run.smithi029.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-26T11:40:58.715 INFO:teuthology.orchestra.run.smithi122.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1focal [6,638 kB] 2024-04-26T11:40:58.748 INFO:teuthology.orchestra.run.smithi029.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T11:40:58.911 INFO:teuthology.orchestra.run.smithi082.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-26T11:40:58.916 INFO:teuthology.orchestra.run.smithi029.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-26T11:40:59.021 INFO:teuthology.orchestra.run.smithi082.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-26T11:40:59.021 INFO:teuthology.orchestra.run.smithi082.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1focal [24.5 MB] 2024-04-26T11:40:59.024 INFO:teuthology.orchestra.run.smithi082.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-26T11:40:59.042 INFO:teuthology.orchestra.run.smithi082.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-26T11:40:59.042 INFO:teuthology.orchestra.run.smithi082.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-26T11:40:59.207 INFO:teuthology.orchestra.run.smithi082.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-26T11:40:59.267 INFO:teuthology.orchestra.run.smithi029.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-26T11:40:59.324 INFO:teuthology.orchestra.run.smithi029.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-26T11:40:59.353 INFO:teuthology.orchestra.run.smithi029.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1focal [113 kB] 2024-04-26T11:40:59.356 INFO:teuthology.orchestra.run.smithi029.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1focal [476 kB] 2024-04-26T11:40:59.390 INFO:teuthology.orchestra.run.smithi029.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-26T11:40:59.397 INFO:teuthology.orchestra.run.smithi029.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-26T11:40:59.411 INFO:teuthology.orchestra.run.smithi082.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-26T11:40:59.412 INFO:teuthology.orchestra.run.smithi029.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-26T11:40:59.432 INFO:teuthology.orchestra.run.smithi122.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1focal [24.5 MB] 2024-04-26T11:40:59.434 INFO:teuthology.orchestra.run.smithi029.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1focal [25.1 MB] 2024-04-26T11:40:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-26T11:40:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-26T11:40:59.560 INFO:teuthology.orchestra.run.smithi082.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-26T11:40:59.677 INFO:teuthology.orchestra.run.smithi082.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-26T11:40:59.703 INFO:teuthology.orchestra.run.smithi082.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-26T11:40:59.758 INFO:teuthology.orchestra.run.smithi082.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-26T11:40:59.920 INFO:teuthology.orchestra.run.smithi029.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-26T11:40:59.997 INFO:teuthology.orchestra.run.smithi029.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-26T11:40:59.998 INFO:teuthology.orchestra.run.smithi029.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-26T11:41:00.037 INFO:teuthology.orchestra.run.smithi029.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-26T11:41:00.038 INFO:teuthology.orchestra.run.smithi029.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-26T11:41:00.126 INFO:teuthology.orchestra.run.smithi082.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-26T11:41:00.203 INFO:teuthology.orchestra.run.smithi029.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-26T11:41:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-26T11:41:00.399 INFO:teuthology.orchestra.run.smithi029.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-26T11:41:00.443 INFO:teuthology.orchestra.run.smithi029.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-26T11:41:00.506 INFO:teuthology.orchestra.run.smithi082.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-26T11:41:00.507 INFO:teuthology.orchestra.run.smithi029.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-26T11:41:00.526 INFO:teuthology.orchestra.run.smithi029.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-26T11:41:00.593 INFO:teuthology.orchestra.run.smithi082.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1focal [13.7 kB] 2024-04-26T11:41:00.594 INFO:teuthology.orchestra.run.smithi082.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1focal [853 kB] 2024-04-26T11:41:00.604 INFO:teuthology.orchestra.run.smithi029.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-26T11:41:00.607 INFO:teuthology.orchestra.run.smithi082.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1focal [2,291 kB] 2024-04-26T11:41:00.614 INFO:teuthology.orchestra.run.smithi029.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-26T11:41:00.634 INFO:teuthology.orchestra.run.smithi029.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-26T11:41:00.729 INFO:teuthology.orchestra.run.smithi029.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-26T11:41:00.732 INFO:teuthology.orchestra.run.smithi082.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1focal [237 kB] 2024-04-26T11:41:00.740 INFO:teuthology.orchestra.run.smithi082.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1focal [142 kB] 2024-04-26T11:41:00.755 INFO:teuthology.orchestra.run.smithi082.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-26T11:41:00.762 INFO:teuthology.orchestra.run.smithi029.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-26T11:41:00.780 INFO:teuthology.orchestra.run.smithi082.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1focal [7,011 kB] 2024-04-26T11:41:00.784 INFO:teuthology.orchestra.run.smithi029.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-26T11:41:00.959 INFO:teuthology.orchestra.run.smithi029.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-26T11:41:01.251 INFO:teuthology.orchestra.run.smithi082.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-26T11:41:01.262 INFO:teuthology.orchestra.run.smithi082.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1focal [7,889 kB] 2024-04-26T11:41:01.299 INFO:teuthology.orchestra.run.smithi082.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-26T11:41:01.442 INFO:teuthology.orchestra.run.smithi029.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-26T11:41:01.493 INFO:teuthology.orchestra.run.smithi029.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-26T11:41:01.531 INFO:teuthology.orchestra.run.smithi082.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-26T11:41:01.541 INFO:teuthology.orchestra.run.smithi082.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-26T11:41:01.550 INFO:teuthology.orchestra.run.smithi082.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-26T11:41:01.711 INFO:teuthology.orchestra.run.smithi082.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-26T11:41:01.713 INFO:teuthology.orchestra.run.smithi082.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-26T11:41:01.713 INFO:teuthology.orchestra.run.smithi082.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-26T11:41:01.714 INFO:teuthology.orchestra.run.smithi082.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-26T11:41:01.721 INFO:teuthology.orchestra.run.smithi029.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-26T11:41:01.733 INFO:teuthology.orchestra.run.smithi029.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-26T11:41:01.742 INFO:teuthology.orchestra.run.smithi029.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-26T11:41:01.762 INFO:teuthology.orchestra.run.smithi082.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T11:41:01.794 INFO:teuthology.orchestra.run.smithi082.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1focal [13.8 kB] 2024-04-26T11:41:01.795 INFO:teuthology.orchestra.run.smithi082.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1focal [46.7 MB] 2024-04-26T11:41:01.895 INFO:teuthology.orchestra.run.smithi029.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-26T11:41:01.896 INFO:teuthology.orchestra.run.smithi029.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-26T11:41:01.896 INFO:teuthology.orchestra.run.smithi029.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-26T11:41:01.898 INFO:teuthology.orchestra.run.smithi029.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-26T11:41:01.927 INFO:teuthology.orchestra.run.smithi082.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-26T11:41:01.940 INFO:teuthology.orchestra.run.smithi029.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T11:41:02.104 INFO:teuthology.orchestra.run.smithi029.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-26T11:41:02.147 INFO:teuthology.orchestra.run.smithi122.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1focal [13.7 kB] 2024-04-26T11:41:02.202 INFO:teuthology.orchestra.run.smithi122.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1focal [853 kB] 2024-04-26T11:41:02.215 INFO:teuthology.orchestra.run.smithi122.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1focal [2,291 kB] 2024-04-26T11:41:02.313 INFO:teuthology.orchestra.run.smithi082.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-26T11:41:02.323 INFO:teuthology.orchestra.run.smithi082.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-26T11:41:02.345 INFO:teuthology.orchestra.run.smithi082.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-26T11:41:02.435 INFO:teuthology.orchestra.run.smithi122.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1focal [237 kB] 2024-04-26T11:41:02.453 INFO:teuthology.orchestra.run.smithi122.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1focal [142 kB] 2024-04-26T11:41:02.457 INFO:teuthology.orchestra.run.smithi122.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1focal [7,011 kB] 2024-04-26T11:41:02.486 INFO:teuthology.orchestra.run.smithi029.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-26T11:41:02.496 INFO:teuthology.orchestra.run.smithi029.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-26T11:41:02.518 INFO:teuthology.orchestra.run.smithi029.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-26T11:41:03.206 INFO:teuthology.orchestra.run.smithi072.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1focal [744 kB] 2024-04-26T11:41:03.231 INFO:teuthology.orchestra.run.smithi122.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1focal [7,889 kB] 2024-04-26T11:41:03.988 INFO:teuthology.orchestra.run.smithi072.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1focal [387 kB] 2024-04-26T11:41:04.081 INFO:teuthology.orchestra.run.smithi122.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1focal [13.8 kB] 2024-04-26T11:41:04.082 INFO:teuthology.orchestra.run.smithi122.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1focal [46.7 MB] 2024-04-26T11:41:04.345 INFO:teuthology.orchestra.run.smithi029.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1focal [9,602 kB] 2024-04-26T11:41:04.391 INFO:teuthology.orchestra.run.smithi072.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1focal [31.9 kB] 2024-04-26T11:41:04.444 INFO:teuthology.orchestra.run.smithi072.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1focal [200 kB] 2024-04-26T11:41:04.652 INFO:teuthology.orchestra.run.smithi072.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1focal [62.4 kB] 2024-04-26T11:41:04.712 INFO:teuthology.orchestra.run.smithi072.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1focal [365 kB] 2024-04-26T11:41:05.081 INFO:teuthology.orchestra.run.smithi072.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1focal [6,590 kB] 2024-04-26T11:41:05.127 INFO:teuthology.orchestra.run.smithi082.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1focal [119 kB] 2024-04-26T11:41:05.130 INFO:teuthology.orchestra.run.smithi082.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1focal [37.4 kB] 2024-04-26T11:41:05.131 INFO:teuthology.orchestra.run.smithi082.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1focal [13.4 MB] 2024-04-26T11:41:05.869 INFO:teuthology.orchestra.run.smithi082.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1focal [107 kB] 2024-04-26T11:41:05.927 INFO:teuthology.orchestra.run.smithi029.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1focal [238 kB] 2024-04-26T11:41:05.934 INFO:teuthology.orchestra.run.smithi029.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1focal [148 kB] 2024-04-26T11:41:05.959 INFO:teuthology.orchestra.run.smithi029.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1focal [1,571 kB] 2024-04-26T11:41:06.069 INFO:teuthology.orchestra.run.smithi029.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1focal [6,638 kB] 2024-04-26T11:41:06.508 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 198 MB in 12s (17.2 MB/s) 2024-04-26T11:41:06.587 INFO:teuthology.orchestra.run.smithi029.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1focal [24.5 MB] 2024-04-26T11:41:06.700 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-26T11:41:06.756 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-26T11:41:06.760 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-26T11:41:06.840 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T11:41:07.351 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T11:41:07.370 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-26T11:41:07.477 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T11:41:07.831 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T11:41:07.847 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-26T11:41:07.889 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T11:41:07.890 INFO:teuthology.orchestra.run.smithi122.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1focal [119 kB] 2024-04-26T11:41:07.893 INFO:teuthology.orchestra.run.smithi122.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1focal [37.4 kB] 2024-04-26T11:41:07.894 INFO:teuthology.orchestra.run.smithi122.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1focal [13.4 MB] 2024-04-26T11:41:08.376 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T11:41:08.392 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:08.444 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:08.506 INFO:teuthology.orchestra.run.smithi122.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1focal [107 kB] 2024-04-26T11:41:08.613 INFO:teuthology.orchestra.run.smithi029.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1focal [13.7 kB] 2024-04-26T11:41:08.613 INFO:teuthology.orchestra.run.smithi029.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1focal [853 kB] 2024-04-26T11:41:08.626 INFO:teuthology.orchestra.run.smithi029.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1focal [2,291 kB] 2024-04-26T11:41:08.716 INFO:teuthology.orchestra.run.smithi029.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1focal [237 kB] 2024-04-26T11:41:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1focal [142 kB] 2024-04-26T11:41:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1focal [7,011 kB] 2024-04-26T11:41:08.937 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T11:41:08.955 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:08.987 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:09.005 INFO:teuthology.orchestra.run.smithi029.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1focal [7,889 kB] 2024-04-26T11:41:09.144 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 198 MB in 14s (14.1 MB/s) 2024-04-26T11:41:09.307 INFO:teuthology.orchestra.run.smithi029.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1focal [13.8 kB] 2024-04-26T11:41:09.307 INFO:teuthology.orchestra.run.smithi029.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1focal [46.7 MB] 2024-04-26T11:41:09.315 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T11:41:09.334 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:09.396 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:09.538 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-26T11:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-26T11:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-26T11:41:09.673 INFO:teuthology.orchestra.run.smithi072.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1focal [113 kB] 2024-04-26T11:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T11:41:09.717 INFO:teuthology.orchestra.run.smithi072.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1focal [476 kB] 2024-04-26T11:41:09.793 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-26T11:41:09.808 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-26T11:41:09.851 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T11:41:09.884 INFO:teuthology.orchestra.run.smithi072.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1focal [25.1 MB] 2024-04-26T11:41:10.105 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T11:41:10.121 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-26T11:41:10.163 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T11:41:10.245 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../007-librbd1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:10.355 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T11:41:10.542 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T11:41:10.560 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-26T11:41:10.600 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T11:41:11.066 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:11.120 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T11:41:11.139 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:11.192 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T11:41:11.231 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:11.799 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T11:41:11.814 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:11.861 INFO:teuthology.orchestra.run.smithi029.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1focal [119 kB] 2024-04-26T11:41:11.864 INFO:teuthology.orchestra.run.smithi029.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1focal [37.4 kB] 2024-04-26T11:41:11.865 INFO:teuthology.orchestra.run.smithi029.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1focal [13.4 MB] 2024-04-26T11:41:11.882 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:11.980 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T11:41:11.998 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:12.038 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:12.225 INFO:teuthology.orchestra.run.smithi029.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1focal [107 kB] 2024-04-26T11:41:12.260 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T11:41:12.277 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:12.340 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rados. 2024-04-26T11:41:12.352 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:12.356 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:12.399 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:12.776 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T11:41:12.792 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:12.797 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-26T11:41:12.813 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-26T11:41:12.834 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:12.855 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T11:41:12.872 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 198 MB in 17s (11.9 MB/s) 2024-04-26T11:41:13.121 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T11:41:13.128 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-26T11:41:13.139 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:13.179 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:13.185 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-26T11:41:13.189 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-26T11:41:13.268 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../007-librbd1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:13.279 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T11:41:13.392 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T11:41:13.515 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T11:41:13.531 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:13.598 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:13.644 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T11:41:13.660 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-26T11:41:13.702 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T11:41:13.926 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T11:41:13.943 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-26T11:41:13.984 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-26T11:41:14.059 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T11:41:14.075 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-26T11:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:14.167 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T11:41:14.270 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T11:41:14.287 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:14.288 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T11:41:14.328 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:14.675 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T11:41:14.690 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-26T11:41:14.691 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:14.705 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-26T11:41:14.739 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T11:41:14.744 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:15.075 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T11:41:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-26T11:41:15.092 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-26T11:41:15.133 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T11:41:15.323 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T11:41:15.340 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:15.381 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:15.495 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T11:41:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-26T11:41:15.519 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rados. 2024-04-26T11:41:15.535 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:15.553 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T11:41:15.577 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:15.781 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T11:41:15.801 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:15.848 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:15.873 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librgw2. 2024-04-26T11:41:15.891 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:15.923 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:15.989 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T11:41:16.005 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:16.047 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:16.313 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-26T11:41:16.333 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-26T11:41:16.334 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T11:41:16.349 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:16.371 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T11:41:16.416 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:16.784 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../007-librbd1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:16.786 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T11:41:16.802 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:16.808 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T11:41:16.826 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:16.844 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:16.867 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:16.921 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T11:41:16.983 INFO:teuthology.orchestra.run.smithi072.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1focal [9,602 kB] 2024-04-26T11:41:17.212 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liboath0. 2024-04-26T11:41:17.230 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-26T11:41:17.247 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T11:41:17.267 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-26T11:41:17.269 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-26T11:41:17.305 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-26T11:41:17.589 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T11:41:17.605 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:17.625 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T11:41:17.641 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:17.647 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:17.683 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:17.787 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:17.914 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T11:41:18.103 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-26T11:41:18.120 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-26T11:41:18.134 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-common. 2024-04-26T11:41:18.150 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:18.161 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T11:41:18.192 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:18.581 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-26T11:41:18.597 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-26T11:41:18.639 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T11:41:18.854 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T11:41:18.871 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:18.914 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:19.026 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T11:41:19.044 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-26T11:41:19.084 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T11:41:19.084 INFO:teuthology.orchestra.run.smithi072.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1focal [238 kB] 2024-04-26T11:41:19.185 INFO:teuthology.orchestra.run.smithi072.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1focal [148 kB] 2024-04-26T11:41:19.254 INFO:teuthology.orchestra.run.smithi072.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1focal [1,571 kB] 2024-04-26T11:41:19.269 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rados. 2024-04-26T11:41:19.289 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:19.335 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:19.503 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librgw2. 2024-04-26T11:41:19.521 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:19.561 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:19.750 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T11:41:19.767 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:19.808 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:19.864 INFO:teuthology.orchestra.run.smithi072.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1focal [6,638 kB] 2024-04-26T11:41:20.071 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T11:41:20.088 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:20.130 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:20.498 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T11:41:20.511 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T11:41:20.516 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:20.528 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:20.556 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:20.570 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:20.656 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-base. 2024-04-26T11:41:20.673 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:20.724 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:20.883 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T11:41:20.902 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-26T11:41:20.950 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-26T11:41:20.976 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liboath0. 2024-04-26T11:41:20.992 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-26T11:41:21.055 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-26T11:41:21.223 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T11:41:21.236 INFO:teuthology.orchestra.run.smithi072.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1focal [24.5 MB] 2024-04-26T11:41:21.240 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:21.281 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:21.395 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T11:41:21.412 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:21.453 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:21.713 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-26T11:41:21.729 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-26T11:41:21.779 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T11:41:21.969 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T11:41:21.982 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-common. 2024-04-26T11:41:21.987 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-26T11:41:22.000 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:22.027 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-26T11:41:22.040 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:22.143 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-26T11:41:22.160 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-26T11:41:22.202 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T11:41:22.405 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T11:41:22.421 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-26T11:41:22.463 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-26T11:41:22.525 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T11:41:22.546 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-26T11:41:22.625 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T11:41:22.808 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T11:41:22.826 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-26T11:41:22.866 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-26T11:41:22.997 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librgw2. 2024-04-26T11:41:23.015 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:23.065 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:23.169 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T11:41:23.189 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-26T11:41:23.219 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-26T11:41:23.505 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-mako. 2024-04-26T11:41:23.525 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-26T11:41:23.564 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T11:41:23.933 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T11:41:23.949 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T11:41:23.992 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:41:24.203 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T11:41:24.219 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:24.261 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:24.295 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T11:41:24.312 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-26T11:41:24.369 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T11:41:24.511 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-base. 2024-04-26T11:41:24.530 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:24.589 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:24.634 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liboath0. 2024-04-26T11:41:24.651 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-26T11:41:24.672 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webob. 2024-04-26T11:41:24.690 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-26T11:41:24.732 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-26T11:41:24.764 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-26T11:41:25.067 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-26T11:41:25.086 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-26T11:41:25.098 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T11:41:25.115 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:25.124 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T11:41:25.165 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:25.461 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-bs4. 2024-04-26T11:41:25.481 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-26T11:41:25.519 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-26T11:41:25.656 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-common. 2024-04-26T11:41:25.672 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:25.714 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:25.881 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T11:41:25.899 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-26T11:41:25.942 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T11:41:26.251 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T11:41:26.266 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-26T11:41:26.309 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-26T11:41:26.620 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-paste. 2024-04-26T11:41:26.633 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T11:41:26.638 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-26T11:41:26.649 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-26T11:41:26.678 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T11:41:26.683 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-26T11:41:26.915 INFO:teuthology.orchestra.run.smithi072.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1focal [13.7 kB] 2024-04-26T11:41:26.917 INFO:teuthology.orchestra.run.smithi072.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1focal [853 kB] 2024-04-26T11:41:27.015 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T11:41:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-26T11:41:27.051 INFO:teuthology.orchestra.run.smithi072.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1focal [2,291 kB] 2024-04-26T11:41:27.070 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T11:41:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T11:41:27.090 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-26T11:41:27.128 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-26T11:41:27.351 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T11:41:27.370 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-26T11:41:27.418 INFO:teuthology.orchestra.run.smithi072.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1focal [237 kB] 2024-04-26T11:41:27.423 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T11:41:27.442 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-26T11:41:27.443 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-26T11:41:27.460 INFO:teuthology.orchestra.run.smithi072.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1focal [142 kB] 2024-04-26T11:41:27.488 INFO:teuthology.orchestra.run.smithi072.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1focal [7,011 kB] 2024-04-26T11:41:27.498 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-26T11:41:27.746 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T11:41:27.762 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-26T11:41:27.804 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-26T11:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T11:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-26T11:41:27.884 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-26T11:41:28.229 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-mako. 2024-04-26T11:41:28.247 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-26T11:41:28.287 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T11:41:28.649 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T11:41:28.665 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T11:41:28.669 INFO:teuthology.orchestra.run.smithi072.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1focal [7,889 kB] 2024-04-26T11:41:28.707 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:41:28.874 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T11:41:28.890 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-26T11:41:28.932 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T11:41:29.001 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T11:41:29.019 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-26T11:41:29.051 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T11:41:29.305 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T11:41:29.325 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-26T11:41:29.364 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T11:41:29.396 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-webob. 2024-04-26T11:41:29.412 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-26T11:41:29.454 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-26T11:41:29.666 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T11:41:29.686 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:29.725 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:29.795 INFO:teuthology.orchestra.run.smithi072.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1focal [13.8 kB] 2024-04-26T11:41:29.798 INFO:teuthology.orchestra.run.smithi072.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1focal [46.7 MB] 2024-04-26T11:41:29.815 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-26T11:41:29.834 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-26T11:41:29.873 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T11:41:29.900 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-base. 2024-04-26T11:41:29.918 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:29.970 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:30.113 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T11:41:30.129 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:30.171 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:30.218 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-bs4. 2024-04-26T11:41:30.234 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-26T11:41:30.309 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-26T11:41:30.533 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T11:41:30.550 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-26T11:41:30.591 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T11:41:30.713 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T11:41:30.731 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-26T11:41:30.783 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T11:41:30.927 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cryptography. 2024-04-26T11:41:30.944 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-26T11:41:30.985 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T11:41:31.175 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T11:41:31.194 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-26T11:41:31.232 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-26T11:41:31.331 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T11:41:31.350 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-26T11:41:31.414 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-26T11:41:31.569 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-paste. 2024-04-26T11:41:31.585 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-26T11:41:31.652 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T11:41:31.717 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T11:41:31.735 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../048-ceph-mgr_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:31.752 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T11:41:31.768 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-26T11:41:31.775 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:31.819 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-26T11:41:31.989 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T11:41:32.007 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-26T11:41:32.089 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T11:41:32.143 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T11:41:32.162 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-26T11:41:32.210 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-26T11:41:32.262 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T11:41:32.280 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../049-ceph-mon_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:32.320 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:32.425 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T11:41:32.441 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-26T11:41:32.483 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-26T11:41:32.575 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T11:41:32.592 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-26T11:41:32.634 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-26T11:41:32.853 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T11:41:32.869 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-26T11:41:32.911 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-26T11:41:32.947 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T11:41:32.964 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-26T11:41:33.014 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-26T11:41:33.249 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T11:41:33.264 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T11:41:33.265 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../050-ceph-osd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:33.283 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-26T11:41:33.320 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-mako. 2024-04-26T11:41:33.322 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T11:41:33.323 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:33.336 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-26T11:41:33.379 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T11:41:33.727 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T11:41:33.744 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-26T11:41:33.778 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T11:41:33.785 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T11:41:33.795 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T11:41:33.844 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:41:34.155 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T11:41:34.166 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T11:41:34.175 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:34.183 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-26T11:41:34.213 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:34.224 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T11:41:34.556 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webob. 2024-04-26T11:41:34.574 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-26T11:41:34.652 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T11:41:34.664 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-26T11:41:34.668 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:34.710 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:35.004 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-26T11:41:35.024 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-26T11:41:35.071 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T11:41:35.113 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T11:41:35.129 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-26T11:41:35.171 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T11:41:35.384 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-bs4. 2024-04-26T11:41:35.400 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-26T11:41:35.443 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-26T11:41:35.468 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph. 2024-04-26T11:41:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../051-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:35.526 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:35.541 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cryptography. 2024-04-26T11:41:35.557 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-26T11:41:35.599 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T11:41:35.887 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T11:41:35.891 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T11:41:35.904 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../052-ceph-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:35.908 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-26T11:41:35.946 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:35.962 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T11:41:36.120 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T11:41:36.136 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-26T11:41:36.177 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-26T11:41:36.257 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T11:41:36.273 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-26T11:41:36.316 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-26T11:41:36.341 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T11:41:36.359 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../053-ceph-mds_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:36.390 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:36.598 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T11:41:36.604 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-paste. 2024-04-26T11:41:36.613 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../048-ceph-mgr_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:36.620 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-26T11:41:36.656 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:36.662 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T11:41:36.902 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephadm. 2024-04-26T11:41:36.917 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../054-cephadm_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:36.960 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:37.037 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T11:41:37.055 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-26T11:41:37.103 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T11:41:37.242 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T11:41:37.260 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../049-ceph-mon_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:37.263 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T11:41:37.282 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-26T11:41:37.300 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:37.346 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-26T11:41:37.425 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T11:41:37.443 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-26T11:41:37.485 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-26T11:41:37.682 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T11:41:37.702 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-26T11:41:37.740 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T11:41:37.874 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T11:41:37.893 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-26T11:41:37.940 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-26T11:41:38.085 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T11:41:38.101 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:38.113 INFO:teuthology.orchestra.run.smithi072.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1focal [119 kB] 2024-04-26T11:41:38.116 INFO:teuthology.orchestra.run.smithi072.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1focal [37.4 kB] 2024-04-26T11:41:38.117 INFO:teuthology.orchestra.run.smithi072.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1focal [13.4 MB] 2024-04-26T11:41:38.143 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:38.247 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T11:41:38.266 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-26T11:41:38.313 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T11:41:38.379 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T11:41:38.399 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../050-ceph-osd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:38.437 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:38.530 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jwt. 2024-04-26T11:41:38.550 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-26T11:41:38.588 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T11:41:38.665 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T11:41:38.683 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-26T11:41:38.732 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T11:41:39.041 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-attr. 2024-04-26T11:41:39.059 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-26T11:41:39.080 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T11:41:39.096 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:39.137 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:39.257 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-26T11:41:39.515 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T11:41:39.534 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:39.574 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:39.618 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T11:41:39.636 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-26T11:41:39.685 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-26T11:41:39.913 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T11:41:39.929 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-26T11:41:39.996 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T11:41:40.005 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-py. 2024-04-26T11:41:40.020 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-26T11:41:40.054 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T11:41:40.068 INFO:teuthology.orchestra.run.smithi072.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1focal [107 kB] 2024-04-26T11:41:40.311 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cryptography. 2024-04-26T11:41:40.328 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-26T11:41:40.378 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T11:41:40.381 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-26T11:41:40.400 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-26T11:41:40.439 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T11:41:40.699 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph. 2024-04-26T11:41:40.714 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 198 MB in 46s (4,332 kB/s) 2024-04-26T11:41:40.719 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../051-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:40.734 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-packaging. 2024-04-26T11:41:40.744 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T11:41:40.750 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-26T11:41:40.757 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:40.763 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-26T11:41:40.784 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-26T11:41:40.811 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-26T11:41:40.891 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-26T11:41:40.947 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-26T11:41:40.952 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-26T11:41:41.041 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T11:41:41.078 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T11:41:41.096 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-26T11:41:41.128 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T11:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T11:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../052-ceph-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:41.200 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T11:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:41.218 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../048-ceph-mgr_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:41.258 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:41.406 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T11:41:41.415 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T11:41:41.424 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-26T11:41:41.432 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-26T11:41:41.465 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T11:41:41.472 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-26T11:41:41.834 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T11:41:41.849 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T11:41:41.854 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T11:41:41.867 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../049-ceph-mon_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:41.889 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T11:41:41.906 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-26T11:41:41.916 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:41.917 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T11:41:41.938 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T11:41:41.947 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T11:41:41.956 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../053-ceph-mds_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:41.996 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:42.204 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-underscore. 2024-04-26T11:41:42.221 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-26T11:41:42.262 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T11:41:42.430 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T11:41:42.446 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:42.499 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:42.540 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-26T11:41:42.557 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-26T11:41:42.598 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T11:41:42.599 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package cephadm. 2024-04-26T11:41:42.617 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../054-cephadm_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:42.658 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:42.916 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T11:41:42.932 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../050-ceph-osd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:42.959 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-routes. 2024-04-26T11:41:42.974 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:42.975 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-26T11:41:42.987 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T11:41:43.005 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:43.017 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-26T11:41:43.027 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T11:41:43.045 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:43.047 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-26T11:41:43.085 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-26T11:41:43.350 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T11:41:43.365 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:43.407 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:43.409 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T11:41:43.426 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T11:41:43.460 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:41:43.530 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T11:41:43.548 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-26T11:41:43.596 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T11:41:43.892 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-26T11:41:43.912 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-26T11:41:43.959 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T11:41:43.991 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T11:41:44.008 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:44.049 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:44.309 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../007-librbd1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T11:41:44.436 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jwt. 2024-04-26T11:41:44.455 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-26T11:41:44.494 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T11:41:44.830 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-decorator. 2024-04-26T11:41:44.848 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-26T11:41:44.864 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-attr. 2024-04-26T11:41:44.881 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-26T11:41:44.895 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T11:41:44.922 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-26T11:41:45.177 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:45.198 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-26T11:41:45.213 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-26T11:41:45.281 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T11:41:45.293 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T11:41:45.301 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T11:41:45.311 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-26T11:41:45.358 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-26T11:41:45.575 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-scipy. 2024-04-26T11:41:45.592 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-26T11:41:45.633 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-26T11:41:45.700 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-py. 2024-04-26T11:41:45.717 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-26T11:41:45.732 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph. 2024-04-26T11:41:45.751 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../051-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:45.784 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T11:41:45.790 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:46.119 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T11:41:46.128 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T11:41:46.134 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:46.137 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-26T11:41:46.144 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../052-ceph-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:46.156 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-26T11:41:46.177 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:46.194 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:46.238 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T11:41:46.498 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rados. 2024-04-26T11:41:46.517 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:46.557 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-packaging. 2024-04-26T11:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-26T11:41:46.625 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-26T11:41:46.668 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T11:41:46.685 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../053-ceph-mds_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:46.727 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:46.913 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T11:41:46.930 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:46.968 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-26T11:41:46.971 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:46.976 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T11:41:46.987 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-26T11:41:46.992 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-26T11:41:47.026 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T11:41:47.034 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T11:41:47.193 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T11:41:47.208 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:47.246 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:47.373 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephadm. 2024-04-26T11:41:47.387 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T11:41:47.394 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../054-cephadm_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:47.404 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-26T11:41:47.432 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:47.445 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-26T11:41:47.557 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T11:41:47.574 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:47.607 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:47.613 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T11:41:47.629 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-26T11:41:47.671 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-26T11:41:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T11:41:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-26T11:41:47.830 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-26T11:41:47.832 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T11:41:47.852 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T11:41:47.891 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T11:41:47.906 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T11:41:47.925 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-26T11:41:47.964 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-26T11:41:48.066 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T11:41:48.083 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-26T11:41:48.124 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T11:41:48.168 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libjs-underscore. 2024-04-26T11:41:48.184 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-26T11:41:48.203 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T11:41:48.210 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T11:41:48.220 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-26T11:41:48.226 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T11:41:48.230 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:48.262 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T11:41:48.269 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:48.554 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-26T11:41:48.570 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-26T11:41:48.609 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-26T11:41:48.612 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T11:41:48.625 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T11:41:48.628 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-26T11:41:48.642 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:48.667 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T11:41:48.683 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T11:41:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:48.924 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:49.000 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-routes. 2024-04-26T11:41:49.017 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-26T11:41:49.031 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-26T11:41:49.049 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-26T11:41:49.049 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jwt. 2024-04-26T11:41:49.058 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-26T11:41:49.065 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-26T11:41:49.107 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T11:41:49.122 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T11:41:49.441 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T11:41:49.455 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T11:41:49.460 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:49.471 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-26T11:41:49.506 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-attr. 2024-04-26T11:41:49.513 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T11:41:49.515 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:49.523 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-26T11:41:49.564 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-26T11:41:49.886 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librgw2. 2024-04-26T11:41:49.894 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T11:41:49.902 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:49.912 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-26T11:41:49.945 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:49.952 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-26T11:41:50.077 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T11:41:50.093 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-26T11:41:50.135 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-26T11:41:50.284 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-py. 2024-04-26T11:41:50.302 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-26T11:41:50.342 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T11:41:50.471 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T11:41:50.488 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-26T11:41:50.530 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T11:41:50.707 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-26T11:41:50.724 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-26T11:41:50.766 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T11:41:50.874 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T11:41:50.892 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-26T11:41:50.932 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T11:41:50.999 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T11:41:51.003 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-decorator. 2024-04-26T11:41:51.015 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:51.020 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-26T11:41:51.061 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T11:41:51.065 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:51.096 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-packaging. 2024-04-26T11:41:51.115 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-26T11:41:51.163 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-26T11:41:51.346 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T11:41:51.366 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-26T11:41:51.404 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-26T11:41:51.422 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liboath0. 2024-04-26T11:41:51.431 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-26T11:41:51.438 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-26T11:41:51.446 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-26T11:41:51.481 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-26T11:41:51.486 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T11:41:51.489 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T11:41:51.506 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-26T11:41:51.602 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T11:41:51.726 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T11:41:51.746 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-26T11:41:51.784 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-26T11:41:51.819 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T11:41:51.837 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:51.867 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-scipy. 2024-04-26T11:41:51.879 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:51.882 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-26T11:41:51.925 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-26T11:41:51.932 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T11:41:51.951 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-26T11:41:51.999 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-26T11:41:52.130 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-blinker. 2024-04-26T11:41:52.150 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-26T11:41:52.188 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T11:41:52.352 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-common. 2024-04-26T11:41:52.359 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T11:41:52.367 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:52.375 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T11:41:52.410 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:52.425 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T11:41:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-26T11:41:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-26T11:41:52.558 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T11:41:52.738 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjs-underscore. 2024-04-26T11:41:52.758 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-26T11:41:52.797 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T11:41:52.895 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T11:41:52.911 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-26T11:41:52.953 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T11:41:53.069 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-26T11:41:53.087 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-26T11:41:53.136 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T11:41:53.289 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T11:41:53.308 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-26T11:41:53.327 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-26T11:41:53.339 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T11:41:53.344 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-26T11:41:53.418 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T11:41:53.457 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-routes. 2024-04-26T11:41:53.474 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-26T11:41:53.525 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-26T11:41:53.684 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T11:41:53.700 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-26T11:41:53.742 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T11:41:53.897 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T11:41:53.918 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:53.964 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:54.013 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T11:41:54.029 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-26T11:41:54.096 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-26T11:41:54.256 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T11:41:54.272 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:54.305 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:54.483 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T11:41:54.501 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-26T11:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T11:41:54.642 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T11:41:54.660 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-26T11:41:54.699 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-26T11:41:55.036 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T11:41:55.047 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-base. 2024-04-26T11:41:55.055 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T11:41:55.063 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:55.094 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:41:55.117 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:55.350 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T11:41:55.366 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:41:55.405 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package jq. 2024-04-26T11:41:55.424 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T11:41:55.430 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:55.464 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:41:55.675 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package socat. 2024-04-26T11:41:55.692 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-26T11:41:55.749 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-26T11:41:55.768 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-decorator. 2024-04-26T11:41:55.784 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-26T11:41:55.878 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T11:41:56.044 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T11:41:56.062 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-26T11:41:56.102 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-26T11:41:56.174 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-26T11:41:56.192 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-26T11:41:56.232 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T11:41:56.440 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-test. 2024-04-26T11:41:56.457 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:41:56.498 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:41:56.564 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-scipy. 2024-04-26T11:41:56.581 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-26T11:41:56.594 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T11:41:56.612 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-26T11:41:56.617 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-26T11:41:56.694 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-26T11:41:56.807 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T11:41:56.824 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-26T11:41:56.858 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-26T11:41:57.030 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T11:41:57.046 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-26T11:41:57.109 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T11:41:57.189 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T11:41:57.206 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-26T11:41:57.248 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-26T11:41:57.467 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T11:41:57.486 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-26T11:41:57.498 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T11:41:57.512 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-26T11:41:57.525 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T11:41:57.546 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-26T11:41:57.843 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T11:41:57.859 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-26T11:41:57.906 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-26T11:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T11:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-26T11:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-26T11:41:58.132 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-26T11:41:58.149 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-26T11:41:58.191 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-mako. 2024-04-26T11:41:58.199 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T11:41:58.207 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-26T11:41:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T11:41:58.427 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T11:41:58.445 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-26T11:41:58.510 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-26T11:41:58.598 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T11:41:58.614 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T11:41:58.657 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:41:58.774 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T11:41:58.794 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-26T11:41:58.839 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-blinker. 2024-04-26T11:41:58.840 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-26T11:41:58.859 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-26T11:41:58.918 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T11:41:58.945 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T11:41:58.962 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-26T11:41:59.004 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T11:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T11:41:59.259 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-26T11:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-26T11:41:59.277 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-26T11:41:59.285 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webob. 2024-04-26T11:41:59.302 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-26T11:41:59.315 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T11:41:59.317 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T11:41:59.338 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-26T11:41:59.675 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-26T11:41:59.691 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-26T11:41:59.696 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T11:41:59.713 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-26T11:41:59.733 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T11:41:59.754 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T11:41:59.968 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T11:41:59.985 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:00.076 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-bs4. 2024-04-26T11:42:00.104 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-26T11:42:00.141 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T11:42:00.155 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-26T11:42:00.157 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-26T11:42:00.198 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T11:42:00.478 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T11:42:00.494 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:00.521 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T11:42:00.536 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:00.538 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-26T11:42:00.570 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T11:42:00.582 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T11:42:00.585 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-26T11:42:00.627 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T11:42:00.832 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-26T11:42:00.848 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T11:42:00.890 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:00.911 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T11:42:00.932 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-26T11:42:00.970 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-26T11:42:01.249 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T11:42:01.267 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-paste. 2024-04-26T11:42:01.268 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:01.283 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-26T11:42:01.298 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:01.325 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T11:42:01.402 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T11:42:01.420 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:01.641 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T11:42:01.660 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-26T11:42:01.693 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T11:42:01.708 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T11:42:01.712 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-26T11:42:01.751 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-26T11:42:01.764 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T11:42:01.784 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-26T11:42:01.831 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-26T11:42:01.847 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T11:42:01.864 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-26T11:42:01.923 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T11:42:02.039 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T11:42:02.057 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-26T11:42:02.096 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T11:42:02.097 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-26T11:42:02.116 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T11:42:02.146 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T11:42:02.162 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:02.163 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-26T11:42:02.204 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T11:42:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T11:42:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-26T11:42:02.318 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-26T11:42:02.411 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T11:42:02.427 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-26T11:42:02.461 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-26T11:42:02.465 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package jq. 2024-04-26T11:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T11:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:02.602 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T11:42:02.626 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-26T11:42:02.670 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T11:42:02.700 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-26T11:42:02.717 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T11:42:02.758 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:02.776 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T11:42:02.796 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-26T11:42:02.835 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package socat. 2024-04-26T11:42:02.843 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T11:42:02.855 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-26T11:42:02.901 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-26T11:42:03.081 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T11:42:03.098 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-26T11:42:03.139 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-26T11:42:03.203 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T11:42:03.219 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-26T11:42:03.230 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T11:42:03.246 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-26T11:42:03.261 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T11:42:03.313 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-26T11:42:03.521 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T11:42:03.537 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-26T11:42:03.577 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T11:42:03.580 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-26T11:42:03.593 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:03.635 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:03.667 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-test. 2024-04-26T11:42:03.685 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:03.913 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-blinker. 2024-04-26T11:42:03.929 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-26T11:42:03.979 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T11:42:04.079 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T11:42:04.095 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:04.137 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:04.295 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-26T11:42:04.312 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-26T11:42:04.389 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-26T11:42:04.395 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T11:42:04.409 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-26T11:42:04.438 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-26T11:42:04.476 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T11:42:04.494 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-26T11:42:04.542 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T11:42:04.745 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T11:42:04.763 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-26T11:42:04.804 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T11:42:04.808 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webencodings. 2024-04-26T11:42:04.825 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-26T11:42:04.857 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cryptography. 2024-04-26T11:42:04.866 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T11:42:04.874 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-26T11:42:04.916 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T11:42:05.129 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T11:42:05.150 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-26T11:42:05.170 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-html5lib. 2024-04-26T11:42:05.186 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-26T11:42:05.196 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T11:42:05.229 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-26T11:42:05.291 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T11:42:05.307 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-26T11:42:05.349 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-26T11:42:05.551 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T11:42:05.571 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-26T11:42:05.582 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-26T11:42:05.602 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-26T11:42:05.618 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T11:42:05.640 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T11:42:05.704 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T11:42:05.724 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../048-ceph-mgr_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:05.771 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:06.110 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T11:42:06.131 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T11:42:06.202 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T11:42:06.239 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T11:42:06.254 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:06.295 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T11:42:06.297 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:06.311 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../049-ceph-mon_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:06.353 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:06.513 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T11:42:06.532 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-26T11:42:06.571 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T11:42:06.710 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T11:42:06.730 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-26T11:42:06.777 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-26T11:42:06.932 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T11:42:06.949 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-26T11:42:06.990 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T11:42:07.159 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T11:42:07.176 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T11:42:07.225 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:07.302 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T11:42:07.320 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-26T11:42:07.359 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T11:42:07.445 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T11:42:07.462 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../050-ceph-osd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:07.497 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package jq. 2024-04-26T11:42:07.503 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:07.515 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T11:42:07.580 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:07.679 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T11:42:07.697 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-26T11:42:07.737 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T11:42:07.870 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package socat. 2024-04-26T11:42:07.886 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-26T11:42:07.936 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-26T11:42:07.989 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T11:42:08.008 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:08.038 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:08.269 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T11:42:08.287 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-26T11:42:08.327 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-26T11:42:08.409 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-26T11:42:08.424 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package radosgw. 2024-04-26T11:42:08.425 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T11:42:08.441 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../110-radosgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:08.458 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:08.490 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:08.752 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-test. 2024-04-26T11:42:08.768 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:08.819 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:09.013 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T11:42:09.030 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:09.071 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:09.516 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T11:42:09.535 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-26T11:42:09.592 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T11:42:09.969 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph. 2024-04-26T11:42:09.979 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T11:42:09.988 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../051-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:09.997 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-26T11:42:10.027 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:10.037 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-26T11:42:10.302 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T11:42:10.322 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:10.348 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T11:42:10.359 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:10.368 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../052-ceph-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:10.415 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:10.478 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-26T11:42:10.496 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T11:42:10.536 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:10.666 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-26T11:42:10.847 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T11:42:10.865 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../053-ceph-mds_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:10.905 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:10.956 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T11:42:11.082 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T11:42:11.208 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T11:42:11.434 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:11.886 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephadm. 2024-04-26T11:42:11.902 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../054-cephadm_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:11.952 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:12.019 INFO:teuthology.orchestra.run.smithi082.stdout:Adding system user cephadm....done 2024-04-26T11:42:12.182 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:12.276 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T11:42:12.293 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-26T11:42:12.308 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T11:42:12.334 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-26T11:42:12.682 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T11:42:12.684 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T11:42:12.698 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-26T11:42:12.741 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T11:42:12.977 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:13.078 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-26T11:42:13.087 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T11:42:13.103 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:13.146 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:13.179 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T11:42:13.212 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-26T11:42:13.231 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-26T11:42:13.261 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-26T11:42:13.419 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T11:42:13.439 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:13.470 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jwt. 2024-04-26T11:42:13.487 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:13.489 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-26T11:42:13.505 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-26T11:42:13.528 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T11:42:13.648 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-webencodings. 2024-04-26T11:42:13.668 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-26T11:42:13.706 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T11:42:13.777 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-26T11:42:13.795 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T11:42:13.843 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-attr. 2024-04-26T11:42:13.844 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:13.859 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-26T11:42:13.902 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-26T11:42:13.907 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T11:42:14.086 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-html5lib. 2024-04-26T11:42:14.108 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-26T11:42:14.144 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-26T11:42:14.190 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T11:42:14.209 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-26T11:42:14.225 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-26T11:42:14.248 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-26T11:42:14.377 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T11:42:14.393 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:14.435 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:14.518 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T11:42:14.540 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-26T11:42:14.546 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-py. 2024-04-26T11:42:14.559 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-26T11:42:14.565 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-26T11:42:14.597 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T11:42:14.613 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T11:42:14.794 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T11:42:14.993 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-26T11:42:15.010 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-26T11:42:15.019 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T11:42:15.039 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-26T11:42:15.053 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T11:42:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:15.118 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T11:42:15.120 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T11:42:15.137 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T11:42:15.197 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T11:42:15.350 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-packaging. 2024-04-26T11:42:15.367 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-26T11:42:15.396 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T11:42:15.408 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-26T11:42:15.471 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T11:42:15.488 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-26T11:42:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-26T11:42:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-26T11:42:15.546 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T11:42:15.563 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-26T11:42:15.604 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T11:42:15.698 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T11:42:15.717 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-26T11:42:15.756 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T11:42:15.848 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T11:42:15.936 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-26T11:42:15.953 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T11:42:15.994 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:15.999 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T11:42:16.017 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-26T11:42:16.053 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T11:42:16.057 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T11:42:16.073 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-26T11:42:16.111 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-26T11:42:16.158 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T11:42:16.283 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T11:42:16.426 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T11:42:16.445 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-26T11:42:16.452 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T11:42:16.472 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T11:42:16.484 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T11:42:16.648 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T11:42:16.693 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-26T11:42:16.787 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T11:42:16.806 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-26T11:42:16.862 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T11:42:16.969 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T11:42:16.974 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjs-underscore. 2024-04-26T11:42:16.991 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-26T11:42:17.033 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T11:42:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T11:42:17.315 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-26T11:42:17.331 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-26T11:42:17.373 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T11:42:17.563 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T11:42:17.602 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package radosgw. 2024-04-26T11:42:17.618 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../110-radosgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:17.659 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:17.679 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-routes. 2024-04-26T11:42:17.697 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-26T11:42:17.737 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-26T11:42:17.825 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-26T11:42:17.839 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T11:42:17.845 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-26T11:42:17.891 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-26T11:42:18.068 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T11:42:18.088 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:18.134 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-26T11:42:18.263 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webencodings. 2024-04-26T11:42:18.283 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-26T11:42:18.329 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T11:42:18.491 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-26T11:42:18.642 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-html5lib. 2024-04-26T11:42:18.660 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-26T11:42:18.701 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-26T11:42:18.784 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T11:42:18.910 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T11:42:19.036 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T11:42:19.041 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-26T11:42:19.060 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-26T11:42:19.062 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T11:42:19.081 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:19.108 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T11:42:19.120 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:19.320 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T11:42:19.464 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-26T11:42:19.663 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T11:42:19.681 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T11:42:19.721 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T11:42:19.730 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T11:42:19.767 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T11:42:19.876 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T11:42:19.938 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-decorator. 2024-04-26T11:42:19.955 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-26T11:42:19.996 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T11:42:20.036 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T11:42:20.054 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T11:42:20.075 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-26T11:42:20.115 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T11:42:20.168 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T11:42:20.245 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:20.335 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-26T11:42:20.351 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-26T11:42:20.386 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T11:42:20.486 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-26T11:42:20.612 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:20.701 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-scipy. 2024-04-26T11:42:20.718 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-26T11:42:20.759 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-26T11:42:20.872 INFO:teuthology.orchestra.run.smithi122.stdout:Adding system user cephadm....done 2024-04-26T11:42:20.938 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:42:20.990 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T11:42:21.010 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-26T11:42:21.035 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:21.056 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T11:42:21.072 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-26T11:42:21.169 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T11:42:21.379 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T11:42:21.397 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-26T11:42:21.415 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T11:42:21.446 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T11:42:21.541 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-26T11:42:21.554 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T11:42:21.650 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-26T11:42:21.767 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T11:42:21.788 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-26T11:42:21.834 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T11:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:21.943 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T11:42:21.997 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-26T11:42:22.133 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T11:42:22.155 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-26T11:42:22.172 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-26T11:42:22.213 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T11:42:22.244 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:42:22.370 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T11:42:22.484 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-26T11:42:22.517 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package radosgw. 2024-04-26T11:42:22.521 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T11:42:22.535 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../110-radosgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:22.576 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:22.786 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T11:42:22.805 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-26T11:42:22.831 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T11:42:22.852 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-26T11:42:22.919 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T11:42:23.108 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-26T11:42:23.170 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-26T11:42:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T11:42:23.243 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-26T11:42:23.285 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T11:42:23.402 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T11:42:23.446 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T11:42:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:42:23.739 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T11:42:23.854 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-26T11:42:23.954 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T11:42:23.973 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:24.021 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:24.082 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:24.155 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T11:42:24.183 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T11:42:24.203 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:24.249 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:24.375 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T11:42:24.439 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T11:42:24.526 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-26T11:42:24.587 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-26T11:42:24.802 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T11:42:24.834 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-26T11:42:24.926 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T11:42:25.070 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T11:42:25.078 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T11:42:25.109 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-26T11:42:25.204 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T11:42:25.213 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T11:42:25.234 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T11:42:25.418 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:25.535 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-26T11:42:25.559 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T11:42:25.576 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-26T11:42:25.580 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-26T11:42:25.651 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-26T11:42:25.907 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T11:42:25.920 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T11:42:25.966 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T11:42:25.983 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-26T11:42:26.024 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T11:42:26.033 INFO:teuthology.orchestra.run.smithi029.stdout:Adding system user cephadm....done 2024-04-26T11:42:26.056 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T11:42:26.191 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T11:42:26.207 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-26T11:42:26.214 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:26.341 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T11:42:26.355 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T11:42:26.371 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-26T11:42:26.415 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T11:42:26.533 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T11:42:26.559 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T11:42:26.696 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T11:42:26.809 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-26T11:42:26.826 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T11:42:26.843 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-26T11:42:26.843 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T11:42:26.884 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-26T11:42:27.040 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:27.153 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-26T11:42:27.175 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-26T11:42:27.216 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T11:42:27.234 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-26T11:42:27.284 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-26T11:42:27.302 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T11:42:27.471 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-26T11:42:27.631 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-26T11:42:27.641 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-blinker. 2024-04-26T11:42:27.657 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-26T11:42:27.708 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T11:42:27.747 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T11:42:27.901 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T11:42:27.998 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-26T11:42:28.017 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-26T11:42:28.032 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T11:42:28.065 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T11:42:28.094 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T11:42:28.306 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:28.373 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-26T11:42:28.390 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T11:42:28.400 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T11:42:28.409 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-26T11:42:28.423 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-26T11:42:28.456 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T11:42:28.667 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T11:42:28.770 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T11:42:28.786 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T11:42:28.789 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-26T11:42:28.791 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-26T11:42:28.828 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T11:42:28.952 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T11:42:29.101 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-26T11:42:29.138 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T11:42:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-26T11:42:29.190 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T11:42:29.196 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T11:42:29.246 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:29.385 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:42:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-26T11:42:29.549 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T11:42:29.592 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-26T11:42:29.678 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-26T11:42:29.739 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:29.815 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T11:42:29.834 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:29.875 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:29.877 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T11:42:29.978 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T11:42:30.069 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:42:30.220 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-26T11:42:30.221 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T11:42:30.231 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-26T11:42:30.239 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-26T11:42:30.255 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T11:42:30.280 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-26T11:42:30.399 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T11:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T11:42:30.607 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T11:42:30.629 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T11:42:30.646 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T11:42:30.695 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:30.697 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-26T11:42:30.786 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-26T11:42:30.824 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-26T11:42:30.941 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T11:42:30.967 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package jq. 2024-04-26T11:42:30.985 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T11:42:31.025 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:31.105 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T11:42:31.158 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T11:42:31.331 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package socat. 2024-04-26T11:42:31.349 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-26T11:42:31.390 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-26T11:42:31.423 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T11:42:31.476 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:42:31.627 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T11:42:31.689 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T11:42:31.709 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-26T11:42:31.738 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T11:42:31.756 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-26T11:42:31.794 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T11:42:31.988 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T11:42:32.079 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T11:42:32.097 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-26T11:42:32.105 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-test. 2024-04-26T11:42:32.107 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T11:42:32.125 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:32.165 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:32.223 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:32.350 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-26T11:42:32.400 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-26T11:42:32.415 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-26T11:42:32.634 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T11:42:32.725 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-26T11:42:32.743 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T11:42:32.759 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-26T11:42:32.869 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:42:33.029 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T11:42:33.069 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T11:42:33.155 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T11:42:33.203 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-26T11:42:33.291 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T11:42:33.362 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T11:42:33.479 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T11:42:33.618 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T11:42:33.688 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T11:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T11:42:34.006 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T11:42:34.048 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:34.170 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-26T11:42:34.174 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-26T11:42:34.300 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:34.425 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T11:42:34.426 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:34.442 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-26T11:42:34.594 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T11:42:34.654 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:34.755 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-26T11:42:34.804 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-26T11:42:34.912 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-26T11:42:34.923 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:35.061 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-26T11:42:35.251 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:42:35.280 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T11:42:35.394 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-26T11:42:35.406 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T11:42:35.492 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:35.582 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-26T11:42:35.652 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:35.778 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:35.789 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T11:42:35.934 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-26T11:42:35.941 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T11:42:36.003 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:42:36.003 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:42:36.077 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-26T11:42:36.243 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-26T11:42:36.371 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T11:42:36.454 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:36.588 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:36.589 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T11:42:36.605 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T11:42:36.682 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:36.690 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:42:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T11:42:36.827 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T11:42:36.954 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T11:42:36.981 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-26T11:42:36.998 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T11:42:37.039 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:37.289 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T11:42:37.539 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T11:42:37.557 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:37.599 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-26T11:42:37.605 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:37.643 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:37.765 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:37.794 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:37.891 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-26T11:42:37.909 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T11:42:37.920 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T11:42:38.033 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-26T11:42:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:38.055 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:42:38.095 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T11:42:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:38.293 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-26T11:42:38.340 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-26T11:42:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T11:42:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-26T11:42:38.499 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-26T11:42:38.610 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-26T11:42:38.650 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T11:42:38.767 INFO:teuthology.orchestra.run.smithi082.stdout:Adding group ceph....done 2024-04-26T11:42:38.890 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-26T11:42:38.907 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T11:42:38.936 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:42:38.956 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:38.977 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T11:42:39.062 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-26T11:42:39.170 INFO:teuthology.orchestra.run.smithi082.stdout:Adding system user ceph....done 2024-04-26T11:42:39.354 INFO:teuthology.orchestra.run.smithi082.stdout:Setting system user ceph properties....done 2024-04-26T11:42:39.367 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-26T11:42:39.379 INFO:teuthology.orchestra.run.smithi082.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T11:42:39.414 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T11:42:39.529 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T11:42:39.625 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-26T11:42:39.732 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-26T11:42:39.819 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T11:42:39.830 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T11:42:40.138 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-26T11:42:40.159 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T11:42:40.275 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:40.426 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:40.492 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T11:42:40.518 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T11:42:40.635 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T11:42:40.769 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-26T11:42:40.788 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-26T11:42:40.817 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-26T11:42:40.827 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-26T11:42:40.895 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:42:40.895 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:42:41.160 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webencodings. 2024-04-26T11:42:41.170 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T11:42:41.176 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-26T11:42:41.218 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T11:42:41.336 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:41.473 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-26T11:42:41.524 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-html5lib. 2024-04-26T11:42:41.545 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-26T11:42:41.586 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-26T11:42:41.597 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T11:42:41.724 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-26T11:42:41.747 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T11:42:41.884 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:41.936 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-26T11:42:41.953 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-26T11:42:41.994 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T11:42:42.009 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-26T11:42:42.196 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:42.336 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T11:42:42.421 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:42:42.421 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:42:42.462 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-26T11:42:42.805 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T11:42:42.864 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:42.919 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T11:42:42.938 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T11:42:42.977 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T11:42:43.012 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:43.081 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T11:42:43.117 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:42:43.117 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:42:43.138 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-26T11:42:43.266 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T11:42:43.286 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-26T11:42:43.324 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T11:42:43.508 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-26T11:42:43.527 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T11:42:43.566 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:43.672 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T11:42:43.689 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-26T11:42:43.730 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T11:42:43.814 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-26T11:42:44.067 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:42:44.067 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:42:44.085 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T11:42:44.103 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-26T11:42:44.152 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T11:42:44.157 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:42:44.168 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:44.284 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-26T11:42:44.319 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-26T11:42:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T11:42:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-26T11:42:44.478 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T11:42:44.604 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:44.635 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:44.636 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T11:42:44.761 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:44.841 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:44.983 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-26T11:42:44.989 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:42:44.989 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:42:45.000 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-26T11:42:45.095 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package radosgw. 2024-04-26T11:42:45.114 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../110-radosgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:45.154 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:45.301 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:45.369 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T11:42:45.437 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:45.460 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-26T11:42:45.588 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:45.713 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T11:42:45.731 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:45.771 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:45.865 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:45.921 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:46.072 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:46.298 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:42:46.298 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:42:46.329 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T11:42:46.621 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-26T11:42:46.758 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:46.793 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T11:42:46.884 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:46.919 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T11:42:46.936 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T11:42:46.938 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T11:42:46.946 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-26T11:42:46.986 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:47.043 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T11:42:47.121 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:42:47.248 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-26T11:42:47.313 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-26T11:42:47.544 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T11:42:47.638 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T11:42:47.696 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-26T11:42:47.765 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T11:42:47.892 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T11:42:47.964 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T11:42:48.097 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:48.106 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:48.232 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:48.341 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T11:42:48.383 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:48.543 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:48.670 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user cephadm....done 2024-04-26T11:42:48.670 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T11:42:48.834 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:48.961 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T11:42:49.058 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:49.179 INFO:teuthology.orchestra.run.smithi122.stdout:Adding group ceph....done 2024-04-26T11:42:49.226 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-26T11:42:49.307 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T11:42:49.355 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:49.506 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:49.597 INFO:teuthology.orchestra.run.smithi122.stdout:Adding system user ceph....done 2024-04-26T11:42:49.635 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T11:42:49.720 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:49.761 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-26T11:42:49.806 INFO:teuthology.orchestra.run.smithi122.stdout:Setting system user ceph properties....done 2024-04-26T11:42:49.822 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-26T11:42:49.833 INFO:teuthology.orchestra.run.smithi122.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T11:42:49.857 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-26T11:42:49.888 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T11:42:49.983 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T11:42:50.152 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:50.218 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-26T11:42:50.297 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T11:42:50.320 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-26T11:42:50.391 INFO:teuthology.orchestra.run.smithi082.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:42:50.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T11:42:50.462 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-04-26T11:42:50.625 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:50.630 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T11:42:50.674 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2024-04-26T11:42:50.674 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2024-04-26T11:42:50.752 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:50.761 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:50.879 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:50.890 INFO:teuthology.orchestra.run.smithi082.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-26T11:42:50.890 INFO:teuthology.orchestra.run.smithi082.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-26T11:42:50.890 INFO:teuthology.orchestra.run.smithi082.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-26T11:42:50.890 INFO:teuthology.orchestra.run.smithi082.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-26T11:42:50.890 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:42:50.891 INFO:teuthology.orchestra.run.smithi082.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T11:42:50.891 INFO:teuthology.orchestra.run.smithi082.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:42:50.892 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2024-04-26T11:42:50.892 INFO:teuthology.orchestra.run.smithi082.stdout: libssl-doc 2024-04-26T11:42:50.916 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-26T11:42:50.928 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:50.935 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2024-04-26T11:42:50.936 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-dev libelf-dev libssl-dev 2024-04-26T11:42:50.938 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages will be upgraded: 2024-04-26T11:42:50.939 INFO:teuthology.orchestra.run.smithi082.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-26T11:42:51.003 INFO:teuthology.orchestra.run.smithi082.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-26T11:42:51.003 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 3,303 kB of archives. 2024-04-26T11:42:51.003 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-26T11:42:51.004 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-26T11:42:51.052 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-26T11:42:51.060 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-26T11:42:51.115 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:42:51.115 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:42:51.127 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-26T11:42:51.135 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-26T11:42:51.195 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T11:42:51.288 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-26T11:42:51.288 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-26T11:42:51.290 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-26T11:42:51.430 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:42:51.430 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:42:51.522 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T11:42:51.683 INFO:teuthology.orchestra.run.smithi082.stdout:Preconfiguring packages ... 2024-04-26T11:42:51.750 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:51.815 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 3,303 kB in 0s (7,979 kB/s) 2024-04-26T11:42:51.815 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:51.872 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:51.877 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:51.952 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T11:42:51.957 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T11:42:52.004 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T11:42:52.087 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T11:42:52.117 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T11:42:52.246 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-26T11:42:52.274 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T11:42:52.523 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T11:42:52.569 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T11:42:52.715 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:52.744 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T11:42:52.791 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T11:42:52.918 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T11:42:52.946 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:52.947 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:42:52.947 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:42:53.098 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:53.104 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T11:42:53.242 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:53.297 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-26T11:42:53.384 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:53.400 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:53.530 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:53.537 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T11:42:53.542 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:42:53.591 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T11:42:53.614 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:42:53.614 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:42:53.685 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T11:42:53.859 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T11:42:54.060 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:54.113 INFO:teuthology.orchestra.run.smithi029.stdout:Adding group ceph....done 2024-04-26T11:42:54.165 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:42:54.212 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T11:42:54.299 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T11:42:54.482 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T11:42:54.567 INFO:teuthology.orchestra.run.smithi029.stdout:Adding system user ceph....done 2024-04-26T11:42:54.670 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:42:54.670 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:42:54.780 INFO:teuthology.orchestra.run.smithi029.stdout:Setting system user ceph properties....done 2024-04-26T11:42:54.789 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T11:42:54.802 INFO:teuthology.orchestra.run.smithi029.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T11:42:54.809 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-26T11:42:54.920 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-26T11:42:54.954 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T11:42:55.112 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:55.119 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-26T11:42:55.263 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:55.284 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T11:42:55.374 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T11:42:55.391 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-26T11:42:55.422 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T11:42:55.431 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:55.432 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T11:42:55.550 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T11:42:55.656 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:42:55.656 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:42:55.677 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T11:42:55.685 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T11:42:55.704 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:42:55.744 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:55.744 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:42:55.870 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:55.962 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T11:42:56.005 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T11:42:56.022 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T11:42:56.063 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:42:56.091 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:56.234 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:56.358 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T11:42:56.359 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:42:56.359 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:42:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:56.533 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:42:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:56.753 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T11:42:56.944 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T11:42:56.947 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T11:42:56.993 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:57.070 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T11:42:57.107 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-26T11:42:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-26T11:42:57.229 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:42:57.266 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:57.364 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:42:57.386 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T11:42:57.450 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T11:42:57.490 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:42:57.587 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:42:57.616 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:42:57.722 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-26T11:42:57.776 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T11:42:57.846 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:58.058 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T11:42:58.102 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:42:58.103 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:42:58.186 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-26T11:42:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-26T11:42:58.543 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:58.591 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T11:42:58.766 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:42:58.766 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:42:58.901 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:42:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T11:42:59.156 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T11:42:59.212 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:42:59.278 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T11:42:59.476 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T11:42:59.708 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:42:59.709 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:42:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:42:59.742 DEBUG:teuthology.parallel:result is None 2024-04-26T11:42:59.762 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-26T11:43:00.048 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T11:43:00.165 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:00.175 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:43:00.277 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:00.395 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-26T11:43:00.421 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:00.461 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-26T11:43:00.654 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:43:00.654 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:43:00.753 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T11:43:01.002 INFO:teuthology.orchestra.run.smithi122.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:43:01.006 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T11:43:01.046 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T11:43:01.083 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-26T11:43:01.098 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:01.234 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:01.295 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-04-26T11:43:01.296 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-04-26T11:43:01.337 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:01.448 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-26T11:43:01.481 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:01.499 INFO:teuthology.orchestra.run.smithi122.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-26T11:43:01.499 INFO:teuthology.orchestra.run.smithi122.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-26T11:43:01.499 INFO:teuthology.orchestra.run.smithi122.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-26T11:43:01.499 INFO:teuthology.orchestra.run.smithi122.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-26T11:43:01.499 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:43:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T11:43:01.500 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:43:01.500 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-04-26T11:43:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: libssl-doc 2024-04-26T11:43:01.540 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-04-26T11:43:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-dev libelf-dev libssl-dev 2024-04-26T11:43:01.542 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages will be upgraded: 2024-04-26T11:43:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-26T11:43:01.703 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-26T11:43:01.732 INFO:teuthology.orchestra.run.smithi122.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-26T11:43:01.732 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 3,303 kB of archives. 2024-04-26T11:43:01.732 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-26T11:43:01.732 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-26T11:43:01.830 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T11:43:01.945 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-26T11:43:01.979 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T11:43:01.979 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-26T11:43:02.207 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-26T11:43:02.222 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-26T11:43:02.241 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-26T11:43:02.301 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-26T11:43:02.439 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-26T11:43:02.539 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-26T11:43:02.540 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-26T11:43:02.578 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T11:43:02.594 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T11:43:02.705 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T11:43:02.836 INFO:teuthology.orchestra.run.smithi122.stdout:Preconfiguring packages ... 2024-04-26T11:43:02.840 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-26T11:43:02.983 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 3,303 kB in 1s (3,396 kB/s) 2024-04-26T11:43:03.167 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T11:43:03.172 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T11:43:03.177 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T11:43:03.332 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T11:43:03.447 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-26T11:43:03.840 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T11:43:04.022 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T11:43:04.365 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T11:43:04.850 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T11:43:04.855 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:43:04.921 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:43:05.058 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-26T11:43:05.380 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T11:43:05.435 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-26T11:43:05.535 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-26T11:43:05.746 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-26T11:43:05.927 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:43:06.053 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T11:43:06.099 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T11:43:06.135 INFO:teuthology.orchestra.run.smithi029.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:43:06.137 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T11:43:06.212 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T11:43:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-26T11:43:06.432 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-04-26T11:43:06.432 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-04-26T11:43:06.562 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T11:43:06.658 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T11:43:06.658 INFO:teuthology.orchestra.run.smithi029.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-26T11:43:06.658 INFO:teuthology.orchestra.run.smithi029.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-26T11:43:06.658 INFO:teuthology.orchestra.run.smithi029.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-26T11:43:06.658 INFO:teuthology.orchestra.run.smithi029.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-26T11:43:06.658 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:43:06.659 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T11:43:06.659 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:43:06.661 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2024-04-26T11:43:06.661 INFO:teuthology.orchestra.run.smithi029.stdout: libssl-doc 2024-04-26T11:43:06.706 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2024-04-26T11:43:06.707 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-dev libelf-dev libssl-dev 2024-04-26T11:43:06.708 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages will be upgraded: 2024-04-26T11:43:06.710 INFO:teuthology.orchestra.run.smithi029.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-26T11:43:06.774 INFO:teuthology.orchestra.run.smithi029.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-26T11:43:06.774 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 3,303 kB of archives. 2024-04-26T11:43:06.774 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-26T11:43:06.774 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-26T11:43:06.825 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-26T11:43:06.833 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-26T11:43:06.834 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-26T11:43:06.886 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-26T11:43:06.891 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-26T11:43:06.896 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-26T11:43:06.948 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-26T11:43:06.948 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-26T11:43:06.949 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-26T11:43:07.272 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T11:43:07.297 INFO:teuthology.orchestra.run.smithi029.stdout:Preconfiguring packages ... 2024-04-26T11:43:07.303 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T11:43:07.321 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-26T11:43:07.428 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T11:43:07.570 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 3,303 kB in 0s (13.0 MB/s) 2024-04-26T11:43:07.624 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T11:43:07.726 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T11:43:07.731 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T11:43:07.748 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T11:43:07.765 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:43:07.806 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:07.864 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T11:43:08.109 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T11:43:08.127 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T11:43:08.200 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:43:08.418 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T11:43:08.587 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T11:43:08.713 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:43:08.729 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T11:43:08.856 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-26T11:43:08.936 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T11:43:08.974 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T11:43:09.022 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T11:43:09.101 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-26T11:43:09.173 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T11:43:09.319 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:43:09.403 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T11:43:09.423 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T11:43:09.427 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:43:09.451 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:09.565 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-26T11:43:09.569 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T11:43:09.601 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:09.727 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:09.867 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T11:43:09.871 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T11:43:10.034 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:43:10.167 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T11:43:10.169 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T11:43:10.506 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T11:43:10.702 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T11:43:10.827 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-26T11:43:10.885 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:11.012 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-26T11:43:11.139 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:11.267 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:11.269 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T11:43:11.286 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-26T11:43:11.369 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T11:43:11.408 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T11:43:11.515 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:11.625 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T11:43:11.643 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-26T11:43:11.644 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:43:11.683 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:11.882 INFO:teuthology.orchestra.run.smithi122.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:43:11.886 DEBUG:teuthology.parallel:result is None 2024-04-26T11:43:11.938 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:11.964 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T11:43:11.983 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T11:43:12.023 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:43:12.065 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-26T11:43:12.386 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:12.513 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:12.576 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:43:12.640 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:43:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:43:13.310 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:13.337 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T11:43:13.438 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:13.515 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T11:43:13.565 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T11:43:13.651 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:43:13.802 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:13.938 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:14.066 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:14.211 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T11:43:14.799 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:14.909 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:15.061 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:15.187 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:15.316 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:15.765 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T11:43:15.841 INFO:teuthology.orchestra.run.smithi072.stdout:Adding group ceph....done 2024-04-26T11:43:16.221 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user ceph....done 2024-04-26T11:43:16.247 INFO:teuthology.orchestra.run.smithi029.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:43:16.251 DEBUG:teuthology.parallel:result is None 2024-04-26T11:43:16.391 INFO:teuthology.orchestra.run.smithi072.stdout:Setting system user ceph properties....done 2024-04-26T11:43:16.415 INFO:teuthology.orchestra.run.smithi072.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T11:43:16.563 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T11:43:16.884 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T11:43:17.346 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:17.473 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:17.960 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:43:17.960 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:43:18.395 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:18.829 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T11:43:19.299 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:19.576 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:43:19.576 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:43:20.027 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:20.261 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:43:20.262 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:43:20.697 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:21.202 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:43:21.202 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:43:21.651 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:21.777 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:21.939 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:22.168 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:43:22.168 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:43:22.600 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:22.744 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:22.870 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:23.016 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T11:43:23.379 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T11:43:23.549 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-26T11:43:23.827 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T11:43:26.684 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-26T11:43:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:43:27.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T11:43:27.370 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T11:43:27.581 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-04-26T11:43:27.582 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-04-26T11:43:27.792 INFO:teuthology.orchestra.run.smithi072.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-26T11:43:27.792 INFO:teuthology.orchestra.run.smithi072.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-26T11:43:27.792 INFO:teuthology.orchestra.run.smithi072.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-26T11:43:27.792 INFO:teuthology.orchestra.run.smithi072.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-26T11:43:27.792 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:43:27.792 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T11:43:27.793 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:43:27.794 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-04-26T11:43:27.794 INFO:teuthology.orchestra.run.smithi072.stdout: libssl-doc 2024-04-26T11:43:27.834 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-04-26T11:43:27.835 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-dev libelf-dev libssl-dev 2024-04-26T11:43:27.836 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages will be upgraded: 2024-04-26T11:43:27.838 INFO:teuthology.orchestra.run.smithi072.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-26T11:43:28.020 INFO:teuthology.orchestra.run.smithi072.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-26T11:43:28.020 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 3,303 kB of archives. 2024-04-26T11:43:28.020 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-26T11:43:28.020 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-26T11:43:28.228 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-26T11:43:28.261 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-26T11:43:28.495 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-26T11:43:28.514 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-26T11:43:28.709 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-26T11:43:28.710 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-26T11:43:28.714 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-26T11:43:29.101 INFO:teuthology.orchestra.run.smithi072.stdout:Preconfiguring packages ... 2024-04-26T11:43:29.248 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 3,303 kB in 1s (3,490 kB/s) 2024-04-26T11:43:29.475 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T11:43:29.480 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T11:43:29.639 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T11:43:30.079 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T11:43:30.252 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T11:43:30.587 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T11:43:31.021 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T11:43:31.026 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:43:31.161 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T11:43:31.656 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:43:31.790 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T11:43:32.275 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T11:43:32.409 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-26T11:43:32.842 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T11:43:32.862 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-26T11:43:32.909 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T11:43:33.205 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T11:43:33.225 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T11:43:33.268 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:33.546 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T11:43:33.563 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T11:43:33.606 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:43:34.111 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:43:34.700 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T11:43:35.256 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T11:43:35.384 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T11:43:35.520 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:35.647 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:35.774 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T11:43:35.902 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T11:43:37.408 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T11:43:37.867 INFO:teuthology.orchestra.run.smithi072.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:43:37.872 DEBUG:teuthology.parallel:result is None 2024-04-26T11:43:37.872 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:43:38.220 DEBUG:teuthology.orchestra.run.smithi029:> dpkg-query -W -f '${Version}' ceph 2024-04-26T11:43:38.243 INFO:teuthology.orchestra.run.smithi029.stdout:18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:43:38.244 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:43:38.244 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1focal is installed. 2024-04-26T11:43:38.246 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:43:38.402 DEBUG:teuthology.orchestra.run.smithi072:> dpkg-query -W -f '${Version}' ceph 2024-04-26T11:43:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:43:38.425 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:43:38.425 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1focal is installed. 2024-04-26T11:43:38.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:43:38.735 DEBUG:teuthology.orchestra.run.smithi082:> dpkg-query -W -f '${Version}' ceph 2024-04-26T11:43:38.758 INFO:teuthology.orchestra.run.smithi082.stdout:18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:43:38.759 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:43:38.759 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1focal is installed. 2024-04-26T11:43:38.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:43:38.898 DEBUG:teuthology.orchestra.run.smithi122:> dpkg-query -W -f '${Version}' ceph 2024-04-26T11:43:38.923 INFO:teuthology.orchestra.run.smithi122.stdout:18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:43:38.923 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T11:43:38.923 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1focal is installed. 2024-04-26T11:43:38.925 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T11:43:38.925 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:38.925 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:43:38.941 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:43:38.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:43:38.958 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:43:38.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:43:38.974 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:43:38.974 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:43:38.990 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T11:43:38.990 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:38.990 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:43:39.005 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:43:39.018 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:43:39.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:43:39.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:43:39.047 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:43:39.047 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:43:39.063 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:43:39.120 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:43:39.120 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:43:39.136 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:43:39.193 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T11:43:39.193 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:39.193 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:43:39.210 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:43:39.226 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:43:39.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:43:39.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:43:39.298 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:43:39.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:43:39.314 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:43:39.372 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:43:39.372 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:43:39.388 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:43:39.445 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T11:43:39.445 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:39.445 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:43:39.461 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:43:39.472 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:43:39.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:43:39.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:43:39.546 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:43:39.547 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:43:39.562 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:43:39.620 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:43:39.620 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:43:39.636 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:43:39.699 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T11:43:39.786 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T11:43:39.787 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2024-04-26T11:43:39.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2024-04-26T11:43:39.791 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2024-04-26T11:43:39.793 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /var/log/ceph 2024-04-26T11:43:39.809 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T11:43:39.809 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:43:39.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:43:39.814 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:43:39.816 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:43:39.829 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T11:43:39.830 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:43:39.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:43:39.869 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:43:39.874 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:43:39.907 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T11:43:39.907 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T11:43:39.907 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_20.04 tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674172', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 1136, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6', 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi122.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T11:43:39.908 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:43:39.910 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:43:39.912 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:43:39.915 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:43:39.922 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:43:39.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:43:39.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:43:39.929 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:43:39.945 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:43:39.945 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:43:39.985 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:43:39.985 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-04-26T11:43:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:43:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:39.992 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 361 Links: 1 2024-04-26T11:43:39.992 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:39.992 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 11:39:10.138430715 +0000 2024-04-26T11:43:39.992 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 11:39:09.906436053 +0000 2024-04-26T11:43:39.992 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 11:39:09.906436053 +0000 2024-04-26T11:43:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T11:43:39.992 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:43:40.007 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T11:43:40.007 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T11:43:40.007 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000364156 s, 1.4 MB/s 2024-04-26T11:43:40.008 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:43:40.016 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-04-26T11:43:40.021 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:43:40.021 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:40.021 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-04-26T11:43:40.021 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:40.021 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 11:39:10.578420592 +0000 2024-04-26T11:43:40.021 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 11:39:10.358425653 +0000 2024-04-26T11:43:40.021 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 11:39:10.358425653 +0000 2024-04-26T11:43:40.022 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T11:43:40.022 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:43:40.077 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T11:43:40.077 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T11:43:40.077 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000417698 s, 1.2 MB/s 2024-04-26T11:43:40.078 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:43:40.087 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-04-26T11:43:40.093 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:43:40.093 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:40.094 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 370 Links: 1 2024-04-26T11:43:40.094 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:40.094 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 11:39:11.006410745 +0000 2024-04-26T11:43:40.094 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 11:39:10.786415806 +0000 2024-04-26T11:43:40.094 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 11:39:10.786415806 +0000 2024-04-26T11:43:40.094 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T11:43:40.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:43:40.106 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T11:43:40.107 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T11:43:40.107 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000396955 s, 1.3 MB/s 2024-04-26T11:43:40.108 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:43:40.159 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-04-26T11:43:40.165 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:43:40.165 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:40.165 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 380 Links: 1 2024-04-26T11:43:40.165 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:40.165 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 11:39:11.422401175 +0000 2024-04-26T11:43:40.165 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 11:39:11.206406143 +0000 2024-04-26T11:43:40.165 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 11:39:11.206406143 +0000 2024-04-26T11:43:40.166 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T11:43:40.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:43:40.177 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T11:43:40.177 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T11:43:40.177 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000363165 s, 1.4 MB/s 2024-04-26T11:43:40.178 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:43:40.186 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T11:43:40.186 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:43:40.187 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:43:40.193 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:43:40.193 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-04-26T11:43:40.201 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:43:40.201 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:40.201 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 358 Links: 1 2024-04-26T11:43:40.201 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:40.201 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 11:39:05.668320214 +0000 2024-04-26T11:43:40.201 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 11:39:05.664320306 +0000 2024-04-26T11:43:40.201 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 11:39:05.664320306 +0000 2024-04-26T11:43:40.201 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-04-26T11:43:40.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:43:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T11:43:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T11:43:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000430437 s, 1.2 MB/s 2024-04-26T11:43:40.216 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:43:40.265 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-04-26T11:43:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:43:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:40.272 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-04-26T11:43:40.272 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:40.272 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 11:39:06.308305470 +0000 2024-04-26T11:43:40.272 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 11:39:06.088310538 +0000 2024-04-26T11:43:40.273 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 11:39:06.088310538 +0000 2024-04-26T11:43:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-04-26T11:43:40.273 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:43:40.284 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T11:43:40.285 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T11:43:40.285 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000429054 s, 1.2 MB/s 2024-04-26T11:43:40.286 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:43:40.295 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-04-26T11:43:40.344 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:43:40.344 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:40.344 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-04-26T11:43:40.344 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:40.344 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 11:39:06.752295240 +0000 2024-04-26T11:43:40.344 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 11:39:06.532300308 +0000 2024-04-26T11:43:40.344 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 11:39:06.532300308 +0000 2024-04-26T11:43:40.345 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-04-26T11:43:40.345 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:43:40.360 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T11:43:40.360 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T11:43:40.360 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000405667 s, 1.3 MB/s 2024-04-26T11:43:40.361 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:43:40.368 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-04-26T11:43:40.420 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:43:40.420 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:40.420 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 380 Links: 1 2024-04-26T11:43:40.420 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:40.420 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 11:39:07.172285564 +0000 2024-04-26T11:43:40.420 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 11:39:06.968290264 +0000 2024-04-26T11:43:40.420 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 11:39:06.968290264 +0000 2024-04-26T11:43:40.420 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-04-26T11:43:40.420 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:43:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T11:43:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T11:43:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000399951 s, 1.3 MB/s 2024-04-26T11:43:40.433 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:43:40.441 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T11:43:40.441 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:43:40.441 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:43:40.448 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:43:40.448 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-04-26T11:43:40.455 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:43:40.455 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:40.455 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 360 Links: 1 2024-04-26T11:43:40.455 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:40.456 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-26 11:39:08.834904610 +0000 2024-04-26T11:43:40.456 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-26 11:39:08.614909671 +0000 2024-04-26T11:43:40.456 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-26 11:39:08.614909671 +0000 2024-04-26T11:43:40.456 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-26T11:43:40.456 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:43:40.469 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-26T11:43:40.469 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-26T11:43:40.469 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000430141 s, 1.2 MB/s 2024-04-26T11:43:40.470 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:43:40.479 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-04-26T11:43:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:43:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:40.529 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-04-26T11:43:40.529 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:40.529 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-26 11:39:09.258894856 +0000 2024-04-26T11:43:40.530 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-26 11:39:09.042899824 +0000 2024-04-26T11:43:40.530 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-26 11:39:09.042899824 +0000 2024-04-26T11:43:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-26T11:43:40.531 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:43:40.542 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-26T11:43:40.543 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-26T11:43:40.543 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000397525 s, 1.3 MB/s 2024-04-26T11:43:40.544 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:43:40.551 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-04-26T11:43:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:43:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:40.600 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 374 Links: 1 2024-04-26T11:43:40.600 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:40.600 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-26 11:39:09.710884456 +0000 2024-04-26T11:43:40.600 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-26 11:39:09.478889795 +0000 2024-04-26T11:43:40.600 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-26 11:39:09.478889795 +0000 2024-04-26T11:43:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-26T11:43:40.601 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:43:40.615 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-26T11:43:40.616 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-26T11:43:40.616 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000415685 s, 1.2 MB/s 2024-04-26T11:43:40.616 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:43:40.623 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-04-26T11:43:40.672 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:43:40.672 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:43:40.672 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-04-26T11:43:40.672 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:43:40.672 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-26 11:39:10.142874517 +0000 2024-04-26T11:43:40.672 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-26 11:39:09.938879210 +0000 2024-04-26T11:43:40.672 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-26 11:39:09.938879210 +0000 2024-04-26T11:43:40.672 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-26T11:43:40.673 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:43:40.684 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-26T11:43:40.684 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-26T11:43:40.684 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000360142 s, 1.4 MB/s 2024-04-26T11:43:40.686 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:43:40.694 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T11:43:40.694 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T11:43:40.695 INFO:tasks.ceph:Generating config... 2024-04-26T11:43:40.696 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T11:43:40.696 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T11:43:40.696 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T11:43:40.696 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T11:43:40.696 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T11:43:40.696 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T11:43:40.696 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T11:43:40.696 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-04-26T11:43:40.696 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T11:43:40.697 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T11:43:40.698 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T11:43:40.698 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T11:43:40.740 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T11:43:40.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T11:43:40.801 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:43:40.816 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.b', '[v2:172.21.15.29:3301,v1:172.21.15.29:6790]'), ('mon.c', '[v2:172.21.15.29:3302,v1:172.21.15.29:6791]')] 2024-04-26T11:43:40.816 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-26T11:43:40.817 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:40.817 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T11:43:40.863 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --addv b '[v2:172.21.15.29:3301,v1:172.21.15.29:6790]' --addv c '[v2:172.21.15.29:3302,v1:172.21.15.29:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:43:40.909 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:43:40.909 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid 6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7 2024-04-26T11:43:40.909 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = pacific 2024-04-26T11:43:40.909 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2024-04-26T11:43:40.909 INFO:teuthology.orchestra.run.smithi029.stdout:fsid 6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7 2024-04-26T11:43:40.909 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2024-04-26T11:43:40.909126+0000 2024-04-26T11:43:40.909 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-04-26T11:43:40.909126+0000 2024-04-26T11:43:40.909 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 16 (pacific) 2024-04-26T11:43:40.909 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2024-04-26T11:43:40.910 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-26T11:43:40.910 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.b 2024-04-26T11:43:40.910 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.29:3302/0,v1:172.21.15.29:6791/0] mon.c 2024-04-26T11:43:40.910 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T11:43:40.911 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T11:43:40.916 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7... 2024-04-26T11:43:40.917 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:43:40.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:43:40.922 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:43:40.924 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:43:40.954 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-04-26T11:43:40.954 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2024-04-26T11:43:40.954 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:43:40.954 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2024-04-26T11:43:40.954 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.954 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2024-04-26T11:43:40.954 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.954 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.955 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.956 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]" 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2024-04-26T11:43:40.957 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.958 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = stupid 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2024-04-26T11:43:40.959 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: osd max markdown count = 1000 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2024-04-26T11:43:40.960 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2024-04-26T11:43:40.961 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:43:40.962 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:43:40.963 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2024-04-26T11:43:40.963 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2024-04-26T11:43:40.963 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2024-04-26T11:43:40.963 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2024-04-26T11:43:40.963 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:43:40.963 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:43:40.963 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2024-04-26T11:43:40.963 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2024-04-26T11:43:40.963 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2024-04-26T11:43:40.963 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-04-26T11:43:40.964 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2024-04-26T11:43:40.964 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2024-04-26T11:43:40.964 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:43:40.964 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.965 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:43:40.966 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]" 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = 6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2024-04-26T11:43:40.967 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2024-04-26T11:43:40.968 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: bdev async discard = True 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: bdev enable discard = True 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore allocator = stupid 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2024-04-26T11:43:40.969 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 1/20 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 1/20 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 4/10 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: osd max markdown count = 1000 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.970 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2024-04-26T11:43:40.971 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.972 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.b] 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.c] 2024-04-26T11:43:40.973 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:43:40.975 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-04-26T11:43:40.976 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]" 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-04-26T11:43:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.978 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: bdev async discard = True 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: bdev enable discard = True 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore allocator = stupid 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 1/20 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 1/20 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 4/10 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:43:40.979 INFO:teuthology.orchestra.run.smithi082.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: osd max markdown count = 1000 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-04-26T11:43:40.980 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:43:40.981 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-04-26T11:43:40.982 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2024-04-26T11:43:40.983 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2024-04-26T11:43:40.983 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-04-26T11:43:40.983 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2024-04-26T11:43:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2024-04-26T11:43:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:43:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2024-04-26T11:43:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2024-04-26T11:43:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]" 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: bdev async discard = True 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: bdev enable discard = True 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore allocator = stupid 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2024-04-26T11:43:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 1/20 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 1/20 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 4/10 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: osd max markdown count = 1000 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2024-04-26T11:43:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2024-04-26T11:43:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2024-04-26T11:43:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2024-04-26T11:43:40.992 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-04-26T11:43:40.995 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T11:43:40.995 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T11:43:41.093 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T11:43:41.094 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:41.094 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T11:43:41.101 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:41.101 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T11:43:41.108 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T11:43:41.108 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:41.108 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:43:41.109 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:43:41.179 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:41.179 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:43:41.187 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:43:41.187 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:43:41.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:43:41.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:43:41.213 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:43:41.214 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:43:41.261 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:43:41.262 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:43:41.262 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:43:41.262 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:43:41.290 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:43:41.290 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:43:41.340 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi122.front.sepia.ceph.com 2024-04-26T11:43:41.340 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:43:41.340 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:43:41.340 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:43:41.366 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:43:41.366 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:43:41.373 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T11:43:41.373 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T11:43:41.373 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T11:43:41.427 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T11:43:41.430 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T11:43:41.474 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T11:43:41.477 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T11:43:41.478 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T11:43:41.522 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T11:43:41.525 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T11:43:41.543 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T11:43:41.543 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T11:43:41.583 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T11:43:41.596 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T11:43:41.597 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T11:43:41.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T11:43:41.613 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T11:43:41.613 INFO:tasks.ceph:role: osd.0 2024-04-26T11:43:41.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:43:41.613 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T11:43:42.143 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T11:43:42.143 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T11:43:42.143 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T11:43:42.143 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 2024-04-26T11:43:42.143 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T11:43:42.143 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-26T11:43:42.143 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T11:43:42.143 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T11:43:42.143 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T11:43:42.143 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T11:43:42.145 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-26T11:43:42.145 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T11:43:42.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T11:43:42.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:43:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T11:43:42.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:43:42.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:43:42.352+0000 7f597115d880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T11:43:42.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:43:42.356+0000 7f597115d880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T11:43:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:43:42.356+0000 7f597115d880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T11:43:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:43:42.356+0000 7f597115d880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T11:43:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:43:42.356+0000 7f597115d880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T11:43:42.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:43:42.364+0000 7f597115d880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T11:43:45.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T11:43:45.371 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T11:43:45.388 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T11:43:45.388 INFO:tasks.ceph:role: osd.1 2024-04-26T11:43:45.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:43:45.388 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T11:43:45.935 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T11:43:45.935 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T11:43:45.935 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T11:43:45.935 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2024-04-26T11:43:45.935 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T11:43:45.935 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-04-26T11:43:45.936 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T11:43:45.936 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T11:43:45.936 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T11:43:45.936 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T11:43:45.937 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-04-26T11:43:45.938 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T11:43:46.031 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T11:43:46.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:43:46.045 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T11:43:46.046 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:43:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:43:46.109+0000 7f6df8009880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T11:43:46.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:43:46.109+0000 7f6df8009880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T11:43:46.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:43:46.109+0000 7f6df8009880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T11:43:46.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:43:46.109+0000 7f6df8009880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T11:43:46.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:43:46.109+0000 7f6df8009880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T11:43:46.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:43:46.117+0000 7f6df8009880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T11:43:49.177 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T11:43:49.193 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T11:43:49.210 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T11:43:49.210 INFO:tasks.ceph:role: osd.2 2024-04-26T11:43:49.210 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-26T11:43:49.211 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T11:43:49.776 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T11:43:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T11:43:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T11:43:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 2024-04-26T11:43:49.776 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T11:43:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-04-26T11:43:49.776 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T11:43:49.776 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T11:43:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T11:43:49.777 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T11:43:49.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-04-26T11:43:49.778 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T11:43:49.868 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T11:43:49.880 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T11:43:49.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:43:49.881 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:43:49.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:43:49.965+0000 7f714231e880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T11:43:49.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:43:49.969+0000 7f714231e880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T11:43:49.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:43:49.969+0000 7f714231e880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T11:43:49.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:43:49.969+0000 7f714231e880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T11:43:49.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:43:49.969+0000 7f714231e880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T11:43:49.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:43:49.969+0000 7f714231e880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T11:43:53.005 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T11:43:53.018 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T11:43:53.018 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:53.018 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T11:43:53.035 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:53.036 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T11:43:53.048 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:53.048 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T11:43:53.105 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:43:53.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T11:43:53.122 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:43:53.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T11:43:53.141 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:43:53.141 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T11:43:53.159 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:43:53.159 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T11:43:53.166 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T11:43:53.166 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T11:43:53.186 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2024-04-26T11:43:53.186 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBtkytmgyaAGRAAfFQsnjimgb10bVKM2oeyFA== 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBtkytmyTNRHBAAaBtFSDqIlcwaazi0VgyD5g== 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBtkytmLGIgHxAATUa24Xstaq36PnmELmz+2Q== 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBukytm40tlFRAAci4aCklGRfZqqy8OZIMDRQ== 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBykytm07bbBhAAaapI8Nc2Az/9/pcfv+KKZA== 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQB1kytm/hrVORAAgexSXItXzZG+ydVP0O6qSw== 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-04-26T11:43:53.187 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBtkytmaQ7OIhAAC4OgeuyqUaHHiizwbFzLjw== 2024-04-26T11:43:53.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T11:43:53.239 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T11:43:53.285 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T11:43:53.334 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T11:43:53.382 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T11:43:53.431 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T11:43:53.479 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T11:43:53.529 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T11:43:53.529 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T11:43:53.541 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T11:43:53.667 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T11:43:53.683 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T11:43:53.698 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T11:43:53.795 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T11:43:53.810 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T11:43:53.826 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T11:43:53.911 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T11:43:53.926 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:43:53.932 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T11:43:53.933 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T11:43:53.933 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T11:43:53.979 INFO:tasks.ceph.mon.a:Started 2024-04-26T11:43:53.979 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T11:43:53.980 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T11:43:53.982 INFO:tasks.ceph.mon.b:Started 2024-04-26T11:43:53.982 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T11:43:53.982 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T11:43:53.984 INFO:tasks.ceph.mon.c:Started 2024-04-26T11:43:53.985 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T11:43:53.985 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T11:43:53.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T11:43:53.987 INFO:tasks.ceph.mgr.x:Started 2024-04-26T11:43:53.987 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T11:43:53.988 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T11:43:53.990 INFO:tasks.ceph.mgr.y:Started 2024-04-26T11:43:53.990 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T11:43:53.990 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T11:44:00.225 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-04-26T11:44:00.237 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T11:44:00.237 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T11:44:00.237 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:44:00.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T11:44:00.254 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:44:00.254 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T11:44:00.270 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:44:00.270 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T11:44:00.287 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 0a044aa1-7704-498d-af77-565f6fdb2bdc 0 2024-04-26T11:44:00.363 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:00.360+0000 7f79062552c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:44:00.365 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:00.360+0000 7fcb680e52c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:44:00.542 INFO:teuthology.orchestra.run.smithi122.stdout:0 2024-04-26T11:44:00.555 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 6aad0623-0085-42f2-873e-766474c95e27 1 2024-04-26T11:44:00.762 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-04-26T11:44:00.779 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 1367cc49-5228-4e11-96fc-ffb092dc8397 2 2024-04-26T11:44:00.985 INFO:teuthology.orchestra.run.smithi122.stdout:2 2024-04-26T11:44:00.999 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T11:44:00.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T11:44:01.001 INFO:tasks.ceph.osd.0:Started 2024-04-26T11:44:01.001 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T11:44:01.002 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T11:44:01.004 INFO:tasks.ceph.osd.1:Started 2024-04-26T11:44:01.004 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T11:44:01.004 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T11:44:01.006 INFO:tasks.ceph.osd.2:Started 2024-04-26T11:44:01.007 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:01.042 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:01.040+0000 7f79062552c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:44:01.042 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:01.040+0000 7fcb680e52c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:44:01.104 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:01.100+0000 7fcb680e52c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:44:01.106 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:01.104+0000 7f79062552c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:44:01.199 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:01.199 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:00.980949+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:01.211 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T11:44:01.212 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T11:44:01.281 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:01.276+0000 7fcb680e52c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:44:01.283 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:01.280+0000 7f79062552c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:44:01.507 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:01.504+0000 7fcb680e52c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:44:01.507 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:01.504+0000 7f79062552c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:44:01.514 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:01.564 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:01.560+0000 7f79062552c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:44:01.564 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:01.560+0000 7fcb680e52c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:44:01.615 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:01.613+0000 7fde86d57880 -1 Falling back to public interface 2024-04-26T11:44:01.619 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:01.613+0000 7fdc6e5b0880 -1 Falling back to public interface 2024-04-26T11:44:01.621 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:01.620+0000 7fa0fa363880 -1 Falling back to public interface 2024-04-26T11:44:01.690 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-26T11:44:01.690 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":5,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:00.980949+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:01.706 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T11:44:01.756 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:01.752+0000 7fcb680e52c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:44:01.756 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:01.752+0000 7f79062552c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:44:01.824 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:01.820+0000 7fcb680e52c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:44:01.824 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:01.820+0000 7f79062552c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:44:01.891 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:01.888+0000 7fcb680e52c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:44:01.891 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:01.888+0000 7f79062552c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:44:02.380 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:02.376+0000 7fcb680e52c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:44:02.381 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:02.376+0000 7f79062552c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:44:02.506 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:02.504+0000 7fcb680e52c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:44:02.506 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:02.504+0000 7f79062552c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:44:02.852 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:02.848+0000 7f79062552c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:44:02.855 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:02.852+0000 7fcb680e52c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:44:03.049 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:03.044+0000 7f79062552c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:44:03.051 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:03.048+0000 7fcb680e52c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:44:03.121 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:03.120+0000 7f79062552c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:44:03.122 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:03.120+0000 7fcb680e52c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:44:03.291 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:03.288+0000 7f79062552c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:44:03.292 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:03.288+0000 7fcb680e52c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:44:04.356 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:04.352+0000 7f79062552c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:44:04.356 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:04.352+0000 7fcb680e52c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:44:04.431 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:04.428+0000 7fcb680e52c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:44:04.431 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:04.428+0000 7f79062552c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:44:04.632 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:04.628+0000 7f79062552c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:44:04.633 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:04.628+0000 7fcb680e52c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:44:04.704 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:04.700+0000 7f79062552c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:44:04.705 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:04.700+0000 7fcb680e52c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:44:04.783 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:04.780+0000 7f79062552c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:44:04.783 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:04.780+0000 7fcb680e52c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:44:05.121 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:05.116+0000 7f79062552c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:44:05.121 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:05.116+0000 7fcb680e52c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:44:05.201 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:05.196+0000 7fcb680e52c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:44:05.202 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:05.200+0000 7f79062552c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:44:05.301 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:05.297+0000 7fdc6e5b0880 -1 osd.1 0 log_to_monitors true 2024-04-26T11:44:05.307 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:05.307+0000 7fa0fa363880 -1 osd.0 0 log_to_monitors true 2024-04-26T11:44:05.323 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:05.321+0000 7fde86d57880 -1 osd.2 0 log_to_monitors true 2024-04-26T11:44:05.941 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:44:05.936+0000 7f79062552c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:44:05.941 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:05.936+0000 7fcb680e52c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:44:06.971 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:06.968+0000 7fcb4ec5b700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T11:44:06.972 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:44:06.968+0000 7fcb4ec5b700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T11:44:07.880 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:07.873+0000 7fdc69bcc700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T11:44:07.887 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:07.881+0000 7fdc61ea1700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:44:08.010 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:08.071 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:08.071+0000 7fa0f732a700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T11:44:08.076 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:08.073+0000 7fde83d1e700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T11:44:08.081 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:08.079+0000 7fa0edc54700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:44:08.091 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:08.089+0000 7fde7a648700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:44:08.308 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-26T11:44:08.308 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":7,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:06.365454+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:08.326 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T11:44:14.630 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:14.940 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-26T11:44:14.940 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":12,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:12.997785+0000","last_up_change":"2024-04-26T11:44:08.882935+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:14.952 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-26T11:44:14.952 INFO:tasks.ceph:Creating RBD pool 2024-04-26T11:44:14.953 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T11:44:16.023 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'rbd' created 2024-04-26T11:44:16.036 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T11:44:17.033 INFO:teuthology.orchestra.run.smithi029.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T11:44:17.046 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T11:44:17.046 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T11:44:17.046 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T11:44:17.049 INFO:tasks.ceph.mds.a:Started 2024-04-26T11:44:17.049 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T11:44:17.049 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:17.130 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-04-26T11:44:17.339 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:17.339 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":14,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:17.013392+0000","last_up_change":"2024-04-26T11:44:08.882935+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:17.354 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:44:10.024928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:44:15.295362+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:44:17.354 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:44:17.667 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-26T11:44:17.681 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:44:17.981 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2024-04-26T11:44:18.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:44:18.343 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:18.343 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6803/3774122357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3774122357},{"type":"v1","addr":"172.21.15.29:6803","nonce":3774122357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-26T11:44:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 2 2024-04-26T11:44:18.362 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:18.669 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:18.669 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":15,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:18.022181+0000","last_up_change":"2024-04-26T11:44:08.882935+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:18.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:44:10.024928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:44:15.295362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:44:18.690 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:44:19.004 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-26T11:44:19.019 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:44:19.326 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2024-04-26T11:44:19.341 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T11:44:19.642 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:19.642 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-04-26T11:44:19.642 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:44:19.642 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-04-26T11:44:19.642 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-04-26T11:44:19.642 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:44:19.642 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:44:19.642 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 2, 2024-04-26T11:44:19.642 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": "rbd" 2024-04-26T11:44:19.642 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:44:19.643 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-04-26T11:44:19.657 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T11:44:19.657 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T11:44:20.049 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-04-26T11:44:20.061 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T11:44:21.058 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-04-26T11:44:21.070 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T11:44:21.430 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T11:44:21.442 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:21.735 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:21.736 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:21.417664+0000","last_up_change":"2024-04-26T11:44:08.882935+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:21.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:22.056 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:22.056 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:21.417664+0000","last_up_change":"2024-04-26T11:44:08.882935+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:22.073 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T11:44:23.458 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T11:44:23.459 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T11:44:24.460 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T11:44:24.461 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:44:24.798 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:24.798 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:44:21.418355+0000","modified":"2024-04-26T11:44:24.430416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4213":{"gid":4213,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/3774122357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3774122357},{"type":"v1","addr":"172.21.15.29:6803","nonce":3774122357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:44:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:44:24.813 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:25.117 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:25.117 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:22.421187+0000","last_up_change":"2024-04-26T11:44:08.882935+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:25.132 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T11:44:25.133 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:44:25.449 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:44:25.464 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T11:44:23.956685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94892,"kb_used_data":1536,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020628,"statfs":{"total":289910292480,"available":289813123072,"internally_reserved":0,"allocated":1572864,"data_stored":1295232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001331"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":209,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:44:17.031829+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:44:17.031829+0000","last_peered":"2024-04-26T11:44:17.031829+0000","last_clean":"2024-04-26T11:44:17.031829+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:44:17.031829+0000","last_undegraded":"2024-04-26T11:44:17.031829+0000","last_fullsized":"2024-04-26T11:44:17.031829+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.316168+0000","last_change":"2024-04-26T11:44:17.037102+0000","last_active":"2024-04-26T11:44:18.316168+0000","last_peered":"2024-04-26T11:44:18.316168+0000","last_clean":"2024-04-26T11:44:18.316168+0000","last_became_active":"2024-04-26T11:44:17.036242+0000","last_became_peered":"2024-04-26T11:44:17.036242+0000","last_unstale":"2024-04-26T11:44:18.316168+0000","last_undegraded":"2024-04-26T11:44:18.316168+0000","last_fullsized":"2024-04-26T11:44:18.316168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.316189+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:44:18.316189+0000","last_peered":"2024-04-26T11:44:18.316189+0000","last_clean":"2024-04-26T11:44:18.316189+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:44:18.316189+0000","last_undegraded":"2024-04-26T11:44:18.316189+0000","last_fullsized":"2024-04-26T11:44:18.316189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.033364+0000","last_change":"2024-04-26T11:44:17.031172+0000","last_active":"2024-04-26T11:44:18.033364+0000","last_peered":"2024-04-26T11:44:18.033364+0000","last_clean":"2024-04-26T11:44:18.033364+0000","last_became_active":"2024-04-26T11:44:17.030306+0000","last_became_peered":"2024-04-26T11:44:17.030306+0000","last_unstale":"2024-04-26T11:44:18.033364+0000","last_undegraded":"2024-04-26T11:44:18.033364+0000","last_fullsized":"2024-04-26T11:44:18.033364+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:30.564274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.316168+0000","last_change":"2024-04-26T11:44:17.037146+0000","last_active":"2024-04-26T11:44:18.316168+0000","last_peered":"2024-04-26T11:44:18.316168+0000","last_clean":"2024-04-26T11:44:18.316168+0000","last_became_active":"2024-04-26T11:44:17.036196+0000","last_became_peered":"2024-04-26T11:44:17.036196+0000","last_unstale":"2024-04-26T11:44:18.316168+0000","last_undegraded":"2024-04-26T11:44:18.316168+0000","last_fullsized":"2024-04-26T11:44:18.316168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.409299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.033429+0000","last_change":"2024-04-26T11:44:17.031782+0000","last_active":"2024-04-26T11:44:18.033429+0000","last_peered":"2024-04-26T11:44:18.033429+0000","last_clean":"2024-04-26T11:44:18.033429+0000","last_became_active":"2024-04-26T11:44:17.030688+0000","last_became_peered":"2024-04-26T11:44:17.030688+0000","last_unstale":"2024-04-26T11:44:18.033429+0000","last_undegraded":"2024-04-26T11:44:18.033429+0000","last_fullsized":"2024-04-26T11:44:18.033429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.289819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.034929+0000","last_change":"2024-04-26T11:44:17.031146+0000","last_active":"2024-04-26T11:44:18.034929+0000","last_peered":"2024-04-26T11:44:18.034929+0000","last_clean":"2024-04-26T11:44:18.034929+0000","last_became_active":"2024-04-26T11:44:17.030637+0000","last_became_peered":"2024-04-26T11:44:17.030637+0000","last_unstale":"2024-04-26T11:44:18.034929+0000","last_undegraded":"2024-04-26T11:44:18.034929+0000","last_fullsized":"2024-04-26T11:44:18.034929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.033435+0000","last_change":"2024-04-26T11:44:17.031358+0000","last_active":"2024-04-26T11:44:18.033435+0000","last_peered":"2024-04-26T11:44:18.033435+0000","last_clean":"2024-04-26T11:44:18.033435+0000","last_became_active":"2024-04-26T11:44:17.030413+0000","last_became_peered":"2024-04-26T11:44:17.030413+0000","last_unstale":"2024-04-26T11:44:18.033435+0000","last_undegraded":"2024-04-26T11:44:18.033435+0000","last_fullsized":"2024-04-26T11:44:18.033435+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.316204+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:44:18.316204+0000","last_peered":"2024-04-26T11:44:18.316204+0000","last_clean":"2024-04-26T11:44:18.316204+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:44:18.316204+0000","last_undegraded":"2024-04-26T11:44:18.316204+0000","last_fullsized":"2024-04-26T11:44:18.316204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":716800,"data_stored":626068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31248,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340592,"statfs":{"total":96636764160,"available":96604766208,"internally_reserved":0,"allocated":131072,"data_stored":39398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":724992,"data_stored":629766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:44:25.468 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:44:25.789 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:25.792 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:44:25.805 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T11:44:23.956685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94892,"kb_used_data":1536,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020628,"statfs":{"total":289910292480,"available":289813123072,"internally_reserved":0,"allocated":1572864,"data_stored":1295232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001331"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":209,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:44:17.031829+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:44:17.031829+0000","last_peered":"2024-04-26T11:44:17.031829+0000","last_clean":"2024-04-26T11:44:17.031829+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:44:17.031829+0000","last_undegraded":"2024-04-26T11:44:17.031829+0000","last_fullsized":"2024-04-26T11:44:17.031829+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.316168+0000","last_change":"2024-04-26T11:44:17.037102+0000","last_active":"2024-04-26T11:44:18.316168+0000","last_peered":"2024-04-26T11:44:18.316168+0000","last_clean":"2024-04-26T11:44:18.316168+0000","last_became_active":"2024-04-26T11:44:17.036242+0000","last_became_peered":"2024-04-26T11:44:17.036242+0000","last_unstale":"2024-04-26T11:44:18.316168+0000","last_undegraded":"2024-04-26T11:44:18.316168+0000","last_fullsized":"2024-04-26T11:44:18.316168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.316189+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:44:18.316189+0000","last_peered":"2024-04-26T11:44:18.316189+0000","last_clean":"2024-04-26T11:44:18.316189+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:44:18.316189+0000","last_undegraded":"2024-04-26T11:44:18.316189+0000","last_fullsized":"2024-04-26T11:44:18.316189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.033364+0000","last_change":"2024-04-26T11:44:17.031172+0000","last_active":"2024-04-26T11:44:18.033364+0000","last_peered":"2024-04-26T11:44:18.033364+0000","last_clean":"2024-04-26T11:44:18.033364+0000","last_became_active":"2024-04-26T11:44:17.030306+0000","last_became_peered":"2024-04-26T11:44:17.030306+0000","last_unstale":"2024-04-26T11:44:18.033364+0000","last_undegraded":"2024-04-26T11:44:18.033364+0000","last_fullsized":"2024-04-26T11:44:18.033364+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:30.564274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.316168+0000","last_change":"2024-04-26T11:44:17.037146+0000","last_active":"2024-04-26T11:44:18.316168+0000","last_peered":"2024-04-26T11:44:18.316168+0000","last_clean":"2024-04-26T11:44:18.316168+0000","last_became_active":"2024-04-26T11:44:17.036196+0000","last_became_peered":"2024-04-26T11:44:17.036196+0000","last_unstale":"2024-04-26T11:44:18.316168+0000","last_undegraded":"2024-04-26T11:44:18.316168+0000","last_fullsized":"2024-04-26T11:44:18.316168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.409299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.033429+0000","last_change":"2024-04-26T11:44:17.031782+0000","last_active":"2024-04-26T11:44:18.033429+0000","last_peered":"2024-04-26T11:44:18.033429+0000","last_clean":"2024-04-26T11:44:18.033429+0000","last_became_active":"2024-04-26T11:44:17.030688+0000","last_became_peered":"2024-04-26T11:44:17.030688+0000","last_unstale":"2024-04-26T11:44:18.033429+0000","last_undegraded":"2024-04-26T11:44:18.033429+0000","last_fullsized":"2024-04-26T11:44:18.033429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.289819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.034929+0000","last_change":"2024-04-26T11:44:17.031146+0000","last_active":"2024-04-26T11:44:18.034929+0000","last_peered":"2024-04-26T11:44:18.034929+0000","last_clean":"2024-04-26T11:44:18.034929+0000","last_became_active":"2024-04-26T11:44:17.030637+0000","last_became_peered":"2024-04-26T11:44:17.030637+0000","last_unstale":"2024-04-26T11:44:18.034929+0000","last_undegraded":"2024-04-26T11:44:18.034929+0000","last_fullsized":"2024-04-26T11:44:18.034929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.033435+0000","last_change":"2024-04-26T11:44:17.031358+0000","last_active":"2024-04-26T11:44:18.033435+0000","last_peered":"2024-04-26T11:44:18.033435+0000","last_clean":"2024-04-26T11:44:18.033435+0000","last_became_active":"2024-04-26T11:44:17.030413+0000","last_became_peered":"2024-04-26T11:44:17.030413+0000","last_unstale":"2024-04-26T11:44:18.033435+0000","last_undegraded":"2024-04-26T11:44:18.033435+0000","last_fullsized":"2024-04-26T11:44:18.033435+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:44:18.316204+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:44:18.316204+0000","last_peered":"2024-04-26T11:44:18.316204+0000","last_clean":"2024-04-26T11:44:18.316204+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:44:18.316204+0000","last_undegraded":"2024-04-26T11:44:18.316204+0000","last_fullsized":"2024-04-26T11:44:18.316204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:21.039002+0000","last_change":"2024-04-26T11:44:21.039002+0000","last_active":"2024-04-26T11:44:21.039002+0000","last_peered":"2024-04-26T11:44:21.039002+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:21.039002+0000","last_undegraded":"2024-04-26T11:44:21.039002+0000","last_fullsized":"2024-04-26T11:44:21.039002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:44:20.031920+0000","last_change":"2024-04-26T11:44:20.031920+0000","last_active":"2024-04-26T11:44:20.031920+0000","last_peered":"2024-04-26T11:44:20.031920+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:44:20.031920+0000","last_undegraded":"2024-04-26T11:44:20.031920+0000","last_fullsized":"2024-04-26T11:44:20.031920+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":716800,"data_stored":626068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31248,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340592,"statfs":{"total":96636764160,"available":96604766208,"internally_reserved":0,"allocated":131072,"data_stored":39398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":724992,"data_stored":629766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:44:25.811 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:44:26.162 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:26.164 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:44:26.179 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T11:44:25.957240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95052,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020468,"statfs":{"total":289910292480,"available":289812959232,"internally_reserved":0,"allocated":1744896,"data_stored":1358551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.917329"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435811+0000","last_change":"2024-04-26T11:44:21.443178+0000","last_active":"2024-04-26T11:44:22.435811+0000","last_peered":"2024-04-26T11:44:22.435811+0000","last_clean":"2024-04-26T11:44:22.435811+0000","last_became_active":"2024-04-26T11:44:21.442734+0000","last_became_peered":"2024-04-26T11:44:21.442734+0000","last_unstale":"2024-04-26T11:44:22.435811+0000","last_undegraded":"2024-04-26T11:44:22.435811+0000","last_fullsized":"2024-04-26T11:44:22.435811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435342+0000","last_change":"2024-04-26T11:44:21.442473+0000","last_active":"2024-04-26T11:44:22.435342+0000","last_peered":"2024-04-26T11:44:22.435342+0000","last_clean":"2024-04-26T11:44:22.435342+0000","last_became_active":"2024-04-26T11:44:21.441778+0000","last_became_peered":"2024-04-26T11:44:21.441778+0000","last_unstale":"2024-04-26T11:44:22.435342+0000","last_undegraded":"2024-04-26T11:44:22.435342+0000","last_fullsized":"2024-04-26T11:44:22.435342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435827+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:44:22.435827+0000","last_peered":"2024-04-26T11:44:22.435827+0000","last_clean":"2024-04-26T11:44:22.435827+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:44:22.435827+0000","last_undegraded":"2024-04-26T11:44:22.435827+0000","last_fullsized":"2024-04-26T11:44:22.435827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435163+0000","last_change":"2024-04-26T11:44:21.448849+0000","last_active":"2024-04-26T11:44:22.435163+0000","last_peered":"2024-04-26T11:44:22.435163+0000","last_clean":"2024-04-26T11:44:22.435163+0000","last_became_active":"2024-04-26T11:44:21.447398+0000","last_became_peered":"2024-04-26T11:44:21.447398+0000","last_unstale":"2024-04-26T11:44:22.435163+0000","last_undegraded":"2024-04-26T11:44:22.435163+0000","last_fullsized":"2024-04-26T11:44:22.435163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:02.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434980+0000","last_change":"2024-04-26T11:44:21.441647+0000","last_active":"2024-04-26T11:44:22.434980+0000","last_peered":"2024-04-26T11:44:22.434980+0000","last_clean":"2024-04-26T11:44:22.434980+0000","last_became_active":"2024-04-26T11:44:21.441237+0000","last_became_peered":"2024-04-26T11:44:21.441237+0000","last_unstale":"2024-04-26T11:44:22.434980+0000","last_undegraded":"2024-04-26T11:44:22.434980+0000","last_fullsized":"2024-04-26T11:44:22.434980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434482+0000","last_change":"2024-04-26T11:44:21.447786+0000","last_active":"2024-04-26T11:44:22.434482+0000","last_peered":"2024-04-26T11:44:22.434482+0000","last_clean":"2024-04-26T11:44:22.434482+0000","last_became_active":"2024-04-26T11:44:21.447367+0000","last_became_peered":"2024-04-26T11:44:21.447367+0000","last_unstale":"2024-04-26T11:44:22.434482+0000","last_undegraded":"2024-04-26T11:44:22.434482+0000","last_fullsized":"2024-04-26T11:44:22.434482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434713+0000","last_change":"2024-04-26T11:44:21.448136+0000","last_active":"2024-04-26T11:44:22.434713+0000","last_peered":"2024-04-26T11:44:22.434713+0000","last_clean":"2024-04-26T11:44:22.434713+0000","last_became_active":"2024-04-26T11:44:21.447382+0000","last_became_peered":"2024-04-26T11:44:21.447382+0000","last_unstale":"2024-04-26T11:44:22.434713+0000","last_undegraded":"2024-04-26T11:44:22.434713+0000","last_fullsized":"2024-04-26T11:44:22.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433838+0000","last_change":"2024-04-26T11:44:21.448950+0000","last_active":"2024-04-26T11:44:22.433838+0000","last_peered":"2024-04-26T11:44:22.433838+0000","last_clean":"2024-04-26T11:44:22.433838+0000","last_became_active":"2024-04-26T11:44:21.447975+0000","last_became_peered":"2024-04-26T11:44:21.447975+0000","last_unstale":"2024-04-26T11:44:22.433838+0000","last_undegraded":"2024-04-26T11:44:22.433838+0000","last_fullsized":"2024-04-26T11:44:22.433838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:07.109775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818672+0000","last_change":"2024-04-26T11:44:21.446676+0000","last_active":"2024-04-26T11:44:22.818672+0000","last_peered":"2024-04-26T11:44:22.818672+0000","last_clean":"2024-04-26T11:44:22.818672+0000","last_became_active":"2024-04-26T11:44:21.445874+0000","last_became_peered":"2024-04-26T11:44:21.445874+0000","last_unstale":"2024-04-26T11:44:22.818672+0000","last_undegraded":"2024-04-26T11:44:22.818672+0000","last_fullsized":"2024-04-26T11:44:22.818672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435569+0000","last_change":"2024-04-26T11:44:21.441552+0000","last_active":"2024-04-26T11:44:22.435569+0000","last_peered":"2024-04-26T11:44:22.435569+0000","last_clean":"2024-04-26T11:44:22.435569+0000","last_became_active":"2024-04-26T11:44:21.441047+0000","last_became_peered":"2024-04-26T11:44:21.441047+0000","last_unstale":"2024-04-26T11:44:22.435569+0000","last_undegraded":"2024-04-26T11:44:22.435569+0000","last_fullsized":"2024-04-26T11:44:22.435569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435826+0000","last_change":"2024-04-26T11:44:21.448723+0000","last_active":"2024-04-26T11:44:22.435826+0000","last_peered":"2024-04-26T11:44:22.435826+0000","last_clean":"2024-04-26T11:44:22.435826+0000","last_became_active":"2024-04-26T11:44:21.448275+0000","last_became_peered":"2024-04-26T11:44:21.448275+0000","last_unstale":"2024-04-26T11:44:22.435826+0000","last_undegraded":"2024-04-26T11:44:22.435826+0000","last_fullsized":"2024-04-26T11:44:22.435826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435154+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:44:22.435154+0000","last_peered":"2024-04-26T11:44:22.435154+0000","last_clean":"2024-04-26T11:44:22.435154+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:44:22.435154+0000","last_undegraded":"2024-04-26T11:44:22.435154+0000","last_fullsized":"2024-04-26T11:44:22.435154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434453+0000","last_change":"2024-04-26T11:44:21.441784+0000","last_active":"2024-04-26T11:44:22.434453+0000","last_peered":"2024-04-26T11:44:22.434453+0000","last_clean":"2024-04-26T11:44:22.434453+0000","last_became_active":"2024-04-26T11:44:21.441107+0000","last_became_peered":"2024-04-26T11:44:21.441107+0000","last_unstale":"2024-04-26T11:44:22.434453+0000","last_undegraded":"2024-04-26T11:44:22.434453+0000","last_fullsized":"2024-04-26T11:44:22.434453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434509+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:44:22.434509+0000","last_peered":"2024-04-26T11:44:22.434509+0000","last_clean":"2024-04-26T11:44:22.434509+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:44:22.434509+0000","last_undegraded":"2024-04-26T11:44:22.434509+0000","last_fullsized":"2024-04-26T11:44:22.434509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434815+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:44:22.434815+0000","last_peered":"2024-04-26T11:44:22.434815+0000","last_clean":"2024-04-26T11:44:22.434815+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:44:22.434815+0000","last_undegraded":"2024-04-26T11:44:22.434815+0000","last_fullsized":"2024-04-26T11:44:22.434815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433958+0000","last_change":"2024-04-26T11:44:21.449098+0000","last_active":"2024-04-26T11:44:22.433958+0000","last_peered":"2024-04-26T11:44:22.433958+0000","last_clean":"2024-04-26T11:44:22.433958+0000","last_became_active":"2024-04-26T11:44:21.448517+0000","last_became_peered":"2024-04-26T11:44:21.448517+0000","last_unstale":"2024-04-26T11:44:22.433958+0000","last_undegraded":"2024-04-26T11:44:22.433958+0000","last_fullsized":"2024-04-26T11:44:22.433958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819570+0000","last_change":"2024-04-26T11:44:21.439565+0000","last_active":"2024-04-26T11:44:22.819570+0000","last_peered":"2024-04-26T11:44:22.819570+0000","last_clean":"2024-04-26T11:44:22.819570+0000","last_became_active":"2024-04-26T11:44:21.438640+0000","last_became_peered":"2024-04-26T11:44:21.438640+0000","last_unstale":"2024-04-26T11:44:22.819570+0000","last_undegraded":"2024-04-26T11:44:22.819570+0000","last_fullsized":"2024-04-26T11:44:22.819570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435844+0000","last_change":"2024-04-26T11:44:21.437913+0000","last_active":"2024-04-26T11:44:22.435844+0000","last_peered":"2024-04-26T11:44:22.435844+0000","last_clean":"2024-04-26T11:44:22.435844+0000","last_became_active":"2024-04-26T11:44:21.437543+0000","last_became_peered":"2024-04-26T11:44:21.437543+0000","last_unstale":"2024-04-26T11:44:22.435844+0000","last_undegraded":"2024-04-26T11:44:22.435844+0000","last_fullsized":"2024-04-26T11:44:22.435844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818621+0000","last_change":"2024-04-26T11:44:21.440138+0000","last_active":"2024-04-26T11:44:22.818621+0000","last_peered":"2024-04-26T11:44:22.818621+0000","last_clean":"2024-04-26T11:44:22.818621+0000","last_became_active":"2024-04-26T11:44:21.439850+0000","last_became_peered":"2024-04-26T11:44:21.439850+0000","last_unstale":"2024-04-26T11:44:22.818621+0000","last_undegraded":"2024-04-26T11:44:22.818621+0000","last_fullsized":"2024-04-26T11:44:22.818621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435721+0000","last_change":"2024-04-26T11:44:21.449248+0000","last_active":"2024-04-26T11:44:22.435721+0000","last_peered":"2024-04-26T11:44:22.435721+0000","last_clean":"2024-04-26T11:44:22.435721+0000","last_became_active":"2024-04-26T11:44:21.448315+0000","last_became_peered":"2024-04-26T11:44:21.448315+0000","last_unstale":"2024-04-26T11:44:22.435721+0000","last_undegraded":"2024-04-26T11:44:22.435721+0000","last_fullsized":"2024-04-26T11:44:22.435721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436209+0000","last_change":"2024-04-26T11:44:21.448524+0000","last_active":"2024-04-26T11:44:22.436209+0000","last_peered":"2024-04-26T11:44:22.436209+0000","last_clean":"2024-04-26T11:44:22.436209+0000","last_became_active":"2024-04-26T11:44:21.447839+0000","last_became_peered":"2024-04-26T11:44:21.447839+0000","last_unstale":"2024-04-26T11:44:22.436209+0000","last_undegraded":"2024-04-26T11:44:22.436209+0000","last_fullsized":"2024-04-26T11:44:22.436209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434386+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:44:22.434386+0000","last_peered":"2024-04-26T11:44:22.434386+0000","last_clean":"2024-04-26T11:44:22.434386+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:44:22.434386+0000","last_undegraded":"2024-04-26T11:44:22.434386+0000","last_fullsized":"2024-04-26T11:44:22.434386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817486+0000","last_change":"2024-04-26T11:44:21.445626+0000","last_active":"2024-04-26T11:44:22.817486+0000","last_peered":"2024-04-26T11:44:22.817486+0000","last_clean":"2024-04-26T11:44:22.817486+0000","last_became_active":"2024-04-26T11:44:21.444990+0000","last_became_peered":"2024-04-26T11:44:21.444990+0000","last_unstale":"2024-04-26T11:44:22.817486+0000","last_undegraded":"2024-04-26T11:44:22.817486+0000","last_fullsized":"2024-04-26T11:44:22.817486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433782+0000","last_change":"2024-04-26T11:44:21.441463+0000","last_active":"2024-04-26T11:44:22.433782+0000","last_peered":"2024-04-26T11:44:22.433782+0000","last_clean":"2024-04-26T11:44:22.433782+0000","last_became_active":"2024-04-26T11:44:21.440895+0000","last_became_peered":"2024-04-26T11:44:21.440895+0000","last_unstale":"2024-04-26T11:44:22.433782+0000","last_undegraded":"2024-04-26T11:44:22.433782+0000","last_fullsized":"2024-04-26T11:44:22.433782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435906+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:44:22.435906+0000","last_peered":"2024-04-26T11:44:22.435906+0000","last_clean":"2024-04-26T11:44:22.435906+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:44:22.435906+0000","last_undegraded":"2024-04-26T11:44:22.435906+0000","last_fullsized":"2024-04-26T11:44:22.435906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819879+0000","last_change":"2024-04-26T11:44:21.444826+0000","last_active":"2024-04-26T11:44:22.819879+0000","last_peered":"2024-04-26T11:44:22.819879+0000","last_clean":"2024-04-26T11:44:22.819879+0000","last_became_active":"2024-04-26T11:44:21.444440+0000","last_became_peered":"2024-04-26T11:44:21.444440+0000","last_unstale":"2024-04-26T11:44:22.819879+0000","last_undegraded":"2024-04-26T11:44:22.819879+0000","last_fullsized":"2024-04-26T11:44:22.819879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436032+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:44:22.436032+0000","last_peered":"2024-04-26T11:44:22.436032+0000","last_clean":"2024-04-26T11:44:22.436032+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:44:22.436032+0000","last_undegraded":"2024-04-26T11:44:22.436032+0000","last_fullsized":"2024-04-26T11:44:22.436032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435465+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:44:22.435465+0000","last_peered":"2024-04-26T11:44:22.435465+0000","last_clean":"2024-04-26T11:44:22.435465+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:44:22.435465+0000","last_undegraded":"2024-04-26T11:44:22.435465+0000","last_fullsized":"2024-04-26T11:44:22.435465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819067+0000","last_change":"2024-04-26T11:44:21.439511+0000","last_active":"2024-04-26T11:44:22.819067+0000","last_peered":"2024-04-26T11:44:22.819067+0000","last_clean":"2024-04-26T11:44:22.819067+0000","last_became_active":"2024-04-26T11:44:21.438539+0000","last_became_peered":"2024-04-26T11:44:21.438539+0000","last_unstale":"2024-04-26T11:44:22.819067+0000","last_undegraded":"2024-04-26T11:44:22.819067+0000","last_fullsized":"2024-04-26T11:44:22.819067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434754+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:44:22.434754+0000","last_peered":"2024-04-26T11:44:22.434754+0000","last_clean":"2024-04-26T11:44:22.434754+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:44:22.434754+0000","last_undegraded":"2024-04-26T11:44:22.434754+0000","last_fullsized":"2024-04-26T11:44:22.434754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817638+0000","last_change":"2024-04-26T11:44:21.439772+0000","last_active":"2024-04-26T11:44:22.817638+0000","last_peered":"2024-04-26T11:44:22.817638+0000","last_clean":"2024-04-26T11:44:22.817638+0000","last_became_active":"2024-04-26T11:44:21.438770+0000","last_became_peered":"2024-04-26T11:44:21.438770+0000","last_unstale":"2024-04-26T11:44:22.817638+0000","last_undegraded":"2024-04-26T11:44:22.817638+0000","last_fullsized":"2024-04-26T11:44:22.817638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434091+0000","last_change":"2024-04-26T11:44:21.452228+0000","last_active":"2024-04-26T11:44:22.434091+0000","last_peered":"2024-04-26T11:44:22.434091+0000","last_clean":"2024-04-26T11:44:22.434091+0000","last_became_active":"2024-04-26T11:44:21.451258+0000","last_became_peered":"2024-04-26T11:44:21.451258+0000","last_unstale":"2024-04-26T11:44:22.434091+0000","last_undegraded":"2024-04-26T11:44:22.434091+0000","last_fullsized":"2024-04-26T11:44:22.434091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435434+0000","last_change":"2024-04-26T11:44:21.438961+0000","last_active":"2024-04-26T11:44:22.435434+0000","last_peered":"2024-04-26T11:44:22.435434+0000","last_clean":"2024-04-26T11:44:22.435434+0000","last_became_active":"2024-04-26T11:44:21.438124+0000","last_became_peered":"2024-04-26T11:44:21.438124+0000","last_unstale":"2024-04-26T11:44:22.435434+0000","last_undegraded":"2024-04-26T11:44:22.435434+0000","last_fullsized":"2024-04-26T11:44:22.435434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436336+0000","last_change":"2024-04-26T11:44:21.066359+0000","last_active":"2024-04-26T11:44:22.436336+0000","last_peered":"2024-04-26T11:44:22.436336+0000","last_clean":"2024-04-26T11:44:22.436336+0000","last_became_active":"2024-04-26T11:44:21.066007+0000","last_became_peered":"2024-04-26T11:44:21.066007+0000","last_unstale":"2024-04-26T11:44:22.436336+0000","last_undegraded":"2024-04-26T11:44:22.436336+0000","last_fullsized":"2024-04-26T11:44:22.436336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435741+0000","last_change":"2024-04-26T11:44:21.439295+0000","last_active":"2024-04-26T11:44:22.435741+0000","last_peered":"2024-04-26T11:44:22.435741+0000","last_clean":"2024-04-26T11:44:22.435741+0000","last_became_active":"2024-04-26T11:44:21.439097+0000","last_became_peered":"2024-04-26T11:44:21.439097+0000","last_unstale":"2024-04-26T11:44:22.435741+0000","last_undegraded":"2024-04-26T11:44:22.435741+0000","last_fullsized":"2024-04-26T11:44:22.435741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818216+0000","last_change":"2024-04-26T11:44:21.066646+0000","last_active":"2024-04-26T11:44:22.818216+0000","last_peered":"2024-04-26T11:44:22.818216+0000","last_clean":"2024-04-26T11:44:22.818216+0000","last_became_active":"2024-04-26T11:44:21.065981+0000","last_became_peered":"2024-04-26T11:44:21.065981+0000","last_unstale":"2024-04-26T11:44:22.818216+0000","last_undegraded":"2024-04-26T11:44:22.818216+0000","last_fullsized":"2024-04-26T11:44:22.818216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820032+0000","last_change":"2024-04-26T11:44:21.443681+0000","last_active":"2024-04-26T11:44:22.820032+0000","last_peered":"2024-04-26T11:44:22.820032+0000","last_clean":"2024-04-26T11:44:22.820032+0000","last_became_active":"2024-04-26T11:44:21.443253+0000","last_became_peered":"2024-04-26T11:44:21.443253+0000","last_unstale":"2024-04-26T11:44:22.820032+0000","last_undegraded":"2024-04-26T11:44:22.820032+0000","last_fullsized":"2024-04-26T11:44:22.820032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434717+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:44:22.434717+0000","last_peered":"2024-04-26T11:44:22.434717+0000","last_clean":"2024-04-26T11:44:22.434717+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:44:22.434717+0000","last_undegraded":"2024-04-26T11:44:22.434717+0000","last_fullsized":"2024-04-26T11:44:22.434717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818804+0000","last_change":"2024-04-26T11:44:21.445426+0000","last_active":"2024-04-26T11:44:22.818804+0000","last_peered":"2024-04-26T11:44:22.818804+0000","last_clean":"2024-04-26T11:44:22.818804+0000","last_became_active":"2024-04-26T11:44:21.444674+0000","last_became_peered":"2024-04-26T11:44:21.444674+0000","last_unstale":"2024-04-26T11:44:22.818804+0000","last_undegraded":"2024-04-26T11:44:22.818804+0000","last_fullsized":"2024-04-26T11:44:22.818804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434190+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:44:22.434190+0000","last_peered":"2024-04-26T11:44:22.434190+0000","last_clean":"2024-04-26T11:44:22.434190+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:44:22.434190+0000","last_undegraded":"2024-04-26T11:44:22.434190+0000","last_fullsized":"2024-04-26T11:44:22.434190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435770+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:44:22.435770+0000","last_peered":"2024-04-26T11:44:22.435770+0000","last_clean":"2024-04-26T11:44:22.435770+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:44:22.435770+0000","last_undegraded":"2024-04-26T11:44:22.435770+0000","last_fullsized":"2024-04-26T11:44:22.435770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433826+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:44:22.433826+0000","last_peered":"2024-04-26T11:44:22.433826+0000","last_clean":"2024-04-26T11:44:22.433826+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:44:22.433826+0000","last_undegraded":"2024-04-26T11:44:22.433826+0000","last_fullsized":"2024-04-26T11:44:22.433826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436104+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:44:22.436104+0000","last_peered":"2024-04-26T11:44:22.436104+0000","last_clean":"2024-04-26T11:44:22.436104+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:44:22.436104+0000","last_undegraded":"2024-04-26T11:44:22.436104+0000","last_fullsized":"2024-04-26T11:44:22.436104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433901+0000","last_change":"2024-04-26T11:44:21.442188+0000","last_active":"2024-04-26T11:44:22.433901+0000","last_peered":"2024-04-26T11:44:22.433901+0000","last_clean":"2024-04-26T11:44:22.433901+0000","last_became_active":"2024-04-26T11:44:21.441105+0000","last_became_peered":"2024-04-26T11:44:21.441105+0000","last_unstale":"2024-04-26T11:44:22.433901+0000","last_undegraded":"2024-04-26T11:44:22.433901+0000","last_fullsized":"2024-04-26T11:44:22.433901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436283+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:44:22.436283+0000","last_peered":"2024-04-26T11:44:22.436283+0000","last_clean":"2024-04-26T11:44:22.436283+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:44:22.436283+0000","last_undegraded":"2024-04-26T11:44:22.436283+0000","last_fullsized":"2024-04-26T11:44:22.436283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435798+0000","last_change":"2024-04-26T11:44:21.449433+0000","last_active":"2024-04-26T11:44:22.435798+0000","last_peered":"2024-04-26T11:44:22.435798+0000","last_clean":"2024-04-26T11:44:22.435798+0000","last_became_active":"2024-04-26T11:44:21.447831+0000","last_became_peered":"2024-04-26T11:44:21.447831+0000","last_unstale":"2024-04-26T11:44:22.435798+0000","last_undegraded":"2024-04-26T11:44:22.435798+0000","last_fullsized":"2024-04-26T11:44:22.435798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435987+0000","last_change":"2024-04-26T11:44:21.065647+0000","last_active":"2024-04-26T11:44:22.435987+0000","last_peered":"2024-04-26T11:44:22.435987+0000","last_clean":"2024-04-26T11:44:22.435987+0000","last_became_active":"2024-04-26T11:44:21.065197+0000","last_became_peered":"2024-04-26T11:44:21.065197+0000","last_unstale":"2024-04-26T11:44:22.435987+0000","last_undegraded":"2024-04-26T11:44:22.435987+0000","last_fullsized":"2024-04-26T11:44:22.435987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818851+0000","last_change":"2024-04-26T11:44:21.443848+0000","last_active":"2024-04-26T11:44:22.818851+0000","last_peered":"2024-04-26T11:44:22.818851+0000","last_clean":"2024-04-26T11:44:22.818851+0000","last_became_active":"2024-04-26T11:44:21.443580+0000","last_became_peered":"2024-04-26T11:44:21.443580+0000","last_unstale":"2024-04-26T11:44:22.818851+0000","last_undegraded":"2024-04-26T11:44:22.818851+0000","last_fullsized":"2024-04-26T11:44:22.818851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819315+0000","last_change":"2024-04-26T11:44:21.068336+0000","last_active":"2024-04-26T11:44:22.819315+0000","last_peered":"2024-04-26T11:44:22.819315+0000","last_clean":"2024-04-26T11:44:22.819315+0000","last_became_active":"2024-04-26T11:44:21.067530+0000","last_became_peered":"2024-04-26T11:44:21.067530+0000","last_unstale":"2024-04-26T11:44:22.819315+0000","last_undegraded":"2024-04-26T11:44:22.819315+0000","last_fullsized":"2024-04-26T11:44:22.819315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435445+0000","last_change":"2024-04-26T11:44:21.449238+0000","last_active":"2024-04-26T11:44:22.435445+0000","last_peered":"2024-04-26T11:44:22.435445+0000","last_clean":"2024-04-26T11:44:22.435445+0000","last_became_active":"2024-04-26T11:44:21.447694+0000","last_became_peered":"2024-04-26T11:44:21.447694+0000","last_unstale":"2024-04-26T11:44:22.435445+0000","last_undegraded":"2024-04-26T11:44:22.435445+0000","last_fullsized":"2024-04-26T11:44:22.435445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435196+0000","last_change":"2024-04-26T11:44:21.066212+0000","last_active":"2024-04-26T11:44:22.435196+0000","last_peered":"2024-04-26T11:44:22.435196+0000","last_clean":"2024-04-26T11:44:22.435196+0000","last_became_active":"2024-04-26T11:44:21.065186+0000","last_became_peered":"2024-04-26T11:44:21.065186+0000","last_unstale":"2024-04-26T11:44:22.435196+0000","last_undegraded":"2024-04-26T11:44:22.435196+0000","last_fullsized":"2024-04-26T11:44:22.435196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436154+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:44:22.436154+0000","last_peered":"2024-04-26T11:44:22.436154+0000","last_clean":"2024-04-26T11:44:22.436154+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:44:22.436154+0000","last_undegraded":"2024-04-26T11:44:22.436154+0000","last_fullsized":"2024-04-26T11:44:22.436154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434230+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:44:22.434230+0000","last_peered":"2024-04-26T11:44:22.434230+0000","last_clean":"2024-04-26T11:44:22.434230+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:44:22.434230+0000","last_undegraded":"2024-04-26T11:44:22.434230+0000","last_fullsized":"2024-04-26T11:44:22.434230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435383+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:44:22.435383+0000","last_peered":"2024-04-26T11:44:22.435383+0000","last_clean":"2024-04-26T11:44:22.435383+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:44:22.435383+0000","last_undegraded":"2024-04-26T11:44:22.435383+0000","last_fullsized":"2024-04-26T11:44:22.435383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434021+0000","last_change":"2024-04-26T11:44:21.065486+0000","last_active":"2024-04-26T11:44:22.434021+0000","last_peered":"2024-04-26T11:44:22.434021+0000","last_clean":"2024-04-26T11:44:22.434021+0000","last_became_active":"2024-04-26T11:44:21.065090+0000","last_became_peered":"2024-04-26T11:44:21.065090+0000","last_unstale":"2024-04-26T11:44:22.434021+0000","last_undegraded":"2024-04-26T11:44:22.434021+0000","last_fullsized":"2024-04-26T11:44:22.434021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:03.456923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818894+0000","last_change":"2024-04-26T11:44:21.446431+0000","last_active":"2024-04-26T11:44:22.818894+0000","last_peered":"2024-04-26T11:44:22.818894+0000","last_clean":"2024-04-26T11:44:22.818894+0000","last_became_active":"2024-04-26T11:44:21.445866+0000","last_became_peered":"2024-04-26T11:44:21.445866+0000","last_unstale":"2024-04-26T11:44:22.818894+0000","last_undegraded":"2024-04-26T11:44:22.818894+0000","last_fullsized":"2024-04-26T11:44:22.818894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440035+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:44:21.440035+0000","last_peered":"2024-04-26T11:44:21.440035+0000","last_clean":"2024-04-26T11:44:21.440035+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:44:21.440035+0000","last_undegraded":"2024-04-26T11:44:21.440035+0000","last_fullsized":"2024-04-26T11:44:21.440035+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440187+0000","last_change":"2024-04-26T11:44:17.037102+0000","last_active":"2024-04-26T11:44:21.440187+0000","last_peered":"2024-04-26T11:44:21.440187+0000","last_clean":"2024-04-26T11:44:21.440187+0000","last_became_active":"2024-04-26T11:44:17.036242+0000","last_became_peered":"2024-04-26T11:44:17.036242+0000","last_unstale":"2024-04-26T11:44:21.440187+0000","last_undegraded":"2024-04-26T11:44:21.440187+0000","last_fullsized":"2024-04-26T11:44:21.440187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818647+0000","last_change":"2024-04-26T11:44:21.064980+0000","last_active":"2024-04-26T11:44:22.818647+0000","last_peered":"2024-04-26T11:44:22.818647+0000","last_clean":"2024-04-26T11:44:22.818647+0000","last_became_active":"2024-04-26T11:44:21.064569+0000","last_became_peered":"2024-04-26T11:44:21.064569+0000","last_unstale":"2024-04-26T11:44:22.818647+0000","last_undegraded":"2024-04-26T11:44:22.818647+0000","last_fullsized":"2024-04-26T11:44:22.818647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436303+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:44:22.436303+0000","last_peered":"2024-04-26T11:44:22.436303+0000","last_clean":"2024-04-26T11:44:22.436303+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:44:22.436303+0000","last_undegraded":"2024-04-26T11:44:22.436303+0000","last_fullsized":"2024-04-26T11:44:22.436303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439848+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:44:21.439848+0000","last_peered":"2024-04-26T11:44:21.439848+0000","last_clean":"2024-04-26T11:44:21.439848+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:44:21.439848+0000","last_undegraded":"2024-04-26T11:44:21.439848+0000","last_fullsized":"2024-04-26T11:44:21.439848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818702+0000","last_change":"2024-04-26T11:44:21.066838+0000","last_active":"2024-04-26T11:44:22.818702+0000","last_peered":"2024-04-26T11:44:22.818702+0000","last_clean":"2024-04-26T11:44:22.818702+0000","last_became_active":"2024-04-26T11:44:21.065781+0000","last_became_peered":"2024-04-26T11:44:21.065781+0000","last_unstale":"2024-04-26T11:44:22.818702+0000","last_undegraded":"2024-04-26T11:44:22.818702+0000","last_fullsized":"2024-04-26T11:44:22.818702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435884+0000","last_change":"2024-04-26T11:44:21.439222+0000","last_active":"2024-04-26T11:44:22.435884+0000","last_peered":"2024-04-26T11:44:22.435884+0000","last_clean":"2024-04-26T11:44:22.435884+0000","last_became_active":"2024-04-26T11:44:21.438876+0000","last_became_peered":"2024-04-26T11:44:21.438876+0000","last_unstale":"2024-04-26T11:44:22.435884+0000","last_undegraded":"2024-04-26T11:44:22.435884+0000","last_fullsized":"2024-04-26T11:44:22.435884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.435673+0000","last_change":"2024-04-26T11:44:17.031172+0000","last_active":"2024-04-26T11:44:21.435673+0000","last_peered":"2024-04-26T11:44:21.435673+0000","last_clean":"2024-04-26T11:44:21.435673+0000","last_became_active":"2024-04-26T11:44:17.030306+0000","last_became_peered":"2024-04-26T11:44:17.030306+0000","last_unstale":"2024-04-26T11:44:21.435673+0000","last_undegraded":"2024-04-26T11:44:21.435673+0000","last_fullsized":"2024-04-26T11:44:21.435673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:30.564274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434093+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:44:22.434093+0000","last_peered":"2024-04-26T11:44:22.434093+0000","last_clean":"2024-04-26T11:44:22.434093+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:44:22.434093+0000","last_undegraded":"2024-04-26T11:44:22.434093+0000","last_fullsized":"2024-04-26T11:44:22.434093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819030+0000","last_change":"2024-04-26T11:44:21.440135+0000","last_active":"2024-04-26T11:44:22.819030+0000","last_peered":"2024-04-26T11:44:22.819030+0000","last_clean":"2024-04-26T11:44:22.819030+0000","last_became_active":"2024-04-26T11:44:21.439757+0000","last_became_peered":"2024-04-26T11:44:21.439757+0000","last_unstale":"2024-04-26T11:44:22.819030+0000","last_undegraded":"2024-04-26T11:44:22.819030+0000","last_fullsized":"2024-04-26T11:44:22.819030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.437818+0000","last_change":"2024-04-26T11:44:17.037146+0000","last_active":"2024-04-26T11:44:21.437818+0000","last_peered":"2024-04-26T11:44:21.437818+0000","last_clean":"2024-04-26T11:44:21.437818+0000","last_became_active":"2024-04-26T11:44:17.036196+0000","last_became_peered":"2024-04-26T11:44:17.036196+0000","last_unstale":"2024-04-26T11:44:21.437818+0000","last_undegraded":"2024-04-26T11:44:21.437818+0000","last_fullsized":"2024-04-26T11:44:21.437818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.409299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436401+0000","last_change":"2024-04-26T11:44:21.065821+0000","last_active":"2024-04-26T11:44:22.436401+0000","last_peered":"2024-04-26T11:44:22.436401+0000","last_clean":"2024-04-26T11:44:22.436401+0000","last_became_active":"2024-04-26T11:44:21.065300+0000","last_became_peered":"2024-04-26T11:44:21.065300+0000","last_unstale":"2024-04-26T11:44:22.436401+0000","last_undegraded":"2024-04-26T11:44:22.436401+0000","last_fullsized":"2024-04-26T11:44:22.436401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819416+0000","last_change":"2024-04-26T11:44:21.439526+0000","last_active":"2024-04-26T11:44:22.819416+0000","last_peered":"2024-04-26T11:44:22.819416+0000","last_clean":"2024-04-26T11:44:22.819416+0000","last_became_active":"2024-04-26T11:44:21.438786+0000","last_became_peered":"2024-04-26T11:44:21.438786+0000","last_unstale":"2024-04-26T11:44:22.819416+0000","last_undegraded":"2024-04-26T11:44:22.819416+0000","last_fullsized":"2024-04-26T11:44:22.819416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436395+0000","last_change":"2024-04-26T11:44:21.066276+0000","last_active":"2024-04-26T11:44:22.436395+0000","last_peered":"2024-04-26T11:44:22.436395+0000","last_clean":"2024-04-26T11:44:22.436395+0000","last_became_active":"2024-04-26T11:44:21.065682+0000","last_became_peered":"2024-04-26T11:44:21.065682+0000","last_unstale":"2024-04-26T11:44:22.436395+0000","last_undegraded":"2024-04-26T11:44:22.436395+0000","last_fullsized":"2024-04-26T11:44:22.436395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436324+0000","last_change":"2024-04-26T11:44:17.031782+0000","last_active":"2024-04-26T11:44:21.436324+0000","last_peered":"2024-04-26T11:44:21.436324+0000","last_clean":"2024-04-26T11:44:21.436324+0000","last_became_active":"2024-04-26T11:44:17.030688+0000","last_became_peered":"2024-04-26T11:44:17.030688+0000","last_unstale":"2024-04-26T11:44:21.436324+0000","last_undegraded":"2024-04-26T11:44:21.436324+0000","last_fullsized":"2024-04-26T11:44:21.436324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.289819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434465+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:44:22.434465+0000","last_peered":"2024-04-26T11:44:22.434465+0000","last_clean":"2024-04-26T11:44:22.434465+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:44:22.434465+0000","last_undegraded":"2024-04-26T11:44:22.434465+0000","last_fullsized":"2024-04-26T11:44:22.434465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819493+0000","last_change":"2024-04-26T11:44:21.065142+0000","last_active":"2024-04-26T11:44:22.819493+0000","last_peered":"2024-04-26T11:44:22.819493+0000","last_clean":"2024-04-26T11:44:22.819493+0000","last_became_active":"2024-04-26T11:44:21.064672+0000","last_became_peered":"2024-04-26T11:44:21.064672+0000","last_unstale":"2024-04-26T11:44:22.819493+0000","last_undegraded":"2024-04-26T11:44:22.819493+0000","last_fullsized":"2024-04-26T11:44:22.819493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.433676+0000","last_change":"2024-04-26T11:44:17.031146+0000","last_active":"2024-04-26T11:44:21.433676+0000","last_peered":"2024-04-26T11:44:21.433676+0000","last_clean":"2024-04-26T11:44:21.433676+0000","last_became_active":"2024-04-26T11:44:17.030637+0000","last_became_peered":"2024-04-26T11:44:17.030637+0000","last_unstale":"2024-04-26T11:44:21.433676+0000","last_undegraded":"2024-04-26T11:44:21.433676+0000","last_fullsized":"2024-04-26T11:44:21.433676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434766+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:44:22.434766+0000","last_peered":"2024-04-26T11:44:22.434766+0000","last_clean":"2024-04-26T11:44:22.434766+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:44:22.434766+0000","last_undegraded":"2024-04-26T11:44:22.434766+0000","last_fullsized":"2024-04-26T11:44:22.434766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819801+0000","last_change":"2024-04-26T11:44:21.065483+0000","last_active":"2024-04-26T11:44:22.819801+0000","last_peered":"2024-04-26T11:44:22.819801+0000","last_clean":"2024-04-26T11:44:22.819801+0000","last_became_active":"2024-04-26T11:44:21.064772+0000","last_became_peered":"2024-04-26T11:44:21.064772+0000","last_unstale":"2024-04-26T11:44:22.819801+0000","last_undegraded":"2024-04-26T11:44:22.819801+0000","last_fullsized":"2024-04-26T11:44:22.819801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436718+0000","last_change":"2024-04-26T11:44:17.031358+0000","last_active":"2024-04-26T11:44:21.436718+0000","last_peered":"2024-04-26T11:44:21.436718+0000","last_clean":"2024-04-26T11:44:21.436718+0000","last_became_active":"2024-04-26T11:44:17.030413+0000","last_became_peered":"2024-04-26T11:44:17.030413+0000","last_unstale":"2024-04-26T11:44:21.436718+0000","last_undegraded":"2024-04-26T11:44:21.436718+0000","last_fullsized":"2024-04-26T11:44:21.436718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817817+0000","last_change":"2024-04-26T11:44:21.444989+0000","last_active":"2024-04-26T11:44:22.817817+0000","last_peered":"2024-04-26T11:44:22.817817+0000","last_clean":"2024-04-26T11:44:22.817817+0000","last_became_active":"2024-04-26T11:44:21.444418+0000","last_became_peered":"2024-04-26T11:44:21.444418+0000","last_unstale":"2024-04-26T11:44:22.817817+0000","last_undegraded":"2024-04-26T11:44:22.817817+0000","last_fullsized":"2024-04-26T11:44:22.817817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820131+0000","last_change":"2024-04-26T11:44:21.067525+0000","last_active":"2024-04-26T11:44:22.820131+0000","last_peered":"2024-04-26T11:44:22.820131+0000","last_clean":"2024-04-26T11:44:22.820131+0000","last_became_active":"2024-04-26T11:44:21.065923+0000","last_became_peered":"2024-04-26T11:44:21.065923+0000","last_unstale":"2024-04-26T11:44:22.820131+0000","last_undegraded":"2024-04-26T11:44:22.820131+0000","last_fullsized":"2024-04-26T11:44:22.820131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439731+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:44:21.439731+0000","last_peered":"2024-04-26T11:44:21.439731+0000","last_clean":"2024-04-26T11:44:21.439731+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:44:21.439731+0000","last_undegraded":"2024-04-26T11:44:21.439731+0000","last_fullsized":"2024-04-26T11:44:21.439731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434002+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:44:22.434002+0000","last_peered":"2024-04-26T11:44:22.434002+0000","last_clean":"2024-04-26T11:44:22.434002+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:44:22.434002+0000","last_undegraded":"2024-04-26T11:44:22.434002+0000","last_fullsized":"2024-04-26T11:44:22.434002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435702+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:44:22.435702+0000","last_peered":"2024-04-26T11:44:22.435702+0000","last_clean":"2024-04-26T11:44:22.435702+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:44:22.435702+0000","last_undegraded":"2024-04-26T11:44:22.435702+0000","last_fullsized":"2024-04-26T11:44:22.435702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435885+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:44:22.435885+0000","last_peered":"2024-04-26T11:44:22.435885+0000","last_clean":"2024-04-26T11:44:22.435885+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:44:22.435885+0000","last_undegraded":"2024-04-26T11:44:22.435885+0000","last_fullsized":"2024-04-26T11:44:22.435885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817896+0000","last_change":"2024-04-26T11:44:21.437907+0000","last_active":"2024-04-26T11:44:22.817896+0000","last_peered":"2024-04-26T11:44:22.817896+0000","last_clean":"2024-04-26T11:44:22.817896+0000","last_became_active":"2024-04-26T11:44:21.437024+0000","last_became_peered":"2024-04-26T11:44:21.437024+0000","last_unstale":"2024-04-26T11:44:22.817896+0000","last_undegraded":"2024-04-26T11:44:22.817896+0000","last_fullsized":"2024-04-26T11:44:22.817896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435937+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:44:22.435937+0000","last_peered":"2024-04-26T11:44:22.435937+0000","last_clean":"2024-04-26T11:44:22.435937+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:44:22.435937+0000","last_undegraded":"2024-04-26T11:44:22.435937+0000","last_fullsized":"2024-04-26T11:44:22.435937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435601+0000","last_change":"2024-04-26T11:44:21.065944+0000","last_active":"2024-04-26T11:44:22.435601+0000","last_peered":"2024-04-26T11:44:22.435601+0000","last_clean":"2024-04-26T11:44:22.435601+0000","last_became_active":"2024-04-26T11:44:21.065251+0000","last_became_peered":"2024-04-26T11:44:21.065251+0000","last_unstale":"2024-04-26T11:44:22.435601+0000","last_undegraded":"2024-04-26T11:44:22.435601+0000","last_fullsized":"2024-04-26T11:44:22.435601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817770+0000","last_change":"2024-04-26T11:44:21.445619+0000","last_active":"2024-04-26T11:44:22.817770+0000","last_peered":"2024-04-26T11:44:22.817770+0000","last_clean":"2024-04-26T11:44:22.817770+0000","last_became_active":"2024-04-26T11:44:21.444597+0000","last_became_peered":"2024-04-26T11:44:21.444597+0000","last_unstale":"2024-04-26T11:44:22.817770+0000","last_undegraded":"2024-04-26T11:44:22.817770+0000","last_fullsized":"2024-04-26T11:44:22.817770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819319+0000","last_change":"2024-04-26T11:44:21.067177+0000","last_active":"2024-04-26T11:44:22.819319+0000","last_peered":"2024-04-26T11:44:22.819319+0000","last_clean":"2024-04-26T11:44:22.819319+0000","last_became_active":"2024-04-26T11:44:21.066727+0000","last_became_peered":"2024-04-26T11:44:21.066727+0000","last_unstale":"2024-04-26T11:44:22.819319+0000","last_undegraded":"2024-04-26T11:44:22.819319+0000","last_fullsized":"2024-04-26T11:44:22.819319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817835+0000","last_change":"2024-04-26T11:44:21.439357+0000","last_active":"2024-04-26T11:44:22.817835+0000","last_peered":"2024-04-26T11:44:22.817835+0000","last_clean":"2024-04-26T11:44:22.817835+0000","last_became_active":"2024-04-26T11:44:21.438703+0000","last_became_peered":"2024-04-26T11:44:21.438703+0000","last_unstale":"2024-04-26T11:44:22.817835+0000","last_undegraded":"2024-04-26T11:44:22.817835+0000","last_fullsized":"2024-04-26T11:44:22.817835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436060+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:44:22.436060+0000","last_peered":"2024-04-26T11:44:22.436060+0000","last_clean":"2024-04-26T11:44:22.436060+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:44:22.436060+0000","last_undegraded":"2024-04-26T11:44:22.436060+0000","last_fullsized":"2024-04-26T11:44:22.436060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818065+0000","last_change":"2024-04-26T11:44:21.065373+0000","last_active":"2024-04-26T11:44:22.818065+0000","last_peered":"2024-04-26T11:44:22.818065+0000","last_clean":"2024-04-26T11:44:22.818065+0000","last_became_active":"2024-04-26T11:44:21.064598+0000","last_became_peered":"2024-04-26T11:44:21.064598+0000","last_unstale":"2024-04-26T11:44:22.818065+0000","last_undegraded":"2024-04-26T11:44:22.818065+0000","last_fullsized":"2024-04-26T11:44:22.818065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819621+0000","last_change":"2024-04-26T11:44:21.445216+0000","last_active":"2024-04-26T11:44:22.819621+0000","last_peered":"2024-04-26T11:44:22.819621+0000","last_clean":"2024-04-26T11:44:22.819621+0000","last_became_active":"2024-04-26T11:44:21.444615+0000","last_became_peered":"2024-04-26T11:44:21.444615+0000","last_unstale":"2024-04-26T11:44:22.819621+0000","last_undegraded":"2024-04-26T11:44:22.819621+0000","last_fullsized":"2024-04-26T11:44:22.819621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818131+0000","last_change":"2024-04-26T11:44:21.066483+0000","last_active":"2024-04-26T11:44:22.818131+0000","last_peered":"2024-04-26T11:44:22.818131+0000","last_clean":"2024-04-26T11:44:22.818131+0000","last_became_active":"2024-04-26T11:44:21.065373+0000","last_became_peered":"2024-04-26T11:44:21.065373+0000","last_unstale":"2024-04-26T11:44:22.818131+0000","last_undegraded":"2024-04-26T11:44:22.818131+0000","last_fullsized":"2024-04-26T11:44:22.818131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435451+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:44:22.435451+0000","last_peered":"2024-04-26T11:44:22.435451+0000","last_clean":"2024-04-26T11:44:22.435451+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:44:22.435451+0000","last_undegraded":"2024-04-26T11:44:22.435451+0000","last_fullsized":"2024-04-26T11:44:22.435451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434803+0000","last_change":"2024-04-26T11:44:21.065431+0000","last_active":"2024-04-26T11:44:22.434803+0000","last_peered":"2024-04-26T11:44:22.434803+0000","last_clean":"2024-04-26T11:44:22.434803+0000","last_became_active":"2024-04-26T11:44:21.065114+0000","last_became_peered":"2024-04-26T11:44:21.065114+0000","last_unstale":"2024-04-26T11:44:22.434803+0000","last_undegraded":"2024-04-26T11:44:22.434803+0000","last_fullsized":"2024-04-26T11:44:22.434803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:39.838237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435212+0000","last_change":"2024-04-26T11:44:21.441795+0000","last_active":"2024-04-26T11:44:22.435212+0000","last_peered":"2024-04-26T11:44:22.435212+0000","last_clean":"2024-04-26T11:44:22.435212+0000","last_became_active":"2024-04-26T11:44:21.441421+0000","last_became_peered":"2024-04-26T11:44:21.441421+0000","last_unstale":"2024-04-26T11:44:22.435212+0000","last_undegraded":"2024-04-26T11:44:22.435212+0000","last_fullsized":"2024-04-26T11:44:22.435212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435013+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:44:22.435013+0000","last_peered":"2024-04-26T11:44:22.435013+0000","last_clean":"2024-04-26T11:44:22.435013+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:44:22.435013+0000","last_undegraded":"2024-04-26T11:44:22.435013+0000","last_fullsized":"2024-04-26T11:44:22.435013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436177+0000","last_change":"2024-04-26T11:44:21.448442+0000","last_active":"2024-04-26T11:44:22.436177+0000","last_peered":"2024-04-26T11:44:22.436177+0000","last_clean":"2024-04-26T11:44:22.436177+0000","last_became_active":"2024-04-26T11:44:21.447770+0000","last_became_peered":"2024-04-26T11:44:21.447770+0000","last_unstale":"2024-04-26T11:44:22.436177+0000","last_undegraded":"2024-04-26T11:44:22.436177+0000","last_fullsized":"2024-04-26T11:44:22.436177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435664+0000","last_change":"2024-04-26T11:44:21.066498+0000","last_active":"2024-04-26T11:44:22.435664+0000","last_peered":"2024-04-26T11:44:22.435664+0000","last_clean":"2024-04-26T11:44:22.435664+0000","last_became_active":"2024-04-26T11:44:21.065945+0000","last_became_peered":"2024-04-26T11:44:21.065945+0000","last_unstale":"2024-04-26T11:44:22.435664+0000","last_undegraded":"2024-04-26T11:44:22.435664+0000","last_fullsized":"2024-04-26T11:44:22.435664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434988+0000","last_change":"2024-04-26T11:44:21.448777+0000","last_active":"2024-04-26T11:44:22.434988+0000","last_peered":"2024-04-26T11:44:22.434988+0000","last_clean":"2024-04-26T11:44:22.434988+0000","last_became_active":"2024-04-26T11:44:21.448274+0000","last_became_peered":"2024-04-26T11:44:21.448274+0000","last_unstale":"2024-04-26T11:44:22.434988+0000","last_undegraded":"2024-04-26T11:44:22.434988+0000","last_fullsized":"2024-04-26T11:44:22.434988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435817+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:44:22.435817+0000","last_peered":"2024-04-26T11:44:22.435817+0000","last_clean":"2024-04-26T11:44:22.435817+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:44:22.435817+0000","last_undegraded":"2024-04-26T11:44:22.435817+0000","last_fullsized":"2024-04-26T11:44:22.435817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434476+0000","last_change":"2024-04-26T11:44:21.438183+0000","last_active":"2024-04-26T11:44:22.434476+0000","last_peered":"2024-04-26T11:44:22.434476+0000","last_clean":"2024-04-26T11:44:22.434476+0000","last_became_active":"2024-04-26T11:44:21.437823+0000","last_became_peered":"2024-04-26T11:44:21.437823+0000","last_unstale":"2024-04-26T11:44:22.434476+0000","last_undegraded":"2024-04-26T11:44:22.434476+0000","last_fullsized":"2024-04-26T11:44:22.434476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820080+0000","last_change":"2024-04-26T11:44:21.068479+0000","last_active":"2024-04-26T11:44:22.820080+0000","last_peered":"2024-04-26T11:44:22.820080+0000","last_clean":"2024-04-26T11:44:22.820080+0000","last_became_active":"2024-04-26T11:44:21.068206+0000","last_became_peered":"2024-04-26T11:44:21.068206+0000","last_unstale":"2024-04-26T11:44:22.820080+0000","last_undegraded":"2024-04-26T11:44:22.820080+0000","last_fullsized":"2024-04-26T11:44:22.820080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434365+0000","last_change":"2024-04-26T11:44:21.452369+0000","last_active":"2024-04-26T11:44:22.434365+0000","last_peered":"2024-04-26T11:44:22.434365+0000","last_clean":"2024-04-26T11:44:22.434365+0000","last_became_active":"2024-04-26T11:44:21.451833+0000","last_became_peered":"2024-04-26T11:44:21.451833+0000","last_unstale":"2024-04-26T11:44:22.434365+0000","last_undegraded":"2024-04-26T11:44:22.434365+0000","last_fullsized":"2024-04-26T11:44:22.434365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819101+0000","last_change":"2024-04-26T11:44:21.068300+0000","last_active":"2024-04-26T11:44:22.819101+0000","last_peered":"2024-04-26T11:44:22.819101+0000","last_clean":"2024-04-26T11:44:22.819101+0000","last_became_active":"2024-04-26T11:44:21.067285+0000","last_became_peered":"2024-04-26T11:44:21.067285+0000","last_unstale":"2024-04-26T11:44:22.819101+0000","last_undegraded":"2024-04-26T11:44:22.819101+0000","last_fullsized":"2024-04-26T11:44:22.819101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":790528,"data_stored":650427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":782336,"data_stored":649811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:44:26.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:44:26.545 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:26.545 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":27,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":19,"num_osds":3,"num_up_osds":3,"osd_up_since":1714131848,"num_in_osds":3,"osd_in_since":1714131840,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":97333248,"bytes_avail":289812959232,"bytes_total":289910292480,"write_bytes_sec":2422,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4213}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-26T11:43:59.330270+0000","services":{}},"progress_events":{}} 2024-04-26T11:44:26.560 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T11:44:26.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:44:26.874 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:44:26.889 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T11:44:25.957240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95052,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020468,"statfs":{"total":289910292480,"available":289812959232,"internally_reserved":0,"allocated":1744896,"data_stored":1358551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.917329"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435811+0000","last_change":"2024-04-26T11:44:21.443178+0000","last_active":"2024-04-26T11:44:22.435811+0000","last_peered":"2024-04-26T11:44:22.435811+0000","last_clean":"2024-04-26T11:44:22.435811+0000","last_became_active":"2024-04-26T11:44:21.442734+0000","last_became_peered":"2024-04-26T11:44:21.442734+0000","last_unstale":"2024-04-26T11:44:22.435811+0000","last_undegraded":"2024-04-26T11:44:22.435811+0000","last_fullsized":"2024-04-26T11:44:22.435811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435342+0000","last_change":"2024-04-26T11:44:21.442473+0000","last_active":"2024-04-26T11:44:22.435342+0000","last_peered":"2024-04-26T11:44:22.435342+0000","last_clean":"2024-04-26T11:44:22.435342+0000","last_became_active":"2024-04-26T11:44:21.441778+0000","last_became_peered":"2024-04-26T11:44:21.441778+0000","last_unstale":"2024-04-26T11:44:22.435342+0000","last_undegraded":"2024-04-26T11:44:22.435342+0000","last_fullsized":"2024-04-26T11:44:22.435342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435827+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:44:22.435827+0000","last_peered":"2024-04-26T11:44:22.435827+0000","last_clean":"2024-04-26T11:44:22.435827+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:44:22.435827+0000","last_undegraded":"2024-04-26T11:44:22.435827+0000","last_fullsized":"2024-04-26T11:44:22.435827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435163+0000","last_change":"2024-04-26T11:44:21.448849+0000","last_active":"2024-04-26T11:44:22.435163+0000","last_peered":"2024-04-26T11:44:22.435163+0000","last_clean":"2024-04-26T11:44:22.435163+0000","last_became_active":"2024-04-26T11:44:21.447398+0000","last_became_peered":"2024-04-26T11:44:21.447398+0000","last_unstale":"2024-04-26T11:44:22.435163+0000","last_undegraded":"2024-04-26T11:44:22.435163+0000","last_fullsized":"2024-04-26T11:44:22.435163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:02.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434980+0000","last_change":"2024-04-26T11:44:21.441647+0000","last_active":"2024-04-26T11:44:22.434980+0000","last_peered":"2024-04-26T11:44:22.434980+0000","last_clean":"2024-04-26T11:44:22.434980+0000","last_became_active":"2024-04-26T11:44:21.441237+0000","last_became_peered":"2024-04-26T11:44:21.441237+0000","last_unstale":"2024-04-26T11:44:22.434980+0000","last_undegraded":"2024-04-26T11:44:22.434980+0000","last_fullsized":"2024-04-26T11:44:22.434980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434482+0000","last_change":"2024-04-26T11:44:21.447786+0000","last_active":"2024-04-26T11:44:22.434482+0000","last_peered":"2024-04-26T11:44:22.434482+0000","last_clean":"2024-04-26T11:44:22.434482+0000","last_became_active":"2024-04-26T11:44:21.447367+0000","last_became_peered":"2024-04-26T11:44:21.447367+0000","last_unstale":"2024-04-26T11:44:22.434482+0000","last_undegraded":"2024-04-26T11:44:22.434482+0000","last_fullsized":"2024-04-26T11:44:22.434482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434713+0000","last_change":"2024-04-26T11:44:21.448136+0000","last_active":"2024-04-26T11:44:22.434713+0000","last_peered":"2024-04-26T11:44:22.434713+0000","last_clean":"2024-04-26T11:44:22.434713+0000","last_became_active":"2024-04-26T11:44:21.447382+0000","last_became_peered":"2024-04-26T11:44:21.447382+0000","last_unstale":"2024-04-26T11:44:22.434713+0000","last_undegraded":"2024-04-26T11:44:22.434713+0000","last_fullsized":"2024-04-26T11:44:22.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433838+0000","last_change":"2024-04-26T11:44:21.448950+0000","last_active":"2024-04-26T11:44:22.433838+0000","last_peered":"2024-04-26T11:44:22.433838+0000","last_clean":"2024-04-26T11:44:22.433838+0000","last_became_active":"2024-04-26T11:44:21.447975+0000","last_became_peered":"2024-04-26T11:44:21.447975+0000","last_unstale":"2024-04-26T11:44:22.433838+0000","last_undegraded":"2024-04-26T11:44:22.433838+0000","last_fullsized":"2024-04-26T11:44:22.433838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:07.109775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818672+0000","last_change":"2024-04-26T11:44:21.446676+0000","last_active":"2024-04-26T11:44:22.818672+0000","last_peered":"2024-04-26T11:44:22.818672+0000","last_clean":"2024-04-26T11:44:22.818672+0000","last_became_active":"2024-04-26T11:44:21.445874+0000","last_became_peered":"2024-04-26T11:44:21.445874+0000","last_unstale":"2024-04-26T11:44:22.818672+0000","last_undegraded":"2024-04-26T11:44:22.818672+0000","last_fullsized":"2024-04-26T11:44:22.818672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435569+0000","last_change":"2024-04-26T11:44:21.441552+0000","last_active":"2024-04-26T11:44:22.435569+0000","last_peered":"2024-04-26T11:44:22.435569+0000","last_clean":"2024-04-26T11:44:22.435569+0000","last_became_active":"2024-04-26T11:44:21.441047+0000","last_became_peered":"2024-04-26T11:44:21.441047+0000","last_unstale":"2024-04-26T11:44:22.435569+0000","last_undegraded":"2024-04-26T11:44:22.435569+0000","last_fullsized":"2024-04-26T11:44:22.435569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435826+0000","last_change":"2024-04-26T11:44:21.448723+0000","last_active":"2024-04-26T11:44:22.435826+0000","last_peered":"2024-04-26T11:44:22.435826+0000","last_clean":"2024-04-26T11:44:22.435826+0000","last_became_active":"2024-04-26T11:44:21.448275+0000","last_became_peered":"2024-04-26T11:44:21.448275+0000","last_unstale":"2024-04-26T11:44:22.435826+0000","last_undegraded":"2024-04-26T11:44:22.435826+0000","last_fullsized":"2024-04-26T11:44:22.435826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435154+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:44:22.435154+0000","last_peered":"2024-04-26T11:44:22.435154+0000","last_clean":"2024-04-26T11:44:22.435154+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:44:22.435154+0000","last_undegraded":"2024-04-26T11:44:22.435154+0000","last_fullsized":"2024-04-26T11:44:22.435154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434453+0000","last_change":"2024-04-26T11:44:21.441784+0000","last_active":"2024-04-26T11:44:22.434453+0000","last_peered":"2024-04-26T11:44:22.434453+0000","last_clean":"2024-04-26T11:44:22.434453+0000","last_became_active":"2024-04-26T11:44:21.441107+0000","last_became_peered":"2024-04-26T11:44:21.441107+0000","last_unstale":"2024-04-26T11:44:22.434453+0000","last_undegraded":"2024-04-26T11:44:22.434453+0000","last_fullsized":"2024-04-26T11:44:22.434453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434509+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:44:22.434509+0000","last_peered":"2024-04-26T11:44:22.434509+0000","last_clean":"2024-04-26T11:44:22.434509+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:44:22.434509+0000","last_undegraded":"2024-04-26T11:44:22.434509+0000","last_fullsized":"2024-04-26T11:44:22.434509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434815+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:44:22.434815+0000","last_peered":"2024-04-26T11:44:22.434815+0000","last_clean":"2024-04-26T11:44:22.434815+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:44:22.434815+0000","last_undegraded":"2024-04-26T11:44:22.434815+0000","last_fullsized":"2024-04-26T11:44:22.434815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433958+0000","last_change":"2024-04-26T11:44:21.449098+0000","last_active":"2024-04-26T11:44:22.433958+0000","last_peered":"2024-04-26T11:44:22.433958+0000","last_clean":"2024-04-26T11:44:22.433958+0000","last_became_active":"2024-04-26T11:44:21.448517+0000","last_became_peered":"2024-04-26T11:44:21.448517+0000","last_unstale":"2024-04-26T11:44:22.433958+0000","last_undegraded":"2024-04-26T11:44:22.433958+0000","last_fullsized":"2024-04-26T11:44:22.433958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819570+0000","last_change":"2024-04-26T11:44:21.439565+0000","last_active":"2024-04-26T11:44:22.819570+0000","last_peered":"2024-04-26T11:44:22.819570+0000","last_clean":"2024-04-26T11:44:22.819570+0000","last_became_active":"2024-04-26T11:44:21.438640+0000","last_became_peered":"2024-04-26T11:44:21.438640+0000","last_unstale":"2024-04-26T11:44:22.819570+0000","last_undegraded":"2024-04-26T11:44:22.819570+0000","last_fullsized":"2024-04-26T11:44:22.819570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435844+0000","last_change":"2024-04-26T11:44:21.437913+0000","last_active":"2024-04-26T11:44:22.435844+0000","last_peered":"2024-04-26T11:44:22.435844+0000","last_clean":"2024-04-26T11:44:22.435844+0000","last_became_active":"2024-04-26T11:44:21.437543+0000","last_became_peered":"2024-04-26T11:44:21.437543+0000","last_unstale":"2024-04-26T11:44:22.435844+0000","last_undegraded":"2024-04-26T11:44:22.435844+0000","last_fullsized":"2024-04-26T11:44:22.435844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818621+0000","last_change":"2024-04-26T11:44:21.440138+0000","last_active":"2024-04-26T11:44:22.818621+0000","last_peered":"2024-04-26T11:44:22.818621+0000","last_clean":"2024-04-26T11:44:22.818621+0000","last_became_active":"2024-04-26T11:44:21.439850+0000","last_became_peered":"2024-04-26T11:44:21.439850+0000","last_unstale":"2024-04-26T11:44:22.818621+0000","last_undegraded":"2024-04-26T11:44:22.818621+0000","last_fullsized":"2024-04-26T11:44:22.818621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435721+0000","last_change":"2024-04-26T11:44:21.449248+0000","last_active":"2024-04-26T11:44:22.435721+0000","last_peered":"2024-04-26T11:44:22.435721+0000","last_clean":"2024-04-26T11:44:22.435721+0000","last_became_active":"2024-04-26T11:44:21.448315+0000","last_became_peered":"2024-04-26T11:44:21.448315+0000","last_unstale":"2024-04-26T11:44:22.435721+0000","last_undegraded":"2024-04-26T11:44:22.435721+0000","last_fullsized":"2024-04-26T11:44:22.435721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436209+0000","last_change":"2024-04-26T11:44:21.448524+0000","last_active":"2024-04-26T11:44:22.436209+0000","last_peered":"2024-04-26T11:44:22.436209+0000","last_clean":"2024-04-26T11:44:22.436209+0000","last_became_active":"2024-04-26T11:44:21.447839+0000","last_became_peered":"2024-04-26T11:44:21.447839+0000","last_unstale":"2024-04-26T11:44:22.436209+0000","last_undegraded":"2024-04-26T11:44:22.436209+0000","last_fullsized":"2024-04-26T11:44:22.436209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434386+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:44:22.434386+0000","last_peered":"2024-04-26T11:44:22.434386+0000","last_clean":"2024-04-26T11:44:22.434386+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:44:22.434386+0000","last_undegraded":"2024-04-26T11:44:22.434386+0000","last_fullsized":"2024-04-26T11:44:22.434386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817486+0000","last_change":"2024-04-26T11:44:21.445626+0000","last_active":"2024-04-26T11:44:22.817486+0000","last_peered":"2024-04-26T11:44:22.817486+0000","last_clean":"2024-04-26T11:44:22.817486+0000","last_became_active":"2024-04-26T11:44:21.444990+0000","last_became_peered":"2024-04-26T11:44:21.444990+0000","last_unstale":"2024-04-26T11:44:22.817486+0000","last_undegraded":"2024-04-26T11:44:22.817486+0000","last_fullsized":"2024-04-26T11:44:22.817486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433782+0000","last_change":"2024-04-26T11:44:21.441463+0000","last_active":"2024-04-26T11:44:22.433782+0000","last_peered":"2024-04-26T11:44:22.433782+0000","last_clean":"2024-04-26T11:44:22.433782+0000","last_became_active":"2024-04-26T11:44:21.440895+0000","last_became_peered":"2024-04-26T11:44:21.440895+0000","last_unstale":"2024-04-26T11:44:22.433782+0000","last_undegraded":"2024-04-26T11:44:22.433782+0000","last_fullsized":"2024-04-26T11:44:22.433782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435906+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:44:22.435906+0000","last_peered":"2024-04-26T11:44:22.435906+0000","last_clean":"2024-04-26T11:44:22.435906+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:44:22.435906+0000","last_undegraded":"2024-04-26T11:44:22.435906+0000","last_fullsized":"2024-04-26T11:44:22.435906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819879+0000","last_change":"2024-04-26T11:44:21.444826+0000","last_active":"2024-04-26T11:44:22.819879+0000","last_peered":"2024-04-26T11:44:22.819879+0000","last_clean":"2024-04-26T11:44:22.819879+0000","last_became_active":"2024-04-26T11:44:21.444440+0000","last_became_peered":"2024-04-26T11:44:21.444440+0000","last_unstale":"2024-04-26T11:44:22.819879+0000","last_undegraded":"2024-04-26T11:44:22.819879+0000","last_fullsized":"2024-04-26T11:44:22.819879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436032+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:44:22.436032+0000","last_peered":"2024-04-26T11:44:22.436032+0000","last_clean":"2024-04-26T11:44:22.436032+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:44:22.436032+0000","last_undegraded":"2024-04-26T11:44:22.436032+0000","last_fullsized":"2024-04-26T11:44:22.436032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435465+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:44:22.435465+0000","last_peered":"2024-04-26T11:44:22.435465+0000","last_clean":"2024-04-26T11:44:22.435465+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:44:22.435465+0000","last_undegraded":"2024-04-26T11:44:22.435465+0000","last_fullsized":"2024-04-26T11:44:22.435465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819067+0000","last_change":"2024-04-26T11:44:21.439511+0000","last_active":"2024-04-26T11:44:22.819067+0000","last_peered":"2024-04-26T11:44:22.819067+0000","last_clean":"2024-04-26T11:44:22.819067+0000","last_became_active":"2024-04-26T11:44:21.438539+0000","last_became_peered":"2024-04-26T11:44:21.438539+0000","last_unstale":"2024-04-26T11:44:22.819067+0000","last_undegraded":"2024-04-26T11:44:22.819067+0000","last_fullsized":"2024-04-26T11:44:22.819067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434754+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:44:22.434754+0000","last_peered":"2024-04-26T11:44:22.434754+0000","last_clean":"2024-04-26T11:44:22.434754+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:44:22.434754+0000","last_undegraded":"2024-04-26T11:44:22.434754+0000","last_fullsized":"2024-04-26T11:44:22.434754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817638+0000","last_change":"2024-04-26T11:44:21.439772+0000","last_active":"2024-04-26T11:44:22.817638+0000","last_peered":"2024-04-26T11:44:22.817638+0000","last_clean":"2024-04-26T11:44:22.817638+0000","last_became_active":"2024-04-26T11:44:21.438770+0000","last_became_peered":"2024-04-26T11:44:21.438770+0000","last_unstale":"2024-04-26T11:44:22.817638+0000","last_undegraded":"2024-04-26T11:44:22.817638+0000","last_fullsized":"2024-04-26T11:44:22.817638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434091+0000","last_change":"2024-04-26T11:44:21.452228+0000","last_active":"2024-04-26T11:44:22.434091+0000","last_peered":"2024-04-26T11:44:22.434091+0000","last_clean":"2024-04-26T11:44:22.434091+0000","last_became_active":"2024-04-26T11:44:21.451258+0000","last_became_peered":"2024-04-26T11:44:21.451258+0000","last_unstale":"2024-04-26T11:44:22.434091+0000","last_undegraded":"2024-04-26T11:44:22.434091+0000","last_fullsized":"2024-04-26T11:44:22.434091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435434+0000","last_change":"2024-04-26T11:44:21.438961+0000","last_active":"2024-04-26T11:44:22.435434+0000","last_peered":"2024-04-26T11:44:22.435434+0000","last_clean":"2024-04-26T11:44:22.435434+0000","last_became_active":"2024-04-26T11:44:21.438124+0000","last_became_peered":"2024-04-26T11:44:21.438124+0000","last_unstale":"2024-04-26T11:44:22.435434+0000","last_undegraded":"2024-04-26T11:44:22.435434+0000","last_fullsized":"2024-04-26T11:44:22.435434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436336+0000","last_change":"2024-04-26T11:44:21.066359+0000","last_active":"2024-04-26T11:44:22.436336+0000","last_peered":"2024-04-26T11:44:22.436336+0000","last_clean":"2024-04-26T11:44:22.436336+0000","last_became_active":"2024-04-26T11:44:21.066007+0000","last_became_peered":"2024-04-26T11:44:21.066007+0000","last_unstale":"2024-04-26T11:44:22.436336+0000","last_undegraded":"2024-04-26T11:44:22.436336+0000","last_fullsized":"2024-04-26T11:44:22.436336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435741+0000","last_change":"2024-04-26T11:44:21.439295+0000","last_active":"2024-04-26T11:44:22.435741+0000","last_peered":"2024-04-26T11:44:22.435741+0000","last_clean":"2024-04-26T11:44:22.435741+0000","last_became_active":"2024-04-26T11:44:21.439097+0000","last_became_peered":"2024-04-26T11:44:21.439097+0000","last_unstale":"2024-04-26T11:44:22.435741+0000","last_undegraded":"2024-04-26T11:44:22.435741+0000","last_fullsized":"2024-04-26T11:44:22.435741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818216+0000","last_change":"2024-04-26T11:44:21.066646+0000","last_active":"2024-04-26T11:44:22.818216+0000","last_peered":"2024-04-26T11:44:22.818216+0000","last_clean":"2024-04-26T11:44:22.818216+0000","last_became_active":"2024-04-26T11:44:21.065981+0000","last_became_peered":"2024-04-26T11:44:21.065981+0000","last_unstale":"2024-04-26T11:44:22.818216+0000","last_undegraded":"2024-04-26T11:44:22.818216+0000","last_fullsized":"2024-04-26T11:44:22.818216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820032+0000","last_change":"2024-04-26T11:44:21.443681+0000","last_active":"2024-04-26T11:44:22.820032+0000","last_peered":"2024-04-26T11:44:22.820032+0000","last_clean":"2024-04-26T11:44:22.820032+0000","last_became_active":"2024-04-26T11:44:21.443253+0000","last_became_peered":"2024-04-26T11:44:21.443253+0000","last_unstale":"2024-04-26T11:44:22.820032+0000","last_undegraded":"2024-04-26T11:44:22.820032+0000","last_fullsized":"2024-04-26T11:44:22.820032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434717+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:44:22.434717+0000","last_peered":"2024-04-26T11:44:22.434717+0000","last_clean":"2024-04-26T11:44:22.434717+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:44:22.434717+0000","last_undegraded":"2024-04-26T11:44:22.434717+0000","last_fullsized":"2024-04-26T11:44:22.434717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818804+0000","last_change":"2024-04-26T11:44:21.445426+0000","last_active":"2024-04-26T11:44:22.818804+0000","last_peered":"2024-04-26T11:44:22.818804+0000","last_clean":"2024-04-26T11:44:22.818804+0000","last_became_active":"2024-04-26T11:44:21.444674+0000","last_became_peered":"2024-04-26T11:44:21.444674+0000","last_unstale":"2024-04-26T11:44:22.818804+0000","last_undegraded":"2024-04-26T11:44:22.818804+0000","last_fullsized":"2024-04-26T11:44:22.818804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434190+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:44:22.434190+0000","last_peered":"2024-04-26T11:44:22.434190+0000","last_clean":"2024-04-26T11:44:22.434190+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:44:22.434190+0000","last_undegraded":"2024-04-26T11:44:22.434190+0000","last_fullsized":"2024-04-26T11:44:22.434190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435770+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:44:22.435770+0000","last_peered":"2024-04-26T11:44:22.435770+0000","last_clean":"2024-04-26T11:44:22.435770+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:44:22.435770+0000","last_undegraded":"2024-04-26T11:44:22.435770+0000","last_fullsized":"2024-04-26T11:44:22.435770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433826+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:44:22.433826+0000","last_peered":"2024-04-26T11:44:22.433826+0000","last_clean":"2024-04-26T11:44:22.433826+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:44:22.433826+0000","last_undegraded":"2024-04-26T11:44:22.433826+0000","last_fullsized":"2024-04-26T11:44:22.433826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436104+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:44:22.436104+0000","last_peered":"2024-04-26T11:44:22.436104+0000","last_clean":"2024-04-26T11:44:22.436104+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:44:22.436104+0000","last_undegraded":"2024-04-26T11:44:22.436104+0000","last_fullsized":"2024-04-26T11:44:22.436104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433901+0000","last_change":"2024-04-26T11:44:21.442188+0000","last_active":"2024-04-26T11:44:22.433901+0000","last_peered":"2024-04-26T11:44:22.433901+0000","last_clean":"2024-04-26T11:44:22.433901+0000","last_became_active":"2024-04-26T11:44:21.441105+0000","last_became_peered":"2024-04-26T11:44:21.441105+0000","last_unstale":"2024-04-26T11:44:22.433901+0000","last_undegraded":"2024-04-26T11:44:22.433901+0000","last_fullsized":"2024-04-26T11:44:22.433901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436283+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:44:22.436283+0000","last_peered":"2024-04-26T11:44:22.436283+0000","last_clean":"2024-04-26T11:44:22.436283+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:44:22.436283+0000","last_undegraded":"2024-04-26T11:44:22.436283+0000","last_fullsized":"2024-04-26T11:44:22.436283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435798+0000","last_change":"2024-04-26T11:44:21.449433+0000","last_active":"2024-04-26T11:44:22.435798+0000","last_peered":"2024-04-26T11:44:22.435798+0000","last_clean":"2024-04-26T11:44:22.435798+0000","last_became_active":"2024-04-26T11:44:21.447831+0000","last_became_peered":"2024-04-26T11:44:21.447831+0000","last_unstale":"2024-04-26T11:44:22.435798+0000","last_undegraded":"2024-04-26T11:44:22.435798+0000","last_fullsized":"2024-04-26T11:44:22.435798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435987+0000","last_change":"2024-04-26T11:44:21.065647+0000","last_active":"2024-04-26T11:44:22.435987+0000","last_peered":"2024-04-26T11:44:22.435987+0000","last_clean":"2024-04-26T11:44:22.435987+0000","last_became_active":"2024-04-26T11:44:21.065197+0000","last_became_peered":"2024-04-26T11:44:21.065197+0000","last_unstale":"2024-04-26T11:44:22.435987+0000","last_undegraded":"2024-04-26T11:44:22.435987+0000","last_fullsized":"2024-04-26T11:44:22.435987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818851+0000","last_change":"2024-04-26T11:44:21.443848+0000","last_active":"2024-04-26T11:44:22.818851+0000","last_peered":"2024-04-26T11:44:22.818851+0000","last_clean":"2024-04-26T11:44:22.818851+0000","last_became_active":"2024-04-26T11:44:21.443580+0000","last_became_peered":"2024-04-26T11:44:21.443580+0000","last_unstale":"2024-04-26T11:44:22.818851+0000","last_undegraded":"2024-04-26T11:44:22.818851+0000","last_fullsized":"2024-04-26T11:44:22.818851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819315+0000","last_change":"2024-04-26T11:44:21.068336+0000","last_active":"2024-04-26T11:44:22.819315+0000","last_peered":"2024-04-26T11:44:22.819315+0000","last_clean":"2024-04-26T11:44:22.819315+0000","last_became_active":"2024-04-26T11:44:21.067530+0000","last_became_peered":"2024-04-26T11:44:21.067530+0000","last_unstale":"2024-04-26T11:44:22.819315+0000","last_undegraded":"2024-04-26T11:44:22.819315+0000","last_fullsized":"2024-04-26T11:44:22.819315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435445+0000","last_change":"2024-04-26T11:44:21.449238+0000","last_active":"2024-04-26T11:44:22.435445+0000","last_peered":"2024-04-26T11:44:22.435445+0000","last_clean":"2024-04-26T11:44:22.435445+0000","last_became_active":"2024-04-26T11:44:21.447694+0000","last_became_peered":"2024-04-26T11:44:21.447694+0000","last_unstale":"2024-04-26T11:44:22.435445+0000","last_undegraded":"2024-04-26T11:44:22.435445+0000","last_fullsized":"2024-04-26T11:44:22.435445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435196+0000","last_change":"2024-04-26T11:44:21.066212+0000","last_active":"2024-04-26T11:44:22.435196+0000","last_peered":"2024-04-26T11:44:22.435196+0000","last_clean":"2024-04-26T11:44:22.435196+0000","last_became_active":"2024-04-26T11:44:21.065186+0000","last_became_peered":"2024-04-26T11:44:21.065186+0000","last_unstale":"2024-04-26T11:44:22.435196+0000","last_undegraded":"2024-04-26T11:44:22.435196+0000","last_fullsized":"2024-04-26T11:44:22.435196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436154+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:44:22.436154+0000","last_peered":"2024-04-26T11:44:22.436154+0000","last_clean":"2024-04-26T11:44:22.436154+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:44:22.436154+0000","last_undegraded":"2024-04-26T11:44:22.436154+0000","last_fullsized":"2024-04-26T11:44:22.436154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434230+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:44:22.434230+0000","last_peered":"2024-04-26T11:44:22.434230+0000","last_clean":"2024-04-26T11:44:22.434230+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:44:22.434230+0000","last_undegraded":"2024-04-26T11:44:22.434230+0000","last_fullsized":"2024-04-26T11:44:22.434230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435383+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:44:22.435383+0000","last_peered":"2024-04-26T11:44:22.435383+0000","last_clean":"2024-04-26T11:44:22.435383+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:44:22.435383+0000","last_undegraded":"2024-04-26T11:44:22.435383+0000","last_fullsized":"2024-04-26T11:44:22.435383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434021+0000","last_change":"2024-04-26T11:44:21.065486+0000","last_active":"2024-04-26T11:44:22.434021+0000","last_peered":"2024-04-26T11:44:22.434021+0000","last_clean":"2024-04-26T11:44:22.434021+0000","last_became_active":"2024-04-26T11:44:21.065090+0000","last_became_peered":"2024-04-26T11:44:21.065090+0000","last_unstale":"2024-04-26T11:44:22.434021+0000","last_undegraded":"2024-04-26T11:44:22.434021+0000","last_fullsized":"2024-04-26T11:44:22.434021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:03.456923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818894+0000","last_change":"2024-04-26T11:44:21.446431+0000","last_active":"2024-04-26T11:44:22.818894+0000","last_peered":"2024-04-26T11:44:22.818894+0000","last_clean":"2024-04-26T11:44:22.818894+0000","last_became_active":"2024-04-26T11:44:21.445866+0000","last_became_peered":"2024-04-26T11:44:21.445866+0000","last_unstale":"2024-04-26T11:44:22.818894+0000","last_undegraded":"2024-04-26T11:44:22.818894+0000","last_fullsized":"2024-04-26T11:44:22.818894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440035+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:44:21.440035+0000","last_peered":"2024-04-26T11:44:21.440035+0000","last_clean":"2024-04-26T11:44:21.440035+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:44:21.440035+0000","last_undegraded":"2024-04-26T11:44:21.440035+0000","last_fullsized":"2024-04-26T11:44:21.440035+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440187+0000","last_change":"2024-04-26T11:44:17.037102+0000","last_active":"2024-04-26T11:44:21.440187+0000","last_peered":"2024-04-26T11:44:21.440187+0000","last_clean":"2024-04-26T11:44:21.440187+0000","last_became_active":"2024-04-26T11:44:17.036242+0000","last_became_peered":"2024-04-26T11:44:17.036242+0000","last_unstale":"2024-04-26T11:44:21.440187+0000","last_undegraded":"2024-04-26T11:44:21.440187+0000","last_fullsized":"2024-04-26T11:44:21.440187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818647+0000","last_change":"2024-04-26T11:44:21.064980+0000","last_active":"2024-04-26T11:44:22.818647+0000","last_peered":"2024-04-26T11:44:22.818647+0000","last_clean":"2024-04-26T11:44:22.818647+0000","last_became_active":"2024-04-26T11:44:21.064569+0000","last_became_peered":"2024-04-26T11:44:21.064569+0000","last_unstale":"2024-04-26T11:44:22.818647+0000","last_undegraded":"2024-04-26T11:44:22.818647+0000","last_fullsized":"2024-04-26T11:44:22.818647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436303+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:44:22.436303+0000","last_peered":"2024-04-26T11:44:22.436303+0000","last_clean":"2024-04-26T11:44:22.436303+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:44:22.436303+0000","last_undegraded":"2024-04-26T11:44:22.436303+0000","last_fullsized":"2024-04-26T11:44:22.436303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439848+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:44:21.439848+0000","last_peered":"2024-04-26T11:44:21.439848+0000","last_clean":"2024-04-26T11:44:21.439848+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:44:21.439848+0000","last_undegraded":"2024-04-26T11:44:21.439848+0000","last_fullsized":"2024-04-26T11:44:21.439848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818702+0000","last_change":"2024-04-26T11:44:21.066838+0000","last_active":"2024-04-26T11:44:22.818702+0000","last_peered":"2024-04-26T11:44:22.818702+0000","last_clean":"2024-04-26T11:44:22.818702+0000","last_became_active":"2024-04-26T11:44:21.065781+0000","last_became_peered":"2024-04-26T11:44:21.065781+0000","last_unstale":"2024-04-26T11:44:22.818702+0000","last_undegraded":"2024-04-26T11:44:22.818702+0000","last_fullsized":"2024-04-26T11:44:22.818702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435884+0000","last_change":"2024-04-26T11:44:21.439222+0000","last_active":"2024-04-26T11:44:22.435884+0000","last_peered":"2024-04-26T11:44:22.435884+0000","last_clean":"2024-04-26T11:44:22.435884+0000","last_became_active":"2024-04-26T11:44:21.438876+0000","last_became_peered":"2024-04-26T11:44:21.438876+0000","last_unstale":"2024-04-26T11:44:22.435884+0000","last_undegraded":"2024-04-26T11:44:22.435884+0000","last_fullsized":"2024-04-26T11:44:22.435884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.435673+0000","last_change":"2024-04-26T11:44:17.031172+0000","last_active":"2024-04-26T11:44:21.435673+0000","last_peered":"2024-04-26T11:44:21.435673+0000","last_clean":"2024-04-26T11:44:21.435673+0000","last_became_active":"2024-04-26T11:44:17.030306+0000","last_became_peered":"2024-04-26T11:44:17.030306+0000","last_unstale":"2024-04-26T11:44:21.435673+0000","last_undegraded":"2024-04-26T11:44:21.435673+0000","last_fullsized":"2024-04-26T11:44:21.435673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:30.564274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434093+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:44:22.434093+0000","last_peered":"2024-04-26T11:44:22.434093+0000","last_clean":"2024-04-26T11:44:22.434093+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:44:22.434093+0000","last_undegraded":"2024-04-26T11:44:22.434093+0000","last_fullsized":"2024-04-26T11:44:22.434093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819030+0000","last_change":"2024-04-26T11:44:21.440135+0000","last_active":"2024-04-26T11:44:22.819030+0000","last_peered":"2024-04-26T11:44:22.819030+0000","last_clean":"2024-04-26T11:44:22.819030+0000","last_became_active":"2024-04-26T11:44:21.439757+0000","last_became_peered":"2024-04-26T11:44:21.439757+0000","last_unstale":"2024-04-26T11:44:22.819030+0000","last_undegraded":"2024-04-26T11:44:22.819030+0000","last_fullsized":"2024-04-26T11:44:22.819030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.437818+0000","last_change":"2024-04-26T11:44:17.037146+0000","last_active":"2024-04-26T11:44:21.437818+0000","last_peered":"2024-04-26T11:44:21.437818+0000","last_clean":"2024-04-26T11:44:21.437818+0000","last_became_active":"2024-04-26T11:44:17.036196+0000","last_became_peered":"2024-04-26T11:44:17.036196+0000","last_unstale":"2024-04-26T11:44:21.437818+0000","last_undegraded":"2024-04-26T11:44:21.437818+0000","last_fullsized":"2024-04-26T11:44:21.437818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.409299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436401+0000","last_change":"2024-04-26T11:44:21.065821+0000","last_active":"2024-04-26T11:44:22.436401+0000","last_peered":"2024-04-26T11:44:22.436401+0000","last_clean":"2024-04-26T11:44:22.436401+0000","last_became_active":"2024-04-26T11:44:21.065300+0000","last_became_peered":"2024-04-26T11:44:21.065300+0000","last_unstale":"2024-04-26T11:44:22.436401+0000","last_undegraded":"2024-04-26T11:44:22.436401+0000","last_fullsized":"2024-04-26T11:44:22.436401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819416+0000","last_change":"2024-04-26T11:44:21.439526+0000","last_active":"2024-04-26T11:44:22.819416+0000","last_peered":"2024-04-26T11:44:22.819416+0000","last_clean":"2024-04-26T11:44:22.819416+0000","last_became_active":"2024-04-26T11:44:21.438786+0000","last_became_peered":"2024-04-26T11:44:21.438786+0000","last_unstale":"2024-04-26T11:44:22.819416+0000","last_undegraded":"2024-04-26T11:44:22.819416+0000","last_fullsized":"2024-04-26T11:44:22.819416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436395+0000","last_change":"2024-04-26T11:44:21.066276+0000","last_active":"2024-04-26T11:44:22.436395+0000","last_peered":"2024-04-26T11:44:22.436395+0000","last_clean":"2024-04-26T11:44:22.436395+0000","last_became_active":"2024-04-26T11:44:21.065682+0000","last_became_peered":"2024-04-26T11:44:21.065682+0000","last_unstale":"2024-04-26T11:44:22.436395+0000","last_undegraded":"2024-04-26T11:44:22.436395+0000","last_fullsized":"2024-04-26T11:44:22.436395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436324+0000","last_change":"2024-04-26T11:44:17.031782+0000","last_active":"2024-04-26T11:44:21.436324+0000","last_peered":"2024-04-26T11:44:21.436324+0000","last_clean":"2024-04-26T11:44:21.436324+0000","last_became_active":"2024-04-26T11:44:17.030688+0000","last_became_peered":"2024-04-26T11:44:17.030688+0000","last_unstale":"2024-04-26T11:44:21.436324+0000","last_undegraded":"2024-04-26T11:44:21.436324+0000","last_fullsized":"2024-04-26T11:44:21.436324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.289819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434465+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:44:22.434465+0000","last_peered":"2024-04-26T11:44:22.434465+0000","last_clean":"2024-04-26T11:44:22.434465+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:44:22.434465+0000","last_undegraded":"2024-04-26T11:44:22.434465+0000","last_fullsized":"2024-04-26T11:44:22.434465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819493+0000","last_change":"2024-04-26T11:44:21.065142+0000","last_active":"2024-04-26T11:44:22.819493+0000","last_peered":"2024-04-26T11:44:22.819493+0000","last_clean":"2024-04-26T11:44:22.819493+0000","last_became_active":"2024-04-26T11:44:21.064672+0000","last_became_peered":"2024-04-26T11:44:21.064672+0000","last_unstale":"2024-04-26T11:44:22.819493+0000","last_undegraded":"2024-04-26T11:44:22.819493+0000","last_fullsized":"2024-04-26T11:44:22.819493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.433676+0000","last_change":"2024-04-26T11:44:17.031146+0000","last_active":"2024-04-26T11:44:21.433676+0000","last_peered":"2024-04-26T11:44:21.433676+0000","last_clean":"2024-04-26T11:44:21.433676+0000","last_became_active":"2024-04-26T11:44:17.030637+0000","last_became_peered":"2024-04-26T11:44:17.030637+0000","last_unstale":"2024-04-26T11:44:21.433676+0000","last_undegraded":"2024-04-26T11:44:21.433676+0000","last_fullsized":"2024-04-26T11:44:21.433676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434766+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:44:22.434766+0000","last_peered":"2024-04-26T11:44:22.434766+0000","last_clean":"2024-04-26T11:44:22.434766+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:44:22.434766+0000","last_undegraded":"2024-04-26T11:44:22.434766+0000","last_fullsized":"2024-04-26T11:44:22.434766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819801+0000","last_change":"2024-04-26T11:44:21.065483+0000","last_active":"2024-04-26T11:44:22.819801+0000","last_peered":"2024-04-26T11:44:22.819801+0000","last_clean":"2024-04-26T11:44:22.819801+0000","last_became_active":"2024-04-26T11:44:21.064772+0000","last_became_peered":"2024-04-26T11:44:21.064772+0000","last_unstale":"2024-04-26T11:44:22.819801+0000","last_undegraded":"2024-04-26T11:44:22.819801+0000","last_fullsized":"2024-04-26T11:44:22.819801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436718+0000","last_change":"2024-04-26T11:44:17.031358+0000","last_active":"2024-04-26T11:44:21.436718+0000","last_peered":"2024-04-26T11:44:21.436718+0000","last_clean":"2024-04-26T11:44:21.436718+0000","last_became_active":"2024-04-26T11:44:17.030413+0000","last_became_peered":"2024-04-26T11:44:17.030413+0000","last_unstale":"2024-04-26T11:44:21.436718+0000","last_undegraded":"2024-04-26T11:44:21.436718+0000","last_fullsized":"2024-04-26T11:44:21.436718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817817+0000","last_change":"2024-04-26T11:44:21.444989+0000","last_active":"2024-04-26T11:44:22.817817+0000","last_peered":"2024-04-26T11:44:22.817817+0000","last_clean":"2024-04-26T11:44:22.817817+0000","last_became_active":"2024-04-26T11:44:21.444418+0000","last_became_peered":"2024-04-26T11:44:21.444418+0000","last_unstale":"2024-04-26T11:44:22.817817+0000","last_undegraded":"2024-04-26T11:44:22.817817+0000","last_fullsized":"2024-04-26T11:44:22.817817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820131+0000","last_change":"2024-04-26T11:44:21.067525+0000","last_active":"2024-04-26T11:44:22.820131+0000","last_peered":"2024-04-26T11:44:22.820131+0000","last_clean":"2024-04-26T11:44:22.820131+0000","last_became_active":"2024-04-26T11:44:21.065923+0000","last_became_peered":"2024-04-26T11:44:21.065923+0000","last_unstale":"2024-04-26T11:44:22.820131+0000","last_undegraded":"2024-04-26T11:44:22.820131+0000","last_fullsized":"2024-04-26T11:44:22.820131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439731+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:44:21.439731+0000","last_peered":"2024-04-26T11:44:21.439731+0000","last_clean":"2024-04-26T11:44:21.439731+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:44:21.439731+0000","last_undegraded":"2024-04-26T11:44:21.439731+0000","last_fullsized":"2024-04-26T11:44:21.439731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434002+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:44:22.434002+0000","last_peered":"2024-04-26T11:44:22.434002+0000","last_clean":"2024-04-26T11:44:22.434002+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:44:22.434002+0000","last_undegraded":"2024-04-26T11:44:22.434002+0000","last_fullsized":"2024-04-26T11:44:22.434002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435702+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:44:22.435702+0000","last_peered":"2024-04-26T11:44:22.435702+0000","last_clean":"2024-04-26T11:44:22.435702+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:44:22.435702+0000","last_undegraded":"2024-04-26T11:44:22.435702+0000","last_fullsized":"2024-04-26T11:44:22.435702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435885+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:44:22.435885+0000","last_peered":"2024-04-26T11:44:22.435885+0000","last_clean":"2024-04-26T11:44:22.435885+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:44:22.435885+0000","last_undegraded":"2024-04-26T11:44:22.435885+0000","last_fullsized":"2024-04-26T11:44:22.435885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817896+0000","last_change":"2024-04-26T11:44:21.437907+0000","last_active":"2024-04-26T11:44:22.817896+0000","last_peered":"2024-04-26T11:44:22.817896+0000","last_clean":"2024-04-26T11:44:22.817896+0000","last_became_active":"2024-04-26T11:44:21.437024+0000","last_became_peered":"2024-04-26T11:44:21.437024+0000","last_unstale":"2024-04-26T11:44:22.817896+0000","last_undegraded":"2024-04-26T11:44:22.817896+0000","last_fullsized":"2024-04-26T11:44:22.817896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435937+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:44:22.435937+0000","last_peered":"2024-04-26T11:44:22.435937+0000","last_clean":"2024-04-26T11:44:22.435937+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:44:22.435937+0000","last_undegraded":"2024-04-26T11:44:22.435937+0000","last_fullsized":"2024-04-26T11:44:22.435937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435601+0000","last_change":"2024-04-26T11:44:21.065944+0000","last_active":"2024-04-26T11:44:22.435601+0000","last_peered":"2024-04-26T11:44:22.435601+0000","last_clean":"2024-04-26T11:44:22.435601+0000","last_became_active":"2024-04-26T11:44:21.065251+0000","last_became_peered":"2024-04-26T11:44:21.065251+0000","last_unstale":"2024-04-26T11:44:22.435601+0000","last_undegraded":"2024-04-26T11:44:22.435601+0000","last_fullsized":"2024-04-26T11:44:22.435601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817770+0000","last_change":"2024-04-26T11:44:21.445619+0000","last_active":"2024-04-26T11:44:22.817770+0000","last_peered":"2024-04-26T11:44:22.817770+0000","last_clean":"2024-04-26T11:44:22.817770+0000","last_became_active":"2024-04-26T11:44:21.444597+0000","last_became_peered":"2024-04-26T11:44:21.444597+0000","last_unstale":"2024-04-26T11:44:22.817770+0000","last_undegraded":"2024-04-26T11:44:22.817770+0000","last_fullsized":"2024-04-26T11:44:22.817770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819319+0000","last_change":"2024-04-26T11:44:21.067177+0000","last_active":"2024-04-26T11:44:22.819319+0000","last_peered":"2024-04-26T11:44:22.819319+0000","last_clean":"2024-04-26T11:44:22.819319+0000","last_became_active":"2024-04-26T11:44:21.066727+0000","last_became_peered":"2024-04-26T11:44:21.066727+0000","last_unstale":"2024-04-26T11:44:22.819319+0000","last_undegraded":"2024-04-26T11:44:22.819319+0000","last_fullsized":"2024-04-26T11:44:22.819319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817835+0000","last_change":"2024-04-26T11:44:21.439357+0000","last_active":"2024-04-26T11:44:22.817835+0000","last_peered":"2024-04-26T11:44:22.817835+0000","last_clean":"2024-04-26T11:44:22.817835+0000","last_became_active":"2024-04-26T11:44:21.438703+0000","last_became_peered":"2024-04-26T11:44:21.438703+0000","last_unstale":"2024-04-26T11:44:22.817835+0000","last_undegraded":"2024-04-26T11:44:22.817835+0000","last_fullsized":"2024-04-26T11:44:22.817835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436060+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:44:22.436060+0000","last_peered":"2024-04-26T11:44:22.436060+0000","last_clean":"2024-04-26T11:44:22.436060+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:44:22.436060+0000","last_undegraded":"2024-04-26T11:44:22.436060+0000","last_fullsized":"2024-04-26T11:44:22.436060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818065+0000","last_change":"2024-04-26T11:44:21.065373+0000","last_active":"2024-04-26T11:44:22.818065+0000","last_peered":"2024-04-26T11:44:22.818065+0000","last_clean":"2024-04-26T11:44:22.818065+0000","last_became_active":"2024-04-26T11:44:21.064598+0000","last_became_peered":"2024-04-26T11:44:21.064598+0000","last_unstale":"2024-04-26T11:44:22.818065+0000","last_undegraded":"2024-04-26T11:44:22.818065+0000","last_fullsized":"2024-04-26T11:44:22.818065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819621+0000","last_change":"2024-04-26T11:44:21.445216+0000","last_active":"2024-04-26T11:44:22.819621+0000","last_peered":"2024-04-26T11:44:22.819621+0000","last_clean":"2024-04-26T11:44:22.819621+0000","last_became_active":"2024-04-26T11:44:21.444615+0000","last_became_peered":"2024-04-26T11:44:21.444615+0000","last_unstale":"2024-04-26T11:44:22.819621+0000","last_undegraded":"2024-04-26T11:44:22.819621+0000","last_fullsized":"2024-04-26T11:44:22.819621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818131+0000","last_change":"2024-04-26T11:44:21.066483+0000","last_active":"2024-04-26T11:44:22.818131+0000","last_peered":"2024-04-26T11:44:22.818131+0000","last_clean":"2024-04-26T11:44:22.818131+0000","last_became_active":"2024-04-26T11:44:21.065373+0000","last_became_peered":"2024-04-26T11:44:21.065373+0000","last_unstale":"2024-04-26T11:44:22.818131+0000","last_undegraded":"2024-04-26T11:44:22.818131+0000","last_fullsized":"2024-04-26T11:44:22.818131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435451+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:44:22.435451+0000","last_peered":"2024-04-26T11:44:22.435451+0000","last_clean":"2024-04-26T11:44:22.435451+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:44:22.435451+0000","last_undegraded":"2024-04-26T11:44:22.435451+0000","last_fullsized":"2024-04-26T11:44:22.435451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434803+0000","last_change":"2024-04-26T11:44:21.065431+0000","last_active":"2024-04-26T11:44:22.434803+0000","last_peered":"2024-04-26T11:44:22.434803+0000","last_clean":"2024-04-26T11:44:22.434803+0000","last_became_active":"2024-04-26T11:44:21.065114+0000","last_became_peered":"2024-04-26T11:44:21.065114+0000","last_unstale":"2024-04-26T11:44:22.434803+0000","last_undegraded":"2024-04-26T11:44:22.434803+0000","last_fullsized":"2024-04-26T11:44:22.434803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:39.838237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435212+0000","last_change":"2024-04-26T11:44:21.441795+0000","last_active":"2024-04-26T11:44:22.435212+0000","last_peered":"2024-04-26T11:44:22.435212+0000","last_clean":"2024-04-26T11:44:22.435212+0000","last_became_active":"2024-04-26T11:44:21.441421+0000","last_became_peered":"2024-04-26T11:44:21.441421+0000","last_unstale":"2024-04-26T11:44:22.435212+0000","last_undegraded":"2024-04-26T11:44:22.435212+0000","last_fullsized":"2024-04-26T11:44:22.435212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435013+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:44:22.435013+0000","last_peered":"2024-04-26T11:44:22.435013+0000","last_clean":"2024-04-26T11:44:22.435013+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:44:22.435013+0000","last_undegraded":"2024-04-26T11:44:22.435013+0000","last_fullsized":"2024-04-26T11:44:22.435013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436177+0000","last_change":"2024-04-26T11:44:21.448442+0000","last_active":"2024-04-26T11:44:22.436177+0000","last_peered":"2024-04-26T11:44:22.436177+0000","last_clean":"2024-04-26T11:44:22.436177+0000","last_became_active":"2024-04-26T11:44:21.447770+0000","last_became_peered":"2024-04-26T11:44:21.447770+0000","last_unstale":"2024-04-26T11:44:22.436177+0000","last_undegraded":"2024-04-26T11:44:22.436177+0000","last_fullsized":"2024-04-26T11:44:22.436177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435664+0000","last_change":"2024-04-26T11:44:21.066498+0000","last_active":"2024-04-26T11:44:22.435664+0000","last_peered":"2024-04-26T11:44:22.435664+0000","last_clean":"2024-04-26T11:44:22.435664+0000","last_became_active":"2024-04-26T11:44:21.065945+0000","last_became_peered":"2024-04-26T11:44:21.065945+0000","last_unstale":"2024-04-26T11:44:22.435664+0000","last_undegraded":"2024-04-26T11:44:22.435664+0000","last_fullsized":"2024-04-26T11:44:22.435664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434988+0000","last_change":"2024-04-26T11:44:21.448777+0000","last_active":"2024-04-26T11:44:22.434988+0000","last_peered":"2024-04-26T11:44:22.434988+0000","last_clean":"2024-04-26T11:44:22.434988+0000","last_became_active":"2024-04-26T11:44:21.448274+0000","last_became_peered":"2024-04-26T11:44:21.448274+0000","last_unstale":"2024-04-26T11:44:22.434988+0000","last_undegraded":"2024-04-26T11:44:22.434988+0000","last_fullsized":"2024-04-26T11:44:22.434988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435817+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:44:22.435817+0000","last_peered":"2024-04-26T11:44:22.435817+0000","last_clean":"2024-04-26T11:44:22.435817+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:44:22.435817+0000","last_undegraded":"2024-04-26T11:44:22.435817+0000","last_fullsized":"2024-04-26T11:44:22.435817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434476+0000","last_change":"2024-04-26T11:44:21.438183+0000","last_active":"2024-04-26T11:44:22.434476+0000","last_peered":"2024-04-26T11:44:22.434476+0000","last_clean":"2024-04-26T11:44:22.434476+0000","last_became_active":"2024-04-26T11:44:21.437823+0000","last_became_peered":"2024-04-26T11:44:21.437823+0000","last_unstale":"2024-04-26T11:44:22.434476+0000","last_undegraded":"2024-04-26T11:44:22.434476+0000","last_fullsized":"2024-04-26T11:44:22.434476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820080+0000","last_change":"2024-04-26T11:44:21.068479+0000","last_active":"2024-04-26T11:44:22.820080+0000","last_peered":"2024-04-26T11:44:22.820080+0000","last_clean":"2024-04-26T11:44:22.820080+0000","last_became_active":"2024-04-26T11:44:21.068206+0000","last_became_peered":"2024-04-26T11:44:21.068206+0000","last_unstale":"2024-04-26T11:44:22.820080+0000","last_undegraded":"2024-04-26T11:44:22.820080+0000","last_fullsized":"2024-04-26T11:44:22.820080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434365+0000","last_change":"2024-04-26T11:44:21.452369+0000","last_active":"2024-04-26T11:44:22.434365+0000","last_peered":"2024-04-26T11:44:22.434365+0000","last_clean":"2024-04-26T11:44:22.434365+0000","last_became_active":"2024-04-26T11:44:21.451833+0000","last_became_peered":"2024-04-26T11:44:21.451833+0000","last_unstale":"2024-04-26T11:44:22.434365+0000","last_undegraded":"2024-04-26T11:44:22.434365+0000","last_fullsized":"2024-04-26T11:44:22.434365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819101+0000","last_change":"2024-04-26T11:44:21.068300+0000","last_active":"2024-04-26T11:44:22.819101+0000","last_peered":"2024-04-26T11:44:22.819101+0000","last_clean":"2024-04-26T11:44:22.819101+0000","last_became_active":"2024-04-26T11:44:21.067285+0000","last_became_peered":"2024-04-26T11:44:21.067285+0000","last_unstale":"2024-04-26T11:44:22.819101+0000","last_undegraded":"2024-04-26T11:44:22.819101+0000","last_fullsized":"2024-04-26T11:44:22.819101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":790528,"data_stored":650427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":782336,"data_stored":649811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:44:29.894 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:44:30.223 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:44:30.236 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-26T11:44:29.958617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95052,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020468,"statfs":{"total":289910292480,"available":289812959232,"internally_reserved":0,"allocated":1744896,"data_stored":1358551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.537556"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435811+0000","last_change":"2024-04-26T11:44:21.443178+0000","last_active":"2024-04-26T11:44:22.435811+0000","last_peered":"2024-04-26T11:44:22.435811+0000","last_clean":"2024-04-26T11:44:22.435811+0000","last_became_active":"2024-04-26T11:44:21.442734+0000","last_became_peered":"2024-04-26T11:44:21.442734+0000","last_unstale":"2024-04-26T11:44:22.435811+0000","last_undegraded":"2024-04-26T11:44:22.435811+0000","last_fullsized":"2024-04-26T11:44:22.435811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435342+0000","last_change":"2024-04-26T11:44:21.442473+0000","last_active":"2024-04-26T11:44:22.435342+0000","last_peered":"2024-04-26T11:44:22.435342+0000","last_clean":"2024-04-26T11:44:22.435342+0000","last_became_active":"2024-04-26T11:44:21.441778+0000","last_became_peered":"2024-04-26T11:44:21.441778+0000","last_unstale":"2024-04-26T11:44:22.435342+0000","last_undegraded":"2024-04-26T11:44:22.435342+0000","last_fullsized":"2024-04-26T11:44:22.435342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435827+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:44:22.435827+0000","last_peered":"2024-04-26T11:44:22.435827+0000","last_clean":"2024-04-26T11:44:22.435827+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:44:22.435827+0000","last_undegraded":"2024-04-26T11:44:22.435827+0000","last_fullsized":"2024-04-26T11:44:22.435827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435163+0000","last_change":"2024-04-26T11:44:21.448849+0000","last_active":"2024-04-26T11:44:22.435163+0000","last_peered":"2024-04-26T11:44:22.435163+0000","last_clean":"2024-04-26T11:44:22.435163+0000","last_became_active":"2024-04-26T11:44:21.447398+0000","last_became_peered":"2024-04-26T11:44:21.447398+0000","last_unstale":"2024-04-26T11:44:22.435163+0000","last_undegraded":"2024-04-26T11:44:22.435163+0000","last_fullsized":"2024-04-26T11:44:22.435163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:02.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434980+0000","last_change":"2024-04-26T11:44:21.441647+0000","last_active":"2024-04-26T11:44:22.434980+0000","last_peered":"2024-04-26T11:44:22.434980+0000","last_clean":"2024-04-26T11:44:22.434980+0000","last_became_active":"2024-04-26T11:44:21.441237+0000","last_became_peered":"2024-04-26T11:44:21.441237+0000","last_unstale":"2024-04-26T11:44:22.434980+0000","last_undegraded":"2024-04-26T11:44:22.434980+0000","last_fullsized":"2024-04-26T11:44:22.434980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434482+0000","last_change":"2024-04-26T11:44:21.447786+0000","last_active":"2024-04-26T11:44:22.434482+0000","last_peered":"2024-04-26T11:44:22.434482+0000","last_clean":"2024-04-26T11:44:22.434482+0000","last_became_active":"2024-04-26T11:44:21.447367+0000","last_became_peered":"2024-04-26T11:44:21.447367+0000","last_unstale":"2024-04-26T11:44:22.434482+0000","last_undegraded":"2024-04-26T11:44:22.434482+0000","last_fullsized":"2024-04-26T11:44:22.434482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434713+0000","last_change":"2024-04-26T11:44:21.448136+0000","last_active":"2024-04-26T11:44:22.434713+0000","last_peered":"2024-04-26T11:44:22.434713+0000","last_clean":"2024-04-26T11:44:22.434713+0000","last_became_active":"2024-04-26T11:44:21.447382+0000","last_became_peered":"2024-04-26T11:44:21.447382+0000","last_unstale":"2024-04-26T11:44:22.434713+0000","last_undegraded":"2024-04-26T11:44:22.434713+0000","last_fullsized":"2024-04-26T11:44:22.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433838+0000","last_change":"2024-04-26T11:44:21.448950+0000","last_active":"2024-04-26T11:44:22.433838+0000","last_peered":"2024-04-26T11:44:22.433838+0000","last_clean":"2024-04-26T11:44:22.433838+0000","last_became_active":"2024-04-26T11:44:21.447975+0000","last_became_peered":"2024-04-26T11:44:21.447975+0000","last_unstale":"2024-04-26T11:44:22.433838+0000","last_undegraded":"2024-04-26T11:44:22.433838+0000","last_fullsized":"2024-04-26T11:44:22.433838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:07.109775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818672+0000","last_change":"2024-04-26T11:44:21.446676+0000","last_active":"2024-04-26T11:44:22.818672+0000","last_peered":"2024-04-26T11:44:22.818672+0000","last_clean":"2024-04-26T11:44:22.818672+0000","last_became_active":"2024-04-26T11:44:21.445874+0000","last_became_peered":"2024-04-26T11:44:21.445874+0000","last_unstale":"2024-04-26T11:44:22.818672+0000","last_undegraded":"2024-04-26T11:44:22.818672+0000","last_fullsized":"2024-04-26T11:44:22.818672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435569+0000","last_change":"2024-04-26T11:44:21.441552+0000","last_active":"2024-04-26T11:44:22.435569+0000","last_peered":"2024-04-26T11:44:22.435569+0000","last_clean":"2024-04-26T11:44:22.435569+0000","last_became_active":"2024-04-26T11:44:21.441047+0000","last_became_peered":"2024-04-26T11:44:21.441047+0000","last_unstale":"2024-04-26T11:44:22.435569+0000","last_undegraded":"2024-04-26T11:44:22.435569+0000","last_fullsized":"2024-04-26T11:44:22.435569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435826+0000","last_change":"2024-04-26T11:44:21.448723+0000","last_active":"2024-04-26T11:44:22.435826+0000","last_peered":"2024-04-26T11:44:22.435826+0000","last_clean":"2024-04-26T11:44:22.435826+0000","last_became_active":"2024-04-26T11:44:21.448275+0000","last_became_peered":"2024-04-26T11:44:21.448275+0000","last_unstale":"2024-04-26T11:44:22.435826+0000","last_undegraded":"2024-04-26T11:44:22.435826+0000","last_fullsized":"2024-04-26T11:44:22.435826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435154+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:44:22.435154+0000","last_peered":"2024-04-26T11:44:22.435154+0000","last_clean":"2024-04-26T11:44:22.435154+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:44:22.435154+0000","last_undegraded":"2024-04-26T11:44:22.435154+0000","last_fullsized":"2024-04-26T11:44:22.435154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434453+0000","last_change":"2024-04-26T11:44:21.441784+0000","last_active":"2024-04-26T11:44:22.434453+0000","last_peered":"2024-04-26T11:44:22.434453+0000","last_clean":"2024-04-26T11:44:22.434453+0000","last_became_active":"2024-04-26T11:44:21.441107+0000","last_became_peered":"2024-04-26T11:44:21.441107+0000","last_unstale":"2024-04-26T11:44:22.434453+0000","last_undegraded":"2024-04-26T11:44:22.434453+0000","last_fullsized":"2024-04-26T11:44:22.434453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434509+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:44:22.434509+0000","last_peered":"2024-04-26T11:44:22.434509+0000","last_clean":"2024-04-26T11:44:22.434509+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:44:22.434509+0000","last_undegraded":"2024-04-26T11:44:22.434509+0000","last_fullsized":"2024-04-26T11:44:22.434509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434815+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:44:22.434815+0000","last_peered":"2024-04-26T11:44:22.434815+0000","last_clean":"2024-04-26T11:44:22.434815+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:44:22.434815+0000","last_undegraded":"2024-04-26T11:44:22.434815+0000","last_fullsized":"2024-04-26T11:44:22.434815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433958+0000","last_change":"2024-04-26T11:44:21.449098+0000","last_active":"2024-04-26T11:44:22.433958+0000","last_peered":"2024-04-26T11:44:22.433958+0000","last_clean":"2024-04-26T11:44:22.433958+0000","last_became_active":"2024-04-26T11:44:21.448517+0000","last_became_peered":"2024-04-26T11:44:21.448517+0000","last_unstale":"2024-04-26T11:44:22.433958+0000","last_undegraded":"2024-04-26T11:44:22.433958+0000","last_fullsized":"2024-04-26T11:44:22.433958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819570+0000","last_change":"2024-04-26T11:44:21.439565+0000","last_active":"2024-04-26T11:44:22.819570+0000","last_peered":"2024-04-26T11:44:22.819570+0000","last_clean":"2024-04-26T11:44:22.819570+0000","last_became_active":"2024-04-26T11:44:21.438640+0000","last_became_peered":"2024-04-26T11:44:21.438640+0000","last_unstale":"2024-04-26T11:44:22.819570+0000","last_undegraded":"2024-04-26T11:44:22.819570+0000","last_fullsized":"2024-04-26T11:44:22.819570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435844+0000","last_change":"2024-04-26T11:44:21.437913+0000","last_active":"2024-04-26T11:44:22.435844+0000","last_peered":"2024-04-26T11:44:22.435844+0000","last_clean":"2024-04-26T11:44:22.435844+0000","last_became_active":"2024-04-26T11:44:21.437543+0000","last_became_peered":"2024-04-26T11:44:21.437543+0000","last_unstale":"2024-04-26T11:44:22.435844+0000","last_undegraded":"2024-04-26T11:44:22.435844+0000","last_fullsized":"2024-04-26T11:44:22.435844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818621+0000","last_change":"2024-04-26T11:44:21.440138+0000","last_active":"2024-04-26T11:44:22.818621+0000","last_peered":"2024-04-26T11:44:22.818621+0000","last_clean":"2024-04-26T11:44:22.818621+0000","last_became_active":"2024-04-26T11:44:21.439850+0000","last_became_peered":"2024-04-26T11:44:21.439850+0000","last_unstale":"2024-04-26T11:44:22.818621+0000","last_undegraded":"2024-04-26T11:44:22.818621+0000","last_fullsized":"2024-04-26T11:44:22.818621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435721+0000","last_change":"2024-04-26T11:44:21.449248+0000","last_active":"2024-04-26T11:44:22.435721+0000","last_peered":"2024-04-26T11:44:22.435721+0000","last_clean":"2024-04-26T11:44:22.435721+0000","last_became_active":"2024-04-26T11:44:21.448315+0000","last_became_peered":"2024-04-26T11:44:21.448315+0000","last_unstale":"2024-04-26T11:44:22.435721+0000","last_undegraded":"2024-04-26T11:44:22.435721+0000","last_fullsized":"2024-04-26T11:44:22.435721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436209+0000","last_change":"2024-04-26T11:44:21.448524+0000","last_active":"2024-04-26T11:44:22.436209+0000","last_peered":"2024-04-26T11:44:22.436209+0000","last_clean":"2024-04-26T11:44:22.436209+0000","last_became_active":"2024-04-26T11:44:21.447839+0000","last_became_peered":"2024-04-26T11:44:21.447839+0000","last_unstale":"2024-04-26T11:44:22.436209+0000","last_undegraded":"2024-04-26T11:44:22.436209+0000","last_fullsized":"2024-04-26T11:44:22.436209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434386+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:44:22.434386+0000","last_peered":"2024-04-26T11:44:22.434386+0000","last_clean":"2024-04-26T11:44:22.434386+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:44:22.434386+0000","last_undegraded":"2024-04-26T11:44:22.434386+0000","last_fullsized":"2024-04-26T11:44:22.434386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817486+0000","last_change":"2024-04-26T11:44:21.445626+0000","last_active":"2024-04-26T11:44:22.817486+0000","last_peered":"2024-04-26T11:44:22.817486+0000","last_clean":"2024-04-26T11:44:22.817486+0000","last_became_active":"2024-04-26T11:44:21.444990+0000","last_became_peered":"2024-04-26T11:44:21.444990+0000","last_unstale":"2024-04-26T11:44:22.817486+0000","last_undegraded":"2024-04-26T11:44:22.817486+0000","last_fullsized":"2024-04-26T11:44:22.817486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433782+0000","last_change":"2024-04-26T11:44:21.441463+0000","last_active":"2024-04-26T11:44:22.433782+0000","last_peered":"2024-04-26T11:44:22.433782+0000","last_clean":"2024-04-26T11:44:22.433782+0000","last_became_active":"2024-04-26T11:44:21.440895+0000","last_became_peered":"2024-04-26T11:44:21.440895+0000","last_unstale":"2024-04-26T11:44:22.433782+0000","last_undegraded":"2024-04-26T11:44:22.433782+0000","last_fullsized":"2024-04-26T11:44:22.433782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435906+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:44:22.435906+0000","last_peered":"2024-04-26T11:44:22.435906+0000","last_clean":"2024-04-26T11:44:22.435906+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:44:22.435906+0000","last_undegraded":"2024-04-26T11:44:22.435906+0000","last_fullsized":"2024-04-26T11:44:22.435906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819879+0000","last_change":"2024-04-26T11:44:21.444826+0000","last_active":"2024-04-26T11:44:22.819879+0000","last_peered":"2024-04-26T11:44:22.819879+0000","last_clean":"2024-04-26T11:44:22.819879+0000","last_became_active":"2024-04-26T11:44:21.444440+0000","last_became_peered":"2024-04-26T11:44:21.444440+0000","last_unstale":"2024-04-26T11:44:22.819879+0000","last_undegraded":"2024-04-26T11:44:22.819879+0000","last_fullsized":"2024-04-26T11:44:22.819879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436032+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:44:22.436032+0000","last_peered":"2024-04-26T11:44:22.436032+0000","last_clean":"2024-04-26T11:44:22.436032+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:44:22.436032+0000","last_undegraded":"2024-04-26T11:44:22.436032+0000","last_fullsized":"2024-04-26T11:44:22.436032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435465+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:44:22.435465+0000","last_peered":"2024-04-26T11:44:22.435465+0000","last_clean":"2024-04-26T11:44:22.435465+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:44:22.435465+0000","last_undegraded":"2024-04-26T11:44:22.435465+0000","last_fullsized":"2024-04-26T11:44:22.435465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819067+0000","last_change":"2024-04-26T11:44:21.439511+0000","last_active":"2024-04-26T11:44:22.819067+0000","last_peered":"2024-04-26T11:44:22.819067+0000","last_clean":"2024-04-26T11:44:22.819067+0000","last_became_active":"2024-04-26T11:44:21.438539+0000","last_became_peered":"2024-04-26T11:44:21.438539+0000","last_unstale":"2024-04-26T11:44:22.819067+0000","last_undegraded":"2024-04-26T11:44:22.819067+0000","last_fullsized":"2024-04-26T11:44:22.819067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434754+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:44:22.434754+0000","last_peered":"2024-04-26T11:44:22.434754+0000","last_clean":"2024-04-26T11:44:22.434754+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:44:22.434754+0000","last_undegraded":"2024-04-26T11:44:22.434754+0000","last_fullsized":"2024-04-26T11:44:22.434754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817638+0000","last_change":"2024-04-26T11:44:21.439772+0000","last_active":"2024-04-26T11:44:22.817638+0000","last_peered":"2024-04-26T11:44:22.817638+0000","last_clean":"2024-04-26T11:44:22.817638+0000","last_became_active":"2024-04-26T11:44:21.438770+0000","last_became_peered":"2024-04-26T11:44:21.438770+0000","last_unstale":"2024-04-26T11:44:22.817638+0000","last_undegraded":"2024-04-26T11:44:22.817638+0000","last_fullsized":"2024-04-26T11:44:22.817638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434091+0000","last_change":"2024-04-26T11:44:21.452228+0000","last_active":"2024-04-26T11:44:22.434091+0000","last_peered":"2024-04-26T11:44:22.434091+0000","last_clean":"2024-04-26T11:44:22.434091+0000","last_became_active":"2024-04-26T11:44:21.451258+0000","last_became_peered":"2024-04-26T11:44:21.451258+0000","last_unstale":"2024-04-26T11:44:22.434091+0000","last_undegraded":"2024-04-26T11:44:22.434091+0000","last_fullsized":"2024-04-26T11:44:22.434091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435434+0000","last_change":"2024-04-26T11:44:21.438961+0000","last_active":"2024-04-26T11:44:22.435434+0000","last_peered":"2024-04-26T11:44:22.435434+0000","last_clean":"2024-04-26T11:44:22.435434+0000","last_became_active":"2024-04-26T11:44:21.438124+0000","last_became_peered":"2024-04-26T11:44:21.438124+0000","last_unstale":"2024-04-26T11:44:22.435434+0000","last_undegraded":"2024-04-26T11:44:22.435434+0000","last_fullsized":"2024-04-26T11:44:22.435434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436336+0000","last_change":"2024-04-26T11:44:21.066359+0000","last_active":"2024-04-26T11:44:22.436336+0000","last_peered":"2024-04-26T11:44:22.436336+0000","last_clean":"2024-04-26T11:44:22.436336+0000","last_became_active":"2024-04-26T11:44:21.066007+0000","last_became_peered":"2024-04-26T11:44:21.066007+0000","last_unstale":"2024-04-26T11:44:22.436336+0000","last_undegraded":"2024-04-26T11:44:22.436336+0000","last_fullsized":"2024-04-26T11:44:22.436336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435741+0000","last_change":"2024-04-26T11:44:21.439295+0000","last_active":"2024-04-26T11:44:22.435741+0000","last_peered":"2024-04-26T11:44:22.435741+0000","last_clean":"2024-04-26T11:44:22.435741+0000","last_became_active":"2024-04-26T11:44:21.439097+0000","last_became_peered":"2024-04-26T11:44:21.439097+0000","last_unstale":"2024-04-26T11:44:22.435741+0000","last_undegraded":"2024-04-26T11:44:22.435741+0000","last_fullsized":"2024-04-26T11:44:22.435741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818216+0000","last_change":"2024-04-26T11:44:21.066646+0000","last_active":"2024-04-26T11:44:22.818216+0000","last_peered":"2024-04-26T11:44:22.818216+0000","last_clean":"2024-04-26T11:44:22.818216+0000","last_became_active":"2024-04-26T11:44:21.065981+0000","last_became_peered":"2024-04-26T11:44:21.065981+0000","last_unstale":"2024-04-26T11:44:22.818216+0000","last_undegraded":"2024-04-26T11:44:22.818216+0000","last_fullsized":"2024-04-26T11:44:22.818216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820032+0000","last_change":"2024-04-26T11:44:21.443681+0000","last_active":"2024-04-26T11:44:22.820032+0000","last_peered":"2024-04-26T11:44:22.820032+0000","last_clean":"2024-04-26T11:44:22.820032+0000","last_became_active":"2024-04-26T11:44:21.443253+0000","last_became_peered":"2024-04-26T11:44:21.443253+0000","last_unstale":"2024-04-26T11:44:22.820032+0000","last_undegraded":"2024-04-26T11:44:22.820032+0000","last_fullsized":"2024-04-26T11:44:22.820032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434717+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:44:22.434717+0000","last_peered":"2024-04-26T11:44:22.434717+0000","last_clean":"2024-04-26T11:44:22.434717+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:44:22.434717+0000","last_undegraded":"2024-04-26T11:44:22.434717+0000","last_fullsized":"2024-04-26T11:44:22.434717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818804+0000","last_change":"2024-04-26T11:44:21.445426+0000","last_active":"2024-04-26T11:44:22.818804+0000","last_peered":"2024-04-26T11:44:22.818804+0000","last_clean":"2024-04-26T11:44:22.818804+0000","last_became_active":"2024-04-26T11:44:21.444674+0000","last_became_peered":"2024-04-26T11:44:21.444674+0000","last_unstale":"2024-04-26T11:44:22.818804+0000","last_undegraded":"2024-04-26T11:44:22.818804+0000","last_fullsized":"2024-04-26T11:44:22.818804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434190+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:44:22.434190+0000","last_peered":"2024-04-26T11:44:22.434190+0000","last_clean":"2024-04-26T11:44:22.434190+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:44:22.434190+0000","last_undegraded":"2024-04-26T11:44:22.434190+0000","last_fullsized":"2024-04-26T11:44:22.434190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435770+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:44:22.435770+0000","last_peered":"2024-04-26T11:44:22.435770+0000","last_clean":"2024-04-26T11:44:22.435770+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:44:22.435770+0000","last_undegraded":"2024-04-26T11:44:22.435770+0000","last_fullsized":"2024-04-26T11:44:22.435770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433826+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:44:22.433826+0000","last_peered":"2024-04-26T11:44:22.433826+0000","last_clean":"2024-04-26T11:44:22.433826+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:44:22.433826+0000","last_undegraded":"2024-04-26T11:44:22.433826+0000","last_fullsized":"2024-04-26T11:44:22.433826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436104+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:44:22.436104+0000","last_peered":"2024-04-26T11:44:22.436104+0000","last_clean":"2024-04-26T11:44:22.436104+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:44:22.436104+0000","last_undegraded":"2024-04-26T11:44:22.436104+0000","last_fullsized":"2024-04-26T11:44:22.436104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433901+0000","last_change":"2024-04-26T11:44:21.442188+0000","last_active":"2024-04-26T11:44:22.433901+0000","last_peered":"2024-04-26T11:44:22.433901+0000","last_clean":"2024-04-26T11:44:22.433901+0000","last_became_active":"2024-04-26T11:44:21.441105+0000","last_became_peered":"2024-04-26T11:44:21.441105+0000","last_unstale":"2024-04-26T11:44:22.433901+0000","last_undegraded":"2024-04-26T11:44:22.433901+0000","last_fullsized":"2024-04-26T11:44:22.433901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436283+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:44:22.436283+0000","last_peered":"2024-04-26T11:44:22.436283+0000","last_clean":"2024-04-26T11:44:22.436283+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:44:22.436283+0000","last_undegraded":"2024-04-26T11:44:22.436283+0000","last_fullsized":"2024-04-26T11:44:22.436283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435798+0000","last_change":"2024-04-26T11:44:21.449433+0000","last_active":"2024-04-26T11:44:22.435798+0000","last_peered":"2024-04-26T11:44:22.435798+0000","last_clean":"2024-04-26T11:44:22.435798+0000","last_became_active":"2024-04-26T11:44:21.447831+0000","last_became_peered":"2024-04-26T11:44:21.447831+0000","last_unstale":"2024-04-26T11:44:22.435798+0000","last_undegraded":"2024-04-26T11:44:22.435798+0000","last_fullsized":"2024-04-26T11:44:22.435798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435987+0000","last_change":"2024-04-26T11:44:21.065647+0000","last_active":"2024-04-26T11:44:22.435987+0000","last_peered":"2024-04-26T11:44:22.435987+0000","last_clean":"2024-04-26T11:44:22.435987+0000","last_became_active":"2024-04-26T11:44:21.065197+0000","last_became_peered":"2024-04-26T11:44:21.065197+0000","last_unstale":"2024-04-26T11:44:22.435987+0000","last_undegraded":"2024-04-26T11:44:22.435987+0000","last_fullsized":"2024-04-26T11:44:22.435987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818851+0000","last_change":"2024-04-26T11:44:21.443848+0000","last_active":"2024-04-26T11:44:22.818851+0000","last_peered":"2024-04-26T11:44:22.818851+0000","last_clean":"2024-04-26T11:44:22.818851+0000","last_became_active":"2024-04-26T11:44:21.443580+0000","last_became_peered":"2024-04-26T11:44:21.443580+0000","last_unstale":"2024-04-26T11:44:22.818851+0000","last_undegraded":"2024-04-26T11:44:22.818851+0000","last_fullsized":"2024-04-26T11:44:22.818851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819315+0000","last_change":"2024-04-26T11:44:21.068336+0000","last_active":"2024-04-26T11:44:22.819315+0000","last_peered":"2024-04-26T11:44:22.819315+0000","last_clean":"2024-04-26T11:44:22.819315+0000","last_became_active":"2024-04-26T11:44:21.067530+0000","last_became_peered":"2024-04-26T11:44:21.067530+0000","last_unstale":"2024-04-26T11:44:22.819315+0000","last_undegraded":"2024-04-26T11:44:22.819315+0000","last_fullsized":"2024-04-26T11:44:22.819315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435445+0000","last_change":"2024-04-26T11:44:21.449238+0000","last_active":"2024-04-26T11:44:22.435445+0000","last_peered":"2024-04-26T11:44:22.435445+0000","last_clean":"2024-04-26T11:44:22.435445+0000","last_became_active":"2024-04-26T11:44:21.447694+0000","last_became_peered":"2024-04-26T11:44:21.447694+0000","last_unstale":"2024-04-26T11:44:22.435445+0000","last_undegraded":"2024-04-26T11:44:22.435445+0000","last_fullsized":"2024-04-26T11:44:22.435445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435196+0000","last_change":"2024-04-26T11:44:21.066212+0000","last_active":"2024-04-26T11:44:22.435196+0000","last_peered":"2024-04-26T11:44:22.435196+0000","last_clean":"2024-04-26T11:44:22.435196+0000","last_became_active":"2024-04-26T11:44:21.065186+0000","last_became_peered":"2024-04-26T11:44:21.065186+0000","last_unstale":"2024-04-26T11:44:22.435196+0000","last_undegraded":"2024-04-26T11:44:22.435196+0000","last_fullsized":"2024-04-26T11:44:22.435196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436154+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:44:22.436154+0000","last_peered":"2024-04-26T11:44:22.436154+0000","last_clean":"2024-04-26T11:44:22.436154+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:44:22.436154+0000","last_undegraded":"2024-04-26T11:44:22.436154+0000","last_fullsized":"2024-04-26T11:44:22.436154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434230+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:44:22.434230+0000","last_peered":"2024-04-26T11:44:22.434230+0000","last_clean":"2024-04-26T11:44:22.434230+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:44:22.434230+0000","last_undegraded":"2024-04-26T11:44:22.434230+0000","last_fullsized":"2024-04-26T11:44:22.434230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435383+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:44:22.435383+0000","last_peered":"2024-04-26T11:44:22.435383+0000","last_clean":"2024-04-26T11:44:22.435383+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:44:22.435383+0000","last_undegraded":"2024-04-26T11:44:22.435383+0000","last_fullsized":"2024-04-26T11:44:22.435383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434021+0000","last_change":"2024-04-26T11:44:21.065486+0000","last_active":"2024-04-26T11:44:22.434021+0000","last_peered":"2024-04-26T11:44:22.434021+0000","last_clean":"2024-04-26T11:44:22.434021+0000","last_became_active":"2024-04-26T11:44:21.065090+0000","last_became_peered":"2024-04-26T11:44:21.065090+0000","last_unstale":"2024-04-26T11:44:22.434021+0000","last_undegraded":"2024-04-26T11:44:22.434021+0000","last_fullsized":"2024-04-26T11:44:22.434021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:03.456923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818894+0000","last_change":"2024-04-26T11:44:21.446431+0000","last_active":"2024-04-26T11:44:22.818894+0000","last_peered":"2024-04-26T11:44:22.818894+0000","last_clean":"2024-04-26T11:44:22.818894+0000","last_became_active":"2024-04-26T11:44:21.445866+0000","last_became_peered":"2024-04-26T11:44:21.445866+0000","last_unstale":"2024-04-26T11:44:22.818894+0000","last_undegraded":"2024-04-26T11:44:22.818894+0000","last_fullsized":"2024-04-26T11:44:22.818894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440035+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:44:21.440035+0000","last_peered":"2024-04-26T11:44:21.440035+0000","last_clean":"2024-04-26T11:44:21.440035+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:44:21.440035+0000","last_undegraded":"2024-04-26T11:44:21.440035+0000","last_fullsized":"2024-04-26T11:44:21.440035+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440187+0000","last_change":"2024-04-26T11:44:17.037102+0000","last_active":"2024-04-26T11:44:21.440187+0000","last_peered":"2024-04-26T11:44:21.440187+0000","last_clean":"2024-04-26T11:44:21.440187+0000","last_became_active":"2024-04-26T11:44:17.036242+0000","last_became_peered":"2024-04-26T11:44:17.036242+0000","last_unstale":"2024-04-26T11:44:21.440187+0000","last_undegraded":"2024-04-26T11:44:21.440187+0000","last_fullsized":"2024-04-26T11:44:21.440187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818647+0000","last_change":"2024-04-26T11:44:21.064980+0000","last_active":"2024-04-26T11:44:22.818647+0000","last_peered":"2024-04-26T11:44:22.818647+0000","last_clean":"2024-04-26T11:44:22.818647+0000","last_became_active":"2024-04-26T11:44:21.064569+0000","last_became_peered":"2024-04-26T11:44:21.064569+0000","last_unstale":"2024-04-26T11:44:22.818647+0000","last_undegraded":"2024-04-26T11:44:22.818647+0000","last_fullsized":"2024-04-26T11:44:22.818647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436303+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:44:22.436303+0000","last_peered":"2024-04-26T11:44:22.436303+0000","last_clean":"2024-04-26T11:44:22.436303+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:44:22.436303+0000","last_undegraded":"2024-04-26T11:44:22.436303+0000","last_fullsized":"2024-04-26T11:44:22.436303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439848+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:44:21.439848+0000","last_peered":"2024-04-26T11:44:21.439848+0000","last_clean":"2024-04-26T11:44:21.439848+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:44:21.439848+0000","last_undegraded":"2024-04-26T11:44:21.439848+0000","last_fullsized":"2024-04-26T11:44:21.439848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818702+0000","last_change":"2024-04-26T11:44:21.066838+0000","last_active":"2024-04-26T11:44:22.818702+0000","last_peered":"2024-04-26T11:44:22.818702+0000","last_clean":"2024-04-26T11:44:22.818702+0000","last_became_active":"2024-04-26T11:44:21.065781+0000","last_became_peered":"2024-04-26T11:44:21.065781+0000","last_unstale":"2024-04-26T11:44:22.818702+0000","last_undegraded":"2024-04-26T11:44:22.818702+0000","last_fullsized":"2024-04-26T11:44:22.818702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435884+0000","last_change":"2024-04-26T11:44:21.439222+0000","last_active":"2024-04-26T11:44:22.435884+0000","last_peered":"2024-04-26T11:44:22.435884+0000","last_clean":"2024-04-26T11:44:22.435884+0000","last_became_active":"2024-04-26T11:44:21.438876+0000","last_became_peered":"2024-04-26T11:44:21.438876+0000","last_unstale":"2024-04-26T11:44:22.435884+0000","last_undegraded":"2024-04-26T11:44:22.435884+0000","last_fullsized":"2024-04-26T11:44:22.435884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.435673+0000","last_change":"2024-04-26T11:44:17.031172+0000","last_active":"2024-04-26T11:44:21.435673+0000","last_peered":"2024-04-26T11:44:21.435673+0000","last_clean":"2024-04-26T11:44:21.435673+0000","last_became_active":"2024-04-26T11:44:17.030306+0000","last_became_peered":"2024-04-26T11:44:17.030306+0000","last_unstale":"2024-04-26T11:44:21.435673+0000","last_undegraded":"2024-04-26T11:44:21.435673+0000","last_fullsized":"2024-04-26T11:44:21.435673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:30.564274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434093+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:44:22.434093+0000","last_peered":"2024-04-26T11:44:22.434093+0000","last_clean":"2024-04-26T11:44:22.434093+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:44:22.434093+0000","last_undegraded":"2024-04-26T11:44:22.434093+0000","last_fullsized":"2024-04-26T11:44:22.434093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819030+0000","last_change":"2024-04-26T11:44:21.440135+0000","last_active":"2024-04-26T11:44:22.819030+0000","last_peered":"2024-04-26T11:44:22.819030+0000","last_clean":"2024-04-26T11:44:22.819030+0000","last_became_active":"2024-04-26T11:44:21.439757+0000","last_became_peered":"2024-04-26T11:44:21.439757+0000","last_unstale":"2024-04-26T11:44:22.819030+0000","last_undegraded":"2024-04-26T11:44:22.819030+0000","last_fullsized":"2024-04-26T11:44:22.819030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.437818+0000","last_change":"2024-04-26T11:44:17.037146+0000","last_active":"2024-04-26T11:44:21.437818+0000","last_peered":"2024-04-26T11:44:21.437818+0000","last_clean":"2024-04-26T11:44:21.437818+0000","last_became_active":"2024-04-26T11:44:17.036196+0000","last_became_peered":"2024-04-26T11:44:17.036196+0000","last_unstale":"2024-04-26T11:44:21.437818+0000","last_undegraded":"2024-04-26T11:44:21.437818+0000","last_fullsized":"2024-04-26T11:44:21.437818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.409299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436401+0000","last_change":"2024-04-26T11:44:21.065821+0000","last_active":"2024-04-26T11:44:22.436401+0000","last_peered":"2024-04-26T11:44:22.436401+0000","last_clean":"2024-04-26T11:44:22.436401+0000","last_became_active":"2024-04-26T11:44:21.065300+0000","last_became_peered":"2024-04-26T11:44:21.065300+0000","last_unstale":"2024-04-26T11:44:22.436401+0000","last_undegraded":"2024-04-26T11:44:22.436401+0000","last_fullsized":"2024-04-26T11:44:22.436401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819416+0000","last_change":"2024-04-26T11:44:21.439526+0000","last_active":"2024-04-26T11:44:22.819416+0000","last_peered":"2024-04-26T11:44:22.819416+0000","last_clean":"2024-04-26T11:44:22.819416+0000","last_became_active":"2024-04-26T11:44:21.438786+0000","last_became_peered":"2024-04-26T11:44:21.438786+0000","last_unstale":"2024-04-26T11:44:22.819416+0000","last_undegraded":"2024-04-26T11:44:22.819416+0000","last_fullsized":"2024-04-26T11:44:22.819416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436395+0000","last_change":"2024-04-26T11:44:21.066276+0000","last_active":"2024-04-26T11:44:22.436395+0000","last_peered":"2024-04-26T11:44:22.436395+0000","last_clean":"2024-04-26T11:44:22.436395+0000","last_became_active":"2024-04-26T11:44:21.065682+0000","last_became_peered":"2024-04-26T11:44:21.065682+0000","last_unstale":"2024-04-26T11:44:22.436395+0000","last_undegraded":"2024-04-26T11:44:22.436395+0000","last_fullsized":"2024-04-26T11:44:22.436395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436324+0000","last_change":"2024-04-26T11:44:17.031782+0000","last_active":"2024-04-26T11:44:21.436324+0000","last_peered":"2024-04-26T11:44:21.436324+0000","last_clean":"2024-04-26T11:44:21.436324+0000","last_became_active":"2024-04-26T11:44:17.030688+0000","last_became_peered":"2024-04-26T11:44:17.030688+0000","last_unstale":"2024-04-26T11:44:21.436324+0000","last_undegraded":"2024-04-26T11:44:21.436324+0000","last_fullsized":"2024-04-26T11:44:21.436324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.289819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434465+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:44:22.434465+0000","last_peered":"2024-04-26T11:44:22.434465+0000","last_clean":"2024-04-26T11:44:22.434465+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:44:22.434465+0000","last_undegraded":"2024-04-26T11:44:22.434465+0000","last_fullsized":"2024-04-26T11:44:22.434465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819493+0000","last_change":"2024-04-26T11:44:21.065142+0000","last_active":"2024-04-26T11:44:22.819493+0000","last_peered":"2024-04-26T11:44:22.819493+0000","last_clean":"2024-04-26T11:44:22.819493+0000","last_became_active":"2024-04-26T11:44:21.064672+0000","last_became_peered":"2024-04-26T11:44:21.064672+0000","last_unstale":"2024-04-26T11:44:22.819493+0000","last_undegraded":"2024-04-26T11:44:22.819493+0000","last_fullsized":"2024-04-26T11:44:22.819493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.433676+0000","last_change":"2024-04-26T11:44:17.031146+0000","last_active":"2024-04-26T11:44:21.433676+0000","last_peered":"2024-04-26T11:44:21.433676+0000","last_clean":"2024-04-26T11:44:21.433676+0000","last_became_active":"2024-04-26T11:44:17.030637+0000","last_became_peered":"2024-04-26T11:44:17.030637+0000","last_unstale":"2024-04-26T11:44:21.433676+0000","last_undegraded":"2024-04-26T11:44:21.433676+0000","last_fullsized":"2024-04-26T11:44:21.433676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434766+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:44:22.434766+0000","last_peered":"2024-04-26T11:44:22.434766+0000","last_clean":"2024-04-26T11:44:22.434766+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:44:22.434766+0000","last_undegraded":"2024-04-26T11:44:22.434766+0000","last_fullsized":"2024-04-26T11:44:22.434766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819801+0000","last_change":"2024-04-26T11:44:21.065483+0000","last_active":"2024-04-26T11:44:22.819801+0000","last_peered":"2024-04-26T11:44:22.819801+0000","last_clean":"2024-04-26T11:44:22.819801+0000","last_became_active":"2024-04-26T11:44:21.064772+0000","last_became_peered":"2024-04-26T11:44:21.064772+0000","last_unstale":"2024-04-26T11:44:22.819801+0000","last_undegraded":"2024-04-26T11:44:22.819801+0000","last_fullsized":"2024-04-26T11:44:22.819801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436718+0000","last_change":"2024-04-26T11:44:17.031358+0000","last_active":"2024-04-26T11:44:21.436718+0000","last_peered":"2024-04-26T11:44:21.436718+0000","last_clean":"2024-04-26T11:44:21.436718+0000","last_became_active":"2024-04-26T11:44:17.030413+0000","last_became_peered":"2024-04-26T11:44:17.030413+0000","last_unstale":"2024-04-26T11:44:21.436718+0000","last_undegraded":"2024-04-26T11:44:21.436718+0000","last_fullsized":"2024-04-26T11:44:21.436718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817817+0000","last_change":"2024-04-26T11:44:21.444989+0000","last_active":"2024-04-26T11:44:22.817817+0000","last_peered":"2024-04-26T11:44:22.817817+0000","last_clean":"2024-04-26T11:44:22.817817+0000","last_became_active":"2024-04-26T11:44:21.444418+0000","last_became_peered":"2024-04-26T11:44:21.444418+0000","last_unstale":"2024-04-26T11:44:22.817817+0000","last_undegraded":"2024-04-26T11:44:22.817817+0000","last_fullsized":"2024-04-26T11:44:22.817817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:23.968635+0000","last_change":"2024-04-26T11:44:21.067525+0000","last_active":"2024-04-26T11:44:23.968635+0000","last_peered":"2024-04-26T11:44:23.968635+0000","last_clean":"2024-04-26T11:44:23.968635+0000","last_became_active":"2024-04-26T11:44:21.065923+0000","last_became_peered":"2024-04-26T11:44:21.065923+0000","last_unstale":"2024-04-26T11:44:23.968635+0000","last_undegraded":"2024-04-26T11:44:23.968635+0000","last_fullsized":"2024-04-26T11:44:23.968635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439731+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:44:21.439731+0000","last_peered":"2024-04-26T11:44:21.439731+0000","last_clean":"2024-04-26T11:44:21.439731+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:44:21.439731+0000","last_undegraded":"2024-04-26T11:44:21.439731+0000","last_fullsized":"2024-04-26T11:44:21.439731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434002+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:44:22.434002+0000","last_peered":"2024-04-26T11:44:22.434002+0000","last_clean":"2024-04-26T11:44:22.434002+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:44:22.434002+0000","last_undegraded":"2024-04-26T11:44:22.434002+0000","last_fullsized":"2024-04-26T11:44:22.434002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435702+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:44:22.435702+0000","last_peered":"2024-04-26T11:44:22.435702+0000","last_clean":"2024-04-26T11:44:22.435702+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:44:22.435702+0000","last_undegraded":"2024-04-26T11:44:22.435702+0000","last_fullsized":"2024-04-26T11:44:22.435702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435885+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:44:22.435885+0000","last_peered":"2024-04-26T11:44:22.435885+0000","last_clean":"2024-04-26T11:44:22.435885+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:44:22.435885+0000","last_undegraded":"2024-04-26T11:44:22.435885+0000","last_fullsized":"2024-04-26T11:44:22.435885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817896+0000","last_change":"2024-04-26T11:44:21.437907+0000","last_active":"2024-04-26T11:44:22.817896+0000","last_peered":"2024-04-26T11:44:22.817896+0000","last_clean":"2024-04-26T11:44:22.817896+0000","last_became_active":"2024-04-26T11:44:21.437024+0000","last_became_peered":"2024-04-26T11:44:21.437024+0000","last_unstale":"2024-04-26T11:44:22.817896+0000","last_undegraded":"2024-04-26T11:44:22.817896+0000","last_fullsized":"2024-04-26T11:44:22.817896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435937+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:44:22.435937+0000","last_peered":"2024-04-26T11:44:22.435937+0000","last_clean":"2024-04-26T11:44:22.435937+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:44:22.435937+0000","last_undegraded":"2024-04-26T11:44:22.435937+0000","last_fullsized":"2024-04-26T11:44:22.435937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435601+0000","last_change":"2024-04-26T11:44:21.065944+0000","last_active":"2024-04-26T11:44:22.435601+0000","last_peered":"2024-04-26T11:44:22.435601+0000","last_clean":"2024-04-26T11:44:22.435601+0000","last_became_active":"2024-04-26T11:44:21.065251+0000","last_became_peered":"2024-04-26T11:44:21.065251+0000","last_unstale":"2024-04-26T11:44:22.435601+0000","last_undegraded":"2024-04-26T11:44:22.435601+0000","last_fullsized":"2024-04-26T11:44:22.435601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817770+0000","last_change":"2024-04-26T11:44:21.445619+0000","last_active":"2024-04-26T11:44:22.817770+0000","last_peered":"2024-04-26T11:44:22.817770+0000","last_clean":"2024-04-26T11:44:22.817770+0000","last_became_active":"2024-04-26T11:44:21.444597+0000","last_became_peered":"2024-04-26T11:44:21.444597+0000","last_unstale":"2024-04-26T11:44:22.817770+0000","last_undegraded":"2024-04-26T11:44:22.817770+0000","last_fullsized":"2024-04-26T11:44:22.817770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819319+0000","last_change":"2024-04-26T11:44:21.067177+0000","last_active":"2024-04-26T11:44:22.819319+0000","last_peered":"2024-04-26T11:44:22.819319+0000","last_clean":"2024-04-26T11:44:22.819319+0000","last_became_active":"2024-04-26T11:44:21.066727+0000","last_became_peered":"2024-04-26T11:44:21.066727+0000","last_unstale":"2024-04-26T11:44:22.819319+0000","last_undegraded":"2024-04-26T11:44:22.819319+0000","last_fullsized":"2024-04-26T11:44:22.819319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817835+0000","last_change":"2024-04-26T11:44:21.439357+0000","last_active":"2024-04-26T11:44:22.817835+0000","last_peered":"2024-04-26T11:44:22.817835+0000","last_clean":"2024-04-26T11:44:22.817835+0000","last_became_active":"2024-04-26T11:44:21.438703+0000","last_became_peered":"2024-04-26T11:44:21.438703+0000","last_unstale":"2024-04-26T11:44:22.817835+0000","last_undegraded":"2024-04-26T11:44:22.817835+0000","last_fullsized":"2024-04-26T11:44:22.817835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436060+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:44:22.436060+0000","last_peered":"2024-04-26T11:44:22.436060+0000","last_clean":"2024-04-26T11:44:22.436060+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:44:22.436060+0000","last_undegraded":"2024-04-26T11:44:22.436060+0000","last_fullsized":"2024-04-26T11:44:22.436060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818065+0000","last_change":"2024-04-26T11:44:21.065373+0000","last_active":"2024-04-26T11:44:22.818065+0000","last_peered":"2024-04-26T11:44:22.818065+0000","last_clean":"2024-04-26T11:44:22.818065+0000","last_became_active":"2024-04-26T11:44:21.064598+0000","last_became_peered":"2024-04-26T11:44:21.064598+0000","last_unstale":"2024-04-26T11:44:22.818065+0000","last_undegraded":"2024-04-26T11:44:22.818065+0000","last_fullsized":"2024-04-26T11:44:22.818065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819621+0000","last_change":"2024-04-26T11:44:21.445216+0000","last_active":"2024-04-26T11:44:22.819621+0000","last_peered":"2024-04-26T11:44:22.819621+0000","last_clean":"2024-04-26T11:44:22.819621+0000","last_became_active":"2024-04-26T11:44:21.444615+0000","last_became_peered":"2024-04-26T11:44:21.444615+0000","last_unstale":"2024-04-26T11:44:22.819621+0000","last_undegraded":"2024-04-26T11:44:22.819621+0000","last_fullsized":"2024-04-26T11:44:22.819621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818131+0000","last_change":"2024-04-26T11:44:21.066483+0000","last_active":"2024-04-26T11:44:22.818131+0000","last_peered":"2024-04-26T11:44:22.818131+0000","last_clean":"2024-04-26T11:44:22.818131+0000","last_became_active":"2024-04-26T11:44:21.065373+0000","last_became_peered":"2024-04-26T11:44:21.065373+0000","last_unstale":"2024-04-26T11:44:22.818131+0000","last_undegraded":"2024-04-26T11:44:22.818131+0000","last_fullsized":"2024-04-26T11:44:22.818131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435451+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:44:22.435451+0000","last_peered":"2024-04-26T11:44:22.435451+0000","last_clean":"2024-04-26T11:44:22.435451+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:44:22.435451+0000","last_undegraded":"2024-04-26T11:44:22.435451+0000","last_fullsized":"2024-04-26T11:44:22.435451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434803+0000","last_change":"2024-04-26T11:44:21.065431+0000","last_active":"2024-04-26T11:44:22.434803+0000","last_peered":"2024-04-26T11:44:22.434803+0000","last_clean":"2024-04-26T11:44:22.434803+0000","last_became_active":"2024-04-26T11:44:21.065114+0000","last_became_peered":"2024-04-26T11:44:21.065114+0000","last_unstale":"2024-04-26T11:44:22.434803+0000","last_undegraded":"2024-04-26T11:44:22.434803+0000","last_fullsized":"2024-04-26T11:44:22.434803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:39.838237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435212+0000","last_change":"2024-04-26T11:44:21.441795+0000","last_active":"2024-04-26T11:44:22.435212+0000","last_peered":"2024-04-26T11:44:22.435212+0000","last_clean":"2024-04-26T11:44:22.435212+0000","last_became_active":"2024-04-26T11:44:21.441421+0000","last_became_peered":"2024-04-26T11:44:21.441421+0000","last_unstale":"2024-04-26T11:44:22.435212+0000","last_undegraded":"2024-04-26T11:44:22.435212+0000","last_fullsized":"2024-04-26T11:44:22.435212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435013+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:44:22.435013+0000","last_peered":"2024-04-26T11:44:22.435013+0000","last_clean":"2024-04-26T11:44:22.435013+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:44:22.435013+0000","last_undegraded":"2024-04-26T11:44:22.435013+0000","last_fullsized":"2024-04-26T11:44:22.435013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436177+0000","last_change":"2024-04-26T11:44:21.448442+0000","last_active":"2024-04-26T11:44:22.436177+0000","last_peered":"2024-04-26T11:44:22.436177+0000","last_clean":"2024-04-26T11:44:22.436177+0000","last_became_active":"2024-04-26T11:44:21.447770+0000","last_became_peered":"2024-04-26T11:44:21.447770+0000","last_unstale":"2024-04-26T11:44:22.436177+0000","last_undegraded":"2024-04-26T11:44:22.436177+0000","last_fullsized":"2024-04-26T11:44:22.436177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435664+0000","last_change":"2024-04-26T11:44:21.066498+0000","last_active":"2024-04-26T11:44:22.435664+0000","last_peered":"2024-04-26T11:44:22.435664+0000","last_clean":"2024-04-26T11:44:22.435664+0000","last_became_active":"2024-04-26T11:44:21.065945+0000","last_became_peered":"2024-04-26T11:44:21.065945+0000","last_unstale":"2024-04-26T11:44:22.435664+0000","last_undegraded":"2024-04-26T11:44:22.435664+0000","last_fullsized":"2024-04-26T11:44:22.435664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434988+0000","last_change":"2024-04-26T11:44:21.448777+0000","last_active":"2024-04-26T11:44:22.434988+0000","last_peered":"2024-04-26T11:44:22.434988+0000","last_clean":"2024-04-26T11:44:22.434988+0000","last_became_active":"2024-04-26T11:44:21.448274+0000","last_became_peered":"2024-04-26T11:44:21.448274+0000","last_unstale":"2024-04-26T11:44:22.434988+0000","last_undegraded":"2024-04-26T11:44:22.434988+0000","last_fullsized":"2024-04-26T11:44:22.434988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435817+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:44:22.435817+0000","last_peered":"2024-04-26T11:44:22.435817+0000","last_clean":"2024-04-26T11:44:22.435817+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:44:22.435817+0000","last_undegraded":"2024-04-26T11:44:22.435817+0000","last_fullsized":"2024-04-26T11:44:22.435817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434476+0000","last_change":"2024-04-26T11:44:21.438183+0000","last_active":"2024-04-26T11:44:22.434476+0000","last_peered":"2024-04-26T11:44:22.434476+0000","last_clean":"2024-04-26T11:44:22.434476+0000","last_became_active":"2024-04-26T11:44:21.437823+0000","last_became_peered":"2024-04-26T11:44:21.437823+0000","last_unstale":"2024-04-26T11:44:22.434476+0000","last_undegraded":"2024-04-26T11:44:22.434476+0000","last_fullsized":"2024-04-26T11:44:22.434476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820080+0000","last_change":"2024-04-26T11:44:21.068479+0000","last_active":"2024-04-26T11:44:22.820080+0000","last_peered":"2024-04-26T11:44:22.820080+0000","last_clean":"2024-04-26T11:44:22.820080+0000","last_became_active":"2024-04-26T11:44:21.068206+0000","last_became_peered":"2024-04-26T11:44:21.068206+0000","last_unstale":"2024-04-26T11:44:22.820080+0000","last_undegraded":"2024-04-26T11:44:22.820080+0000","last_fullsized":"2024-04-26T11:44:22.820080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434365+0000","last_change":"2024-04-26T11:44:21.452369+0000","last_active":"2024-04-26T11:44:22.434365+0000","last_peered":"2024-04-26T11:44:22.434365+0000","last_clean":"2024-04-26T11:44:22.434365+0000","last_became_active":"2024-04-26T11:44:21.451833+0000","last_became_peered":"2024-04-26T11:44:21.451833+0000","last_unstale":"2024-04-26T11:44:22.434365+0000","last_undegraded":"2024-04-26T11:44:22.434365+0000","last_fullsized":"2024-04-26T11:44:22.434365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819101+0000","last_change":"2024-04-26T11:44:21.068300+0000","last_active":"2024-04-26T11:44:22.819101+0000","last_peered":"2024-04-26T11:44:22.819101+0000","last_clean":"2024-04-26T11:44:22.819101+0000","last_became_active":"2024-04-26T11:44:21.067285+0000","last_became_peered":"2024-04-26T11:44:21.067285+0000","last_unstale":"2024-04-26T11:44:22.819101+0000","last_undegraded":"2024-04-26T11:44:22.819101+0000","last_fullsized":"2024-04-26T11:44:22.819101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":790528,"data_stored":650427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":782336,"data_stored":649811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:44:30.241 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T11:44:30.241 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T11:44:30.241 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T11:44:30.241 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T11:44:30.242 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T11:44:30.579 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:30.592 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":17153},{"type":"v1","addr":"172.21.15.29:6801","nonce":17153}]},"active_addr":"172.21.15.29:6801/17153","active_change":"2024-04-26T11:44:05.944083+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":3715899016}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":2641812741}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":3314994349}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":2306172330}]}]} 2024-04-26T11:44:30.595 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T11:44:30.595 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T11:44:30.595 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:30.904 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:30.904 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:22.421187+0000","last_up_change":"2024-04-26T11:44:08.882935+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:30.919 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T11:44:30.919 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:31.222 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:31.222 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:22.421187+0000","last_up_change":"2024-04-26T11:44:08.882935+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:31.238 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T11:44:31.238 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T11:44:31.239 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T11:44:31.382 INFO:teuthology.orchestra.run.smithi029.stdout:34359738375 2024-04-26T11:44:31.383 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:44:31.393 INFO:teuthology.orchestra.run.smithi029.stdout:34359738376 2024-04-26T11:44:31.394 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:44:31.399 INFO:teuthology.orchestra.run.smithi029.stdout:34359738374 2024-04-26T11:44:31.400 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:44:31.698 INFO:teuthology.orchestra.run.smithi029.stdout:34359738373 2024-04-26T11:44:31.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-04-26T11:44:31.716 INFO:teuthology.orchestra.run.smithi029.stdout:34359738375 2024-04-26T11:44:31.723 INFO:teuthology.orchestra.run.smithi029.stdout:34359738374 2024-04-26T11:44:31.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.2 2024-04-26T11:44:31.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2024-04-26T11:44:32.715 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:44:32.731 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:44:32.738 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:44:33.049 INFO:teuthology.orchestra.run.smithi029.stdout:34359738375 2024-04-26T11:44:33.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-04-26T11:44:33.069 DEBUG:teuthology.parallel:result is None 2024-04-26T11:44:33.078 INFO:teuthology.orchestra.run.smithi029.stdout:34359738376 2024-04-26T11:44:33.079 INFO:teuthology.orchestra.run.smithi029.stdout:34359738374 2024-04-26T11:44:33.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.2 2024-04-26T11:44:33.092 DEBUG:teuthology.parallel:result is None 2024-04-26T11:44:33.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-04-26T11:44:33.097 DEBUG:teuthology.parallel:result is None 2024-04-26T11:44:33.097 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T11:44:33.098 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:44:33.415 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:33.417 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:44:33.429 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-26T11:44:31.959566+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95052,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020468,"statfs":{"total":289910292480,"available":289812959232,"internally_reserved":0,"allocated":1744896,"data_stored":1358551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003530"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435811+0000","last_change":"2024-04-26T11:44:21.443178+0000","last_active":"2024-04-26T11:44:22.435811+0000","last_peered":"2024-04-26T11:44:22.435811+0000","last_clean":"2024-04-26T11:44:22.435811+0000","last_became_active":"2024-04-26T11:44:21.442734+0000","last_became_peered":"2024-04-26T11:44:21.442734+0000","last_unstale":"2024-04-26T11:44:22.435811+0000","last_undegraded":"2024-04-26T11:44:22.435811+0000","last_fullsized":"2024-04-26T11:44:22.435811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435342+0000","last_change":"2024-04-26T11:44:21.442473+0000","last_active":"2024-04-26T11:44:22.435342+0000","last_peered":"2024-04-26T11:44:22.435342+0000","last_clean":"2024-04-26T11:44:22.435342+0000","last_became_active":"2024-04-26T11:44:21.441778+0000","last_became_peered":"2024-04-26T11:44:21.441778+0000","last_unstale":"2024-04-26T11:44:22.435342+0000","last_undegraded":"2024-04-26T11:44:22.435342+0000","last_fullsized":"2024-04-26T11:44:22.435342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435827+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:44:22.435827+0000","last_peered":"2024-04-26T11:44:22.435827+0000","last_clean":"2024-04-26T11:44:22.435827+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:44:22.435827+0000","last_undegraded":"2024-04-26T11:44:22.435827+0000","last_fullsized":"2024-04-26T11:44:22.435827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435163+0000","last_change":"2024-04-26T11:44:21.448849+0000","last_active":"2024-04-26T11:44:22.435163+0000","last_peered":"2024-04-26T11:44:22.435163+0000","last_clean":"2024-04-26T11:44:22.435163+0000","last_became_active":"2024-04-26T11:44:21.447398+0000","last_became_peered":"2024-04-26T11:44:21.447398+0000","last_unstale":"2024-04-26T11:44:22.435163+0000","last_undegraded":"2024-04-26T11:44:22.435163+0000","last_fullsized":"2024-04-26T11:44:22.435163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:02.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434980+0000","last_change":"2024-04-26T11:44:21.441647+0000","last_active":"2024-04-26T11:44:22.434980+0000","last_peered":"2024-04-26T11:44:22.434980+0000","last_clean":"2024-04-26T11:44:22.434980+0000","last_became_active":"2024-04-26T11:44:21.441237+0000","last_became_peered":"2024-04-26T11:44:21.441237+0000","last_unstale":"2024-04-26T11:44:22.434980+0000","last_undegraded":"2024-04-26T11:44:22.434980+0000","last_fullsized":"2024-04-26T11:44:22.434980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434482+0000","last_change":"2024-04-26T11:44:21.447786+0000","last_active":"2024-04-26T11:44:22.434482+0000","last_peered":"2024-04-26T11:44:22.434482+0000","last_clean":"2024-04-26T11:44:22.434482+0000","last_became_active":"2024-04-26T11:44:21.447367+0000","last_became_peered":"2024-04-26T11:44:21.447367+0000","last_unstale":"2024-04-26T11:44:22.434482+0000","last_undegraded":"2024-04-26T11:44:22.434482+0000","last_fullsized":"2024-04-26T11:44:22.434482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434713+0000","last_change":"2024-04-26T11:44:21.448136+0000","last_active":"2024-04-26T11:44:22.434713+0000","last_peered":"2024-04-26T11:44:22.434713+0000","last_clean":"2024-04-26T11:44:22.434713+0000","last_became_active":"2024-04-26T11:44:21.447382+0000","last_became_peered":"2024-04-26T11:44:21.447382+0000","last_unstale":"2024-04-26T11:44:22.434713+0000","last_undegraded":"2024-04-26T11:44:22.434713+0000","last_fullsized":"2024-04-26T11:44:22.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433838+0000","last_change":"2024-04-26T11:44:21.448950+0000","last_active":"2024-04-26T11:44:22.433838+0000","last_peered":"2024-04-26T11:44:22.433838+0000","last_clean":"2024-04-26T11:44:22.433838+0000","last_became_active":"2024-04-26T11:44:21.447975+0000","last_became_peered":"2024-04-26T11:44:21.447975+0000","last_unstale":"2024-04-26T11:44:22.433838+0000","last_undegraded":"2024-04-26T11:44:22.433838+0000","last_fullsized":"2024-04-26T11:44:22.433838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:07.109775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818672+0000","last_change":"2024-04-26T11:44:21.446676+0000","last_active":"2024-04-26T11:44:22.818672+0000","last_peered":"2024-04-26T11:44:22.818672+0000","last_clean":"2024-04-26T11:44:22.818672+0000","last_became_active":"2024-04-26T11:44:21.445874+0000","last_became_peered":"2024-04-26T11:44:21.445874+0000","last_unstale":"2024-04-26T11:44:22.818672+0000","last_undegraded":"2024-04-26T11:44:22.818672+0000","last_fullsized":"2024-04-26T11:44:22.818672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435569+0000","last_change":"2024-04-26T11:44:21.441552+0000","last_active":"2024-04-26T11:44:22.435569+0000","last_peered":"2024-04-26T11:44:22.435569+0000","last_clean":"2024-04-26T11:44:22.435569+0000","last_became_active":"2024-04-26T11:44:21.441047+0000","last_became_peered":"2024-04-26T11:44:21.441047+0000","last_unstale":"2024-04-26T11:44:22.435569+0000","last_undegraded":"2024-04-26T11:44:22.435569+0000","last_fullsized":"2024-04-26T11:44:22.435569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435826+0000","last_change":"2024-04-26T11:44:21.448723+0000","last_active":"2024-04-26T11:44:22.435826+0000","last_peered":"2024-04-26T11:44:22.435826+0000","last_clean":"2024-04-26T11:44:22.435826+0000","last_became_active":"2024-04-26T11:44:21.448275+0000","last_became_peered":"2024-04-26T11:44:21.448275+0000","last_unstale":"2024-04-26T11:44:22.435826+0000","last_undegraded":"2024-04-26T11:44:22.435826+0000","last_fullsized":"2024-04-26T11:44:22.435826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435154+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:44:22.435154+0000","last_peered":"2024-04-26T11:44:22.435154+0000","last_clean":"2024-04-26T11:44:22.435154+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:44:22.435154+0000","last_undegraded":"2024-04-26T11:44:22.435154+0000","last_fullsized":"2024-04-26T11:44:22.435154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434453+0000","last_change":"2024-04-26T11:44:21.441784+0000","last_active":"2024-04-26T11:44:22.434453+0000","last_peered":"2024-04-26T11:44:22.434453+0000","last_clean":"2024-04-26T11:44:22.434453+0000","last_became_active":"2024-04-26T11:44:21.441107+0000","last_became_peered":"2024-04-26T11:44:21.441107+0000","last_unstale":"2024-04-26T11:44:22.434453+0000","last_undegraded":"2024-04-26T11:44:22.434453+0000","last_fullsized":"2024-04-26T11:44:22.434453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434509+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:44:22.434509+0000","last_peered":"2024-04-26T11:44:22.434509+0000","last_clean":"2024-04-26T11:44:22.434509+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:44:22.434509+0000","last_undegraded":"2024-04-26T11:44:22.434509+0000","last_fullsized":"2024-04-26T11:44:22.434509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434815+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:44:22.434815+0000","last_peered":"2024-04-26T11:44:22.434815+0000","last_clean":"2024-04-26T11:44:22.434815+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:44:22.434815+0000","last_undegraded":"2024-04-26T11:44:22.434815+0000","last_fullsized":"2024-04-26T11:44:22.434815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433958+0000","last_change":"2024-04-26T11:44:21.449098+0000","last_active":"2024-04-26T11:44:22.433958+0000","last_peered":"2024-04-26T11:44:22.433958+0000","last_clean":"2024-04-26T11:44:22.433958+0000","last_became_active":"2024-04-26T11:44:21.448517+0000","last_became_peered":"2024-04-26T11:44:21.448517+0000","last_unstale":"2024-04-26T11:44:22.433958+0000","last_undegraded":"2024-04-26T11:44:22.433958+0000","last_fullsized":"2024-04-26T11:44:22.433958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819570+0000","last_change":"2024-04-26T11:44:21.439565+0000","last_active":"2024-04-26T11:44:22.819570+0000","last_peered":"2024-04-26T11:44:22.819570+0000","last_clean":"2024-04-26T11:44:22.819570+0000","last_became_active":"2024-04-26T11:44:21.438640+0000","last_became_peered":"2024-04-26T11:44:21.438640+0000","last_unstale":"2024-04-26T11:44:22.819570+0000","last_undegraded":"2024-04-26T11:44:22.819570+0000","last_fullsized":"2024-04-26T11:44:22.819570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435844+0000","last_change":"2024-04-26T11:44:21.437913+0000","last_active":"2024-04-26T11:44:22.435844+0000","last_peered":"2024-04-26T11:44:22.435844+0000","last_clean":"2024-04-26T11:44:22.435844+0000","last_became_active":"2024-04-26T11:44:21.437543+0000","last_became_peered":"2024-04-26T11:44:21.437543+0000","last_unstale":"2024-04-26T11:44:22.435844+0000","last_undegraded":"2024-04-26T11:44:22.435844+0000","last_fullsized":"2024-04-26T11:44:22.435844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818621+0000","last_change":"2024-04-26T11:44:21.440138+0000","last_active":"2024-04-26T11:44:22.818621+0000","last_peered":"2024-04-26T11:44:22.818621+0000","last_clean":"2024-04-26T11:44:22.818621+0000","last_became_active":"2024-04-26T11:44:21.439850+0000","last_became_peered":"2024-04-26T11:44:21.439850+0000","last_unstale":"2024-04-26T11:44:22.818621+0000","last_undegraded":"2024-04-26T11:44:22.818621+0000","last_fullsized":"2024-04-26T11:44:22.818621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435721+0000","last_change":"2024-04-26T11:44:21.449248+0000","last_active":"2024-04-26T11:44:22.435721+0000","last_peered":"2024-04-26T11:44:22.435721+0000","last_clean":"2024-04-26T11:44:22.435721+0000","last_became_active":"2024-04-26T11:44:21.448315+0000","last_became_peered":"2024-04-26T11:44:21.448315+0000","last_unstale":"2024-04-26T11:44:22.435721+0000","last_undegraded":"2024-04-26T11:44:22.435721+0000","last_fullsized":"2024-04-26T11:44:22.435721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436209+0000","last_change":"2024-04-26T11:44:21.448524+0000","last_active":"2024-04-26T11:44:22.436209+0000","last_peered":"2024-04-26T11:44:22.436209+0000","last_clean":"2024-04-26T11:44:22.436209+0000","last_became_active":"2024-04-26T11:44:21.447839+0000","last_became_peered":"2024-04-26T11:44:21.447839+0000","last_unstale":"2024-04-26T11:44:22.436209+0000","last_undegraded":"2024-04-26T11:44:22.436209+0000","last_fullsized":"2024-04-26T11:44:22.436209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434386+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:44:22.434386+0000","last_peered":"2024-04-26T11:44:22.434386+0000","last_clean":"2024-04-26T11:44:22.434386+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:44:22.434386+0000","last_undegraded":"2024-04-26T11:44:22.434386+0000","last_fullsized":"2024-04-26T11:44:22.434386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817486+0000","last_change":"2024-04-26T11:44:21.445626+0000","last_active":"2024-04-26T11:44:22.817486+0000","last_peered":"2024-04-26T11:44:22.817486+0000","last_clean":"2024-04-26T11:44:22.817486+0000","last_became_active":"2024-04-26T11:44:21.444990+0000","last_became_peered":"2024-04-26T11:44:21.444990+0000","last_unstale":"2024-04-26T11:44:22.817486+0000","last_undegraded":"2024-04-26T11:44:22.817486+0000","last_fullsized":"2024-04-26T11:44:22.817486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433782+0000","last_change":"2024-04-26T11:44:21.441463+0000","last_active":"2024-04-26T11:44:22.433782+0000","last_peered":"2024-04-26T11:44:22.433782+0000","last_clean":"2024-04-26T11:44:22.433782+0000","last_became_active":"2024-04-26T11:44:21.440895+0000","last_became_peered":"2024-04-26T11:44:21.440895+0000","last_unstale":"2024-04-26T11:44:22.433782+0000","last_undegraded":"2024-04-26T11:44:22.433782+0000","last_fullsized":"2024-04-26T11:44:22.433782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435906+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:44:22.435906+0000","last_peered":"2024-04-26T11:44:22.435906+0000","last_clean":"2024-04-26T11:44:22.435906+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:44:22.435906+0000","last_undegraded":"2024-04-26T11:44:22.435906+0000","last_fullsized":"2024-04-26T11:44:22.435906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819879+0000","last_change":"2024-04-26T11:44:21.444826+0000","last_active":"2024-04-26T11:44:22.819879+0000","last_peered":"2024-04-26T11:44:22.819879+0000","last_clean":"2024-04-26T11:44:22.819879+0000","last_became_active":"2024-04-26T11:44:21.444440+0000","last_became_peered":"2024-04-26T11:44:21.444440+0000","last_unstale":"2024-04-26T11:44:22.819879+0000","last_undegraded":"2024-04-26T11:44:22.819879+0000","last_fullsized":"2024-04-26T11:44:22.819879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436032+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:44:22.436032+0000","last_peered":"2024-04-26T11:44:22.436032+0000","last_clean":"2024-04-26T11:44:22.436032+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:44:22.436032+0000","last_undegraded":"2024-04-26T11:44:22.436032+0000","last_fullsized":"2024-04-26T11:44:22.436032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435465+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:44:22.435465+0000","last_peered":"2024-04-26T11:44:22.435465+0000","last_clean":"2024-04-26T11:44:22.435465+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:44:22.435465+0000","last_undegraded":"2024-04-26T11:44:22.435465+0000","last_fullsized":"2024-04-26T11:44:22.435465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819067+0000","last_change":"2024-04-26T11:44:21.439511+0000","last_active":"2024-04-26T11:44:22.819067+0000","last_peered":"2024-04-26T11:44:22.819067+0000","last_clean":"2024-04-26T11:44:22.819067+0000","last_became_active":"2024-04-26T11:44:21.438539+0000","last_became_peered":"2024-04-26T11:44:21.438539+0000","last_unstale":"2024-04-26T11:44:22.819067+0000","last_undegraded":"2024-04-26T11:44:22.819067+0000","last_fullsized":"2024-04-26T11:44:22.819067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434754+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:44:22.434754+0000","last_peered":"2024-04-26T11:44:22.434754+0000","last_clean":"2024-04-26T11:44:22.434754+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:44:22.434754+0000","last_undegraded":"2024-04-26T11:44:22.434754+0000","last_fullsized":"2024-04-26T11:44:22.434754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817638+0000","last_change":"2024-04-26T11:44:21.439772+0000","last_active":"2024-04-26T11:44:22.817638+0000","last_peered":"2024-04-26T11:44:22.817638+0000","last_clean":"2024-04-26T11:44:22.817638+0000","last_became_active":"2024-04-26T11:44:21.438770+0000","last_became_peered":"2024-04-26T11:44:21.438770+0000","last_unstale":"2024-04-26T11:44:22.817638+0000","last_undegraded":"2024-04-26T11:44:22.817638+0000","last_fullsized":"2024-04-26T11:44:22.817638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434091+0000","last_change":"2024-04-26T11:44:21.452228+0000","last_active":"2024-04-26T11:44:22.434091+0000","last_peered":"2024-04-26T11:44:22.434091+0000","last_clean":"2024-04-26T11:44:22.434091+0000","last_became_active":"2024-04-26T11:44:21.451258+0000","last_became_peered":"2024-04-26T11:44:21.451258+0000","last_unstale":"2024-04-26T11:44:22.434091+0000","last_undegraded":"2024-04-26T11:44:22.434091+0000","last_fullsized":"2024-04-26T11:44:22.434091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435434+0000","last_change":"2024-04-26T11:44:21.438961+0000","last_active":"2024-04-26T11:44:22.435434+0000","last_peered":"2024-04-26T11:44:22.435434+0000","last_clean":"2024-04-26T11:44:22.435434+0000","last_became_active":"2024-04-26T11:44:21.438124+0000","last_became_peered":"2024-04-26T11:44:21.438124+0000","last_unstale":"2024-04-26T11:44:22.435434+0000","last_undegraded":"2024-04-26T11:44:22.435434+0000","last_fullsized":"2024-04-26T11:44:22.435434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436336+0000","last_change":"2024-04-26T11:44:21.066359+0000","last_active":"2024-04-26T11:44:22.436336+0000","last_peered":"2024-04-26T11:44:22.436336+0000","last_clean":"2024-04-26T11:44:22.436336+0000","last_became_active":"2024-04-26T11:44:21.066007+0000","last_became_peered":"2024-04-26T11:44:21.066007+0000","last_unstale":"2024-04-26T11:44:22.436336+0000","last_undegraded":"2024-04-26T11:44:22.436336+0000","last_fullsized":"2024-04-26T11:44:22.436336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435741+0000","last_change":"2024-04-26T11:44:21.439295+0000","last_active":"2024-04-26T11:44:22.435741+0000","last_peered":"2024-04-26T11:44:22.435741+0000","last_clean":"2024-04-26T11:44:22.435741+0000","last_became_active":"2024-04-26T11:44:21.439097+0000","last_became_peered":"2024-04-26T11:44:21.439097+0000","last_unstale":"2024-04-26T11:44:22.435741+0000","last_undegraded":"2024-04-26T11:44:22.435741+0000","last_fullsized":"2024-04-26T11:44:22.435741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818216+0000","last_change":"2024-04-26T11:44:21.066646+0000","last_active":"2024-04-26T11:44:22.818216+0000","last_peered":"2024-04-26T11:44:22.818216+0000","last_clean":"2024-04-26T11:44:22.818216+0000","last_became_active":"2024-04-26T11:44:21.065981+0000","last_became_peered":"2024-04-26T11:44:21.065981+0000","last_unstale":"2024-04-26T11:44:22.818216+0000","last_undegraded":"2024-04-26T11:44:22.818216+0000","last_fullsized":"2024-04-26T11:44:22.818216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820032+0000","last_change":"2024-04-26T11:44:21.443681+0000","last_active":"2024-04-26T11:44:22.820032+0000","last_peered":"2024-04-26T11:44:22.820032+0000","last_clean":"2024-04-26T11:44:22.820032+0000","last_became_active":"2024-04-26T11:44:21.443253+0000","last_became_peered":"2024-04-26T11:44:21.443253+0000","last_unstale":"2024-04-26T11:44:22.820032+0000","last_undegraded":"2024-04-26T11:44:22.820032+0000","last_fullsized":"2024-04-26T11:44:22.820032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434717+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:44:22.434717+0000","last_peered":"2024-04-26T11:44:22.434717+0000","last_clean":"2024-04-26T11:44:22.434717+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:44:22.434717+0000","last_undegraded":"2024-04-26T11:44:22.434717+0000","last_fullsized":"2024-04-26T11:44:22.434717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818804+0000","last_change":"2024-04-26T11:44:21.445426+0000","last_active":"2024-04-26T11:44:22.818804+0000","last_peered":"2024-04-26T11:44:22.818804+0000","last_clean":"2024-04-26T11:44:22.818804+0000","last_became_active":"2024-04-26T11:44:21.444674+0000","last_became_peered":"2024-04-26T11:44:21.444674+0000","last_unstale":"2024-04-26T11:44:22.818804+0000","last_undegraded":"2024-04-26T11:44:22.818804+0000","last_fullsized":"2024-04-26T11:44:22.818804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434190+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:44:22.434190+0000","last_peered":"2024-04-26T11:44:22.434190+0000","last_clean":"2024-04-26T11:44:22.434190+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:44:22.434190+0000","last_undegraded":"2024-04-26T11:44:22.434190+0000","last_fullsized":"2024-04-26T11:44:22.434190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435770+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:44:22.435770+0000","last_peered":"2024-04-26T11:44:22.435770+0000","last_clean":"2024-04-26T11:44:22.435770+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:44:22.435770+0000","last_undegraded":"2024-04-26T11:44:22.435770+0000","last_fullsized":"2024-04-26T11:44:22.435770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433826+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:44:22.433826+0000","last_peered":"2024-04-26T11:44:22.433826+0000","last_clean":"2024-04-26T11:44:22.433826+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:44:22.433826+0000","last_undegraded":"2024-04-26T11:44:22.433826+0000","last_fullsized":"2024-04-26T11:44:22.433826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436104+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:44:22.436104+0000","last_peered":"2024-04-26T11:44:22.436104+0000","last_clean":"2024-04-26T11:44:22.436104+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:44:22.436104+0000","last_undegraded":"2024-04-26T11:44:22.436104+0000","last_fullsized":"2024-04-26T11:44:22.436104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433901+0000","last_change":"2024-04-26T11:44:21.442188+0000","last_active":"2024-04-26T11:44:22.433901+0000","last_peered":"2024-04-26T11:44:22.433901+0000","last_clean":"2024-04-26T11:44:22.433901+0000","last_became_active":"2024-04-26T11:44:21.441105+0000","last_became_peered":"2024-04-26T11:44:21.441105+0000","last_unstale":"2024-04-26T11:44:22.433901+0000","last_undegraded":"2024-04-26T11:44:22.433901+0000","last_fullsized":"2024-04-26T11:44:22.433901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436283+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:44:22.436283+0000","last_peered":"2024-04-26T11:44:22.436283+0000","last_clean":"2024-04-26T11:44:22.436283+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:44:22.436283+0000","last_undegraded":"2024-04-26T11:44:22.436283+0000","last_fullsized":"2024-04-26T11:44:22.436283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435798+0000","last_change":"2024-04-26T11:44:21.449433+0000","last_active":"2024-04-26T11:44:22.435798+0000","last_peered":"2024-04-26T11:44:22.435798+0000","last_clean":"2024-04-26T11:44:22.435798+0000","last_became_active":"2024-04-26T11:44:21.447831+0000","last_became_peered":"2024-04-26T11:44:21.447831+0000","last_unstale":"2024-04-26T11:44:22.435798+0000","last_undegraded":"2024-04-26T11:44:22.435798+0000","last_fullsized":"2024-04-26T11:44:22.435798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435987+0000","last_change":"2024-04-26T11:44:21.065647+0000","last_active":"2024-04-26T11:44:22.435987+0000","last_peered":"2024-04-26T11:44:22.435987+0000","last_clean":"2024-04-26T11:44:22.435987+0000","last_became_active":"2024-04-26T11:44:21.065197+0000","last_became_peered":"2024-04-26T11:44:21.065197+0000","last_unstale":"2024-04-26T11:44:22.435987+0000","last_undegraded":"2024-04-26T11:44:22.435987+0000","last_fullsized":"2024-04-26T11:44:22.435987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818851+0000","last_change":"2024-04-26T11:44:21.443848+0000","last_active":"2024-04-26T11:44:22.818851+0000","last_peered":"2024-04-26T11:44:22.818851+0000","last_clean":"2024-04-26T11:44:22.818851+0000","last_became_active":"2024-04-26T11:44:21.443580+0000","last_became_peered":"2024-04-26T11:44:21.443580+0000","last_unstale":"2024-04-26T11:44:22.818851+0000","last_undegraded":"2024-04-26T11:44:22.818851+0000","last_fullsized":"2024-04-26T11:44:22.818851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819315+0000","last_change":"2024-04-26T11:44:21.068336+0000","last_active":"2024-04-26T11:44:22.819315+0000","last_peered":"2024-04-26T11:44:22.819315+0000","last_clean":"2024-04-26T11:44:22.819315+0000","last_became_active":"2024-04-26T11:44:21.067530+0000","last_became_peered":"2024-04-26T11:44:21.067530+0000","last_unstale":"2024-04-26T11:44:22.819315+0000","last_undegraded":"2024-04-26T11:44:22.819315+0000","last_fullsized":"2024-04-26T11:44:22.819315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435445+0000","last_change":"2024-04-26T11:44:21.449238+0000","last_active":"2024-04-26T11:44:22.435445+0000","last_peered":"2024-04-26T11:44:22.435445+0000","last_clean":"2024-04-26T11:44:22.435445+0000","last_became_active":"2024-04-26T11:44:21.447694+0000","last_became_peered":"2024-04-26T11:44:21.447694+0000","last_unstale":"2024-04-26T11:44:22.435445+0000","last_undegraded":"2024-04-26T11:44:22.435445+0000","last_fullsized":"2024-04-26T11:44:22.435445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435196+0000","last_change":"2024-04-26T11:44:21.066212+0000","last_active":"2024-04-26T11:44:22.435196+0000","last_peered":"2024-04-26T11:44:22.435196+0000","last_clean":"2024-04-26T11:44:22.435196+0000","last_became_active":"2024-04-26T11:44:21.065186+0000","last_became_peered":"2024-04-26T11:44:21.065186+0000","last_unstale":"2024-04-26T11:44:22.435196+0000","last_undegraded":"2024-04-26T11:44:22.435196+0000","last_fullsized":"2024-04-26T11:44:22.435196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436154+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:44:22.436154+0000","last_peered":"2024-04-26T11:44:22.436154+0000","last_clean":"2024-04-26T11:44:22.436154+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:44:22.436154+0000","last_undegraded":"2024-04-26T11:44:22.436154+0000","last_fullsized":"2024-04-26T11:44:22.436154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434230+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:44:22.434230+0000","last_peered":"2024-04-26T11:44:22.434230+0000","last_clean":"2024-04-26T11:44:22.434230+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:44:22.434230+0000","last_undegraded":"2024-04-26T11:44:22.434230+0000","last_fullsized":"2024-04-26T11:44:22.434230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435383+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:44:22.435383+0000","last_peered":"2024-04-26T11:44:22.435383+0000","last_clean":"2024-04-26T11:44:22.435383+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:44:22.435383+0000","last_undegraded":"2024-04-26T11:44:22.435383+0000","last_fullsized":"2024-04-26T11:44:22.435383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434021+0000","last_change":"2024-04-26T11:44:21.065486+0000","last_active":"2024-04-26T11:44:22.434021+0000","last_peered":"2024-04-26T11:44:22.434021+0000","last_clean":"2024-04-26T11:44:22.434021+0000","last_became_active":"2024-04-26T11:44:21.065090+0000","last_became_peered":"2024-04-26T11:44:21.065090+0000","last_unstale":"2024-04-26T11:44:22.434021+0000","last_undegraded":"2024-04-26T11:44:22.434021+0000","last_fullsized":"2024-04-26T11:44:22.434021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:03.456923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818894+0000","last_change":"2024-04-26T11:44:21.446431+0000","last_active":"2024-04-26T11:44:22.818894+0000","last_peered":"2024-04-26T11:44:22.818894+0000","last_clean":"2024-04-26T11:44:22.818894+0000","last_became_active":"2024-04-26T11:44:21.445866+0000","last_became_peered":"2024-04-26T11:44:21.445866+0000","last_unstale":"2024-04-26T11:44:22.818894+0000","last_undegraded":"2024-04-26T11:44:22.818894+0000","last_fullsized":"2024-04-26T11:44:22.818894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440035+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:44:21.440035+0000","last_peered":"2024-04-26T11:44:21.440035+0000","last_clean":"2024-04-26T11:44:21.440035+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:44:21.440035+0000","last_undegraded":"2024-04-26T11:44:21.440035+0000","last_fullsized":"2024-04-26T11:44:21.440035+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440187+0000","last_change":"2024-04-26T11:44:17.037102+0000","last_active":"2024-04-26T11:44:21.440187+0000","last_peered":"2024-04-26T11:44:21.440187+0000","last_clean":"2024-04-26T11:44:21.440187+0000","last_became_active":"2024-04-26T11:44:17.036242+0000","last_became_peered":"2024-04-26T11:44:17.036242+0000","last_unstale":"2024-04-26T11:44:21.440187+0000","last_undegraded":"2024-04-26T11:44:21.440187+0000","last_fullsized":"2024-04-26T11:44:21.440187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818647+0000","last_change":"2024-04-26T11:44:21.064980+0000","last_active":"2024-04-26T11:44:22.818647+0000","last_peered":"2024-04-26T11:44:22.818647+0000","last_clean":"2024-04-26T11:44:22.818647+0000","last_became_active":"2024-04-26T11:44:21.064569+0000","last_became_peered":"2024-04-26T11:44:21.064569+0000","last_unstale":"2024-04-26T11:44:22.818647+0000","last_undegraded":"2024-04-26T11:44:22.818647+0000","last_fullsized":"2024-04-26T11:44:22.818647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436303+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:44:22.436303+0000","last_peered":"2024-04-26T11:44:22.436303+0000","last_clean":"2024-04-26T11:44:22.436303+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:44:22.436303+0000","last_undegraded":"2024-04-26T11:44:22.436303+0000","last_fullsized":"2024-04-26T11:44:22.436303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439848+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:44:21.439848+0000","last_peered":"2024-04-26T11:44:21.439848+0000","last_clean":"2024-04-26T11:44:21.439848+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:44:21.439848+0000","last_undegraded":"2024-04-26T11:44:21.439848+0000","last_fullsized":"2024-04-26T11:44:21.439848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818702+0000","last_change":"2024-04-26T11:44:21.066838+0000","last_active":"2024-04-26T11:44:22.818702+0000","last_peered":"2024-04-26T11:44:22.818702+0000","last_clean":"2024-04-26T11:44:22.818702+0000","last_became_active":"2024-04-26T11:44:21.065781+0000","last_became_peered":"2024-04-26T11:44:21.065781+0000","last_unstale":"2024-04-26T11:44:22.818702+0000","last_undegraded":"2024-04-26T11:44:22.818702+0000","last_fullsized":"2024-04-26T11:44:22.818702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435884+0000","last_change":"2024-04-26T11:44:21.439222+0000","last_active":"2024-04-26T11:44:22.435884+0000","last_peered":"2024-04-26T11:44:22.435884+0000","last_clean":"2024-04-26T11:44:22.435884+0000","last_became_active":"2024-04-26T11:44:21.438876+0000","last_became_peered":"2024-04-26T11:44:21.438876+0000","last_unstale":"2024-04-26T11:44:22.435884+0000","last_undegraded":"2024-04-26T11:44:22.435884+0000","last_fullsized":"2024-04-26T11:44:22.435884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.435673+0000","last_change":"2024-04-26T11:44:17.031172+0000","last_active":"2024-04-26T11:44:21.435673+0000","last_peered":"2024-04-26T11:44:21.435673+0000","last_clean":"2024-04-26T11:44:21.435673+0000","last_became_active":"2024-04-26T11:44:17.030306+0000","last_became_peered":"2024-04-26T11:44:17.030306+0000","last_unstale":"2024-04-26T11:44:21.435673+0000","last_undegraded":"2024-04-26T11:44:21.435673+0000","last_fullsized":"2024-04-26T11:44:21.435673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:30.564274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434093+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:44:22.434093+0000","last_peered":"2024-04-26T11:44:22.434093+0000","last_clean":"2024-04-26T11:44:22.434093+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:44:22.434093+0000","last_undegraded":"2024-04-26T11:44:22.434093+0000","last_fullsized":"2024-04-26T11:44:22.434093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819030+0000","last_change":"2024-04-26T11:44:21.440135+0000","last_active":"2024-04-26T11:44:22.819030+0000","last_peered":"2024-04-26T11:44:22.819030+0000","last_clean":"2024-04-26T11:44:22.819030+0000","last_became_active":"2024-04-26T11:44:21.439757+0000","last_became_peered":"2024-04-26T11:44:21.439757+0000","last_unstale":"2024-04-26T11:44:22.819030+0000","last_undegraded":"2024-04-26T11:44:22.819030+0000","last_fullsized":"2024-04-26T11:44:22.819030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.437818+0000","last_change":"2024-04-26T11:44:17.037146+0000","last_active":"2024-04-26T11:44:21.437818+0000","last_peered":"2024-04-26T11:44:21.437818+0000","last_clean":"2024-04-26T11:44:21.437818+0000","last_became_active":"2024-04-26T11:44:17.036196+0000","last_became_peered":"2024-04-26T11:44:17.036196+0000","last_unstale":"2024-04-26T11:44:21.437818+0000","last_undegraded":"2024-04-26T11:44:21.437818+0000","last_fullsized":"2024-04-26T11:44:21.437818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.409299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436401+0000","last_change":"2024-04-26T11:44:21.065821+0000","last_active":"2024-04-26T11:44:22.436401+0000","last_peered":"2024-04-26T11:44:22.436401+0000","last_clean":"2024-04-26T11:44:22.436401+0000","last_became_active":"2024-04-26T11:44:21.065300+0000","last_became_peered":"2024-04-26T11:44:21.065300+0000","last_unstale":"2024-04-26T11:44:22.436401+0000","last_undegraded":"2024-04-26T11:44:22.436401+0000","last_fullsized":"2024-04-26T11:44:22.436401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819416+0000","last_change":"2024-04-26T11:44:21.439526+0000","last_active":"2024-04-26T11:44:22.819416+0000","last_peered":"2024-04-26T11:44:22.819416+0000","last_clean":"2024-04-26T11:44:22.819416+0000","last_became_active":"2024-04-26T11:44:21.438786+0000","last_became_peered":"2024-04-26T11:44:21.438786+0000","last_unstale":"2024-04-26T11:44:22.819416+0000","last_undegraded":"2024-04-26T11:44:22.819416+0000","last_fullsized":"2024-04-26T11:44:22.819416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436395+0000","last_change":"2024-04-26T11:44:21.066276+0000","last_active":"2024-04-26T11:44:22.436395+0000","last_peered":"2024-04-26T11:44:22.436395+0000","last_clean":"2024-04-26T11:44:22.436395+0000","last_became_active":"2024-04-26T11:44:21.065682+0000","last_became_peered":"2024-04-26T11:44:21.065682+0000","last_unstale":"2024-04-26T11:44:22.436395+0000","last_undegraded":"2024-04-26T11:44:22.436395+0000","last_fullsized":"2024-04-26T11:44:22.436395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436324+0000","last_change":"2024-04-26T11:44:17.031782+0000","last_active":"2024-04-26T11:44:21.436324+0000","last_peered":"2024-04-26T11:44:21.436324+0000","last_clean":"2024-04-26T11:44:21.436324+0000","last_became_active":"2024-04-26T11:44:17.030688+0000","last_became_peered":"2024-04-26T11:44:17.030688+0000","last_unstale":"2024-04-26T11:44:21.436324+0000","last_undegraded":"2024-04-26T11:44:21.436324+0000","last_fullsized":"2024-04-26T11:44:21.436324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.289819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434465+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:44:22.434465+0000","last_peered":"2024-04-26T11:44:22.434465+0000","last_clean":"2024-04-26T11:44:22.434465+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:44:22.434465+0000","last_undegraded":"2024-04-26T11:44:22.434465+0000","last_fullsized":"2024-04-26T11:44:22.434465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819493+0000","last_change":"2024-04-26T11:44:21.065142+0000","last_active":"2024-04-26T11:44:22.819493+0000","last_peered":"2024-04-26T11:44:22.819493+0000","last_clean":"2024-04-26T11:44:22.819493+0000","last_became_active":"2024-04-26T11:44:21.064672+0000","last_became_peered":"2024-04-26T11:44:21.064672+0000","last_unstale":"2024-04-26T11:44:22.819493+0000","last_undegraded":"2024-04-26T11:44:22.819493+0000","last_fullsized":"2024-04-26T11:44:22.819493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.433676+0000","last_change":"2024-04-26T11:44:17.031146+0000","last_active":"2024-04-26T11:44:21.433676+0000","last_peered":"2024-04-26T11:44:21.433676+0000","last_clean":"2024-04-26T11:44:21.433676+0000","last_became_active":"2024-04-26T11:44:17.030637+0000","last_became_peered":"2024-04-26T11:44:17.030637+0000","last_unstale":"2024-04-26T11:44:21.433676+0000","last_undegraded":"2024-04-26T11:44:21.433676+0000","last_fullsized":"2024-04-26T11:44:21.433676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434766+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:44:22.434766+0000","last_peered":"2024-04-26T11:44:22.434766+0000","last_clean":"2024-04-26T11:44:22.434766+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:44:22.434766+0000","last_undegraded":"2024-04-26T11:44:22.434766+0000","last_fullsized":"2024-04-26T11:44:22.434766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819801+0000","last_change":"2024-04-26T11:44:21.065483+0000","last_active":"2024-04-26T11:44:22.819801+0000","last_peered":"2024-04-26T11:44:22.819801+0000","last_clean":"2024-04-26T11:44:22.819801+0000","last_became_active":"2024-04-26T11:44:21.064772+0000","last_became_peered":"2024-04-26T11:44:21.064772+0000","last_unstale":"2024-04-26T11:44:22.819801+0000","last_undegraded":"2024-04-26T11:44:22.819801+0000","last_fullsized":"2024-04-26T11:44:22.819801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436718+0000","last_change":"2024-04-26T11:44:17.031358+0000","last_active":"2024-04-26T11:44:21.436718+0000","last_peered":"2024-04-26T11:44:21.436718+0000","last_clean":"2024-04-26T11:44:21.436718+0000","last_became_active":"2024-04-26T11:44:17.030413+0000","last_became_peered":"2024-04-26T11:44:17.030413+0000","last_unstale":"2024-04-26T11:44:21.436718+0000","last_undegraded":"2024-04-26T11:44:21.436718+0000","last_fullsized":"2024-04-26T11:44:21.436718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817817+0000","last_change":"2024-04-26T11:44:21.444989+0000","last_active":"2024-04-26T11:44:22.817817+0000","last_peered":"2024-04-26T11:44:22.817817+0000","last_clean":"2024-04-26T11:44:22.817817+0000","last_became_active":"2024-04-26T11:44:21.444418+0000","last_became_peered":"2024-04-26T11:44:21.444418+0000","last_unstale":"2024-04-26T11:44:22.817817+0000","last_undegraded":"2024-04-26T11:44:22.817817+0000","last_fullsized":"2024-04-26T11:44:22.817817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:23.968635+0000","last_change":"2024-04-26T11:44:21.067525+0000","last_active":"2024-04-26T11:44:23.968635+0000","last_peered":"2024-04-26T11:44:23.968635+0000","last_clean":"2024-04-26T11:44:23.968635+0000","last_became_active":"2024-04-26T11:44:21.065923+0000","last_became_peered":"2024-04-26T11:44:21.065923+0000","last_unstale":"2024-04-26T11:44:23.968635+0000","last_undegraded":"2024-04-26T11:44:23.968635+0000","last_fullsized":"2024-04-26T11:44:23.968635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439731+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:44:21.439731+0000","last_peered":"2024-04-26T11:44:21.439731+0000","last_clean":"2024-04-26T11:44:21.439731+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:44:21.439731+0000","last_undegraded":"2024-04-26T11:44:21.439731+0000","last_fullsized":"2024-04-26T11:44:21.439731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434002+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:44:22.434002+0000","last_peered":"2024-04-26T11:44:22.434002+0000","last_clean":"2024-04-26T11:44:22.434002+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:44:22.434002+0000","last_undegraded":"2024-04-26T11:44:22.434002+0000","last_fullsized":"2024-04-26T11:44:22.434002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435702+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:44:22.435702+0000","last_peered":"2024-04-26T11:44:22.435702+0000","last_clean":"2024-04-26T11:44:22.435702+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:44:22.435702+0000","last_undegraded":"2024-04-26T11:44:22.435702+0000","last_fullsized":"2024-04-26T11:44:22.435702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435885+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:44:22.435885+0000","last_peered":"2024-04-26T11:44:22.435885+0000","last_clean":"2024-04-26T11:44:22.435885+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:44:22.435885+0000","last_undegraded":"2024-04-26T11:44:22.435885+0000","last_fullsized":"2024-04-26T11:44:22.435885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817896+0000","last_change":"2024-04-26T11:44:21.437907+0000","last_active":"2024-04-26T11:44:22.817896+0000","last_peered":"2024-04-26T11:44:22.817896+0000","last_clean":"2024-04-26T11:44:22.817896+0000","last_became_active":"2024-04-26T11:44:21.437024+0000","last_became_peered":"2024-04-26T11:44:21.437024+0000","last_unstale":"2024-04-26T11:44:22.817896+0000","last_undegraded":"2024-04-26T11:44:22.817896+0000","last_fullsized":"2024-04-26T11:44:22.817896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435937+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:44:22.435937+0000","last_peered":"2024-04-26T11:44:22.435937+0000","last_clean":"2024-04-26T11:44:22.435937+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:44:22.435937+0000","last_undegraded":"2024-04-26T11:44:22.435937+0000","last_fullsized":"2024-04-26T11:44:22.435937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435601+0000","last_change":"2024-04-26T11:44:21.065944+0000","last_active":"2024-04-26T11:44:22.435601+0000","last_peered":"2024-04-26T11:44:22.435601+0000","last_clean":"2024-04-26T11:44:22.435601+0000","last_became_active":"2024-04-26T11:44:21.065251+0000","last_became_peered":"2024-04-26T11:44:21.065251+0000","last_unstale":"2024-04-26T11:44:22.435601+0000","last_undegraded":"2024-04-26T11:44:22.435601+0000","last_fullsized":"2024-04-26T11:44:22.435601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817770+0000","last_change":"2024-04-26T11:44:21.445619+0000","last_active":"2024-04-26T11:44:22.817770+0000","last_peered":"2024-04-26T11:44:22.817770+0000","last_clean":"2024-04-26T11:44:22.817770+0000","last_became_active":"2024-04-26T11:44:21.444597+0000","last_became_peered":"2024-04-26T11:44:21.444597+0000","last_unstale":"2024-04-26T11:44:22.817770+0000","last_undegraded":"2024-04-26T11:44:22.817770+0000","last_fullsized":"2024-04-26T11:44:22.817770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819319+0000","last_change":"2024-04-26T11:44:21.067177+0000","last_active":"2024-04-26T11:44:22.819319+0000","last_peered":"2024-04-26T11:44:22.819319+0000","last_clean":"2024-04-26T11:44:22.819319+0000","last_became_active":"2024-04-26T11:44:21.066727+0000","last_became_peered":"2024-04-26T11:44:21.066727+0000","last_unstale":"2024-04-26T11:44:22.819319+0000","last_undegraded":"2024-04-26T11:44:22.819319+0000","last_fullsized":"2024-04-26T11:44:22.819319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817835+0000","last_change":"2024-04-26T11:44:21.439357+0000","last_active":"2024-04-26T11:44:22.817835+0000","last_peered":"2024-04-26T11:44:22.817835+0000","last_clean":"2024-04-26T11:44:22.817835+0000","last_became_active":"2024-04-26T11:44:21.438703+0000","last_became_peered":"2024-04-26T11:44:21.438703+0000","last_unstale":"2024-04-26T11:44:22.817835+0000","last_undegraded":"2024-04-26T11:44:22.817835+0000","last_fullsized":"2024-04-26T11:44:22.817835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436060+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:44:22.436060+0000","last_peered":"2024-04-26T11:44:22.436060+0000","last_clean":"2024-04-26T11:44:22.436060+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:44:22.436060+0000","last_undegraded":"2024-04-26T11:44:22.436060+0000","last_fullsized":"2024-04-26T11:44:22.436060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818065+0000","last_change":"2024-04-26T11:44:21.065373+0000","last_active":"2024-04-26T11:44:22.818065+0000","last_peered":"2024-04-26T11:44:22.818065+0000","last_clean":"2024-04-26T11:44:22.818065+0000","last_became_active":"2024-04-26T11:44:21.064598+0000","last_became_peered":"2024-04-26T11:44:21.064598+0000","last_unstale":"2024-04-26T11:44:22.818065+0000","last_undegraded":"2024-04-26T11:44:22.818065+0000","last_fullsized":"2024-04-26T11:44:22.818065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819621+0000","last_change":"2024-04-26T11:44:21.445216+0000","last_active":"2024-04-26T11:44:22.819621+0000","last_peered":"2024-04-26T11:44:22.819621+0000","last_clean":"2024-04-26T11:44:22.819621+0000","last_became_active":"2024-04-26T11:44:21.444615+0000","last_became_peered":"2024-04-26T11:44:21.444615+0000","last_unstale":"2024-04-26T11:44:22.819621+0000","last_undegraded":"2024-04-26T11:44:22.819621+0000","last_fullsized":"2024-04-26T11:44:22.819621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818131+0000","last_change":"2024-04-26T11:44:21.066483+0000","last_active":"2024-04-26T11:44:22.818131+0000","last_peered":"2024-04-26T11:44:22.818131+0000","last_clean":"2024-04-26T11:44:22.818131+0000","last_became_active":"2024-04-26T11:44:21.065373+0000","last_became_peered":"2024-04-26T11:44:21.065373+0000","last_unstale":"2024-04-26T11:44:22.818131+0000","last_undegraded":"2024-04-26T11:44:22.818131+0000","last_fullsized":"2024-04-26T11:44:22.818131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435451+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:44:22.435451+0000","last_peered":"2024-04-26T11:44:22.435451+0000","last_clean":"2024-04-26T11:44:22.435451+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:44:22.435451+0000","last_undegraded":"2024-04-26T11:44:22.435451+0000","last_fullsized":"2024-04-26T11:44:22.435451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434803+0000","last_change":"2024-04-26T11:44:21.065431+0000","last_active":"2024-04-26T11:44:22.434803+0000","last_peered":"2024-04-26T11:44:22.434803+0000","last_clean":"2024-04-26T11:44:22.434803+0000","last_became_active":"2024-04-26T11:44:21.065114+0000","last_became_peered":"2024-04-26T11:44:21.065114+0000","last_unstale":"2024-04-26T11:44:22.434803+0000","last_undegraded":"2024-04-26T11:44:22.434803+0000","last_fullsized":"2024-04-26T11:44:22.434803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:39.838237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435212+0000","last_change":"2024-04-26T11:44:21.441795+0000","last_active":"2024-04-26T11:44:22.435212+0000","last_peered":"2024-04-26T11:44:22.435212+0000","last_clean":"2024-04-26T11:44:22.435212+0000","last_became_active":"2024-04-26T11:44:21.441421+0000","last_became_peered":"2024-04-26T11:44:21.441421+0000","last_unstale":"2024-04-26T11:44:22.435212+0000","last_undegraded":"2024-04-26T11:44:22.435212+0000","last_fullsized":"2024-04-26T11:44:22.435212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435013+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:44:22.435013+0000","last_peered":"2024-04-26T11:44:22.435013+0000","last_clean":"2024-04-26T11:44:22.435013+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:44:22.435013+0000","last_undegraded":"2024-04-26T11:44:22.435013+0000","last_fullsized":"2024-04-26T11:44:22.435013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436177+0000","last_change":"2024-04-26T11:44:21.448442+0000","last_active":"2024-04-26T11:44:22.436177+0000","last_peered":"2024-04-26T11:44:22.436177+0000","last_clean":"2024-04-26T11:44:22.436177+0000","last_became_active":"2024-04-26T11:44:21.447770+0000","last_became_peered":"2024-04-26T11:44:21.447770+0000","last_unstale":"2024-04-26T11:44:22.436177+0000","last_undegraded":"2024-04-26T11:44:22.436177+0000","last_fullsized":"2024-04-26T11:44:22.436177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435664+0000","last_change":"2024-04-26T11:44:21.066498+0000","last_active":"2024-04-26T11:44:22.435664+0000","last_peered":"2024-04-26T11:44:22.435664+0000","last_clean":"2024-04-26T11:44:22.435664+0000","last_became_active":"2024-04-26T11:44:21.065945+0000","last_became_peered":"2024-04-26T11:44:21.065945+0000","last_unstale":"2024-04-26T11:44:22.435664+0000","last_undegraded":"2024-04-26T11:44:22.435664+0000","last_fullsized":"2024-04-26T11:44:22.435664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434988+0000","last_change":"2024-04-26T11:44:21.448777+0000","last_active":"2024-04-26T11:44:22.434988+0000","last_peered":"2024-04-26T11:44:22.434988+0000","last_clean":"2024-04-26T11:44:22.434988+0000","last_became_active":"2024-04-26T11:44:21.448274+0000","last_became_peered":"2024-04-26T11:44:21.448274+0000","last_unstale":"2024-04-26T11:44:22.434988+0000","last_undegraded":"2024-04-26T11:44:22.434988+0000","last_fullsized":"2024-04-26T11:44:22.434988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435817+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:44:22.435817+0000","last_peered":"2024-04-26T11:44:22.435817+0000","last_clean":"2024-04-26T11:44:22.435817+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:44:22.435817+0000","last_undegraded":"2024-04-26T11:44:22.435817+0000","last_fullsized":"2024-04-26T11:44:22.435817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434476+0000","last_change":"2024-04-26T11:44:21.438183+0000","last_active":"2024-04-26T11:44:22.434476+0000","last_peered":"2024-04-26T11:44:22.434476+0000","last_clean":"2024-04-26T11:44:22.434476+0000","last_became_active":"2024-04-26T11:44:21.437823+0000","last_became_peered":"2024-04-26T11:44:21.437823+0000","last_unstale":"2024-04-26T11:44:22.434476+0000","last_undegraded":"2024-04-26T11:44:22.434476+0000","last_fullsized":"2024-04-26T11:44:22.434476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820080+0000","last_change":"2024-04-26T11:44:21.068479+0000","last_active":"2024-04-26T11:44:22.820080+0000","last_peered":"2024-04-26T11:44:22.820080+0000","last_clean":"2024-04-26T11:44:22.820080+0000","last_became_active":"2024-04-26T11:44:21.068206+0000","last_became_peered":"2024-04-26T11:44:21.068206+0000","last_unstale":"2024-04-26T11:44:22.820080+0000","last_undegraded":"2024-04-26T11:44:22.820080+0000","last_fullsized":"2024-04-26T11:44:22.820080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434365+0000","last_change":"2024-04-26T11:44:21.452369+0000","last_active":"2024-04-26T11:44:22.434365+0000","last_peered":"2024-04-26T11:44:22.434365+0000","last_clean":"2024-04-26T11:44:22.434365+0000","last_became_active":"2024-04-26T11:44:21.451833+0000","last_became_peered":"2024-04-26T11:44:21.451833+0000","last_unstale":"2024-04-26T11:44:22.434365+0000","last_undegraded":"2024-04-26T11:44:22.434365+0000","last_fullsized":"2024-04-26T11:44:22.434365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819101+0000","last_change":"2024-04-26T11:44:21.068300+0000","last_active":"2024-04-26T11:44:22.819101+0000","last_peered":"2024-04-26T11:44:22.819101+0000","last_clean":"2024-04-26T11:44:22.819101+0000","last_became_active":"2024-04-26T11:44:21.067285+0000","last_became_peered":"2024-04-26T11:44:21.067285+0000","last_unstale":"2024-04-26T11:44:22.819101+0000","last_undegraded":"2024-04-26T11:44:22.819101+0000","last_fullsized":"2024-04-26T11:44:22.819101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":790528,"data_stored":650427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":782336,"data_stored":649811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:44:33.434 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:44:33.747 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:44:33.764 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-26T11:44:31.959566+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95052,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020468,"statfs":{"total":289910292480,"available":289812959232,"internally_reserved":0,"allocated":1744896,"data_stored":1358551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003530"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435811+0000","last_change":"2024-04-26T11:44:21.443178+0000","last_active":"2024-04-26T11:44:22.435811+0000","last_peered":"2024-04-26T11:44:22.435811+0000","last_clean":"2024-04-26T11:44:22.435811+0000","last_became_active":"2024-04-26T11:44:21.442734+0000","last_became_peered":"2024-04-26T11:44:21.442734+0000","last_unstale":"2024-04-26T11:44:22.435811+0000","last_undegraded":"2024-04-26T11:44:22.435811+0000","last_fullsized":"2024-04-26T11:44:22.435811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435342+0000","last_change":"2024-04-26T11:44:21.442473+0000","last_active":"2024-04-26T11:44:22.435342+0000","last_peered":"2024-04-26T11:44:22.435342+0000","last_clean":"2024-04-26T11:44:22.435342+0000","last_became_active":"2024-04-26T11:44:21.441778+0000","last_became_peered":"2024-04-26T11:44:21.441778+0000","last_unstale":"2024-04-26T11:44:22.435342+0000","last_undegraded":"2024-04-26T11:44:22.435342+0000","last_fullsized":"2024-04-26T11:44:22.435342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435827+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:44:22.435827+0000","last_peered":"2024-04-26T11:44:22.435827+0000","last_clean":"2024-04-26T11:44:22.435827+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:44:22.435827+0000","last_undegraded":"2024-04-26T11:44:22.435827+0000","last_fullsized":"2024-04-26T11:44:22.435827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435163+0000","last_change":"2024-04-26T11:44:21.448849+0000","last_active":"2024-04-26T11:44:22.435163+0000","last_peered":"2024-04-26T11:44:22.435163+0000","last_clean":"2024-04-26T11:44:22.435163+0000","last_became_active":"2024-04-26T11:44:21.447398+0000","last_became_peered":"2024-04-26T11:44:21.447398+0000","last_unstale":"2024-04-26T11:44:22.435163+0000","last_undegraded":"2024-04-26T11:44:22.435163+0000","last_fullsized":"2024-04-26T11:44:22.435163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:02.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434980+0000","last_change":"2024-04-26T11:44:21.441647+0000","last_active":"2024-04-26T11:44:22.434980+0000","last_peered":"2024-04-26T11:44:22.434980+0000","last_clean":"2024-04-26T11:44:22.434980+0000","last_became_active":"2024-04-26T11:44:21.441237+0000","last_became_peered":"2024-04-26T11:44:21.441237+0000","last_unstale":"2024-04-26T11:44:22.434980+0000","last_undegraded":"2024-04-26T11:44:22.434980+0000","last_fullsized":"2024-04-26T11:44:22.434980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434482+0000","last_change":"2024-04-26T11:44:21.447786+0000","last_active":"2024-04-26T11:44:22.434482+0000","last_peered":"2024-04-26T11:44:22.434482+0000","last_clean":"2024-04-26T11:44:22.434482+0000","last_became_active":"2024-04-26T11:44:21.447367+0000","last_became_peered":"2024-04-26T11:44:21.447367+0000","last_unstale":"2024-04-26T11:44:22.434482+0000","last_undegraded":"2024-04-26T11:44:22.434482+0000","last_fullsized":"2024-04-26T11:44:22.434482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434713+0000","last_change":"2024-04-26T11:44:21.448136+0000","last_active":"2024-04-26T11:44:22.434713+0000","last_peered":"2024-04-26T11:44:22.434713+0000","last_clean":"2024-04-26T11:44:22.434713+0000","last_became_active":"2024-04-26T11:44:21.447382+0000","last_became_peered":"2024-04-26T11:44:21.447382+0000","last_unstale":"2024-04-26T11:44:22.434713+0000","last_undegraded":"2024-04-26T11:44:22.434713+0000","last_fullsized":"2024-04-26T11:44:22.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433838+0000","last_change":"2024-04-26T11:44:21.448950+0000","last_active":"2024-04-26T11:44:22.433838+0000","last_peered":"2024-04-26T11:44:22.433838+0000","last_clean":"2024-04-26T11:44:22.433838+0000","last_became_active":"2024-04-26T11:44:21.447975+0000","last_became_peered":"2024-04-26T11:44:21.447975+0000","last_unstale":"2024-04-26T11:44:22.433838+0000","last_undegraded":"2024-04-26T11:44:22.433838+0000","last_fullsized":"2024-04-26T11:44:22.433838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:07.109775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818672+0000","last_change":"2024-04-26T11:44:21.446676+0000","last_active":"2024-04-26T11:44:22.818672+0000","last_peered":"2024-04-26T11:44:22.818672+0000","last_clean":"2024-04-26T11:44:22.818672+0000","last_became_active":"2024-04-26T11:44:21.445874+0000","last_became_peered":"2024-04-26T11:44:21.445874+0000","last_unstale":"2024-04-26T11:44:22.818672+0000","last_undegraded":"2024-04-26T11:44:22.818672+0000","last_fullsized":"2024-04-26T11:44:22.818672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435569+0000","last_change":"2024-04-26T11:44:21.441552+0000","last_active":"2024-04-26T11:44:22.435569+0000","last_peered":"2024-04-26T11:44:22.435569+0000","last_clean":"2024-04-26T11:44:22.435569+0000","last_became_active":"2024-04-26T11:44:21.441047+0000","last_became_peered":"2024-04-26T11:44:21.441047+0000","last_unstale":"2024-04-26T11:44:22.435569+0000","last_undegraded":"2024-04-26T11:44:22.435569+0000","last_fullsized":"2024-04-26T11:44:22.435569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435826+0000","last_change":"2024-04-26T11:44:21.448723+0000","last_active":"2024-04-26T11:44:22.435826+0000","last_peered":"2024-04-26T11:44:22.435826+0000","last_clean":"2024-04-26T11:44:22.435826+0000","last_became_active":"2024-04-26T11:44:21.448275+0000","last_became_peered":"2024-04-26T11:44:21.448275+0000","last_unstale":"2024-04-26T11:44:22.435826+0000","last_undegraded":"2024-04-26T11:44:22.435826+0000","last_fullsized":"2024-04-26T11:44:22.435826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435154+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:44:22.435154+0000","last_peered":"2024-04-26T11:44:22.435154+0000","last_clean":"2024-04-26T11:44:22.435154+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:44:22.435154+0000","last_undegraded":"2024-04-26T11:44:22.435154+0000","last_fullsized":"2024-04-26T11:44:22.435154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434453+0000","last_change":"2024-04-26T11:44:21.441784+0000","last_active":"2024-04-26T11:44:22.434453+0000","last_peered":"2024-04-26T11:44:22.434453+0000","last_clean":"2024-04-26T11:44:22.434453+0000","last_became_active":"2024-04-26T11:44:21.441107+0000","last_became_peered":"2024-04-26T11:44:21.441107+0000","last_unstale":"2024-04-26T11:44:22.434453+0000","last_undegraded":"2024-04-26T11:44:22.434453+0000","last_fullsized":"2024-04-26T11:44:22.434453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434509+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:44:22.434509+0000","last_peered":"2024-04-26T11:44:22.434509+0000","last_clean":"2024-04-26T11:44:22.434509+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:44:22.434509+0000","last_undegraded":"2024-04-26T11:44:22.434509+0000","last_fullsized":"2024-04-26T11:44:22.434509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434815+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:44:22.434815+0000","last_peered":"2024-04-26T11:44:22.434815+0000","last_clean":"2024-04-26T11:44:22.434815+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:44:22.434815+0000","last_undegraded":"2024-04-26T11:44:22.434815+0000","last_fullsized":"2024-04-26T11:44:22.434815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433958+0000","last_change":"2024-04-26T11:44:21.449098+0000","last_active":"2024-04-26T11:44:22.433958+0000","last_peered":"2024-04-26T11:44:22.433958+0000","last_clean":"2024-04-26T11:44:22.433958+0000","last_became_active":"2024-04-26T11:44:21.448517+0000","last_became_peered":"2024-04-26T11:44:21.448517+0000","last_unstale":"2024-04-26T11:44:22.433958+0000","last_undegraded":"2024-04-26T11:44:22.433958+0000","last_fullsized":"2024-04-26T11:44:22.433958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819570+0000","last_change":"2024-04-26T11:44:21.439565+0000","last_active":"2024-04-26T11:44:22.819570+0000","last_peered":"2024-04-26T11:44:22.819570+0000","last_clean":"2024-04-26T11:44:22.819570+0000","last_became_active":"2024-04-26T11:44:21.438640+0000","last_became_peered":"2024-04-26T11:44:21.438640+0000","last_unstale":"2024-04-26T11:44:22.819570+0000","last_undegraded":"2024-04-26T11:44:22.819570+0000","last_fullsized":"2024-04-26T11:44:22.819570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435844+0000","last_change":"2024-04-26T11:44:21.437913+0000","last_active":"2024-04-26T11:44:22.435844+0000","last_peered":"2024-04-26T11:44:22.435844+0000","last_clean":"2024-04-26T11:44:22.435844+0000","last_became_active":"2024-04-26T11:44:21.437543+0000","last_became_peered":"2024-04-26T11:44:21.437543+0000","last_unstale":"2024-04-26T11:44:22.435844+0000","last_undegraded":"2024-04-26T11:44:22.435844+0000","last_fullsized":"2024-04-26T11:44:22.435844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818621+0000","last_change":"2024-04-26T11:44:21.440138+0000","last_active":"2024-04-26T11:44:22.818621+0000","last_peered":"2024-04-26T11:44:22.818621+0000","last_clean":"2024-04-26T11:44:22.818621+0000","last_became_active":"2024-04-26T11:44:21.439850+0000","last_became_peered":"2024-04-26T11:44:21.439850+0000","last_unstale":"2024-04-26T11:44:22.818621+0000","last_undegraded":"2024-04-26T11:44:22.818621+0000","last_fullsized":"2024-04-26T11:44:22.818621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435721+0000","last_change":"2024-04-26T11:44:21.449248+0000","last_active":"2024-04-26T11:44:22.435721+0000","last_peered":"2024-04-26T11:44:22.435721+0000","last_clean":"2024-04-26T11:44:22.435721+0000","last_became_active":"2024-04-26T11:44:21.448315+0000","last_became_peered":"2024-04-26T11:44:21.448315+0000","last_unstale":"2024-04-26T11:44:22.435721+0000","last_undegraded":"2024-04-26T11:44:22.435721+0000","last_fullsized":"2024-04-26T11:44:22.435721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436209+0000","last_change":"2024-04-26T11:44:21.448524+0000","last_active":"2024-04-26T11:44:22.436209+0000","last_peered":"2024-04-26T11:44:22.436209+0000","last_clean":"2024-04-26T11:44:22.436209+0000","last_became_active":"2024-04-26T11:44:21.447839+0000","last_became_peered":"2024-04-26T11:44:21.447839+0000","last_unstale":"2024-04-26T11:44:22.436209+0000","last_undegraded":"2024-04-26T11:44:22.436209+0000","last_fullsized":"2024-04-26T11:44:22.436209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434386+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:44:22.434386+0000","last_peered":"2024-04-26T11:44:22.434386+0000","last_clean":"2024-04-26T11:44:22.434386+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:44:22.434386+0000","last_undegraded":"2024-04-26T11:44:22.434386+0000","last_fullsized":"2024-04-26T11:44:22.434386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817486+0000","last_change":"2024-04-26T11:44:21.445626+0000","last_active":"2024-04-26T11:44:22.817486+0000","last_peered":"2024-04-26T11:44:22.817486+0000","last_clean":"2024-04-26T11:44:22.817486+0000","last_became_active":"2024-04-26T11:44:21.444990+0000","last_became_peered":"2024-04-26T11:44:21.444990+0000","last_unstale":"2024-04-26T11:44:22.817486+0000","last_undegraded":"2024-04-26T11:44:22.817486+0000","last_fullsized":"2024-04-26T11:44:22.817486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433782+0000","last_change":"2024-04-26T11:44:21.441463+0000","last_active":"2024-04-26T11:44:22.433782+0000","last_peered":"2024-04-26T11:44:22.433782+0000","last_clean":"2024-04-26T11:44:22.433782+0000","last_became_active":"2024-04-26T11:44:21.440895+0000","last_became_peered":"2024-04-26T11:44:21.440895+0000","last_unstale":"2024-04-26T11:44:22.433782+0000","last_undegraded":"2024-04-26T11:44:22.433782+0000","last_fullsized":"2024-04-26T11:44:22.433782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435906+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:44:22.435906+0000","last_peered":"2024-04-26T11:44:22.435906+0000","last_clean":"2024-04-26T11:44:22.435906+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:44:22.435906+0000","last_undegraded":"2024-04-26T11:44:22.435906+0000","last_fullsized":"2024-04-26T11:44:22.435906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819879+0000","last_change":"2024-04-26T11:44:21.444826+0000","last_active":"2024-04-26T11:44:22.819879+0000","last_peered":"2024-04-26T11:44:22.819879+0000","last_clean":"2024-04-26T11:44:22.819879+0000","last_became_active":"2024-04-26T11:44:21.444440+0000","last_became_peered":"2024-04-26T11:44:21.444440+0000","last_unstale":"2024-04-26T11:44:22.819879+0000","last_undegraded":"2024-04-26T11:44:22.819879+0000","last_fullsized":"2024-04-26T11:44:22.819879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436032+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:44:22.436032+0000","last_peered":"2024-04-26T11:44:22.436032+0000","last_clean":"2024-04-26T11:44:22.436032+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:44:22.436032+0000","last_undegraded":"2024-04-26T11:44:22.436032+0000","last_fullsized":"2024-04-26T11:44:22.436032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435465+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:44:22.435465+0000","last_peered":"2024-04-26T11:44:22.435465+0000","last_clean":"2024-04-26T11:44:22.435465+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:44:22.435465+0000","last_undegraded":"2024-04-26T11:44:22.435465+0000","last_fullsized":"2024-04-26T11:44:22.435465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819067+0000","last_change":"2024-04-26T11:44:21.439511+0000","last_active":"2024-04-26T11:44:22.819067+0000","last_peered":"2024-04-26T11:44:22.819067+0000","last_clean":"2024-04-26T11:44:22.819067+0000","last_became_active":"2024-04-26T11:44:21.438539+0000","last_became_peered":"2024-04-26T11:44:21.438539+0000","last_unstale":"2024-04-26T11:44:22.819067+0000","last_undegraded":"2024-04-26T11:44:22.819067+0000","last_fullsized":"2024-04-26T11:44:22.819067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434754+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:44:22.434754+0000","last_peered":"2024-04-26T11:44:22.434754+0000","last_clean":"2024-04-26T11:44:22.434754+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:44:22.434754+0000","last_undegraded":"2024-04-26T11:44:22.434754+0000","last_fullsized":"2024-04-26T11:44:22.434754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817638+0000","last_change":"2024-04-26T11:44:21.439772+0000","last_active":"2024-04-26T11:44:22.817638+0000","last_peered":"2024-04-26T11:44:22.817638+0000","last_clean":"2024-04-26T11:44:22.817638+0000","last_became_active":"2024-04-26T11:44:21.438770+0000","last_became_peered":"2024-04-26T11:44:21.438770+0000","last_unstale":"2024-04-26T11:44:22.817638+0000","last_undegraded":"2024-04-26T11:44:22.817638+0000","last_fullsized":"2024-04-26T11:44:22.817638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434091+0000","last_change":"2024-04-26T11:44:21.452228+0000","last_active":"2024-04-26T11:44:22.434091+0000","last_peered":"2024-04-26T11:44:22.434091+0000","last_clean":"2024-04-26T11:44:22.434091+0000","last_became_active":"2024-04-26T11:44:21.451258+0000","last_became_peered":"2024-04-26T11:44:21.451258+0000","last_unstale":"2024-04-26T11:44:22.434091+0000","last_undegraded":"2024-04-26T11:44:22.434091+0000","last_fullsized":"2024-04-26T11:44:22.434091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435434+0000","last_change":"2024-04-26T11:44:21.438961+0000","last_active":"2024-04-26T11:44:22.435434+0000","last_peered":"2024-04-26T11:44:22.435434+0000","last_clean":"2024-04-26T11:44:22.435434+0000","last_became_active":"2024-04-26T11:44:21.438124+0000","last_became_peered":"2024-04-26T11:44:21.438124+0000","last_unstale":"2024-04-26T11:44:22.435434+0000","last_undegraded":"2024-04-26T11:44:22.435434+0000","last_fullsized":"2024-04-26T11:44:22.435434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436336+0000","last_change":"2024-04-26T11:44:21.066359+0000","last_active":"2024-04-26T11:44:22.436336+0000","last_peered":"2024-04-26T11:44:22.436336+0000","last_clean":"2024-04-26T11:44:22.436336+0000","last_became_active":"2024-04-26T11:44:21.066007+0000","last_became_peered":"2024-04-26T11:44:21.066007+0000","last_unstale":"2024-04-26T11:44:22.436336+0000","last_undegraded":"2024-04-26T11:44:22.436336+0000","last_fullsized":"2024-04-26T11:44:22.436336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435741+0000","last_change":"2024-04-26T11:44:21.439295+0000","last_active":"2024-04-26T11:44:22.435741+0000","last_peered":"2024-04-26T11:44:22.435741+0000","last_clean":"2024-04-26T11:44:22.435741+0000","last_became_active":"2024-04-26T11:44:21.439097+0000","last_became_peered":"2024-04-26T11:44:21.439097+0000","last_unstale":"2024-04-26T11:44:22.435741+0000","last_undegraded":"2024-04-26T11:44:22.435741+0000","last_fullsized":"2024-04-26T11:44:22.435741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818216+0000","last_change":"2024-04-26T11:44:21.066646+0000","last_active":"2024-04-26T11:44:22.818216+0000","last_peered":"2024-04-26T11:44:22.818216+0000","last_clean":"2024-04-26T11:44:22.818216+0000","last_became_active":"2024-04-26T11:44:21.065981+0000","last_became_peered":"2024-04-26T11:44:21.065981+0000","last_unstale":"2024-04-26T11:44:22.818216+0000","last_undegraded":"2024-04-26T11:44:22.818216+0000","last_fullsized":"2024-04-26T11:44:22.818216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820032+0000","last_change":"2024-04-26T11:44:21.443681+0000","last_active":"2024-04-26T11:44:22.820032+0000","last_peered":"2024-04-26T11:44:22.820032+0000","last_clean":"2024-04-26T11:44:22.820032+0000","last_became_active":"2024-04-26T11:44:21.443253+0000","last_became_peered":"2024-04-26T11:44:21.443253+0000","last_unstale":"2024-04-26T11:44:22.820032+0000","last_undegraded":"2024-04-26T11:44:22.820032+0000","last_fullsized":"2024-04-26T11:44:22.820032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434717+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:44:22.434717+0000","last_peered":"2024-04-26T11:44:22.434717+0000","last_clean":"2024-04-26T11:44:22.434717+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:44:22.434717+0000","last_undegraded":"2024-04-26T11:44:22.434717+0000","last_fullsized":"2024-04-26T11:44:22.434717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818804+0000","last_change":"2024-04-26T11:44:21.445426+0000","last_active":"2024-04-26T11:44:22.818804+0000","last_peered":"2024-04-26T11:44:22.818804+0000","last_clean":"2024-04-26T11:44:22.818804+0000","last_became_active":"2024-04-26T11:44:21.444674+0000","last_became_peered":"2024-04-26T11:44:21.444674+0000","last_unstale":"2024-04-26T11:44:22.818804+0000","last_undegraded":"2024-04-26T11:44:22.818804+0000","last_fullsized":"2024-04-26T11:44:22.818804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434190+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:44:22.434190+0000","last_peered":"2024-04-26T11:44:22.434190+0000","last_clean":"2024-04-26T11:44:22.434190+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:44:22.434190+0000","last_undegraded":"2024-04-26T11:44:22.434190+0000","last_fullsized":"2024-04-26T11:44:22.434190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435770+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:44:22.435770+0000","last_peered":"2024-04-26T11:44:22.435770+0000","last_clean":"2024-04-26T11:44:22.435770+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:44:22.435770+0000","last_undegraded":"2024-04-26T11:44:22.435770+0000","last_fullsized":"2024-04-26T11:44:22.435770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433826+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:44:22.433826+0000","last_peered":"2024-04-26T11:44:22.433826+0000","last_clean":"2024-04-26T11:44:22.433826+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:44:22.433826+0000","last_undegraded":"2024-04-26T11:44:22.433826+0000","last_fullsized":"2024-04-26T11:44:22.433826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436104+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:44:22.436104+0000","last_peered":"2024-04-26T11:44:22.436104+0000","last_clean":"2024-04-26T11:44:22.436104+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:44:22.436104+0000","last_undegraded":"2024-04-26T11:44:22.436104+0000","last_fullsized":"2024-04-26T11:44:22.436104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433901+0000","last_change":"2024-04-26T11:44:21.442188+0000","last_active":"2024-04-26T11:44:22.433901+0000","last_peered":"2024-04-26T11:44:22.433901+0000","last_clean":"2024-04-26T11:44:22.433901+0000","last_became_active":"2024-04-26T11:44:21.441105+0000","last_became_peered":"2024-04-26T11:44:21.441105+0000","last_unstale":"2024-04-26T11:44:22.433901+0000","last_undegraded":"2024-04-26T11:44:22.433901+0000","last_fullsized":"2024-04-26T11:44:22.433901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436283+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:44:22.436283+0000","last_peered":"2024-04-26T11:44:22.436283+0000","last_clean":"2024-04-26T11:44:22.436283+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:44:22.436283+0000","last_undegraded":"2024-04-26T11:44:22.436283+0000","last_fullsized":"2024-04-26T11:44:22.436283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435798+0000","last_change":"2024-04-26T11:44:21.449433+0000","last_active":"2024-04-26T11:44:22.435798+0000","last_peered":"2024-04-26T11:44:22.435798+0000","last_clean":"2024-04-26T11:44:22.435798+0000","last_became_active":"2024-04-26T11:44:21.447831+0000","last_became_peered":"2024-04-26T11:44:21.447831+0000","last_unstale":"2024-04-26T11:44:22.435798+0000","last_undegraded":"2024-04-26T11:44:22.435798+0000","last_fullsized":"2024-04-26T11:44:22.435798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435987+0000","last_change":"2024-04-26T11:44:21.065647+0000","last_active":"2024-04-26T11:44:22.435987+0000","last_peered":"2024-04-26T11:44:22.435987+0000","last_clean":"2024-04-26T11:44:22.435987+0000","last_became_active":"2024-04-26T11:44:21.065197+0000","last_became_peered":"2024-04-26T11:44:21.065197+0000","last_unstale":"2024-04-26T11:44:22.435987+0000","last_undegraded":"2024-04-26T11:44:22.435987+0000","last_fullsized":"2024-04-26T11:44:22.435987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818851+0000","last_change":"2024-04-26T11:44:21.443848+0000","last_active":"2024-04-26T11:44:22.818851+0000","last_peered":"2024-04-26T11:44:22.818851+0000","last_clean":"2024-04-26T11:44:22.818851+0000","last_became_active":"2024-04-26T11:44:21.443580+0000","last_became_peered":"2024-04-26T11:44:21.443580+0000","last_unstale":"2024-04-26T11:44:22.818851+0000","last_undegraded":"2024-04-26T11:44:22.818851+0000","last_fullsized":"2024-04-26T11:44:22.818851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819315+0000","last_change":"2024-04-26T11:44:21.068336+0000","last_active":"2024-04-26T11:44:22.819315+0000","last_peered":"2024-04-26T11:44:22.819315+0000","last_clean":"2024-04-26T11:44:22.819315+0000","last_became_active":"2024-04-26T11:44:21.067530+0000","last_became_peered":"2024-04-26T11:44:21.067530+0000","last_unstale":"2024-04-26T11:44:22.819315+0000","last_undegraded":"2024-04-26T11:44:22.819315+0000","last_fullsized":"2024-04-26T11:44:22.819315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435445+0000","last_change":"2024-04-26T11:44:21.449238+0000","last_active":"2024-04-26T11:44:22.435445+0000","last_peered":"2024-04-26T11:44:22.435445+0000","last_clean":"2024-04-26T11:44:22.435445+0000","last_became_active":"2024-04-26T11:44:21.447694+0000","last_became_peered":"2024-04-26T11:44:21.447694+0000","last_unstale":"2024-04-26T11:44:22.435445+0000","last_undegraded":"2024-04-26T11:44:22.435445+0000","last_fullsized":"2024-04-26T11:44:22.435445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435196+0000","last_change":"2024-04-26T11:44:21.066212+0000","last_active":"2024-04-26T11:44:22.435196+0000","last_peered":"2024-04-26T11:44:22.435196+0000","last_clean":"2024-04-26T11:44:22.435196+0000","last_became_active":"2024-04-26T11:44:21.065186+0000","last_became_peered":"2024-04-26T11:44:21.065186+0000","last_unstale":"2024-04-26T11:44:22.435196+0000","last_undegraded":"2024-04-26T11:44:22.435196+0000","last_fullsized":"2024-04-26T11:44:22.435196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436154+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:44:22.436154+0000","last_peered":"2024-04-26T11:44:22.436154+0000","last_clean":"2024-04-26T11:44:22.436154+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:44:22.436154+0000","last_undegraded":"2024-04-26T11:44:22.436154+0000","last_fullsized":"2024-04-26T11:44:22.436154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434230+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:44:22.434230+0000","last_peered":"2024-04-26T11:44:22.434230+0000","last_clean":"2024-04-26T11:44:22.434230+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:44:22.434230+0000","last_undegraded":"2024-04-26T11:44:22.434230+0000","last_fullsized":"2024-04-26T11:44:22.434230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435383+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:44:22.435383+0000","last_peered":"2024-04-26T11:44:22.435383+0000","last_clean":"2024-04-26T11:44:22.435383+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:44:22.435383+0000","last_undegraded":"2024-04-26T11:44:22.435383+0000","last_fullsized":"2024-04-26T11:44:22.435383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434021+0000","last_change":"2024-04-26T11:44:21.065486+0000","last_active":"2024-04-26T11:44:22.434021+0000","last_peered":"2024-04-26T11:44:22.434021+0000","last_clean":"2024-04-26T11:44:22.434021+0000","last_became_active":"2024-04-26T11:44:21.065090+0000","last_became_peered":"2024-04-26T11:44:21.065090+0000","last_unstale":"2024-04-26T11:44:22.434021+0000","last_undegraded":"2024-04-26T11:44:22.434021+0000","last_fullsized":"2024-04-26T11:44:22.434021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:03.456923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818894+0000","last_change":"2024-04-26T11:44:21.446431+0000","last_active":"2024-04-26T11:44:22.818894+0000","last_peered":"2024-04-26T11:44:22.818894+0000","last_clean":"2024-04-26T11:44:22.818894+0000","last_became_active":"2024-04-26T11:44:21.445866+0000","last_became_peered":"2024-04-26T11:44:21.445866+0000","last_unstale":"2024-04-26T11:44:22.818894+0000","last_undegraded":"2024-04-26T11:44:22.818894+0000","last_fullsized":"2024-04-26T11:44:22.818894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440035+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:44:21.440035+0000","last_peered":"2024-04-26T11:44:21.440035+0000","last_clean":"2024-04-26T11:44:21.440035+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:44:21.440035+0000","last_undegraded":"2024-04-26T11:44:21.440035+0000","last_fullsized":"2024-04-26T11:44:21.440035+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440187+0000","last_change":"2024-04-26T11:44:17.037102+0000","last_active":"2024-04-26T11:44:21.440187+0000","last_peered":"2024-04-26T11:44:21.440187+0000","last_clean":"2024-04-26T11:44:21.440187+0000","last_became_active":"2024-04-26T11:44:17.036242+0000","last_became_peered":"2024-04-26T11:44:17.036242+0000","last_unstale":"2024-04-26T11:44:21.440187+0000","last_undegraded":"2024-04-26T11:44:21.440187+0000","last_fullsized":"2024-04-26T11:44:21.440187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818647+0000","last_change":"2024-04-26T11:44:21.064980+0000","last_active":"2024-04-26T11:44:22.818647+0000","last_peered":"2024-04-26T11:44:22.818647+0000","last_clean":"2024-04-26T11:44:22.818647+0000","last_became_active":"2024-04-26T11:44:21.064569+0000","last_became_peered":"2024-04-26T11:44:21.064569+0000","last_unstale":"2024-04-26T11:44:22.818647+0000","last_undegraded":"2024-04-26T11:44:22.818647+0000","last_fullsized":"2024-04-26T11:44:22.818647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436303+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:44:22.436303+0000","last_peered":"2024-04-26T11:44:22.436303+0000","last_clean":"2024-04-26T11:44:22.436303+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:44:22.436303+0000","last_undegraded":"2024-04-26T11:44:22.436303+0000","last_fullsized":"2024-04-26T11:44:22.436303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439848+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:44:21.439848+0000","last_peered":"2024-04-26T11:44:21.439848+0000","last_clean":"2024-04-26T11:44:21.439848+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:44:21.439848+0000","last_undegraded":"2024-04-26T11:44:21.439848+0000","last_fullsized":"2024-04-26T11:44:21.439848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818702+0000","last_change":"2024-04-26T11:44:21.066838+0000","last_active":"2024-04-26T11:44:22.818702+0000","last_peered":"2024-04-26T11:44:22.818702+0000","last_clean":"2024-04-26T11:44:22.818702+0000","last_became_active":"2024-04-26T11:44:21.065781+0000","last_became_peered":"2024-04-26T11:44:21.065781+0000","last_unstale":"2024-04-26T11:44:22.818702+0000","last_undegraded":"2024-04-26T11:44:22.818702+0000","last_fullsized":"2024-04-26T11:44:22.818702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435884+0000","last_change":"2024-04-26T11:44:21.439222+0000","last_active":"2024-04-26T11:44:22.435884+0000","last_peered":"2024-04-26T11:44:22.435884+0000","last_clean":"2024-04-26T11:44:22.435884+0000","last_became_active":"2024-04-26T11:44:21.438876+0000","last_became_peered":"2024-04-26T11:44:21.438876+0000","last_unstale":"2024-04-26T11:44:22.435884+0000","last_undegraded":"2024-04-26T11:44:22.435884+0000","last_fullsized":"2024-04-26T11:44:22.435884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.435673+0000","last_change":"2024-04-26T11:44:17.031172+0000","last_active":"2024-04-26T11:44:21.435673+0000","last_peered":"2024-04-26T11:44:21.435673+0000","last_clean":"2024-04-26T11:44:21.435673+0000","last_became_active":"2024-04-26T11:44:17.030306+0000","last_became_peered":"2024-04-26T11:44:17.030306+0000","last_unstale":"2024-04-26T11:44:21.435673+0000","last_undegraded":"2024-04-26T11:44:21.435673+0000","last_fullsized":"2024-04-26T11:44:21.435673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:30.564274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434093+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:44:22.434093+0000","last_peered":"2024-04-26T11:44:22.434093+0000","last_clean":"2024-04-26T11:44:22.434093+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:44:22.434093+0000","last_undegraded":"2024-04-26T11:44:22.434093+0000","last_fullsized":"2024-04-26T11:44:22.434093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819030+0000","last_change":"2024-04-26T11:44:21.440135+0000","last_active":"2024-04-26T11:44:22.819030+0000","last_peered":"2024-04-26T11:44:22.819030+0000","last_clean":"2024-04-26T11:44:22.819030+0000","last_became_active":"2024-04-26T11:44:21.439757+0000","last_became_peered":"2024-04-26T11:44:21.439757+0000","last_unstale":"2024-04-26T11:44:22.819030+0000","last_undegraded":"2024-04-26T11:44:22.819030+0000","last_fullsized":"2024-04-26T11:44:22.819030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.437818+0000","last_change":"2024-04-26T11:44:17.037146+0000","last_active":"2024-04-26T11:44:21.437818+0000","last_peered":"2024-04-26T11:44:21.437818+0000","last_clean":"2024-04-26T11:44:21.437818+0000","last_became_active":"2024-04-26T11:44:17.036196+0000","last_became_peered":"2024-04-26T11:44:17.036196+0000","last_unstale":"2024-04-26T11:44:21.437818+0000","last_undegraded":"2024-04-26T11:44:21.437818+0000","last_fullsized":"2024-04-26T11:44:21.437818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.409299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436401+0000","last_change":"2024-04-26T11:44:21.065821+0000","last_active":"2024-04-26T11:44:22.436401+0000","last_peered":"2024-04-26T11:44:22.436401+0000","last_clean":"2024-04-26T11:44:22.436401+0000","last_became_active":"2024-04-26T11:44:21.065300+0000","last_became_peered":"2024-04-26T11:44:21.065300+0000","last_unstale":"2024-04-26T11:44:22.436401+0000","last_undegraded":"2024-04-26T11:44:22.436401+0000","last_fullsized":"2024-04-26T11:44:22.436401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819416+0000","last_change":"2024-04-26T11:44:21.439526+0000","last_active":"2024-04-26T11:44:22.819416+0000","last_peered":"2024-04-26T11:44:22.819416+0000","last_clean":"2024-04-26T11:44:22.819416+0000","last_became_active":"2024-04-26T11:44:21.438786+0000","last_became_peered":"2024-04-26T11:44:21.438786+0000","last_unstale":"2024-04-26T11:44:22.819416+0000","last_undegraded":"2024-04-26T11:44:22.819416+0000","last_fullsized":"2024-04-26T11:44:22.819416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436395+0000","last_change":"2024-04-26T11:44:21.066276+0000","last_active":"2024-04-26T11:44:22.436395+0000","last_peered":"2024-04-26T11:44:22.436395+0000","last_clean":"2024-04-26T11:44:22.436395+0000","last_became_active":"2024-04-26T11:44:21.065682+0000","last_became_peered":"2024-04-26T11:44:21.065682+0000","last_unstale":"2024-04-26T11:44:22.436395+0000","last_undegraded":"2024-04-26T11:44:22.436395+0000","last_fullsized":"2024-04-26T11:44:22.436395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436324+0000","last_change":"2024-04-26T11:44:17.031782+0000","last_active":"2024-04-26T11:44:21.436324+0000","last_peered":"2024-04-26T11:44:21.436324+0000","last_clean":"2024-04-26T11:44:21.436324+0000","last_became_active":"2024-04-26T11:44:17.030688+0000","last_became_peered":"2024-04-26T11:44:17.030688+0000","last_unstale":"2024-04-26T11:44:21.436324+0000","last_undegraded":"2024-04-26T11:44:21.436324+0000","last_fullsized":"2024-04-26T11:44:21.436324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.289819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434465+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:44:22.434465+0000","last_peered":"2024-04-26T11:44:22.434465+0000","last_clean":"2024-04-26T11:44:22.434465+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:44:22.434465+0000","last_undegraded":"2024-04-26T11:44:22.434465+0000","last_fullsized":"2024-04-26T11:44:22.434465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819493+0000","last_change":"2024-04-26T11:44:21.065142+0000","last_active":"2024-04-26T11:44:22.819493+0000","last_peered":"2024-04-26T11:44:22.819493+0000","last_clean":"2024-04-26T11:44:22.819493+0000","last_became_active":"2024-04-26T11:44:21.064672+0000","last_became_peered":"2024-04-26T11:44:21.064672+0000","last_unstale":"2024-04-26T11:44:22.819493+0000","last_undegraded":"2024-04-26T11:44:22.819493+0000","last_fullsized":"2024-04-26T11:44:22.819493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.433676+0000","last_change":"2024-04-26T11:44:17.031146+0000","last_active":"2024-04-26T11:44:21.433676+0000","last_peered":"2024-04-26T11:44:21.433676+0000","last_clean":"2024-04-26T11:44:21.433676+0000","last_became_active":"2024-04-26T11:44:17.030637+0000","last_became_peered":"2024-04-26T11:44:17.030637+0000","last_unstale":"2024-04-26T11:44:21.433676+0000","last_undegraded":"2024-04-26T11:44:21.433676+0000","last_fullsized":"2024-04-26T11:44:21.433676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434766+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:44:22.434766+0000","last_peered":"2024-04-26T11:44:22.434766+0000","last_clean":"2024-04-26T11:44:22.434766+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:44:22.434766+0000","last_undegraded":"2024-04-26T11:44:22.434766+0000","last_fullsized":"2024-04-26T11:44:22.434766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819801+0000","last_change":"2024-04-26T11:44:21.065483+0000","last_active":"2024-04-26T11:44:22.819801+0000","last_peered":"2024-04-26T11:44:22.819801+0000","last_clean":"2024-04-26T11:44:22.819801+0000","last_became_active":"2024-04-26T11:44:21.064772+0000","last_became_peered":"2024-04-26T11:44:21.064772+0000","last_unstale":"2024-04-26T11:44:22.819801+0000","last_undegraded":"2024-04-26T11:44:22.819801+0000","last_fullsized":"2024-04-26T11:44:22.819801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436718+0000","last_change":"2024-04-26T11:44:17.031358+0000","last_active":"2024-04-26T11:44:21.436718+0000","last_peered":"2024-04-26T11:44:21.436718+0000","last_clean":"2024-04-26T11:44:21.436718+0000","last_became_active":"2024-04-26T11:44:17.030413+0000","last_became_peered":"2024-04-26T11:44:17.030413+0000","last_unstale":"2024-04-26T11:44:21.436718+0000","last_undegraded":"2024-04-26T11:44:21.436718+0000","last_fullsized":"2024-04-26T11:44:21.436718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817817+0000","last_change":"2024-04-26T11:44:21.444989+0000","last_active":"2024-04-26T11:44:22.817817+0000","last_peered":"2024-04-26T11:44:22.817817+0000","last_clean":"2024-04-26T11:44:22.817817+0000","last_became_active":"2024-04-26T11:44:21.444418+0000","last_became_peered":"2024-04-26T11:44:21.444418+0000","last_unstale":"2024-04-26T11:44:22.817817+0000","last_undegraded":"2024-04-26T11:44:22.817817+0000","last_fullsized":"2024-04-26T11:44:22.817817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:23.968635+0000","last_change":"2024-04-26T11:44:21.067525+0000","last_active":"2024-04-26T11:44:23.968635+0000","last_peered":"2024-04-26T11:44:23.968635+0000","last_clean":"2024-04-26T11:44:23.968635+0000","last_became_active":"2024-04-26T11:44:21.065923+0000","last_became_peered":"2024-04-26T11:44:21.065923+0000","last_unstale":"2024-04-26T11:44:23.968635+0000","last_undegraded":"2024-04-26T11:44:23.968635+0000","last_fullsized":"2024-04-26T11:44:23.968635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439731+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:44:21.439731+0000","last_peered":"2024-04-26T11:44:21.439731+0000","last_clean":"2024-04-26T11:44:21.439731+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:44:21.439731+0000","last_undegraded":"2024-04-26T11:44:21.439731+0000","last_fullsized":"2024-04-26T11:44:21.439731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434002+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:44:22.434002+0000","last_peered":"2024-04-26T11:44:22.434002+0000","last_clean":"2024-04-26T11:44:22.434002+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:44:22.434002+0000","last_undegraded":"2024-04-26T11:44:22.434002+0000","last_fullsized":"2024-04-26T11:44:22.434002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435702+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:44:22.435702+0000","last_peered":"2024-04-26T11:44:22.435702+0000","last_clean":"2024-04-26T11:44:22.435702+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:44:22.435702+0000","last_undegraded":"2024-04-26T11:44:22.435702+0000","last_fullsized":"2024-04-26T11:44:22.435702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435885+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:44:22.435885+0000","last_peered":"2024-04-26T11:44:22.435885+0000","last_clean":"2024-04-26T11:44:22.435885+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:44:22.435885+0000","last_undegraded":"2024-04-26T11:44:22.435885+0000","last_fullsized":"2024-04-26T11:44:22.435885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817896+0000","last_change":"2024-04-26T11:44:21.437907+0000","last_active":"2024-04-26T11:44:22.817896+0000","last_peered":"2024-04-26T11:44:22.817896+0000","last_clean":"2024-04-26T11:44:22.817896+0000","last_became_active":"2024-04-26T11:44:21.437024+0000","last_became_peered":"2024-04-26T11:44:21.437024+0000","last_unstale":"2024-04-26T11:44:22.817896+0000","last_undegraded":"2024-04-26T11:44:22.817896+0000","last_fullsized":"2024-04-26T11:44:22.817896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435937+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:44:22.435937+0000","last_peered":"2024-04-26T11:44:22.435937+0000","last_clean":"2024-04-26T11:44:22.435937+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:44:22.435937+0000","last_undegraded":"2024-04-26T11:44:22.435937+0000","last_fullsized":"2024-04-26T11:44:22.435937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435601+0000","last_change":"2024-04-26T11:44:21.065944+0000","last_active":"2024-04-26T11:44:22.435601+0000","last_peered":"2024-04-26T11:44:22.435601+0000","last_clean":"2024-04-26T11:44:22.435601+0000","last_became_active":"2024-04-26T11:44:21.065251+0000","last_became_peered":"2024-04-26T11:44:21.065251+0000","last_unstale":"2024-04-26T11:44:22.435601+0000","last_undegraded":"2024-04-26T11:44:22.435601+0000","last_fullsized":"2024-04-26T11:44:22.435601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817770+0000","last_change":"2024-04-26T11:44:21.445619+0000","last_active":"2024-04-26T11:44:22.817770+0000","last_peered":"2024-04-26T11:44:22.817770+0000","last_clean":"2024-04-26T11:44:22.817770+0000","last_became_active":"2024-04-26T11:44:21.444597+0000","last_became_peered":"2024-04-26T11:44:21.444597+0000","last_unstale":"2024-04-26T11:44:22.817770+0000","last_undegraded":"2024-04-26T11:44:22.817770+0000","last_fullsized":"2024-04-26T11:44:22.817770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819319+0000","last_change":"2024-04-26T11:44:21.067177+0000","last_active":"2024-04-26T11:44:22.819319+0000","last_peered":"2024-04-26T11:44:22.819319+0000","last_clean":"2024-04-26T11:44:22.819319+0000","last_became_active":"2024-04-26T11:44:21.066727+0000","last_became_peered":"2024-04-26T11:44:21.066727+0000","last_unstale":"2024-04-26T11:44:22.819319+0000","last_undegraded":"2024-04-26T11:44:22.819319+0000","last_fullsized":"2024-04-26T11:44:22.819319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817835+0000","last_change":"2024-04-26T11:44:21.439357+0000","last_active":"2024-04-26T11:44:22.817835+0000","last_peered":"2024-04-26T11:44:22.817835+0000","last_clean":"2024-04-26T11:44:22.817835+0000","last_became_active":"2024-04-26T11:44:21.438703+0000","last_became_peered":"2024-04-26T11:44:21.438703+0000","last_unstale":"2024-04-26T11:44:22.817835+0000","last_undegraded":"2024-04-26T11:44:22.817835+0000","last_fullsized":"2024-04-26T11:44:22.817835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436060+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:44:22.436060+0000","last_peered":"2024-04-26T11:44:22.436060+0000","last_clean":"2024-04-26T11:44:22.436060+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:44:22.436060+0000","last_undegraded":"2024-04-26T11:44:22.436060+0000","last_fullsized":"2024-04-26T11:44:22.436060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818065+0000","last_change":"2024-04-26T11:44:21.065373+0000","last_active":"2024-04-26T11:44:22.818065+0000","last_peered":"2024-04-26T11:44:22.818065+0000","last_clean":"2024-04-26T11:44:22.818065+0000","last_became_active":"2024-04-26T11:44:21.064598+0000","last_became_peered":"2024-04-26T11:44:21.064598+0000","last_unstale":"2024-04-26T11:44:22.818065+0000","last_undegraded":"2024-04-26T11:44:22.818065+0000","last_fullsized":"2024-04-26T11:44:22.818065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819621+0000","last_change":"2024-04-26T11:44:21.445216+0000","last_active":"2024-04-26T11:44:22.819621+0000","last_peered":"2024-04-26T11:44:22.819621+0000","last_clean":"2024-04-26T11:44:22.819621+0000","last_became_active":"2024-04-26T11:44:21.444615+0000","last_became_peered":"2024-04-26T11:44:21.444615+0000","last_unstale":"2024-04-26T11:44:22.819621+0000","last_undegraded":"2024-04-26T11:44:22.819621+0000","last_fullsized":"2024-04-26T11:44:22.819621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818131+0000","last_change":"2024-04-26T11:44:21.066483+0000","last_active":"2024-04-26T11:44:22.818131+0000","last_peered":"2024-04-26T11:44:22.818131+0000","last_clean":"2024-04-26T11:44:22.818131+0000","last_became_active":"2024-04-26T11:44:21.065373+0000","last_became_peered":"2024-04-26T11:44:21.065373+0000","last_unstale":"2024-04-26T11:44:22.818131+0000","last_undegraded":"2024-04-26T11:44:22.818131+0000","last_fullsized":"2024-04-26T11:44:22.818131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435451+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:44:22.435451+0000","last_peered":"2024-04-26T11:44:22.435451+0000","last_clean":"2024-04-26T11:44:22.435451+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:44:22.435451+0000","last_undegraded":"2024-04-26T11:44:22.435451+0000","last_fullsized":"2024-04-26T11:44:22.435451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434803+0000","last_change":"2024-04-26T11:44:21.065431+0000","last_active":"2024-04-26T11:44:22.434803+0000","last_peered":"2024-04-26T11:44:22.434803+0000","last_clean":"2024-04-26T11:44:22.434803+0000","last_became_active":"2024-04-26T11:44:21.065114+0000","last_became_peered":"2024-04-26T11:44:21.065114+0000","last_unstale":"2024-04-26T11:44:22.434803+0000","last_undegraded":"2024-04-26T11:44:22.434803+0000","last_fullsized":"2024-04-26T11:44:22.434803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:39.838237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435212+0000","last_change":"2024-04-26T11:44:21.441795+0000","last_active":"2024-04-26T11:44:22.435212+0000","last_peered":"2024-04-26T11:44:22.435212+0000","last_clean":"2024-04-26T11:44:22.435212+0000","last_became_active":"2024-04-26T11:44:21.441421+0000","last_became_peered":"2024-04-26T11:44:21.441421+0000","last_unstale":"2024-04-26T11:44:22.435212+0000","last_undegraded":"2024-04-26T11:44:22.435212+0000","last_fullsized":"2024-04-26T11:44:22.435212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435013+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:44:22.435013+0000","last_peered":"2024-04-26T11:44:22.435013+0000","last_clean":"2024-04-26T11:44:22.435013+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:44:22.435013+0000","last_undegraded":"2024-04-26T11:44:22.435013+0000","last_fullsized":"2024-04-26T11:44:22.435013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436177+0000","last_change":"2024-04-26T11:44:21.448442+0000","last_active":"2024-04-26T11:44:22.436177+0000","last_peered":"2024-04-26T11:44:22.436177+0000","last_clean":"2024-04-26T11:44:22.436177+0000","last_became_active":"2024-04-26T11:44:21.447770+0000","last_became_peered":"2024-04-26T11:44:21.447770+0000","last_unstale":"2024-04-26T11:44:22.436177+0000","last_undegraded":"2024-04-26T11:44:22.436177+0000","last_fullsized":"2024-04-26T11:44:22.436177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435664+0000","last_change":"2024-04-26T11:44:21.066498+0000","last_active":"2024-04-26T11:44:22.435664+0000","last_peered":"2024-04-26T11:44:22.435664+0000","last_clean":"2024-04-26T11:44:22.435664+0000","last_became_active":"2024-04-26T11:44:21.065945+0000","last_became_peered":"2024-04-26T11:44:21.065945+0000","last_unstale":"2024-04-26T11:44:22.435664+0000","last_undegraded":"2024-04-26T11:44:22.435664+0000","last_fullsized":"2024-04-26T11:44:22.435664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434988+0000","last_change":"2024-04-26T11:44:21.448777+0000","last_active":"2024-04-26T11:44:22.434988+0000","last_peered":"2024-04-26T11:44:22.434988+0000","last_clean":"2024-04-26T11:44:22.434988+0000","last_became_active":"2024-04-26T11:44:21.448274+0000","last_became_peered":"2024-04-26T11:44:21.448274+0000","last_unstale":"2024-04-26T11:44:22.434988+0000","last_undegraded":"2024-04-26T11:44:22.434988+0000","last_fullsized":"2024-04-26T11:44:22.434988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435817+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:44:22.435817+0000","last_peered":"2024-04-26T11:44:22.435817+0000","last_clean":"2024-04-26T11:44:22.435817+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:44:22.435817+0000","last_undegraded":"2024-04-26T11:44:22.435817+0000","last_fullsized":"2024-04-26T11:44:22.435817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434476+0000","last_change":"2024-04-26T11:44:21.438183+0000","last_active":"2024-04-26T11:44:22.434476+0000","last_peered":"2024-04-26T11:44:22.434476+0000","last_clean":"2024-04-26T11:44:22.434476+0000","last_became_active":"2024-04-26T11:44:21.437823+0000","last_became_peered":"2024-04-26T11:44:21.437823+0000","last_unstale":"2024-04-26T11:44:22.434476+0000","last_undegraded":"2024-04-26T11:44:22.434476+0000","last_fullsized":"2024-04-26T11:44:22.434476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820080+0000","last_change":"2024-04-26T11:44:21.068479+0000","last_active":"2024-04-26T11:44:22.820080+0000","last_peered":"2024-04-26T11:44:22.820080+0000","last_clean":"2024-04-26T11:44:22.820080+0000","last_became_active":"2024-04-26T11:44:21.068206+0000","last_became_peered":"2024-04-26T11:44:21.068206+0000","last_unstale":"2024-04-26T11:44:22.820080+0000","last_undegraded":"2024-04-26T11:44:22.820080+0000","last_fullsized":"2024-04-26T11:44:22.820080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434365+0000","last_change":"2024-04-26T11:44:21.452369+0000","last_active":"2024-04-26T11:44:22.434365+0000","last_peered":"2024-04-26T11:44:22.434365+0000","last_clean":"2024-04-26T11:44:22.434365+0000","last_became_active":"2024-04-26T11:44:21.451833+0000","last_became_peered":"2024-04-26T11:44:21.451833+0000","last_unstale":"2024-04-26T11:44:22.434365+0000","last_undegraded":"2024-04-26T11:44:22.434365+0000","last_fullsized":"2024-04-26T11:44:22.434365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819101+0000","last_change":"2024-04-26T11:44:21.068300+0000","last_active":"2024-04-26T11:44:22.819101+0000","last_peered":"2024-04-26T11:44:22.819101+0000","last_clean":"2024-04-26T11:44:22.819101+0000","last_became_active":"2024-04-26T11:44:21.067285+0000","last_became_peered":"2024-04-26T11:44:21.067285+0000","last_unstale":"2024-04-26T11:44:22.819101+0000","last_undegraded":"2024-04-26T11:44:22.819101+0000","last_fullsized":"2024-04-26T11:44:22.819101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":790528,"data_stored":650427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":782336,"data_stored":649811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:44:33.768 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T11:44:33.768 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T11:44:33.768 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T11:44:33.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T11:44:34.104 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:34.104 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T11:44:34.119 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T11:44:34.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:34.424 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:34.424 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:22.421187+0000","last_up_change":"2024-04-26T11:44:08.882935+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:34.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:44:10.024928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:44:15.295362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:44:19.992912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:44:20.415578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:44:34.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:44:34.744 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-26T11:44:34.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:44:35.067 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2024-04-26T11:44:35.088 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T11:44:35.395 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-26T11:44:35.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T11:44:35.718 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-26T11:44:35.733 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:44:36.072 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:36.072 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:44:21.418355+0000","modified":"2024-04-26T11:44:24.430416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4213":{"gid":4213,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/3774122357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3774122357},{"type":"v1","addr":"172.21.15.29:6803","nonce":3774122357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:44:36.075 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:44:36.087 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:36.386 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:36.386 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:22.421187+0000","last_up_change":"2024-04-26T11:44:08.882935+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:36.405 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:44:10.024928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:44:15.295362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:44:19.992912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:44:20.415578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:44:36.405 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:44:36.712 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-26T11:44:36.726 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:44:37.034 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2024-04-26T11:44:37.049 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T11:44:37.340 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-26T11:44:37.355 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T11:44:37.657 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-26T11:44:37.673 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:44:38.018 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:38.018 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:44:21.418355+0000","modified":"2024-04-26T11:44:24.430416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4213":{"gid":4213,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/3774122357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3774122357},{"type":"v1","addr":"172.21.15.29:6803","nonce":3774122357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:44:38.021 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:44:38.032 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:44:38.331 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:38.331 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:44:22.421187+0000","last_up_change":"2024-04-26T11:44:08.882935+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:44:38.346 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:44:38.685 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:38.686 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:44:21.418355+0000","modified":"2024-04-26T11:44:24.430416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4213":{"gid":4213,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/3774122357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3774122357},{"type":"v1","addr":"172.21.15.29:6803","nonce":3774122357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:44:38.689 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:44:38.801 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T11:44:21.418355+0000', 'modified': '2024-04-26T11:44:24.430416+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4213}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4213': {'gid': 4213, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6803/3774122357', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6802', 'nonce': 3774122357}, {'type': 'v1', 'addr': '172.21.15.29:6803', 'nonce': 3774122357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-26T11:44:38.801 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T11:44:38.801 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T11:44:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T11:44:38.939+0000 7eff1dffb700 0 client.4638 ms_handle_reset on v2:172.21.15.29:6802/3774122357 2024-04-26T11:44:38.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T11:44:38.967+0000 7eff1dffb700 0 client.4644 ms_handle_reset on v2:172.21.15.29:6802/3774122357 2024-04-26T11:44:38.970 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7", 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4213, 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 17.547790934999998, 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 6, 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 19, 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 19, 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 21.838802124000001 2024-04-26T11:44:38.971 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:44:38.989 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T11:44:39.002 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T11:44:39.002 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}} 2024-04-26T11:44:39.002 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T11:44:39.003 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-26T11:44:39.003 DEBUG:teuthology.orchestra.run.smithi029:> sync 2024-04-26T11:44:39.387 DEBUG:teuthology.orchestra.run.smithi072:> sync 2024-04-26T11:44:39.512 DEBUG:teuthology.orchestra.run.smithi082:> sync 2024-04-26T11:44:39.577 DEBUG:teuthology.orchestra.run.smithi122:> sync 2024-04-26T11:44:39.641 DEBUG:tasks.thrashosds:checking console status of smithi029 2024-04-26T11:44:39.642 DEBUG:teuthology.orchestra.console.smithi029:Waiting for login prompt 2024-04-26T11:44:39.642 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi029 2024-04-26T11:44:39.756 DEBUG:teuthology.orchestra.console.smithi029:expect before: [Enter `^Ec?' for help] 2024-04-26T11:44:39.757 DEBUG:teuthology.orchestra.console.smithi029:expect after: smithi029 login: 2024-04-26T11:44:39.809 DEBUG:teuthology.orchestra.console.smithi029:console disconnect output: [Enter `^Ec?' for help] smithi029 login: [disconnect] 2024-04-26T11:44:39.909 DEBUG:tasks.thrashosds:checking console status of smithi072 2024-04-26T11:44:39.910 DEBUG:teuthology.orchestra.console.smithi072:Waiting for login prompt 2024-04-26T11:44:39.910 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi072 2024-04-26T11:44:40.088 DEBUG:teuthology.orchestra.console.smithi072:expect before: [Enter `^Ec?' for help] 2024-04-26T11:44:40.088 DEBUG:teuthology.orchestra.console.smithi072:expect after: smithi072 login: 2024-04-26T11:44:40.140 DEBUG:teuthology.orchestra.console.smithi072:console disconnect output: [Enter `^Ec?' for help] smithi072 login: [disconnect] 2024-04-26T11:44:40.241 DEBUG:tasks.thrashosds:checking console status of smithi082 2024-04-26T11:44:40.241 DEBUG:teuthology.orchestra.console.smithi082:Waiting for login prompt 2024-04-26T11:44:40.241 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi082 2024-04-26T11:44:40.337 DEBUG:teuthology.orchestra.console.smithi082:expect before: [Enter `^Ec?' for help] 2024-04-26T11:44:40.337 DEBUG:teuthology.orchestra.console.smithi082:expect after: smithi082 login: 2024-04-26T11:44:40.391 DEBUG:teuthology.orchestra.console.smithi082:console disconnect output: [Enter `^Ec?' for help] smithi082 login: [disconnect] 2024-04-26T11:44:40.492 DEBUG:tasks.thrashosds:checking console status of smithi122 2024-04-26T11:44:40.492 DEBUG:teuthology.orchestra.console.smithi122:Waiting for login prompt 2024-04-26T11:44:40.493 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi122 2024-04-26T11:44:40.652 DEBUG:teuthology.orchestra.console.smithi122:expect before: [Enter `^Ec?' for help] 2024-04-26T11:44:40.652 DEBUG:teuthology.orchestra.console.smithi122:expect after: smithi122 login: 2024-04-26T11:44:40.704 DEBUG:teuthology.orchestra.console.smithi122:console disconnect output: [Enter `^Ec?' for help] smithi122 login: [disconnect] 2024-04-26T11:44:40.805 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T11:44:41.156 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T11:44:41.157 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T11:44:41.157 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:44:41.468 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:41.470 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:44:41.482 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-26T11:44:39.962627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95052,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020468,"statfs":{"total":289910292480,"available":289812959232,"internally_reserved":0,"allocated":1744896,"data_stored":1358551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004547"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435811+0000","last_change":"2024-04-26T11:44:21.443178+0000","last_active":"2024-04-26T11:44:22.435811+0000","last_peered":"2024-04-26T11:44:22.435811+0000","last_clean":"2024-04-26T11:44:22.435811+0000","last_became_active":"2024-04-26T11:44:21.442734+0000","last_became_peered":"2024-04-26T11:44:21.442734+0000","last_unstale":"2024-04-26T11:44:22.435811+0000","last_undegraded":"2024-04-26T11:44:22.435811+0000","last_fullsized":"2024-04-26T11:44:22.435811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435342+0000","last_change":"2024-04-26T11:44:21.442473+0000","last_active":"2024-04-26T11:44:22.435342+0000","last_peered":"2024-04-26T11:44:22.435342+0000","last_clean":"2024-04-26T11:44:22.435342+0000","last_became_active":"2024-04-26T11:44:21.441778+0000","last_became_peered":"2024-04-26T11:44:21.441778+0000","last_unstale":"2024-04-26T11:44:22.435342+0000","last_undegraded":"2024-04-26T11:44:22.435342+0000","last_fullsized":"2024-04-26T11:44:22.435342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435827+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:44:22.435827+0000","last_peered":"2024-04-26T11:44:22.435827+0000","last_clean":"2024-04-26T11:44:22.435827+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:44:22.435827+0000","last_undegraded":"2024-04-26T11:44:22.435827+0000","last_fullsized":"2024-04-26T11:44:22.435827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435163+0000","last_change":"2024-04-26T11:44:21.448849+0000","last_active":"2024-04-26T11:44:22.435163+0000","last_peered":"2024-04-26T11:44:22.435163+0000","last_clean":"2024-04-26T11:44:22.435163+0000","last_became_active":"2024-04-26T11:44:21.447398+0000","last_became_peered":"2024-04-26T11:44:21.447398+0000","last_unstale":"2024-04-26T11:44:22.435163+0000","last_undegraded":"2024-04-26T11:44:22.435163+0000","last_fullsized":"2024-04-26T11:44:22.435163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:02.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434980+0000","last_change":"2024-04-26T11:44:21.441647+0000","last_active":"2024-04-26T11:44:22.434980+0000","last_peered":"2024-04-26T11:44:22.434980+0000","last_clean":"2024-04-26T11:44:22.434980+0000","last_became_active":"2024-04-26T11:44:21.441237+0000","last_became_peered":"2024-04-26T11:44:21.441237+0000","last_unstale":"2024-04-26T11:44:22.434980+0000","last_undegraded":"2024-04-26T11:44:22.434980+0000","last_fullsized":"2024-04-26T11:44:22.434980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434482+0000","last_change":"2024-04-26T11:44:21.447786+0000","last_active":"2024-04-26T11:44:22.434482+0000","last_peered":"2024-04-26T11:44:22.434482+0000","last_clean":"2024-04-26T11:44:22.434482+0000","last_became_active":"2024-04-26T11:44:21.447367+0000","last_became_peered":"2024-04-26T11:44:21.447367+0000","last_unstale":"2024-04-26T11:44:22.434482+0000","last_undegraded":"2024-04-26T11:44:22.434482+0000","last_fullsized":"2024-04-26T11:44:22.434482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434713+0000","last_change":"2024-04-26T11:44:21.448136+0000","last_active":"2024-04-26T11:44:22.434713+0000","last_peered":"2024-04-26T11:44:22.434713+0000","last_clean":"2024-04-26T11:44:22.434713+0000","last_became_active":"2024-04-26T11:44:21.447382+0000","last_became_peered":"2024-04-26T11:44:21.447382+0000","last_unstale":"2024-04-26T11:44:22.434713+0000","last_undegraded":"2024-04-26T11:44:22.434713+0000","last_fullsized":"2024-04-26T11:44:22.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433838+0000","last_change":"2024-04-26T11:44:21.448950+0000","last_active":"2024-04-26T11:44:22.433838+0000","last_peered":"2024-04-26T11:44:22.433838+0000","last_clean":"2024-04-26T11:44:22.433838+0000","last_became_active":"2024-04-26T11:44:21.447975+0000","last_became_peered":"2024-04-26T11:44:21.447975+0000","last_unstale":"2024-04-26T11:44:22.433838+0000","last_undegraded":"2024-04-26T11:44:22.433838+0000","last_fullsized":"2024-04-26T11:44:22.433838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:07.109775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818672+0000","last_change":"2024-04-26T11:44:21.446676+0000","last_active":"2024-04-26T11:44:22.818672+0000","last_peered":"2024-04-26T11:44:22.818672+0000","last_clean":"2024-04-26T11:44:22.818672+0000","last_became_active":"2024-04-26T11:44:21.445874+0000","last_became_peered":"2024-04-26T11:44:21.445874+0000","last_unstale":"2024-04-26T11:44:22.818672+0000","last_undegraded":"2024-04-26T11:44:22.818672+0000","last_fullsized":"2024-04-26T11:44:22.818672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435569+0000","last_change":"2024-04-26T11:44:21.441552+0000","last_active":"2024-04-26T11:44:22.435569+0000","last_peered":"2024-04-26T11:44:22.435569+0000","last_clean":"2024-04-26T11:44:22.435569+0000","last_became_active":"2024-04-26T11:44:21.441047+0000","last_became_peered":"2024-04-26T11:44:21.441047+0000","last_unstale":"2024-04-26T11:44:22.435569+0000","last_undegraded":"2024-04-26T11:44:22.435569+0000","last_fullsized":"2024-04-26T11:44:22.435569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435826+0000","last_change":"2024-04-26T11:44:21.448723+0000","last_active":"2024-04-26T11:44:22.435826+0000","last_peered":"2024-04-26T11:44:22.435826+0000","last_clean":"2024-04-26T11:44:22.435826+0000","last_became_active":"2024-04-26T11:44:21.448275+0000","last_became_peered":"2024-04-26T11:44:21.448275+0000","last_unstale":"2024-04-26T11:44:22.435826+0000","last_undegraded":"2024-04-26T11:44:22.435826+0000","last_fullsized":"2024-04-26T11:44:22.435826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435154+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:44:22.435154+0000","last_peered":"2024-04-26T11:44:22.435154+0000","last_clean":"2024-04-26T11:44:22.435154+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:44:22.435154+0000","last_undegraded":"2024-04-26T11:44:22.435154+0000","last_fullsized":"2024-04-26T11:44:22.435154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434453+0000","last_change":"2024-04-26T11:44:21.441784+0000","last_active":"2024-04-26T11:44:22.434453+0000","last_peered":"2024-04-26T11:44:22.434453+0000","last_clean":"2024-04-26T11:44:22.434453+0000","last_became_active":"2024-04-26T11:44:21.441107+0000","last_became_peered":"2024-04-26T11:44:21.441107+0000","last_unstale":"2024-04-26T11:44:22.434453+0000","last_undegraded":"2024-04-26T11:44:22.434453+0000","last_fullsized":"2024-04-26T11:44:22.434453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434509+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:44:22.434509+0000","last_peered":"2024-04-26T11:44:22.434509+0000","last_clean":"2024-04-26T11:44:22.434509+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:44:22.434509+0000","last_undegraded":"2024-04-26T11:44:22.434509+0000","last_fullsized":"2024-04-26T11:44:22.434509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434815+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:44:22.434815+0000","last_peered":"2024-04-26T11:44:22.434815+0000","last_clean":"2024-04-26T11:44:22.434815+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:44:22.434815+0000","last_undegraded":"2024-04-26T11:44:22.434815+0000","last_fullsized":"2024-04-26T11:44:22.434815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433958+0000","last_change":"2024-04-26T11:44:21.449098+0000","last_active":"2024-04-26T11:44:22.433958+0000","last_peered":"2024-04-26T11:44:22.433958+0000","last_clean":"2024-04-26T11:44:22.433958+0000","last_became_active":"2024-04-26T11:44:21.448517+0000","last_became_peered":"2024-04-26T11:44:21.448517+0000","last_unstale":"2024-04-26T11:44:22.433958+0000","last_undegraded":"2024-04-26T11:44:22.433958+0000","last_fullsized":"2024-04-26T11:44:22.433958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819570+0000","last_change":"2024-04-26T11:44:21.439565+0000","last_active":"2024-04-26T11:44:22.819570+0000","last_peered":"2024-04-26T11:44:22.819570+0000","last_clean":"2024-04-26T11:44:22.819570+0000","last_became_active":"2024-04-26T11:44:21.438640+0000","last_became_peered":"2024-04-26T11:44:21.438640+0000","last_unstale":"2024-04-26T11:44:22.819570+0000","last_undegraded":"2024-04-26T11:44:22.819570+0000","last_fullsized":"2024-04-26T11:44:22.819570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435844+0000","last_change":"2024-04-26T11:44:21.437913+0000","last_active":"2024-04-26T11:44:22.435844+0000","last_peered":"2024-04-26T11:44:22.435844+0000","last_clean":"2024-04-26T11:44:22.435844+0000","last_became_active":"2024-04-26T11:44:21.437543+0000","last_became_peered":"2024-04-26T11:44:21.437543+0000","last_unstale":"2024-04-26T11:44:22.435844+0000","last_undegraded":"2024-04-26T11:44:22.435844+0000","last_fullsized":"2024-04-26T11:44:22.435844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818621+0000","last_change":"2024-04-26T11:44:21.440138+0000","last_active":"2024-04-26T11:44:22.818621+0000","last_peered":"2024-04-26T11:44:22.818621+0000","last_clean":"2024-04-26T11:44:22.818621+0000","last_became_active":"2024-04-26T11:44:21.439850+0000","last_became_peered":"2024-04-26T11:44:21.439850+0000","last_unstale":"2024-04-26T11:44:22.818621+0000","last_undegraded":"2024-04-26T11:44:22.818621+0000","last_fullsized":"2024-04-26T11:44:22.818621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435721+0000","last_change":"2024-04-26T11:44:21.449248+0000","last_active":"2024-04-26T11:44:22.435721+0000","last_peered":"2024-04-26T11:44:22.435721+0000","last_clean":"2024-04-26T11:44:22.435721+0000","last_became_active":"2024-04-26T11:44:21.448315+0000","last_became_peered":"2024-04-26T11:44:21.448315+0000","last_unstale":"2024-04-26T11:44:22.435721+0000","last_undegraded":"2024-04-26T11:44:22.435721+0000","last_fullsized":"2024-04-26T11:44:22.435721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436209+0000","last_change":"2024-04-26T11:44:21.448524+0000","last_active":"2024-04-26T11:44:22.436209+0000","last_peered":"2024-04-26T11:44:22.436209+0000","last_clean":"2024-04-26T11:44:22.436209+0000","last_became_active":"2024-04-26T11:44:21.447839+0000","last_became_peered":"2024-04-26T11:44:21.447839+0000","last_unstale":"2024-04-26T11:44:22.436209+0000","last_undegraded":"2024-04-26T11:44:22.436209+0000","last_fullsized":"2024-04-26T11:44:22.436209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434386+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:44:22.434386+0000","last_peered":"2024-04-26T11:44:22.434386+0000","last_clean":"2024-04-26T11:44:22.434386+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:44:22.434386+0000","last_undegraded":"2024-04-26T11:44:22.434386+0000","last_fullsized":"2024-04-26T11:44:22.434386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817486+0000","last_change":"2024-04-26T11:44:21.445626+0000","last_active":"2024-04-26T11:44:22.817486+0000","last_peered":"2024-04-26T11:44:22.817486+0000","last_clean":"2024-04-26T11:44:22.817486+0000","last_became_active":"2024-04-26T11:44:21.444990+0000","last_became_peered":"2024-04-26T11:44:21.444990+0000","last_unstale":"2024-04-26T11:44:22.817486+0000","last_undegraded":"2024-04-26T11:44:22.817486+0000","last_fullsized":"2024-04-26T11:44:22.817486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433782+0000","last_change":"2024-04-26T11:44:21.441463+0000","last_active":"2024-04-26T11:44:22.433782+0000","last_peered":"2024-04-26T11:44:22.433782+0000","last_clean":"2024-04-26T11:44:22.433782+0000","last_became_active":"2024-04-26T11:44:21.440895+0000","last_became_peered":"2024-04-26T11:44:21.440895+0000","last_unstale":"2024-04-26T11:44:22.433782+0000","last_undegraded":"2024-04-26T11:44:22.433782+0000","last_fullsized":"2024-04-26T11:44:22.433782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435906+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:44:22.435906+0000","last_peered":"2024-04-26T11:44:22.435906+0000","last_clean":"2024-04-26T11:44:22.435906+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:44:22.435906+0000","last_undegraded":"2024-04-26T11:44:22.435906+0000","last_fullsized":"2024-04-26T11:44:22.435906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819879+0000","last_change":"2024-04-26T11:44:21.444826+0000","last_active":"2024-04-26T11:44:22.819879+0000","last_peered":"2024-04-26T11:44:22.819879+0000","last_clean":"2024-04-26T11:44:22.819879+0000","last_became_active":"2024-04-26T11:44:21.444440+0000","last_became_peered":"2024-04-26T11:44:21.444440+0000","last_unstale":"2024-04-26T11:44:22.819879+0000","last_undegraded":"2024-04-26T11:44:22.819879+0000","last_fullsized":"2024-04-26T11:44:22.819879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436032+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:44:22.436032+0000","last_peered":"2024-04-26T11:44:22.436032+0000","last_clean":"2024-04-26T11:44:22.436032+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:44:22.436032+0000","last_undegraded":"2024-04-26T11:44:22.436032+0000","last_fullsized":"2024-04-26T11:44:22.436032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435465+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:44:22.435465+0000","last_peered":"2024-04-26T11:44:22.435465+0000","last_clean":"2024-04-26T11:44:22.435465+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:44:22.435465+0000","last_undegraded":"2024-04-26T11:44:22.435465+0000","last_fullsized":"2024-04-26T11:44:22.435465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819067+0000","last_change":"2024-04-26T11:44:21.439511+0000","last_active":"2024-04-26T11:44:22.819067+0000","last_peered":"2024-04-26T11:44:22.819067+0000","last_clean":"2024-04-26T11:44:22.819067+0000","last_became_active":"2024-04-26T11:44:21.438539+0000","last_became_peered":"2024-04-26T11:44:21.438539+0000","last_unstale":"2024-04-26T11:44:22.819067+0000","last_undegraded":"2024-04-26T11:44:22.819067+0000","last_fullsized":"2024-04-26T11:44:22.819067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434754+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:44:22.434754+0000","last_peered":"2024-04-26T11:44:22.434754+0000","last_clean":"2024-04-26T11:44:22.434754+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:44:22.434754+0000","last_undegraded":"2024-04-26T11:44:22.434754+0000","last_fullsized":"2024-04-26T11:44:22.434754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817638+0000","last_change":"2024-04-26T11:44:21.439772+0000","last_active":"2024-04-26T11:44:22.817638+0000","last_peered":"2024-04-26T11:44:22.817638+0000","last_clean":"2024-04-26T11:44:22.817638+0000","last_became_active":"2024-04-26T11:44:21.438770+0000","last_became_peered":"2024-04-26T11:44:21.438770+0000","last_unstale":"2024-04-26T11:44:22.817638+0000","last_undegraded":"2024-04-26T11:44:22.817638+0000","last_fullsized":"2024-04-26T11:44:22.817638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434091+0000","last_change":"2024-04-26T11:44:21.452228+0000","last_active":"2024-04-26T11:44:22.434091+0000","last_peered":"2024-04-26T11:44:22.434091+0000","last_clean":"2024-04-26T11:44:22.434091+0000","last_became_active":"2024-04-26T11:44:21.451258+0000","last_became_peered":"2024-04-26T11:44:21.451258+0000","last_unstale":"2024-04-26T11:44:22.434091+0000","last_undegraded":"2024-04-26T11:44:22.434091+0000","last_fullsized":"2024-04-26T11:44:22.434091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435434+0000","last_change":"2024-04-26T11:44:21.438961+0000","last_active":"2024-04-26T11:44:22.435434+0000","last_peered":"2024-04-26T11:44:22.435434+0000","last_clean":"2024-04-26T11:44:22.435434+0000","last_became_active":"2024-04-26T11:44:21.438124+0000","last_became_peered":"2024-04-26T11:44:21.438124+0000","last_unstale":"2024-04-26T11:44:22.435434+0000","last_undegraded":"2024-04-26T11:44:22.435434+0000","last_fullsized":"2024-04-26T11:44:22.435434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436336+0000","last_change":"2024-04-26T11:44:21.066359+0000","last_active":"2024-04-26T11:44:22.436336+0000","last_peered":"2024-04-26T11:44:22.436336+0000","last_clean":"2024-04-26T11:44:22.436336+0000","last_became_active":"2024-04-26T11:44:21.066007+0000","last_became_peered":"2024-04-26T11:44:21.066007+0000","last_unstale":"2024-04-26T11:44:22.436336+0000","last_undegraded":"2024-04-26T11:44:22.436336+0000","last_fullsized":"2024-04-26T11:44:22.436336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435741+0000","last_change":"2024-04-26T11:44:21.439295+0000","last_active":"2024-04-26T11:44:22.435741+0000","last_peered":"2024-04-26T11:44:22.435741+0000","last_clean":"2024-04-26T11:44:22.435741+0000","last_became_active":"2024-04-26T11:44:21.439097+0000","last_became_peered":"2024-04-26T11:44:21.439097+0000","last_unstale":"2024-04-26T11:44:22.435741+0000","last_undegraded":"2024-04-26T11:44:22.435741+0000","last_fullsized":"2024-04-26T11:44:22.435741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818216+0000","last_change":"2024-04-26T11:44:21.066646+0000","last_active":"2024-04-26T11:44:22.818216+0000","last_peered":"2024-04-26T11:44:22.818216+0000","last_clean":"2024-04-26T11:44:22.818216+0000","last_became_active":"2024-04-26T11:44:21.065981+0000","last_became_peered":"2024-04-26T11:44:21.065981+0000","last_unstale":"2024-04-26T11:44:22.818216+0000","last_undegraded":"2024-04-26T11:44:22.818216+0000","last_fullsized":"2024-04-26T11:44:22.818216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820032+0000","last_change":"2024-04-26T11:44:21.443681+0000","last_active":"2024-04-26T11:44:22.820032+0000","last_peered":"2024-04-26T11:44:22.820032+0000","last_clean":"2024-04-26T11:44:22.820032+0000","last_became_active":"2024-04-26T11:44:21.443253+0000","last_became_peered":"2024-04-26T11:44:21.443253+0000","last_unstale":"2024-04-26T11:44:22.820032+0000","last_undegraded":"2024-04-26T11:44:22.820032+0000","last_fullsized":"2024-04-26T11:44:22.820032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434717+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:44:22.434717+0000","last_peered":"2024-04-26T11:44:22.434717+0000","last_clean":"2024-04-26T11:44:22.434717+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:44:22.434717+0000","last_undegraded":"2024-04-26T11:44:22.434717+0000","last_fullsized":"2024-04-26T11:44:22.434717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818804+0000","last_change":"2024-04-26T11:44:21.445426+0000","last_active":"2024-04-26T11:44:22.818804+0000","last_peered":"2024-04-26T11:44:22.818804+0000","last_clean":"2024-04-26T11:44:22.818804+0000","last_became_active":"2024-04-26T11:44:21.444674+0000","last_became_peered":"2024-04-26T11:44:21.444674+0000","last_unstale":"2024-04-26T11:44:22.818804+0000","last_undegraded":"2024-04-26T11:44:22.818804+0000","last_fullsized":"2024-04-26T11:44:22.818804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434190+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:44:22.434190+0000","last_peered":"2024-04-26T11:44:22.434190+0000","last_clean":"2024-04-26T11:44:22.434190+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:44:22.434190+0000","last_undegraded":"2024-04-26T11:44:22.434190+0000","last_fullsized":"2024-04-26T11:44:22.434190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435770+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:44:22.435770+0000","last_peered":"2024-04-26T11:44:22.435770+0000","last_clean":"2024-04-26T11:44:22.435770+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:44:22.435770+0000","last_undegraded":"2024-04-26T11:44:22.435770+0000","last_fullsized":"2024-04-26T11:44:22.435770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433826+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:44:22.433826+0000","last_peered":"2024-04-26T11:44:22.433826+0000","last_clean":"2024-04-26T11:44:22.433826+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:44:22.433826+0000","last_undegraded":"2024-04-26T11:44:22.433826+0000","last_fullsized":"2024-04-26T11:44:22.433826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436104+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:44:22.436104+0000","last_peered":"2024-04-26T11:44:22.436104+0000","last_clean":"2024-04-26T11:44:22.436104+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:44:22.436104+0000","last_undegraded":"2024-04-26T11:44:22.436104+0000","last_fullsized":"2024-04-26T11:44:22.436104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433901+0000","last_change":"2024-04-26T11:44:21.442188+0000","last_active":"2024-04-26T11:44:22.433901+0000","last_peered":"2024-04-26T11:44:22.433901+0000","last_clean":"2024-04-26T11:44:22.433901+0000","last_became_active":"2024-04-26T11:44:21.441105+0000","last_became_peered":"2024-04-26T11:44:21.441105+0000","last_unstale":"2024-04-26T11:44:22.433901+0000","last_undegraded":"2024-04-26T11:44:22.433901+0000","last_fullsized":"2024-04-26T11:44:22.433901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436283+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:44:22.436283+0000","last_peered":"2024-04-26T11:44:22.436283+0000","last_clean":"2024-04-26T11:44:22.436283+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:44:22.436283+0000","last_undegraded":"2024-04-26T11:44:22.436283+0000","last_fullsized":"2024-04-26T11:44:22.436283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435798+0000","last_change":"2024-04-26T11:44:21.449433+0000","last_active":"2024-04-26T11:44:22.435798+0000","last_peered":"2024-04-26T11:44:22.435798+0000","last_clean":"2024-04-26T11:44:22.435798+0000","last_became_active":"2024-04-26T11:44:21.447831+0000","last_became_peered":"2024-04-26T11:44:21.447831+0000","last_unstale":"2024-04-26T11:44:22.435798+0000","last_undegraded":"2024-04-26T11:44:22.435798+0000","last_fullsized":"2024-04-26T11:44:22.435798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435987+0000","last_change":"2024-04-26T11:44:21.065647+0000","last_active":"2024-04-26T11:44:22.435987+0000","last_peered":"2024-04-26T11:44:22.435987+0000","last_clean":"2024-04-26T11:44:22.435987+0000","last_became_active":"2024-04-26T11:44:21.065197+0000","last_became_peered":"2024-04-26T11:44:21.065197+0000","last_unstale":"2024-04-26T11:44:22.435987+0000","last_undegraded":"2024-04-26T11:44:22.435987+0000","last_fullsized":"2024-04-26T11:44:22.435987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818851+0000","last_change":"2024-04-26T11:44:21.443848+0000","last_active":"2024-04-26T11:44:22.818851+0000","last_peered":"2024-04-26T11:44:22.818851+0000","last_clean":"2024-04-26T11:44:22.818851+0000","last_became_active":"2024-04-26T11:44:21.443580+0000","last_became_peered":"2024-04-26T11:44:21.443580+0000","last_unstale":"2024-04-26T11:44:22.818851+0000","last_undegraded":"2024-04-26T11:44:22.818851+0000","last_fullsized":"2024-04-26T11:44:22.818851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819315+0000","last_change":"2024-04-26T11:44:21.068336+0000","last_active":"2024-04-26T11:44:22.819315+0000","last_peered":"2024-04-26T11:44:22.819315+0000","last_clean":"2024-04-26T11:44:22.819315+0000","last_became_active":"2024-04-26T11:44:21.067530+0000","last_became_peered":"2024-04-26T11:44:21.067530+0000","last_unstale":"2024-04-26T11:44:22.819315+0000","last_undegraded":"2024-04-26T11:44:22.819315+0000","last_fullsized":"2024-04-26T11:44:22.819315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435445+0000","last_change":"2024-04-26T11:44:21.449238+0000","last_active":"2024-04-26T11:44:22.435445+0000","last_peered":"2024-04-26T11:44:22.435445+0000","last_clean":"2024-04-26T11:44:22.435445+0000","last_became_active":"2024-04-26T11:44:21.447694+0000","last_became_peered":"2024-04-26T11:44:21.447694+0000","last_unstale":"2024-04-26T11:44:22.435445+0000","last_undegraded":"2024-04-26T11:44:22.435445+0000","last_fullsized":"2024-04-26T11:44:22.435445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435196+0000","last_change":"2024-04-26T11:44:21.066212+0000","last_active":"2024-04-26T11:44:22.435196+0000","last_peered":"2024-04-26T11:44:22.435196+0000","last_clean":"2024-04-26T11:44:22.435196+0000","last_became_active":"2024-04-26T11:44:21.065186+0000","last_became_peered":"2024-04-26T11:44:21.065186+0000","last_unstale":"2024-04-26T11:44:22.435196+0000","last_undegraded":"2024-04-26T11:44:22.435196+0000","last_fullsized":"2024-04-26T11:44:22.435196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436154+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:44:22.436154+0000","last_peered":"2024-04-26T11:44:22.436154+0000","last_clean":"2024-04-26T11:44:22.436154+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:44:22.436154+0000","last_undegraded":"2024-04-26T11:44:22.436154+0000","last_fullsized":"2024-04-26T11:44:22.436154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434230+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:44:22.434230+0000","last_peered":"2024-04-26T11:44:22.434230+0000","last_clean":"2024-04-26T11:44:22.434230+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:44:22.434230+0000","last_undegraded":"2024-04-26T11:44:22.434230+0000","last_fullsized":"2024-04-26T11:44:22.434230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435383+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:44:22.435383+0000","last_peered":"2024-04-26T11:44:22.435383+0000","last_clean":"2024-04-26T11:44:22.435383+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:44:22.435383+0000","last_undegraded":"2024-04-26T11:44:22.435383+0000","last_fullsized":"2024-04-26T11:44:22.435383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434021+0000","last_change":"2024-04-26T11:44:21.065486+0000","last_active":"2024-04-26T11:44:22.434021+0000","last_peered":"2024-04-26T11:44:22.434021+0000","last_clean":"2024-04-26T11:44:22.434021+0000","last_became_active":"2024-04-26T11:44:21.065090+0000","last_became_peered":"2024-04-26T11:44:21.065090+0000","last_unstale":"2024-04-26T11:44:22.434021+0000","last_undegraded":"2024-04-26T11:44:22.434021+0000","last_fullsized":"2024-04-26T11:44:22.434021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:03.456923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818894+0000","last_change":"2024-04-26T11:44:21.446431+0000","last_active":"2024-04-26T11:44:22.818894+0000","last_peered":"2024-04-26T11:44:22.818894+0000","last_clean":"2024-04-26T11:44:22.818894+0000","last_became_active":"2024-04-26T11:44:21.445866+0000","last_became_peered":"2024-04-26T11:44:21.445866+0000","last_unstale":"2024-04-26T11:44:22.818894+0000","last_undegraded":"2024-04-26T11:44:22.818894+0000","last_fullsized":"2024-04-26T11:44:22.818894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440035+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:44:21.440035+0000","last_peered":"2024-04-26T11:44:21.440035+0000","last_clean":"2024-04-26T11:44:21.440035+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:44:21.440035+0000","last_undegraded":"2024-04-26T11:44:21.440035+0000","last_fullsized":"2024-04-26T11:44:21.440035+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440187+0000","last_change":"2024-04-26T11:44:17.037102+0000","last_active":"2024-04-26T11:44:21.440187+0000","last_peered":"2024-04-26T11:44:21.440187+0000","last_clean":"2024-04-26T11:44:21.440187+0000","last_became_active":"2024-04-26T11:44:17.036242+0000","last_became_peered":"2024-04-26T11:44:17.036242+0000","last_unstale":"2024-04-26T11:44:21.440187+0000","last_undegraded":"2024-04-26T11:44:21.440187+0000","last_fullsized":"2024-04-26T11:44:21.440187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818647+0000","last_change":"2024-04-26T11:44:21.064980+0000","last_active":"2024-04-26T11:44:22.818647+0000","last_peered":"2024-04-26T11:44:22.818647+0000","last_clean":"2024-04-26T11:44:22.818647+0000","last_became_active":"2024-04-26T11:44:21.064569+0000","last_became_peered":"2024-04-26T11:44:21.064569+0000","last_unstale":"2024-04-26T11:44:22.818647+0000","last_undegraded":"2024-04-26T11:44:22.818647+0000","last_fullsized":"2024-04-26T11:44:22.818647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436303+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:44:22.436303+0000","last_peered":"2024-04-26T11:44:22.436303+0000","last_clean":"2024-04-26T11:44:22.436303+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:44:22.436303+0000","last_undegraded":"2024-04-26T11:44:22.436303+0000","last_fullsized":"2024-04-26T11:44:22.436303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439848+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:44:21.439848+0000","last_peered":"2024-04-26T11:44:21.439848+0000","last_clean":"2024-04-26T11:44:21.439848+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:44:21.439848+0000","last_undegraded":"2024-04-26T11:44:21.439848+0000","last_fullsized":"2024-04-26T11:44:21.439848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818702+0000","last_change":"2024-04-26T11:44:21.066838+0000","last_active":"2024-04-26T11:44:22.818702+0000","last_peered":"2024-04-26T11:44:22.818702+0000","last_clean":"2024-04-26T11:44:22.818702+0000","last_became_active":"2024-04-26T11:44:21.065781+0000","last_became_peered":"2024-04-26T11:44:21.065781+0000","last_unstale":"2024-04-26T11:44:22.818702+0000","last_undegraded":"2024-04-26T11:44:22.818702+0000","last_fullsized":"2024-04-26T11:44:22.818702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435884+0000","last_change":"2024-04-26T11:44:21.439222+0000","last_active":"2024-04-26T11:44:22.435884+0000","last_peered":"2024-04-26T11:44:22.435884+0000","last_clean":"2024-04-26T11:44:22.435884+0000","last_became_active":"2024-04-26T11:44:21.438876+0000","last_became_peered":"2024-04-26T11:44:21.438876+0000","last_unstale":"2024-04-26T11:44:22.435884+0000","last_undegraded":"2024-04-26T11:44:22.435884+0000","last_fullsized":"2024-04-26T11:44:22.435884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.435673+0000","last_change":"2024-04-26T11:44:17.031172+0000","last_active":"2024-04-26T11:44:21.435673+0000","last_peered":"2024-04-26T11:44:21.435673+0000","last_clean":"2024-04-26T11:44:21.435673+0000","last_became_active":"2024-04-26T11:44:17.030306+0000","last_became_peered":"2024-04-26T11:44:17.030306+0000","last_unstale":"2024-04-26T11:44:21.435673+0000","last_undegraded":"2024-04-26T11:44:21.435673+0000","last_fullsized":"2024-04-26T11:44:21.435673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:30.564274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434093+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:44:22.434093+0000","last_peered":"2024-04-26T11:44:22.434093+0000","last_clean":"2024-04-26T11:44:22.434093+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:44:22.434093+0000","last_undegraded":"2024-04-26T11:44:22.434093+0000","last_fullsized":"2024-04-26T11:44:22.434093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819030+0000","last_change":"2024-04-26T11:44:21.440135+0000","last_active":"2024-04-26T11:44:22.819030+0000","last_peered":"2024-04-26T11:44:22.819030+0000","last_clean":"2024-04-26T11:44:22.819030+0000","last_became_active":"2024-04-26T11:44:21.439757+0000","last_became_peered":"2024-04-26T11:44:21.439757+0000","last_unstale":"2024-04-26T11:44:22.819030+0000","last_undegraded":"2024-04-26T11:44:22.819030+0000","last_fullsized":"2024-04-26T11:44:22.819030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.437818+0000","last_change":"2024-04-26T11:44:17.037146+0000","last_active":"2024-04-26T11:44:21.437818+0000","last_peered":"2024-04-26T11:44:21.437818+0000","last_clean":"2024-04-26T11:44:21.437818+0000","last_became_active":"2024-04-26T11:44:17.036196+0000","last_became_peered":"2024-04-26T11:44:17.036196+0000","last_unstale":"2024-04-26T11:44:21.437818+0000","last_undegraded":"2024-04-26T11:44:21.437818+0000","last_fullsized":"2024-04-26T11:44:21.437818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.409299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436401+0000","last_change":"2024-04-26T11:44:21.065821+0000","last_active":"2024-04-26T11:44:22.436401+0000","last_peered":"2024-04-26T11:44:22.436401+0000","last_clean":"2024-04-26T11:44:22.436401+0000","last_became_active":"2024-04-26T11:44:21.065300+0000","last_became_peered":"2024-04-26T11:44:21.065300+0000","last_unstale":"2024-04-26T11:44:22.436401+0000","last_undegraded":"2024-04-26T11:44:22.436401+0000","last_fullsized":"2024-04-26T11:44:22.436401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819416+0000","last_change":"2024-04-26T11:44:21.439526+0000","last_active":"2024-04-26T11:44:22.819416+0000","last_peered":"2024-04-26T11:44:22.819416+0000","last_clean":"2024-04-26T11:44:22.819416+0000","last_became_active":"2024-04-26T11:44:21.438786+0000","last_became_peered":"2024-04-26T11:44:21.438786+0000","last_unstale":"2024-04-26T11:44:22.819416+0000","last_undegraded":"2024-04-26T11:44:22.819416+0000","last_fullsized":"2024-04-26T11:44:22.819416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436395+0000","last_change":"2024-04-26T11:44:21.066276+0000","last_active":"2024-04-26T11:44:22.436395+0000","last_peered":"2024-04-26T11:44:22.436395+0000","last_clean":"2024-04-26T11:44:22.436395+0000","last_became_active":"2024-04-26T11:44:21.065682+0000","last_became_peered":"2024-04-26T11:44:21.065682+0000","last_unstale":"2024-04-26T11:44:22.436395+0000","last_undegraded":"2024-04-26T11:44:22.436395+0000","last_fullsized":"2024-04-26T11:44:22.436395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436324+0000","last_change":"2024-04-26T11:44:17.031782+0000","last_active":"2024-04-26T11:44:21.436324+0000","last_peered":"2024-04-26T11:44:21.436324+0000","last_clean":"2024-04-26T11:44:21.436324+0000","last_became_active":"2024-04-26T11:44:17.030688+0000","last_became_peered":"2024-04-26T11:44:17.030688+0000","last_unstale":"2024-04-26T11:44:21.436324+0000","last_undegraded":"2024-04-26T11:44:21.436324+0000","last_fullsized":"2024-04-26T11:44:21.436324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.289819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434465+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:44:22.434465+0000","last_peered":"2024-04-26T11:44:22.434465+0000","last_clean":"2024-04-26T11:44:22.434465+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:44:22.434465+0000","last_undegraded":"2024-04-26T11:44:22.434465+0000","last_fullsized":"2024-04-26T11:44:22.434465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819493+0000","last_change":"2024-04-26T11:44:21.065142+0000","last_active":"2024-04-26T11:44:22.819493+0000","last_peered":"2024-04-26T11:44:22.819493+0000","last_clean":"2024-04-26T11:44:22.819493+0000","last_became_active":"2024-04-26T11:44:21.064672+0000","last_became_peered":"2024-04-26T11:44:21.064672+0000","last_unstale":"2024-04-26T11:44:22.819493+0000","last_undegraded":"2024-04-26T11:44:22.819493+0000","last_fullsized":"2024-04-26T11:44:22.819493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.433676+0000","last_change":"2024-04-26T11:44:17.031146+0000","last_active":"2024-04-26T11:44:21.433676+0000","last_peered":"2024-04-26T11:44:21.433676+0000","last_clean":"2024-04-26T11:44:21.433676+0000","last_became_active":"2024-04-26T11:44:17.030637+0000","last_became_peered":"2024-04-26T11:44:17.030637+0000","last_unstale":"2024-04-26T11:44:21.433676+0000","last_undegraded":"2024-04-26T11:44:21.433676+0000","last_fullsized":"2024-04-26T11:44:21.433676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434766+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:44:22.434766+0000","last_peered":"2024-04-26T11:44:22.434766+0000","last_clean":"2024-04-26T11:44:22.434766+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:44:22.434766+0000","last_undegraded":"2024-04-26T11:44:22.434766+0000","last_fullsized":"2024-04-26T11:44:22.434766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819801+0000","last_change":"2024-04-26T11:44:21.065483+0000","last_active":"2024-04-26T11:44:22.819801+0000","last_peered":"2024-04-26T11:44:22.819801+0000","last_clean":"2024-04-26T11:44:22.819801+0000","last_became_active":"2024-04-26T11:44:21.064772+0000","last_became_peered":"2024-04-26T11:44:21.064772+0000","last_unstale":"2024-04-26T11:44:22.819801+0000","last_undegraded":"2024-04-26T11:44:22.819801+0000","last_fullsized":"2024-04-26T11:44:22.819801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436718+0000","last_change":"2024-04-26T11:44:17.031358+0000","last_active":"2024-04-26T11:44:21.436718+0000","last_peered":"2024-04-26T11:44:21.436718+0000","last_clean":"2024-04-26T11:44:21.436718+0000","last_became_active":"2024-04-26T11:44:17.030413+0000","last_became_peered":"2024-04-26T11:44:17.030413+0000","last_unstale":"2024-04-26T11:44:21.436718+0000","last_undegraded":"2024-04-26T11:44:21.436718+0000","last_fullsized":"2024-04-26T11:44:21.436718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817817+0000","last_change":"2024-04-26T11:44:21.444989+0000","last_active":"2024-04-26T11:44:22.817817+0000","last_peered":"2024-04-26T11:44:22.817817+0000","last_clean":"2024-04-26T11:44:22.817817+0000","last_became_active":"2024-04-26T11:44:21.444418+0000","last_became_peered":"2024-04-26T11:44:21.444418+0000","last_unstale":"2024-04-26T11:44:22.817817+0000","last_undegraded":"2024-04-26T11:44:22.817817+0000","last_fullsized":"2024-04-26T11:44:22.817817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:23.968635+0000","last_change":"2024-04-26T11:44:21.067525+0000","last_active":"2024-04-26T11:44:23.968635+0000","last_peered":"2024-04-26T11:44:23.968635+0000","last_clean":"2024-04-26T11:44:23.968635+0000","last_became_active":"2024-04-26T11:44:21.065923+0000","last_became_peered":"2024-04-26T11:44:21.065923+0000","last_unstale":"2024-04-26T11:44:23.968635+0000","last_undegraded":"2024-04-26T11:44:23.968635+0000","last_fullsized":"2024-04-26T11:44:23.968635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439731+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:44:21.439731+0000","last_peered":"2024-04-26T11:44:21.439731+0000","last_clean":"2024-04-26T11:44:21.439731+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:44:21.439731+0000","last_undegraded":"2024-04-26T11:44:21.439731+0000","last_fullsized":"2024-04-26T11:44:21.439731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434002+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:44:22.434002+0000","last_peered":"2024-04-26T11:44:22.434002+0000","last_clean":"2024-04-26T11:44:22.434002+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:44:22.434002+0000","last_undegraded":"2024-04-26T11:44:22.434002+0000","last_fullsized":"2024-04-26T11:44:22.434002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435702+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:44:22.435702+0000","last_peered":"2024-04-26T11:44:22.435702+0000","last_clean":"2024-04-26T11:44:22.435702+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:44:22.435702+0000","last_undegraded":"2024-04-26T11:44:22.435702+0000","last_fullsized":"2024-04-26T11:44:22.435702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435885+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:44:22.435885+0000","last_peered":"2024-04-26T11:44:22.435885+0000","last_clean":"2024-04-26T11:44:22.435885+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:44:22.435885+0000","last_undegraded":"2024-04-26T11:44:22.435885+0000","last_fullsized":"2024-04-26T11:44:22.435885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817896+0000","last_change":"2024-04-26T11:44:21.437907+0000","last_active":"2024-04-26T11:44:22.817896+0000","last_peered":"2024-04-26T11:44:22.817896+0000","last_clean":"2024-04-26T11:44:22.817896+0000","last_became_active":"2024-04-26T11:44:21.437024+0000","last_became_peered":"2024-04-26T11:44:21.437024+0000","last_unstale":"2024-04-26T11:44:22.817896+0000","last_undegraded":"2024-04-26T11:44:22.817896+0000","last_fullsized":"2024-04-26T11:44:22.817896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435937+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:44:22.435937+0000","last_peered":"2024-04-26T11:44:22.435937+0000","last_clean":"2024-04-26T11:44:22.435937+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:44:22.435937+0000","last_undegraded":"2024-04-26T11:44:22.435937+0000","last_fullsized":"2024-04-26T11:44:22.435937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435601+0000","last_change":"2024-04-26T11:44:21.065944+0000","last_active":"2024-04-26T11:44:22.435601+0000","last_peered":"2024-04-26T11:44:22.435601+0000","last_clean":"2024-04-26T11:44:22.435601+0000","last_became_active":"2024-04-26T11:44:21.065251+0000","last_became_peered":"2024-04-26T11:44:21.065251+0000","last_unstale":"2024-04-26T11:44:22.435601+0000","last_undegraded":"2024-04-26T11:44:22.435601+0000","last_fullsized":"2024-04-26T11:44:22.435601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817770+0000","last_change":"2024-04-26T11:44:21.445619+0000","last_active":"2024-04-26T11:44:22.817770+0000","last_peered":"2024-04-26T11:44:22.817770+0000","last_clean":"2024-04-26T11:44:22.817770+0000","last_became_active":"2024-04-26T11:44:21.444597+0000","last_became_peered":"2024-04-26T11:44:21.444597+0000","last_unstale":"2024-04-26T11:44:22.817770+0000","last_undegraded":"2024-04-26T11:44:22.817770+0000","last_fullsized":"2024-04-26T11:44:22.817770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819319+0000","last_change":"2024-04-26T11:44:21.067177+0000","last_active":"2024-04-26T11:44:22.819319+0000","last_peered":"2024-04-26T11:44:22.819319+0000","last_clean":"2024-04-26T11:44:22.819319+0000","last_became_active":"2024-04-26T11:44:21.066727+0000","last_became_peered":"2024-04-26T11:44:21.066727+0000","last_unstale":"2024-04-26T11:44:22.819319+0000","last_undegraded":"2024-04-26T11:44:22.819319+0000","last_fullsized":"2024-04-26T11:44:22.819319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817835+0000","last_change":"2024-04-26T11:44:21.439357+0000","last_active":"2024-04-26T11:44:22.817835+0000","last_peered":"2024-04-26T11:44:22.817835+0000","last_clean":"2024-04-26T11:44:22.817835+0000","last_became_active":"2024-04-26T11:44:21.438703+0000","last_became_peered":"2024-04-26T11:44:21.438703+0000","last_unstale":"2024-04-26T11:44:22.817835+0000","last_undegraded":"2024-04-26T11:44:22.817835+0000","last_fullsized":"2024-04-26T11:44:22.817835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436060+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:44:22.436060+0000","last_peered":"2024-04-26T11:44:22.436060+0000","last_clean":"2024-04-26T11:44:22.436060+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:44:22.436060+0000","last_undegraded":"2024-04-26T11:44:22.436060+0000","last_fullsized":"2024-04-26T11:44:22.436060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818065+0000","last_change":"2024-04-26T11:44:21.065373+0000","last_active":"2024-04-26T11:44:22.818065+0000","last_peered":"2024-04-26T11:44:22.818065+0000","last_clean":"2024-04-26T11:44:22.818065+0000","last_became_active":"2024-04-26T11:44:21.064598+0000","last_became_peered":"2024-04-26T11:44:21.064598+0000","last_unstale":"2024-04-26T11:44:22.818065+0000","last_undegraded":"2024-04-26T11:44:22.818065+0000","last_fullsized":"2024-04-26T11:44:22.818065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819621+0000","last_change":"2024-04-26T11:44:21.445216+0000","last_active":"2024-04-26T11:44:22.819621+0000","last_peered":"2024-04-26T11:44:22.819621+0000","last_clean":"2024-04-26T11:44:22.819621+0000","last_became_active":"2024-04-26T11:44:21.444615+0000","last_became_peered":"2024-04-26T11:44:21.444615+0000","last_unstale":"2024-04-26T11:44:22.819621+0000","last_undegraded":"2024-04-26T11:44:22.819621+0000","last_fullsized":"2024-04-26T11:44:22.819621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818131+0000","last_change":"2024-04-26T11:44:21.066483+0000","last_active":"2024-04-26T11:44:22.818131+0000","last_peered":"2024-04-26T11:44:22.818131+0000","last_clean":"2024-04-26T11:44:22.818131+0000","last_became_active":"2024-04-26T11:44:21.065373+0000","last_became_peered":"2024-04-26T11:44:21.065373+0000","last_unstale":"2024-04-26T11:44:22.818131+0000","last_undegraded":"2024-04-26T11:44:22.818131+0000","last_fullsized":"2024-04-26T11:44:22.818131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435451+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:44:22.435451+0000","last_peered":"2024-04-26T11:44:22.435451+0000","last_clean":"2024-04-26T11:44:22.435451+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:44:22.435451+0000","last_undegraded":"2024-04-26T11:44:22.435451+0000","last_fullsized":"2024-04-26T11:44:22.435451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434803+0000","last_change":"2024-04-26T11:44:21.065431+0000","last_active":"2024-04-26T11:44:22.434803+0000","last_peered":"2024-04-26T11:44:22.434803+0000","last_clean":"2024-04-26T11:44:22.434803+0000","last_became_active":"2024-04-26T11:44:21.065114+0000","last_became_peered":"2024-04-26T11:44:21.065114+0000","last_unstale":"2024-04-26T11:44:22.434803+0000","last_undegraded":"2024-04-26T11:44:22.434803+0000","last_fullsized":"2024-04-26T11:44:22.434803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:39.838237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435212+0000","last_change":"2024-04-26T11:44:21.441795+0000","last_active":"2024-04-26T11:44:22.435212+0000","last_peered":"2024-04-26T11:44:22.435212+0000","last_clean":"2024-04-26T11:44:22.435212+0000","last_became_active":"2024-04-26T11:44:21.441421+0000","last_became_peered":"2024-04-26T11:44:21.441421+0000","last_unstale":"2024-04-26T11:44:22.435212+0000","last_undegraded":"2024-04-26T11:44:22.435212+0000","last_fullsized":"2024-04-26T11:44:22.435212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435013+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:44:22.435013+0000","last_peered":"2024-04-26T11:44:22.435013+0000","last_clean":"2024-04-26T11:44:22.435013+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:44:22.435013+0000","last_undegraded":"2024-04-26T11:44:22.435013+0000","last_fullsized":"2024-04-26T11:44:22.435013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436177+0000","last_change":"2024-04-26T11:44:21.448442+0000","last_active":"2024-04-26T11:44:22.436177+0000","last_peered":"2024-04-26T11:44:22.436177+0000","last_clean":"2024-04-26T11:44:22.436177+0000","last_became_active":"2024-04-26T11:44:21.447770+0000","last_became_peered":"2024-04-26T11:44:21.447770+0000","last_unstale":"2024-04-26T11:44:22.436177+0000","last_undegraded":"2024-04-26T11:44:22.436177+0000","last_fullsized":"2024-04-26T11:44:22.436177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435664+0000","last_change":"2024-04-26T11:44:21.066498+0000","last_active":"2024-04-26T11:44:22.435664+0000","last_peered":"2024-04-26T11:44:22.435664+0000","last_clean":"2024-04-26T11:44:22.435664+0000","last_became_active":"2024-04-26T11:44:21.065945+0000","last_became_peered":"2024-04-26T11:44:21.065945+0000","last_unstale":"2024-04-26T11:44:22.435664+0000","last_undegraded":"2024-04-26T11:44:22.435664+0000","last_fullsized":"2024-04-26T11:44:22.435664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434988+0000","last_change":"2024-04-26T11:44:21.448777+0000","last_active":"2024-04-26T11:44:22.434988+0000","last_peered":"2024-04-26T11:44:22.434988+0000","last_clean":"2024-04-26T11:44:22.434988+0000","last_became_active":"2024-04-26T11:44:21.448274+0000","last_became_peered":"2024-04-26T11:44:21.448274+0000","last_unstale":"2024-04-26T11:44:22.434988+0000","last_undegraded":"2024-04-26T11:44:22.434988+0000","last_fullsized":"2024-04-26T11:44:22.434988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435817+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:44:22.435817+0000","last_peered":"2024-04-26T11:44:22.435817+0000","last_clean":"2024-04-26T11:44:22.435817+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:44:22.435817+0000","last_undegraded":"2024-04-26T11:44:22.435817+0000","last_fullsized":"2024-04-26T11:44:22.435817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434476+0000","last_change":"2024-04-26T11:44:21.438183+0000","last_active":"2024-04-26T11:44:22.434476+0000","last_peered":"2024-04-26T11:44:22.434476+0000","last_clean":"2024-04-26T11:44:22.434476+0000","last_became_active":"2024-04-26T11:44:21.437823+0000","last_became_peered":"2024-04-26T11:44:21.437823+0000","last_unstale":"2024-04-26T11:44:22.434476+0000","last_undegraded":"2024-04-26T11:44:22.434476+0000","last_fullsized":"2024-04-26T11:44:22.434476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820080+0000","last_change":"2024-04-26T11:44:21.068479+0000","last_active":"2024-04-26T11:44:22.820080+0000","last_peered":"2024-04-26T11:44:22.820080+0000","last_clean":"2024-04-26T11:44:22.820080+0000","last_became_active":"2024-04-26T11:44:21.068206+0000","last_became_peered":"2024-04-26T11:44:21.068206+0000","last_unstale":"2024-04-26T11:44:22.820080+0000","last_undegraded":"2024-04-26T11:44:22.820080+0000","last_fullsized":"2024-04-26T11:44:22.820080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434365+0000","last_change":"2024-04-26T11:44:21.452369+0000","last_active":"2024-04-26T11:44:22.434365+0000","last_peered":"2024-04-26T11:44:22.434365+0000","last_clean":"2024-04-26T11:44:22.434365+0000","last_became_active":"2024-04-26T11:44:21.451833+0000","last_became_peered":"2024-04-26T11:44:21.451833+0000","last_unstale":"2024-04-26T11:44:22.434365+0000","last_undegraded":"2024-04-26T11:44:22.434365+0000","last_fullsized":"2024-04-26T11:44:22.434365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819101+0000","last_change":"2024-04-26T11:44:21.068300+0000","last_active":"2024-04-26T11:44:22.819101+0000","last_peered":"2024-04-26T11:44:22.819101+0000","last_clean":"2024-04-26T11:44:22.819101+0000","last_became_active":"2024-04-26T11:44:21.067285+0000","last_became_peered":"2024-04-26T11:44:21.067285+0000","last_unstale":"2024-04-26T11:44:22.819101+0000","last_undegraded":"2024-04-26T11:44:22.819101+0000","last_fullsized":"2024-04-26T11:44:22.819101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":790528,"data_stored":650427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":782336,"data_stored":649811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:44:41.487 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:44:41.843 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:44:41.846 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:44:41.859 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-26T11:44:39.962627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95052,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020468,"statfs":{"total":289910292480,"available":289812959232,"internally_reserved":0,"allocated":1744896,"data_stored":1358551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004547"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435811+0000","last_change":"2024-04-26T11:44:21.443178+0000","last_active":"2024-04-26T11:44:22.435811+0000","last_peered":"2024-04-26T11:44:22.435811+0000","last_clean":"2024-04-26T11:44:22.435811+0000","last_became_active":"2024-04-26T11:44:21.442734+0000","last_became_peered":"2024-04-26T11:44:21.442734+0000","last_unstale":"2024-04-26T11:44:22.435811+0000","last_undegraded":"2024-04-26T11:44:22.435811+0000","last_fullsized":"2024-04-26T11:44:22.435811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435342+0000","last_change":"2024-04-26T11:44:21.442473+0000","last_active":"2024-04-26T11:44:22.435342+0000","last_peered":"2024-04-26T11:44:22.435342+0000","last_clean":"2024-04-26T11:44:22.435342+0000","last_became_active":"2024-04-26T11:44:21.441778+0000","last_became_peered":"2024-04-26T11:44:21.441778+0000","last_unstale":"2024-04-26T11:44:22.435342+0000","last_undegraded":"2024-04-26T11:44:22.435342+0000","last_fullsized":"2024-04-26T11:44:22.435342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435827+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:44:22.435827+0000","last_peered":"2024-04-26T11:44:22.435827+0000","last_clean":"2024-04-26T11:44:22.435827+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:44:22.435827+0000","last_undegraded":"2024-04-26T11:44:22.435827+0000","last_fullsized":"2024-04-26T11:44:22.435827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435163+0000","last_change":"2024-04-26T11:44:21.448849+0000","last_active":"2024-04-26T11:44:22.435163+0000","last_peered":"2024-04-26T11:44:22.435163+0000","last_clean":"2024-04-26T11:44:22.435163+0000","last_became_active":"2024-04-26T11:44:21.447398+0000","last_became_peered":"2024-04-26T11:44:21.447398+0000","last_unstale":"2024-04-26T11:44:22.435163+0000","last_undegraded":"2024-04-26T11:44:22.435163+0000","last_fullsized":"2024-04-26T11:44:22.435163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:02.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434980+0000","last_change":"2024-04-26T11:44:21.441647+0000","last_active":"2024-04-26T11:44:22.434980+0000","last_peered":"2024-04-26T11:44:22.434980+0000","last_clean":"2024-04-26T11:44:22.434980+0000","last_became_active":"2024-04-26T11:44:21.441237+0000","last_became_peered":"2024-04-26T11:44:21.441237+0000","last_unstale":"2024-04-26T11:44:22.434980+0000","last_undegraded":"2024-04-26T11:44:22.434980+0000","last_fullsized":"2024-04-26T11:44:22.434980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434482+0000","last_change":"2024-04-26T11:44:21.447786+0000","last_active":"2024-04-26T11:44:22.434482+0000","last_peered":"2024-04-26T11:44:22.434482+0000","last_clean":"2024-04-26T11:44:22.434482+0000","last_became_active":"2024-04-26T11:44:21.447367+0000","last_became_peered":"2024-04-26T11:44:21.447367+0000","last_unstale":"2024-04-26T11:44:22.434482+0000","last_undegraded":"2024-04-26T11:44:22.434482+0000","last_fullsized":"2024-04-26T11:44:22.434482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:58.516257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434713+0000","last_change":"2024-04-26T11:44:21.448136+0000","last_active":"2024-04-26T11:44:22.434713+0000","last_peered":"2024-04-26T11:44:22.434713+0000","last_clean":"2024-04-26T11:44:22.434713+0000","last_became_active":"2024-04-26T11:44:21.447382+0000","last_became_peered":"2024-04-26T11:44:21.447382+0000","last_unstale":"2024-04-26T11:44:22.434713+0000","last_undegraded":"2024-04-26T11:44:22.434713+0000","last_fullsized":"2024-04-26T11:44:22.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:51.127025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433838+0000","last_change":"2024-04-26T11:44:21.448950+0000","last_active":"2024-04-26T11:44:22.433838+0000","last_peered":"2024-04-26T11:44:22.433838+0000","last_clean":"2024-04-26T11:44:22.433838+0000","last_became_active":"2024-04-26T11:44:21.447975+0000","last_became_peered":"2024-04-26T11:44:21.447975+0000","last_unstale":"2024-04-26T11:44:22.433838+0000","last_undegraded":"2024-04-26T11:44:22.433838+0000","last_fullsized":"2024-04-26T11:44:22.433838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:07.109775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818672+0000","last_change":"2024-04-26T11:44:21.446676+0000","last_active":"2024-04-26T11:44:22.818672+0000","last_peered":"2024-04-26T11:44:22.818672+0000","last_clean":"2024-04-26T11:44:22.818672+0000","last_became_active":"2024-04-26T11:44:21.445874+0000","last_became_peered":"2024-04-26T11:44:21.445874+0000","last_unstale":"2024-04-26T11:44:22.818672+0000","last_undegraded":"2024-04-26T11:44:22.818672+0000","last_fullsized":"2024-04-26T11:44:22.818672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435569+0000","last_change":"2024-04-26T11:44:21.441552+0000","last_active":"2024-04-26T11:44:22.435569+0000","last_peered":"2024-04-26T11:44:22.435569+0000","last_clean":"2024-04-26T11:44:22.435569+0000","last_became_active":"2024-04-26T11:44:21.441047+0000","last_became_peered":"2024-04-26T11:44:21.441047+0000","last_unstale":"2024-04-26T11:44:22.435569+0000","last_undegraded":"2024-04-26T11:44:22.435569+0000","last_fullsized":"2024-04-26T11:44:22.435569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435826+0000","last_change":"2024-04-26T11:44:21.448723+0000","last_active":"2024-04-26T11:44:22.435826+0000","last_peered":"2024-04-26T11:44:22.435826+0000","last_clean":"2024-04-26T11:44:22.435826+0000","last_became_active":"2024-04-26T11:44:21.448275+0000","last_became_peered":"2024-04-26T11:44:21.448275+0000","last_unstale":"2024-04-26T11:44:22.435826+0000","last_undegraded":"2024-04-26T11:44:22.435826+0000","last_fullsized":"2024-04-26T11:44:22.435826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:12.372004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435154+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:44:22.435154+0000","last_peered":"2024-04-26T11:44:22.435154+0000","last_clean":"2024-04-26T11:44:22.435154+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:44:22.435154+0000","last_undegraded":"2024-04-26T11:44:22.435154+0000","last_fullsized":"2024-04-26T11:44:22.435154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434453+0000","last_change":"2024-04-26T11:44:21.441784+0000","last_active":"2024-04-26T11:44:22.434453+0000","last_peered":"2024-04-26T11:44:22.434453+0000","last_clean":"2024-04-26T11:44:22.434453+0000","last_became_active":"2024-04-26T11:44:21.441107+0000","last_became_peered":"2024-04-26T11:44:21.441107+0000","last_unstale":"2024-04-26T11:44:22.434453+0000","last_undegraded":"2024-04-26T11:44:22.434453+0000","last_fullsized":"2024-04-26T11:44:22.434453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434509+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:44:22.434509+0000","last_peered":"2024-04-26T11:44:22.434509+0000","last_clean":"2024-04-26T11:44:22.434509+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:44:22.434509+0000","last_undegraded":"2024-04-26T11:44:22.434509+0000","last_fullsized":"2024-04-26T11:44:22.434509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434815+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:44:22.434815+0000","last_peered":"2024-04-26T11:44:22.434815+0000","last_clean":"2024-04-26T11:44:22.434815+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:44:22.434815+0000","last_undegraded":"2024-04-26T11:44:22.434815+0000","last_fullsized":"2024-04-26T11:44:22.434815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433958+0000","last_change":"2024-04-26T11:44:21.449098+0000","last_active":"2024-04-26T11:44:22.433958+0000","last_peered":"2024-04-26T11:44:22.433958+0000","last_clean":"2024-04-26T11:44:22.433958+0000","last_became_active":"2024-04-26T11:44:21.448517+0000","last_became_peered":"2024-04-26T11:44:21.448517+0000","last_unstale":"2024-04-26T11:44:22.433958+0000","last_undegraded":"2024-04-26T11:44:22.433958+0000","last_fullsized":"2024-04-26T11:44:22.433958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:06.687165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819570+0000","last_change":"2024-04-26T11:44:21.439565+0000","last_active":"2024-04-26T11:44:22.819570+0000","last_peered":"2024-04-26T11:44:22.819570+0000","last_clean":"2024-04-26T11:44:22.819570+0000","last_became_active":"2024-04-26T11:44:21.438640+0000","last_became_peered":"2024-04-26T11:44:21.438640+0000","last_unstale":"2024-04-26T11:44:22.819570+0000","last_undegraded":"2024-04-26T11:44:22.819570+0000","last_fullsized":"2024-04-26T11:44:22.819570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435844+0000","last_change":"2024-04-26T11:44:21.437913+0000","last_active":"2024-04-26T11:44:22.435844+0000","last_peered":"2024-04-26T11:44:22.435844+0000","last_clean":"2024-04-26T11:44:22.435844+0000","last_became_active":"2024-04-26T11:44:21.437543+0000","last_became_peered":"2024-04-26T11:44:21.437543+0000","last_unstale":"2024-04-26T11:44:22.435844+0000","last_undegraded":"2024-04-26T11:44:22.435844+0000","last_fullsized":"2024-04-26T11:44:22.435844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818621+0000","last_change":"2024-04-26T11:44:21.440138+0000","last_active":"2024-04-26T11:44:22.818621+0000","last_peered":"2024-04-26T11:44:22.818621+0000","last_clean":"2024-04-26T11:44:22.818621+0000","last_became_active":"2024-04-26T11:44:21.439850+0000","last_became_peered":"2024-04-26T11:44:21.439850+0000","last_unstale":"2024-04-26T11:44:22.818621+0000","last_undegraded":"2024-04-26T11:44:22.818621+0000","last_fullsized":"2024-04-26T11:44:22.818621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435721+0000","last_change":"2024-04-26T11:44:21.449248+0000","last_active":"2024-04-26T11:44:22.435721+0000","last_peered":"2024-04-26T11:44:22.435721+0000","last_clean":"2024-04-26T11:44:22.435721+0000","last_became_active":"2024-04-26T11:44:21.448315+0000","last_became_peered":"2024-04-26T11:44:21.448315+0000","last_unstale":"2024-04-26T11:44:22.435721+0000","last_undegraded":"2024-04-26T11:44:22.435721+0000","last_fullsized":"2024-04-26T11:44:22.435721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436209+0000","last_change":"2024-04-26T11:44:21.448524+0000","last_active":"2024-04-26T11:44:22.436209+0000","last_peered":"2024-04-26T11:44:22.436209+0000","last_clean":"2024-04-26T11:44:22.436209+0000","last_became_active":"2024-04-26T11:44:21.447839+0000","last_became_peered":"2024-04-26T11:44:21.447839+0000","last_unstale":"2024-04-26T11:44:22.436209+0000","last_undegraded":"2024-04-26T11:44:22.436209+0000","last_fullsized":"2024-04-26T11:44:22.436209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434386+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:44:22.434386+0000","last_peered":"2024-04-26T11:44:22.434386+0000","last_clean":"2024-04-26T11:44:22.434386+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:44:22.434386+0000","last_undegraded":"2024-04-26T11:44:22.434386+0000","last_fullsized":"2024-04-26T11:44:22.434386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817486+0000","last_change":"2024-04-26T11:44:21.445626+0000","last_active":"2024-04-26T11:44:22.817486+0000","last_peered":"2024-04-26T11:44:22.817486+0000","last_clean":"2024-04-26T11:44:22.817486+0000","last_became_active":"2024-04-26T11:44:21.444990+0000","last_became_peered":"2024-04-26T11:44:21.444990+0000","last_unstale":"2024-04-26T11:44:22.817486+0000","last_undegraded":"2024-04-26T11:44:22.817486+0000","last_fullsized":"2024-04-26T11:44:22.817486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433782+0000","last_change":"2024-04-26T11:44:21.441463+0000","last_active":"2024-04-26T11:44:22.433782+0000","last_peered":"2024-04-26T11:44:22.433782+0000","last_clean":"2024-04-26T11:44:22.433782+0000","last_became_active":"2024-04-26T11:44:21.440895+0000","last_became_peered":"2024-04-26T11:44:21.440895+0000","last_unstale":"2024-04-26T11:44:22.433782+0000","last_undegraded":"2024-04-26T11:44:22.433782+0000","last_fullsized":"2024-04-26T11:44:22.433782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435906+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:44:22.435906+0000","last_peered":"2024-04-26T11:44:22.435906+0000","last_clean":"2024-04-26T11:44:22.435906+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:44:22.435906+0000","last_undegraded":"2024-04-26T11:44:22.435906+0000","last_fullsized":"2024-04-26T11:44:22.435906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819879+0000","last_change":"2024-04-26T11:44:21.444826+0000","last_active":"2024-04-26T11:44:22.819879+0000","last_peered":"2024-04-26T11:44:22.819879+0000","last_clean":"2024-04-26T11:44:22.819879+0000","last_became_active":"2024-04-26T11:44:21.444440+0000","last_became_peered":"2024-04-26T11:44:21.444440+0000","last_unstale":"2024-04-26T11:44:22.819879+0000","last_undegraded":"2024-04-26T11:44:22.819879+0000","last_fullsized":"2024-04-26T11:44:22.819879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436032+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:44:22.436032+0000","last_peered":"2024-04-26T11:44:22.436032+0000","last_clean":"2024-04-26T11:44:22.436032+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:44:22.436032+0000","last_undegraded":"2024-04-26T11:44:22.436032+0000","last_fullsized":"2024-04-26T11:44:22.436032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435465+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:44:22.435465+0000","last_peered":"2024-04-26T11:44:22.435465+0000","last_clean":"2024-04-26T11:44:22.435465+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:44:22.435465+0000","last_undegraded":"2024-04-26T11:44:22.435465+0000","last_fullsized":"2024-04-26T11:44:22.435465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819067+0000","last_change":"2024-04-26T11:44:21.439511+0000","last_active":"2024-04-26T11:44:22.819067+0000","last_peered":"2024-04-26T11:44:22.819067+0000","last_clean":"2024-04-26T11:44:22.819067+0000","last_became_active":"2024-04-26T11:44:21.438539+0000","last_became_peered":"2024-04-26T11:44:21.438539+0000","last_unstale":"2024-04-26T11:44:22.819067+0000","last_undegraded":"2024-04-26T11:44:22.819067+0000","last_fullsized":"2024-04-26T11:44:22.819067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434754+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:44:22.434754+0000","last_peered":"2024-04-26T11:44:22.434754+0000","last_clean":"2024-04-26T11:44:22.434754+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:44:22.434754+0000","last_undegraded":"2024-04-26T11:44:22.434754+0000","last_fullsized":"2024-04-26T11:44:22.434754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817638+0000","last_change":"2024-04-26T11:44:21.439772+0000","last_active":"2024-04-26T11:44:22.817638+0000","last_peered":"2024-04-26T11:44:22.817638+0000","last_clean":"2024-04-26T11:44:22.817638+0000","last_became_active":"2024-04-26T11:44:21.438770+0000","last_became_peered":"2024-04-26T11:44:21.438770+0000","last_unstale":"2024-04-26T11:44:22.817638+0000","last_undegraded":"2024-04-26T11:44:22.817638+0000","last_fullsized":"2024-04-26T11:44:22.817638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434091+0000","last_change":"2024-04-26T11:44:21.452228+0000","last_active":"2024-04-26T11:44:22.434091+0000","last_peered":"2024-04-26T11:44:22.434091+0000","last_clean":"2024-04-26T11:44:22.434091+0000","last_became_active":"2024-04-26T11:44:21.451258+0000","last_became_peered":"2024-04-26T11:44:21.451258+0000","last_unstale":"2024-04-26T11:44:22.434091+0000","last_undegraded":"2024-04-26T11:44:22.434091+0000","last_fullsized":"2024-04-26T11:44:22.434091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435434+0000","last_change":"2024-04-26T11:44:21.438961+0000","last_active":"2024-04-26T11:44:22.435434+0000","last_peered":"2024-04-26T11:44:22.435434+0000","last_clean":"2024-04-26T11:44:22.435434+0000","last_became_active":"2024-04-26T11:44:21.438124+0000","last_became_peered":"2024-04-26T11:44:21.438124+0000","last_unstale":"2024-04-26T11:44:22.435434+0000","last_undegraded":"2024-04-26T11:44:22.435434+0000","last_fullsized":"2024-04-26T11:44:22.435434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436336+0000","last_change":"2024-04-26T11:44:21.066359+0000","last_active":"2024-04-26T11:44:22.436336+0000","last_peered":"2024-04-26T11:44:22.436336+0000","last_clean":"2024-04-26T11:44:22.436336+0000","last_became_active":"2024-04-26T11:44:21.066007+0000","last_became_peered":"2024-04-26T11:44:21.066007+0000","last_unstale":"2024-04-26T11:44:22.436336+0000","last_undegraded":"2024-04-26T11:44:22.436336+0000","last_fullsized":"2024-04-26T11:44:22.436336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435741+0000","last_change":"2024-04-26T11:44:21.439295+0000","last_active":"2024-04-26T11:44:22.435741+0000","last_peered":"2024-04-26T11:44:22.435741+0000","last_clean":"2024-04-26T11:44:22.435741+0000","last_became_active":"2024-04-26T11:44:21.439097+0000","last_became_peered":"2024-04-26T11:44:21.439097+0000","last_unstale":"2024-04-26T11:44:22.435741+0000","last_undegraded":"2024-04-26T11:44:22.435741+0000","last_fullsized":"2024-04-26T11:44:22.435741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818216+0000","last_change":"2024-04-26T11:44:21.066646+0000","last_active":"2024-04-26T11:44:22.818216+0000","last_peered":"2024-04-26T11:44:22.818216+0000","last_clean":"2024-04-26T11:44:22.818216+0000","last_became_active":"2024-04-26T11:44:21.065981+0000","last_became_peered":"2024-04-26T11:44:21.065981+0000","last_unstale":"2024-04-26T11:44:22.818216+0000","last_undegraded":"2024-04-26T11:44:22.818216+0000","last_fullsized":"2024-04-26T11:44:22.818216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820032+0000","last_change":"2024-04-26T11:44:21.443681+0000","last_active":"2024-04-26T11:44:22.820032+0000","last_peered":"2024-04-26T11:44:22.820032+0000","last_clean":"2024-04-26T11:44:22.820032+0000","last_became_active":"2024-04-26T11:44:21.443253+0000","last_became_peered":"2024-04-26T11:44:21.443253+0000","last_unstale":"2024-04-26T11:44:22.820032+0000","last_undegraded":"2024-04-26T11:44:22.820032+0000","last_fullsized":"2024-04-26T11:44:22.820032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434717+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:44:22.434717+0000","last_peered":"2024-04-26T11:44:22.434717+0000","last_clean":"2024-04-26T11:44:22.434717+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:44:22.434717+0000","last_undegraded":"2024-04-26T11:44:22.434717+0000","last_fullsized":"2024-04-26T11:44:22.434717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818804+0000","last_change":"2024-04-26T11:44:21.445426+0000","last_active":"2024-04-26T11:44:22.818804+0000","last_peered":"2024-04-26T11:44:22.818804+0000","last_clean":"2024-04-26T11:44:22.818804+0000","last_became_active":"2024-04-26T11:44:21.444674+0000","last_became_peered":"2024-04-26T11:44:21.444674+0000","last_unstale":"2024-04-26T11:44:22.818804+0000","last_undegraded":"2024-04-26T11:44:22.818804+0000","last_fullsized":"2024-04-26T11:44:22.818804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434190+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:44:22.434190+0000","last_peered":"2024-04-26T11:44:22.434190+0000","last_clean":"2024-04-26T11:44:22.434190+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:44:22.434190+0000","last_undegraded":"2024-04-26T11:44:22.434190+0000","last_fullsized":"2024-04-26T11:44:22.434190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435770+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:44:22.435770+0000","last_peered":"2024-04-26T11:44:22.435770+0000","last_clean":"2024-04-26T11:44:22.435770+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:44:22.435770+0000","last_undegraded":"2024-04-26T11:44:22.435770+0000","last_fullsized":"2024-04-26T11:44:22.435770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433826+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:44:22.433826+0000","last_peered":"2024-04-26T11:44:22.433826+0000","last_clean":"2024-04-26T11:44:22.433826+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:44:22.433826+0000","last_undegraded":"2024-04-26T11:44:22.433826+0000","last_fullsized":"2024-04-26T11:44:22.433826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436104+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:44:22.436104+0000","last_peered":"2024-04-26T11:44:22.436104+0000","last_clean":"2024-04-26T11:44:22.436104+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:44:22.436104+0000","last_undegraded":"2024-04-26T11:44:22.436104+0000","last_fullsized":"2024-04-26T11:44:22.436104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.433901+0000","last_change":"2024-04-26T11:44:21.442188+0000","last_active":"2024-04-26T11:44:22.433901+0000","last_peered":"2024-04-26T11:44:22.433901+0000","last_clean":"2024-04-26T11:44:22.433901+0000","last_became_active":"2024-04-26T11:44:21.441105+0000","last_became_peered":"2024-04-26T11:44:21.441105+0000","last_unstale":"2024-04-26T11:44:22.433901+0000","last_undegraded":"2024-04-26T11:44:22.433901+0000","last_fullsized":"2024-04-26T11:44:22.433901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:45.407967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436283+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:44:22.436283+0000","last_peered":"2024-04-26T11:44:22.436283+0000","last_clean":"2024-04-26T11:44:22.436283+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:44:22.436283+0000","last_undegraded":"2024-04-26T11:44:22.436283+0000","last_fullsized":"2024-04-26T11:44:22.436283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435798+0000","last_change":"2024-04-26T11:44:21.449433+0000","last_active":"2024-04-26T11:44:22.435798+0000","last_peered":"2024-04-26T11:44:22.435798+0000","last_clean":"2024-04-26T11:44:22.435798+0000","last_became_active":"2024-04-26T11:44:21.447831+0000","last_became_peered":"2024-04-26T11:44:21.447831+0000","last_unstale":"2024-04-26T11:44:22.435798+0000","last_undegraded":"2024-04-26T11:44:22.435798+0000","last_fullsized":"2024-04-26T11:44:22.435798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435987+0000","last_change":"2024-04-26T11:44:21.065647+0000","last_active":"2024-04-26T11:44:22.435987+0000","last_peered":"2024-04-26T11:44:22.435987+0000","last_clean":"2024-04-26T11:44:22.435987+0000","last_became_active":"2024-04-26T11:44:21.065197+0000","last_became_peered":"2024-04-26T11:44:21.065197+0000","last_unstale":"2024-04-26T11:44:22.435987+0000","last_undegraded":"2024-04-26T11:44:22.435987+0000","last_fullsized":"2024-04-26T11:44:22.435987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.211340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818851+0000","last_change":"2024-04-26T11:44:21.443848+0000","last_active":"2024-04-26T11:44:22.818851+0000","last_peered":"2024-04-26T11:44:22.818851+0000","last_clean":"2024-04-26T11:44:22.818851+0000","last_became_active":"2024-04-26T11:44:21.443580+0000","last_became_peered":"2024-04-26T11:44:21.443580+0000","last_unstale":"2024-04-26T11:44:22.818851+0000","last_undegraded":"2024-04-26T11:44:22.818851+0000","last_fullsized":"2024-04-26T11:44:22.818851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:43.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819315+0000","last_change":"2024-04-26T11:44:21.068336+0000","last_active":"2024-04-26T11:44:22.819315+0000","last_peered":"2024-04-26T11:44:22.819315+0000","last_clean":"2024-04-26T11:44:22.819315+0000","last_became_active":"2024-04-26T11:44:21.067530+0000","last_became_peered":"2024-04-26T11:44:21.067530+0000","last_unstale":"2024-04-26T11:44:22.819315+0000","last_undegraded":"2024-04-26T11:44:22.819315+0000","last_fullsized":"2024-04-26T11:44:22.819315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:43.496839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435445+0000","last_change":"2024-04-26T11:44:21.449238+0000","last_active":"2024-04-26T11:44:22.435445+0000","last_peered":"2024-04-26T11:44:22.435445+0000","last_clean":"2024-04-26T11:44:22.435445+0000","last_became_active":"2024-04-26T11:44:21.447694+0000","last_became_peered":"2024-04-26T11:44:21.447694+0000","last_unstale":"2024-04-26T11:44:22.435445+0000","last_undegraded":"2024-04-26T11:44:22.435445+0000","last_fullsized":"2024-04-26T11:44:22.435445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435196+0000","last_change":"2024-04-26T11:44:21.066212+0000","last_active":"2024-04-26T11:44:22.435196+0000","last_peered":"2024-04-26T11:44:22.435196+0000","last_clean":"2024-04-26T11:44:22.435196+0000","last_became_active":"2024-04-26T11:44:21.065186+0000","last_became_peered":"2024-04-26T11:44:21.065186+0000","last_unstale":"2024-04-26T11:44:22.435196+0000","last_undegraded":"2024-04-26T11:44:22.435196+0000","last_fullsized":"2024-04-26T11:44:22.435196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436154+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:44:22.436154+0000","last_peered":"2024-04-26T11:44:22.436154+0000","last_clean":"2024-04-26T11:44:22.436154+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:44:22.436154+0000","last_undegraded":"2024-04-26T11:44:22.436154+0000","last_fullsized":"2024-04-26T11:44:22.436154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434230+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:44:22.434230+0000","last_peered":"2024-04-26T11:44:22.434230+0000","last_clean":"2024-04-26T11:44:22.434230+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:44:22.434230+0000","last_undegraded":"2024-04-26T11:44:22.434230+0000","last_fullsized":"2024-04-26T11:44:22.434230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435383+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:44:22.435383+0000","last_peered":"2024-04-26T11:44:22.435383+0000","last_clean":"2024-04-26T11:44:22.435383+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:44:22.435383+0000","last_undegraded":"2024-04-26T11:44:22.435383+0000","last_fullsized":"2024-04-26T11:44:22.435383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434021+0000","last_change":"2024-04-26T11:44:21.065486+0000","last_active":"2024-04-26T11:44:22.434021+0000","last_peered":"2024-04-26T11:44:22.434021+0000","last_clean":"2024-04-26T11:44:22.434021+0000","last_became_active":"2024-04-26T11:44:21.065090+0000","last_became_peered":"2024-04-26T11:44:21.065090+0000","last_unstale":"2024-04-26T11:44:22.434021+0000","last_undegraded":"2024-04-26T11:44:22.434021+0000","last_fullsized":"2024-04-26T11:44:22.434021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:03.456923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818894+0000","last_change":"2024-04-26T11:44:21.446431+0000","last_active":"2024-04-26T11:44:22.818894+0000","last_peered":"2024-04-26T11:44:22.818894+0000","last_clean":"2024-04-26T11:44:22.818894+0000","last_became_active":"2024-04-26T11:44:21.445866+0000","last_became_peered":"2024-04-26T11:44:21.445866+0000","last_unstale":"2024-04-26T11:44:22.818894+0000","last_undegraded":"2024-04-26T11:44:22.818894+0000","last_fullsized":"2024-04-26T11:44:22.818894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440035+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:44:21.440035+0000","last_peered":"2024-04-26T11:44:21.440035+0000","last_clean":"2024-04-26T11:44:21.440035+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:44:21.440035+0000","last_undegraded":"2024-04-26T11:44:21.440035+0000","last_fullsized":"2024-04-26T11:44:21.440035+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.440187+0000","last_change":"2024-04-26T11:44:17.037102+0000","last_active":"2024-04-26T11:44:21.440187+0000","last_peered":"2024-04-26T11:44:21.440187+0000","last_clean":"2024-04-26T11:44:21.440187+0000","last_became_active":"2024-04-26T11:44:17.036242+0000","last_became_peered":"2024-04-26T11:44:17.036242+0000","last_unstale":"2024-04-26T11:44:21.440187+0000","last_undegraded":"2024-04-26T11:44:21.440187+0000","last_fullsized":"2024-04-26T11:44:21.440187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818647+0000","last_change":"2024-04-26T11:44:21.064980+0000","last_active":"2024-04-26T11:44:22.818647+0000","last_peered":"2024-04-26T11:44:22.818647+0000","last_clean":"2024-04-26T11:44:22.818647+0000","last_became_active":"2024-04-26T11:44:21.064569+0000","last_became_peered":"2024-04-26T11:44:21.064569+0000","last_unstale":"2024-04-26T11:44:22.818647+0000","last_undegraded":"2024-04-26T11:44:22.818647+0000","last_fullsized":"2024-04-26T11:44:22.818647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436303+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:44:22.436303+0000","last_peered":"2024-04-26T11:44:22.436303+0000","last_clean":"2024-04-26T11:44:22.436303+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:44:22.436303+0000","last_undegraded":"2024-04-26T11:44:22.436303+0000","last_fullsized":"2024-04-26T11:44:22.436303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439848+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:44:21.439848+0000","last_peered":"2024-04-26T11:44:21.439848+0000","last_clean":"2024-04-26T11:44:21.439848+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:44:21.439848+0000","last_undegraded":"2024-04-26T11:44:21.439848+0000","last_fullsized":"2024-04-26T11:44:21.439848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818702+0000","last_change":"2024-04-26T11:44:21.066838+0000","last_active":"2024-04-26T11:44:22.818702+0000","last_peered":"2024-04-26T11:44:22.818702+0000","last_clean":"2024-04-26T11:44:22.818702+0000","last_became_active":"2024-04-26T11:44:21.065781+0000","last_became_peered":"2024-04-26T11:44:21.065781+0000","last_unstale":"2024-04-26T11:44:22.818702+0000","last_undegraded":"2024-04-26T11:44:22.818702+0000","last_fullsized":"2024-04-26T11:44:22.818702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435884+0000","last_change":"2024-04-26T11:44:21.439222+0000","last_active":"2024-04-26T11:44:22.435884+0000","last_peered":"2024-04-26T11:44:22.435884+0000","last_clean":"2024-04-26T11:44:22.435884+0000","last_became_active":"2024-04-26T11:44:21.438876+0000","last_became_peered":"2024-04-26T11:44:21.438876+0000","last_unstale":"2024-04-26T11:44:22.435884+0000","last_undegraded":"2024-04-26T11:44:22.435884+0000","last_fullsized":"2024-04-26T11:44:22.435884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.435673+0000","last_change":"2024-04-26T11:44:17.031172+0000","last_active":"2024-04-26T11:44:21.435673+0000","last_peered":"2024-04-26T11:44:21.435673+0000","last_clean":"2024-04-26T11:44:21.435673+0000","last_became_active":"2024-04-26T11:44:17.030306+0000","last_became_peered":"2024-04-26T11:44:17.030306+0000","last_unstale":"2024-04-26T11:44:21.435673+0000","last_undegraded":"2024-04-26T11:44:21.435673+0000","last_fullsized":"2024-04-26T11:44:21.435673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:30.564274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434093+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:44:22.434093+0000","last_peered":"2024-04-26T11:44:22.434093+0000","last_clean":"2024-04-26T11:44:22.434093+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:44:22.434093+0000","last_undegraded":"2024-04-26T11:44:22.434093+0000","last_fullsized":"2024-04-26T11:44:22.434093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819030+0000","last_change":"2024-04-26T11:44:21.440135+0000","last_active":"2024-04-26T11:44:22.819030+0000","last_peered":"2024-04-26T11:44:22.819030+0000","last_clean":"2024-04-26T11:44:22.819030+0000","last_became_active":"2024-04-26T11:44:21.439757+0000","last_became_peered":"2024-04-26T11:44:21.439757+0000","last_unstale":"2024-04-26T11:44:22.819030+0000","last_undegraded":"2024-04-26T11:44:22.819030+0000","last_fullsized":"2024-04-26T11:44:22.819030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.437818+0000","last_change":"2024-04-26T11:44:17.037146+0000","last_active":"2024-04-26T11:44:21.437818+0000","last_peered":"2024-04-26T11:44:21.437818+0000","last_clean":"2024-04-26T11:44:21.437818+0000","last_became_active":"2024-04-26T11:44:17.036196+0000","last_became_peered":"2024-04-26T11:44:17.036196+0000","last_unstale":"2024-04-26T11:44:21.437818+0000","last_undegraded":"2024-04-26T11:44:21.437818+0000","last_fullsized":"2024-04-26T11:44:21.437818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.409299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436401+0000","last_change":"2024-04-26T11:44:21.065821+0000","last_active":"2024-04-26T11:44:22.436401+0000","last_peered":"2024-04-26T11:44:22.436401+0000","last_clean":"2024-04-26T11:44:22.436401+0000","last_became_active":"2024-04-26T11:44:21.065300+0000","last_became_peered":"2024-04-26T11:44:21.065300+0000","last_unstale":"2024-04-26T11:44:22.436401+0000","last_undegraded":"2024-04-26T11:44:22.436401+0000","last_fullsized":"2024-04-26T11:44:22.436401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819416+0000","last_change":"2024-04-26T11:44:21.439526+0000","last_active":"2024-04-26T11:44:22.819416+0000","last_peered":"2024-04-26T11:44:22.819416+0000","last_clean":"2024-04-26T11:44:22.819416+0000","last_became_active":"2024-04-26T11:44:21.438786+0000","last_became_peered":"2024-04-26T11:44:21.438786+0000","last_unstale":"2024-04-26T11:44:22.819416+0000","last_undegraded":"2024-04-26T11:44:22.819416+0000","last_fullsized":"2024-04-26T11:44:22.819416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436395+0000","last_change":"2024-04-26T11:44:21.066276+0000","last_active":"2024-04-26T11:44:22.436395+0000","last_peered":"2024-04-26T11:44:22.436395+0000","last_clean":"2024-04-26T11:44:22.436395+0000","last_became_active":"2024-04-26T11:44:21.065682+0000","last_became_peered":"2024-04-26T11:44:21.065682+0000","last_unstale":"2024-04-26T11:44:22.436395+0000","last_undegraded":"2024-04-26T11:44:22.436395+0000","last_fullsized":"2024-04-26T11:44:22.436395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436324+0000","last_change":"2024-04-26T11:44:17.031782+0000","last_active":"2024-04-26T11:44:21.436324+0000","last_peered":"2024-04-26T11:44:21.436324+0000","last_clean":"2024-04-26T11:44:21.436324+0000","last_became_active":"2024-04-26T11:44:17.030688+0000","last_became_peered":"2024-04-26T11:44:17.030688+0000","last_unstale":"2024-04-26T11:44:21.436324+0000","last_undegraded":"2024-04-26T11:44:21.436324+0000","last_fullsized":"2024-04-26T11:44:21.436324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.289819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434465+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:44:22.434465+0000","last_peered":"2024-04-26T11:44:22.434465+0000","last_clean":"2024-04-26T11:44:22.434465+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:44:22.434465+0000","last_undegraded":"2024-04-26T11:44:22.434465+0000","last_fullsized":"2024-04-26T11:44:22.434465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819493+0000","last_change":"2024-04-26T11:44:21.065142+0000","last_active":"2024-04-26T11:44:22.819493+0000","last_peered":"2024-04-26T11:44:22.819493+0000","last_clean":"2024-04-26T11:44:22.819493+0000","last_became_active":"2024-04-26T11:44:21.064672+0000","last_became_peered":"2024-04-26T11:44:21.064672+0000","last_unstale":"2024-04-26T11:44:22.819493+0000","last_undegraded":"2024-04-26T11:44:22.819493+0000","last_fullsized":"2024-04-26T11:44:22.819493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.433676+0000","last_change":"2024-04-26T11:44:17.031146+0000","last_active":"2024-04-26T11:44:21.433676+0000","last_peered":"2024-04-26T11:44:21.433676+0000","last_clean":"2024-04-26T11:44:21.433676+0000","last_became_active":"2024-04-26T11:44:17.030637+0000","last_became_peered":"2024-04-26T11:44:17.030637+0000","last_unstale":"2024-04-26T11:44:21.433676+0000","last_undegraded":"2024-04-26T11:44:21.433676+0000","last_fullsized":"2024-04-26T11:44:21.433676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434766+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:44:22.434766+0000","last_peered":"2024-04-26T11:44:22.434766+0000","last_clean":"2024-04-26T11:44:22.434766+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:44:22.434766+0000","last_undegraded":"2024-04-26T11:44:22.434766+0000","last_fullsized":"2024-04-26T11:44:22.434766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819801+0000","last_change":"2024-04-26T11:44:21.065483+0000","last_active":"2024-04-26T11:44:22.819801+0000","last_peered":"2024-04-26T11:44:22.819801+0000","last_clean":"2024-04-26T11:44:22.819801+0000","last_became_active":"2024-04-26T11:44:21.064772+0000","last_became_peered":"2024-04-26T11:44:21.064772+0000","last_unstale":"2024-04-26T11:44:22.819801+0000","last_undegraded":"2024-04-26T11:44:22.819801+0000","last_fullsized":"2024-04-26T11:44:22.819801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:42.418356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.436718+0000","last_change":"2024-04-26T11:44:17.031358+0000","last_active":"2024-04-26T11:44:21.436718+0000","last_peered":"2024-04-26T11:44:21.436718+0000","last_clean":"2024-04-26T11:44:21.436718+0000","last_became_active":"2024-04-26T11:44:17.030413+0000","last_became_peered":"2024-04-26T11:44:17.030413+0000","last_unstale":"2024-04-26T11:44:21.436718+0000","last_undegraded":"2024-04-26T11:44:21.436718+0000","last_fullsized":"2024-04-26T11:44:21.436718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:01.338062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817817+0000","last_change":"2024-04-26T11:44:21.444989+0000","last_active":"2024-04-26T11:44:22.817817+0000","last_peered":"2024-04-26T11:44:22.817817+0000","last_clean":"2024-04-26T11:44:22.817817+0000","last_became_active":"2024-04-26T11:44:21.444418+0000","last_became_peered":"2024-04-26T11:44:21.444418+0000","last_unstale":"2024-04-26T11:44:22.817817+0000","last_undegraded":"2024-04-26T11:44:22.817817+0000","last_fullsized":"2024-04-26T11:44:22.817817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:23.968635+0000","last_change":"2024-04-26T11:44:21.067525+0000","last_active":"2024-04-26T11:44:23.968635+0000","last_peered":"2024-04-26T11:44:23.968635+0000","last_clean":"2024-04-26T11:44:23.968635+0000","last_became_active":"2024-04-26T11:44:21.065923+0000","last_became_peered":"2024-04-26T11:44:21.065923+0000","last_unstale":"2024-04-26T11:44:23.968635+0000","last_undegraded":"2024-04-26T11:44:23.968635+0000","last_fullsized":"2024-04-26T11:44:23.968635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:48.373491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:44:21.439731+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:44:21.439731+0000","last_peered":"2024-04-26T11:44:21.439731+0000","last_clean":"2024-04-26T11:44:21.439731+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:44:21.439731+0000","last_undegraded":"2024-04-26T11:44:21.439731+0000","last_fullsized":"2024-04-26T11:44:21.439731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434002+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:44:22.434002+0000","last_peered":"2024-04-26T11:44:22.434002+0000","last_clean":"2024-04-26T11:44:22.434002+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:44:22.434002+0000","last_undegraded":"2024-04-26T11:44:22.434002+0000","last_fullsized":"2024-04-26T11:44:22.434002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435702+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:44:22.435702+0000","last_peered":"2024-04-26T11:44:22.435702+0000","last_clean":"2024-04-26T11:44:22.435702+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:44:22.435702+0000","last_undegraded":"2024-04-26T11:44:22.435702+0000","last_fullsized":"2024-04-26T11:44:22.435702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435885+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:44:22.435885+0000","last_peered":"2024-04-26T11:44:22.435885+0000","last_clean":"2024-04-26T11:44:22.435885+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:44:22.435885+0000","last_undegraded":"2024-04-26T11:44:22.435885+0000","last_fullsized":"2024-04-26T11:44:22.435885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817896+0000","last_change":"2024-04-26T11:44:21.437907+0000","last_active":"2024-04-26T11:44:22.817896+0000","last_peered":"2024-04-26T11:44:22.817896+0000","last_clean":"2024-04-26T11:44:22.817896+0000","last_became_active":"2024-04-26T11:44:21.437024+0000","last_became_peered":"2024-04-26T11:44:21.437024+0000","last_unstale":"2024-04-26T11:44:22.817896+0000","last_undegraded":"2024-04-26T11:44:22.817896+0000","last_fullsized":"2024-04-26T11:44:22.817896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435937+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:44:22.435937+0000","last_peered":"2024-04-26T11:44:22.435937+0000","last_clean":"2024-04-26T11:44:22.435937+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:44:22.435937+0000","last_undegraded":"2024-04-26T11:44:22.435937+0000","last_fullsized":"2024-04-26T11:44:22.435937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435601+0000","last_change":"2024-04-26T11:44:21.065944+0000","last_active":"2024-04-26T11:44:22.435601+0000","last_peered":"2024-04-26T11:44:22.435601+0000","last_clean":"2024-04-26T11:44:22.435601+0000","last_became_active":"2024-04-26T11:44:21.065251+0000","last_became_peered":"2024-04-26T11:44:21.065251+0000","last_unstale":"2024-04-26T11:44:22.435601+0000","last_undegraded":"2024-04-26T11:44:22.435601+0000","last_fullsized":"2024-04-26T11:44:22.435601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817770+0000","last_change":"2024-04-26T11:44:21.445619+0000","last_active":"2024-04-26T11:44:22.817770+0000","last_peered":"2024-04-26T11:44:22.817770+0000","last_clean":"2024-04-26T11:44:22.817770+0000","last_became_active":"2024-04-26T11:44:21.444597+0000","last_became_peered":"2024-04-26T11:44:21.444597+0000","last_unstale":"2024-04-26T11:44:22.817770+0000","last_undegraded":"2024-04-26T11:44:22.817770+0000","last_fullsized":"2024-04-26T11:44:22.817770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819319+0000","last_change":"2024-04-26T11:44:21.067177+0000","last_active":"2024-04-26T11:44:22.819319+0000","last_peered":"2024-04-26T11:44:22.819319+0000","last_clean":"2024-04-26T11:44:22.819319+0000","last_became_active":"2024-04-26T11:44:21.066727+0000","last_became_peered":"2024-04-26T11:44:21.066727+0000","last_unstale":"2024-04-26T11:44:22.819319+0000","last_undegraded":"2024-04-26T11:44:22.819319+0000","last_fullsized":"2024-04-26T11:44:22.819319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.710369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.817835+0000","last_change":"2024-04-26T11:44:21.439357+0000","last_active":"2024-04-26T11:44:22.817835+0000","last_peered":"2024-04-26T11:44:22.817835+0000","last_clean":"2024-04-26T11:44:22.817835+0000","last_became_active":"2024-04-26T11:44:21.438703+0000","last_became_peered":"2024-04-26T11:44:21.438703+0000","last_unstale":"2024-04-26T11:44:22.817835+0000","last_undegraded":"2024-04-26T11:44:22.817835+0000","last_fullsized":"2024-04-26T11:44:22.817835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436060+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:44:22.436060+0000","last_peered":"2024-04-26T11:44:22.436060+0000","last_clean":"2024-04-26T11:44:22.436060+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:44:22.436060+0000","last_undegraded":"2024-04-26T11:44:22.436060+0000","last_fullsized":"2024-04-26T11:44:22.436060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818065+0000","last_change":"2024-04-26T11:44:21.065373+0000","last_active":"2024-04-26T11:44:22.818065+0000","last_peered":"2024-04-26T11:44:22.818065+0000","last_clean":"2024-04-26T11:44:22.818065+0000","last_became_active":"2024-04-26T11:44:21.064598+0000","last_became_peered":"2024-04-26T11:44:21.064598+0000","last_unstale":"2024-04-26T11:44:22.818065+0000","last_undegraded":"2024-04-26T11:44:22.818065+0000","last_fullsized":"2024-04-26T11:44:22.818065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819621+0000","last_change":"2024-04-26T11:44:21.445216+0000","last_active":"2024-04-26T11:44:22.819621+0000","last_peered":"2024-04-26T11:44:22.819621+0000","last_clean":"2024-04-26T11:44:22.819621+0000","last_became_active":"2024-04-26T11:44:21.444615+0000","last_became_peered":"2024-04-26T11:44:21.444615+0000","last_unstale":"2024-04-26T11:44:22.819621+0000","last_undegraded":"2024-04-26T11:44:22.819621+0000","last_fullsized":"2024-04-26T11:44:22.819621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:52.437824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.818131+0000","last_change":"2024-04-26T11:44:21.066483+0000","last_active":"2024-04-26T11:44:22.818131+0000","last_peered":"2024-04-26T11:44:22.818131+0000","last_clean":"2024-04-26T11:44:22.818131+0000","last_became_active":"2024-04-26T11:44:21.065373+0000","last_became_peered":"2024-04-26T11:44:21.065373+0000","last_unstale":"2024-04-26T11:44:22.818131+0000","last_undegraded":"2024-04-26T11:44:22.818131+0000","last_fullsized":"2024-04-26T11:44:22.818131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435451+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:44:22.435451+0000","last_peered":"2024-04-26T11:44:22.435451+0000","last_clean":"2024-04-26T11:44:22.435451+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:44:22.435451+0000","last_undegraded":"2024-04-26T11:44:22.435451+0000","last_fullsized":"2024-04-26T11:44:22.435451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434803+0000","last_change":"2024-04-26T11:44:21.065431+0000","last_active":"2024-04-26T11:44:22.434803+0000","last_peered":"2024-04-26T11:44:22.434803+0000","last_clean":"2024-04-26T11:44:22.434803+0000","last_became_active":"2024-04-26T11:44:21.065114+0000","last_became_peered":"2024-04-26T11:44:21.065114+0000","last_unstale":"2024-04-26T11:44:22.434803+0000","last_undegraded":"2024-04-26T11:44:22.434803+0000","last_fullsized":"2024-04-26T11:44:22.434803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:39.838237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435212+0000","last_change":"2024-04-26T11:44:21.441795+0000","last_active":"2024-04-26T11:44:22.435212+0000","last_peered":"2024-04-26T11:44:22.435212+0000","last_clean":"2024-04-26T11:44:22.435212+0000","last_became_active":"2024-04-26T11:44:21.441421+0000","last_became_peered":"2024-04-26T11:44:21.441421+0000","last_unstale":"2024-04-26T11:44:22.435212+0000","last_undegraded":"2024-04-26T11:44:22.435212+0000","last_fullsized":"2024-04-26T11:44:22.435212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:06.599346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435013+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:44:22.435013+0000","last_peered":"2024-04-26T11:44:22.435013+0000","last_clean":"2024-04-26T11:44:22.435013+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:44:22.435013+0000","last_undegraded":"2024-04-26T11:44:22.435013+0000","last_fullsized":"2024-04-26T11:44:22.435013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.436177+0000","last_change":"2024-04-26T11:44:21.448442+0000","last_active":"2024-04-26T11:44:22.436177+0000","last_peered":"2024-04-26T11:44:22.436177+0000","last_clean":"2024-04-26T11:44:22.436177+0000","last_became_active":"2024-04-26T11:44:21.447770+0000","last_became_peered":"2024-04-26T11:44:21.447770+0000","last_unstale":"2024-04-26T11:44:22.436177+0000","last_undegraded":"2024-04-26T11:44:22.436177+0000","last_fullsized":"2024-04-26T11:44:22.436177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:00.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435664+0000","last_change":"2024-04-26T11:44:21.066498+0000","last_active":"2024-04-26T11:44:22.435664+0000","last_peered":"2024-04-26T11:44:22.435664+0000","last_clean":"2024-04-26T11:44:22.435664+0000","last_became_active":"2024-04-26T11:44:21.065945+0000","last_became_peered":"2024-04-26T11:44:21.065945+0000","last_unstale":"2024-04-26T11:44:22.435664+0000","last_undegraded":"2024-04-26T11:44:22.435664+0000","last_fullsized":"2024-04-26T11:44:22.435664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434988+0000","last_change":"2024-04-26T11:44:21.448777+0000","last_active":"2024-04-26T11:44:22.434988+0000","last_peered":"2024-04-26T11:44:22.434988+0000","last_clean":"2024-04-26T11:44:22.434988+0000","last_became_active":"2024-04-26T11:44:21.448274+0000","last_became_peered":"2024-04-26T11:44:21.448274+0000","last_unstale":"2024-04-26T11:44:22.434988+0000","last_undegraded":"2024-04-26T11:44:22.434988+0000","last_fullsized":"2024-04-26T11:44:22.434988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.981135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.435817+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:44:22.435817+0000","last_peered":"2024-04-26T11:44:22.435817+0000","last_clean":"2024-04-26T11:44:22.435817+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:44:22.435817+0000","last_undegraded":"2024-04-26T11:44:22.435817+0000","last_fullsized":"2024-04-26T11:44:22.435817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434476+0000","last_change":"2024-04-26T11:44:21.438183+0000","last_active":"2024-04-26T11:44:22.434476+0000","last_peered":"2024-04-26T11:44:22.434476+0000","last_clean":"2024-04-26T11:44:22.434476+0000","last_became_active":"2024-04-26T11:44:21.437823+0000","last_became_peered":"2024-04-26T11:44:21.437823+0000","last_unstale":"2024-04-26T11:44:22.434476+0000","last_undegraded":"2024-04-26T11:44:22.434476+0000","last_fullsized":"2024-04-26T11:44:22.434476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:09.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.820080+0000","last_change":"2024-04-26T11:44:21.068479+0000","last_active":"2024-04-26T11:44:22.820080+0000","last_peered":"2024-04-26T11:44:22.820080+0000","last_clean":"2024-04-26T11:44:22.820080+0000","last_became_active":"2024-04-26T11:44:21.068206+0000","last_became_peered":"2024-04-26T11:44:21.068206+0000","last_unstale":"2024-04-26T11:44:22.820080+0000","last_undegraded":"2024-04-26T11:44:22.820080+0000","last_fullsized":"2024-04-26T11:44:22.820080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:45.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.434365+0000","last_change":"2024-04-26T11:44:21.452369+0000","last_active":"2024-04-26T11:44:22.434365+0000","last_peered":"2024-04-26T11:44:22.434365+0000","last_clean":"2024-04-26T11:44:22.434365+0000","last_became_active":"2024-04-26T11:44:21.451833+0000","last_became_peered":"2024-04-26T11:44:21.451833+0000","last_unstale":"2024-04-26T11:44:22.434365+0000","last_undegraded":"2024-04-26T11:44:22.434365+0000","last_fullsized":"2024-04-26T11:44:22.434365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:11.610498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:44:22.819101+0000","last_change":"2024-04-26T11:44:21.068300+0000","last_active":"2024-04-26T11:44:22.819101+0000","last_peered":"2024-04-26T11:44:22.819101+0000","last_clean":"2024-04-26T11:44:22.819101+0000","last_became_active":"2024-04-26T11:44:21.067285+0000","last_became_peered":"2024-04-26T11:44:21.067285+0000","last_unstale":"2024-04-26T11:44:22.819101+0000","last_undegraded":"2024-04-26T11:44:22.819101+0000","last_fullsized":"2024-04-26T11:44:22.819101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:33.707214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":790528,"data_stored":650427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":782336,"data_stored":649811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:44:41.863 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T11:44:41.863 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T11:44:42.169 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 19 2024-04-26T11:44:42.169 INFO:teuthology.orchestra.run.smithi029.stdout:fsid 6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7 2024-04-26T11:44:42.169 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-04-26T11:43:59.327999+0000 2024-04-26T11:44:42.169 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2024-04-26T11:44:22.421187+0000 2024-04-26T11:44:42.169 INFO:teuthology.orchestra.run.smithi029.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T11:44:42.169 INFO:teuthology.orchestra.run.smithi029.stdout:crush_version 4 2024-04-26T11:44:42.169 INFO:teuthology.orchestra.run.smithi029.stdout:full_ratio 0.95 2024-04-26T11:44:42.169 INFO:teuthology.orchestra.run.smithi029.stdout:backfillfull_ratio 0.9 2024-04-26T11:44:42.170 INFO:teuthology.orchestra.run.smithi029.stdout:nearfull_ratio 0.85 2024-04-26T11:44:42.170 INFO:teuthology.orchestra.run.smithi029.stdout:require_min_compat_client luminous 2024-04-26T11:44:42.170 INFO:teuthology.orchestra.run.smithi029.stdout:min_compat_client jewel 2024-04-26T11:44:42.170 INFO:teuthology.orchestra.run.smithi029.stdout:require_osd_release reef 2024-04-26T11:44:42.170 INFO:teuthology.orchestra.run.smithi029.stdout:stretch_mode_enabled false 2024-04-26T11:44:42.170 INFO:teuthology.orchestra.run.smithi029.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-26T11:44:42.170 INFO:teuthology.orchestra.run.smithi029.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-26T11:44:42.170 INFO:teuthology.orchestra.run.smithi029.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-26T11:44:42.170 INFO:teuthology.orchestra.run.smithi029.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-26T11:44:42.170 INFO:teuthology.orchestra.run.smithi029.stdout:max_osd 3 2024-04-26T11:44:42.170 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.72:6800/18212,v1:172.21.15.72:6801/18212] [v2:172.21.15.72:6802/18212,v1:172.21.15.72:6803/18212] exists,up 0a044aa1-7704-498d-af77-565f6fdb2bdc 2024-04-26T11:44:42.171 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6800/18195,v1:172.21.15.82:6801/18195] [v2:172.21.15.82:6802/18195,v1:172.21.15.82:6803/18195] exists,up 6aad0623-0085-42f2-873e-766474c95e27 2024-04-26T11:44:42.171 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/18323,v1:172.21.15.122:6801/18323] [v2:172.21.15.122:6802/18323,v1:172.21.15.122:6803/18323] exists,up 1367cc49-5228-4e11-96fc-ffb092dc8397 2024-04-26T11:44:42.183 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.72:6800/18212,v1:172.21.15.72:6801/18212] [v2:172.21.15.72:6802/18212,v1:172.21.15.72:6803/18212] exists,up 0a044aa1-7704-498d-af77-565f6fdb2bdc', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6800/18195,v1:172.21.15.82:6801/18195] [v2:172.21.15.82:6802/18195,v1:172.21.15.82:6803/18195] exists,up 6aad0623-0085-42f2-873e-766474c95e27', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/18323,v1:172.21.15.122:6801/18323] [v2:172.21.15.122:6802/18323,v1:172.21.15.122:6803/18323] exists,up 1367cc49-5228-4e11-96fc-ffb092dc8397'] 2024-04-26T11:44:42.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T11:44:42.288 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:44:42.288 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mon.a", 2024-04-26T11:44:42.288 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster": "ceph", 2024-04-26T11:44:42.288 INFO:teuthology.orchestra.run.smithi029.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T11:44:42.288 INFO:teuthology.orchestra.run.smithi029.stdout: "admin_socket_mode": "", 2024-04-26T11:44:42.288 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T11:44:42.288 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_client_required": "cephx, none", 2024-04-26T11:44:42.288 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_cluster_required": "cephx", 2024-04-26T11:44:42.288 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_debug": "true", 2024-04-26T11:44:42.288 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T11:44:42.288 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_service_required": "cephx", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_supported": "cephx", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_aio": "true", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_aio_reap_max": "16", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_async_discard": "false", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_block_size": "4096", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_debug_aio": "false", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T11:44:42.289 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_enable_discard": "false", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_flock_retry": "3", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_inject_crash": "0", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_ioring": "false", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_ioring_hipri": "false", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T11:44:42.290 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_type": "", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_allocator": "hybrid", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_buffered_io": "true", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T11:44:42.291 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_replay_recovery": "false", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_sync_write": "false", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_allocator": "hybrid", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T11:44:42.292 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_create": "true", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_db_create": "false", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_db_path": "", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_db_size": "0", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_path": "", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_size": "107374182400", 2024-04-26T11:44:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_wal_create": "false", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_wal_path": "", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bluefs": "true", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_autotune": "true", 2024-04-26T11:44:42.294 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_size": "0", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_type": "2q", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_clone_cow": "true", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T11:44:42.295 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_mode": "none", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_freelist": "false", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-26T11:44:42.296 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T11:44:42.297 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fail_eio": "false", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T11:44:42.298 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T11:44:42.299 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_blob_size": "0", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T11:44:42.300 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T11:44:42.301 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_spdk_mem": "512", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_tracing": "false", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T11:44:42.302 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T11:44:42.303 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_cluster_require_version": "2", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_require_signatures": "false", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_require_version": "2", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_service_require_signatures": "false", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_service_require_version": "2", 2024-04-26T11:44:42.304 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_sign_messages": "true", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "chdir": "", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_acl_type": "", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_asio_thread_count": "2", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_cache_mid": "0.750000", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_cache_size": "16384", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_caps_release_delay": "5", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_check_pool_perm": "true", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_debug_force_sync_read": "false", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_debug_getattr_caps": "false", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_die_on_failed_remount": "false", 2024-04-26T11:44:42.305 INFO:teuthology.orchestra.run.smithi029.stdout: "client_dirsize_rbytes": "true", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_force_lazyio": "false", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_fs": "", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_inject_release_failure": "false", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_max_inline_size": "4096", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_mds_namespace": "", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_metadata": "", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_mount_gid": "-1", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_mount_timeout": "300", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_mount_uid": "-1", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_mountpoint": "/", 2024-04-26T11:44:42.306 INFO:teuthology.orchestra.run.smithi029.stdout: "client_notify_timeout": "10", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc": "true", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc_max_objects": "1000", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc_size": "209715200", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_permissions": "true", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_quota": "true", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_quota_df": "true", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_readahead_max_bytes": "0", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_readahead_max_periods": "4", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_readahead_min": "131072", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_reconnect_stale": "false", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_shutdown_timeout": "30", 2024-04-26T11:44:42.307 INFO:teuthology.orchestra.run.smithi029.stdout: "client_snapdir": ".snap", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "client_tick_interval": "1", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "client_trace": "", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "client_use_faked_inos": "false", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "client_use_random_mds": "false", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_graylog": "false", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_graylog_port": "12201", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_monitors": "default=true", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_syslog": "false", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_syslog_level": "info", 2024-04-26T11:44:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "-", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_network": "", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_network_interface": "", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "compressor_zlib_isal": "false", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "compressor_zlib_level": "5", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "compressor_zstd_level": "1", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "crimson_seastar_smp": "1", 2024-04-26T11:44:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_location": "", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_location_hook": "", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_location_hook_timeout": "10", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "daemonize": "false", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "daos_pool": "tank", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_alienstore": "0/5", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_asok": "1/5", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_asok_assert_abort": "false", 2024-04-26T11:44:42.310 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_auth": "20/20", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_bdev": "1/3", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_bluefs": "1/5", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_bluestore": "1/5", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_buffer": "0/1", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_cephsqlite": "0/5", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_client": "0/5", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_compressor": "1/5", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_context": "0/1", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_crush": "1/1", 2024-04-26T11:44:42.311 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_crypto": "1/5", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_cyanstore": "0/5", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_dpdk": "1/5", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_eventtrace": "1/5", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_filer": "0/1", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_filestore": "1/3", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_finisher": "1/1", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_fuse": "1/5", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_javaclient": "1/5", 2024-04-26T11:44:42.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_journal": "1/3", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_journaler": "0/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_kstore": "1/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_leveldb": "4/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_lockdep": "0/1", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mclock": "1/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds": "1/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds_balancer": "1/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds_locker": "1/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds_log": "1/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds_migrator": "1/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_memstore": "1/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mgr": "2/5", 2024-04-26T11:44:42.313 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mgrc": "1/5", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mon": "20/20", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_monc": "0/10", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_ms": "1/1", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_none": "0/5", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_objclass": "0/5", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_objectcacher": "0/5", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_objecter": "0/1", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_optracker": "0/5", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_osd": "1/5", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_paxos": "20/20", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_perfcounter": "1/5", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_prioritycache": "1/5", 2024-04-26T11:44:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rados": "0/5", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rbd": "0/5", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rbd_replay": "0/5", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_refs": "0/0", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_reserver": "1/1", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw": "1/5", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw_access": "1/5", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw_flight": "1/5", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw_sync": "1/5", 2024-04-26T11:44:42.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rocksdb": "4/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_backref": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_cache": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_device": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_epm": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_journal": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_lba": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_odata": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_omap": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_onode": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_t": "0/5", 2024-04-26T11:44:42.316 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_tm": "0/5", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_striper": "0/1", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_test": "0/5", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_throttle": "1/1", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_timer": "0/1", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_tp": "0/5", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "device_failure_prediction_mode": "none", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "err_to_graylog": "false", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "err_to_journald": "false", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "err_to_stderr": "true", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "err_to_syslog": "false", 2024-04-26T11:44:42.317 INFO:teuthology.orchestra.run.smithi029.stdout: "event_tracing": "false", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_http_port": "9926", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_prio_limit": "5", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_sort_metrics": "true", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_stats_period": "5", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "fake_statfs_for_testing": "0", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "fatal_signal_handlers": "true", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "filer_max_purge_ops": "10", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "filer_max_truncate_ops": "128", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_blackhole": "false", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T11:44:42.318 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_btrfs_snap": "true", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_caller_concurrency": "10", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_debug_omap_check": "false", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_debug_verify_split": "false", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_dump_file": "", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fadvise": "true", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fail_eio": "true", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T11:44:42.319 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fd_cache_size": "128", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fiemap": "false", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_inject_stall": "0", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_journal_parallel": "false", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_journal_trailing": "false", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_journal_writeahead": "false", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_kill_at": "0", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T11:44:42.320 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_merge_threshold": "-10", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_odsync_write": "false", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T11:44:42.321 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_omap_backend_path": "", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_op_threads": "2", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_punch_hole": "false", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T11:44:42.322 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_max_ops": "50", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_seek_data_hole": "false", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_sloppy_crc": "false", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_splice": "false", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_split_multiple": "2", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_split_rand_factor": "20", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_update_to": "1000", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T11:44:42.323 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_xfs_extsize": "false", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_zfs_snap": "false", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "fio_dir": "/tmp/fio", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "fsid": "6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7", 2024-04-26T11:44:42.324 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_allow_other": "true", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_big_writes": "true", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_debug": "false", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_default_permissions": "false", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_disable_pagecache": "false", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_max_write": "0", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_multithreaded": "true", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_require_active_mds": "true", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_set_user_groups": "true", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_splice_move": "true", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_splice_read": "true", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_splice_write": "true", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T11:44:42.325 INFO:teuthology.orchestra.run.smithi029.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "gss_target_name": "ceph", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_file": "", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_inject_failure": "0", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_interval": "5", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "host": "smithi029", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T11:44:42.326 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "inject_early_sigterm": "false", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "jaeger_agent_port": "6799", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "jaeger_tracing_enable": "false", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_aio": "true", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_align_min_size": "65536", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_block_align": "true", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_block_size": "4096", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_dio": "true", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_discard": "false", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_force_aio": "false", 2024-04-26T11:44:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_ignore_corruption": "false", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_max_write_entries": "100", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_replay_from": "0", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_write_header_frequency": "0", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_zero_on_create": "false", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journaler_prefetch_periods": "10", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journaler_prezero_periods": "5", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "journaler_write_head_interval": "15", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "", 2024-04-26T11:44:42.328 INFO:teuthology.orchestra.run.smithi029.stdout: "keyfile": "", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_backend": "rocksdb", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_max_bytes": "67108864", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_max_ops": "512", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_onode_map_size": "1024", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_sync_transaction": "false", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_block_size": "65536", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_bloom_size": "0", 2024-04-26T11:44:42.329 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_cache_size": "536870912", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_compact_on_mount": "false", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_compression": "false", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_log": "", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_max_open_files": "0", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_paranoid": "false", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "librados_thread_count": "2", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "lockdep": "false", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "lockdep_force_backtrace": "false", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "log_coarse_timestamps": "true", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T11:44:42.330 INFO:teuthology.orchestra.run.smithi029.stdout: "log_flush_on_exit": "false", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_graylog_port": "12201", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_max_new": "1000", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_max_recent": "10000", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_stderr_prefix": "", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": "true", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_graylog": "false", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_journald": "false", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_stderr": "false", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_syslog": "false", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T11:44:42.331 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_action_on_write_error": "1", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_alternate_name_max": "8192", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_asio_thread_count": "2", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_export_pin": "true", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_interval": "10", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_max": "-1", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_max_until": "-1", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_merge_size": "50", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T11:44:42.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_mode": "0", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_split_bits": "3", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_split_size": "10000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T11:44:42.333 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_mid": "0.700000", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_trim_interval": "1", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T11:44:42.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_debug_auth_pins": "false", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_debug_frag": "false", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_debug_scatterstat": "false", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_debug_subtrees": "false", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_default_dir_hash": "2", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_defer_session_stale": "true", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T11:44:42.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dir_max_entries": "0", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dir_prefetch": "true", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_early_reply": "true", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_enable_op_tracker": "true", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_enforce_unique_name": "true", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T11:44:42.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_health_dummy": "false", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T11:44:42.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_join_fs": "", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_journal_format": "1", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_create_at": "0", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_export_at": "0", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_import_at": "0", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_journal_at": "0", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_link_at": "0", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_openc_at": "0", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_rename_at": "0", 2024-04-26T11:44:42.338 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_max_events": "-1", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_max_segments": "128", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_pause": "false", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_segment_size": "0", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_completed_requests": "100000", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_export_size": "20971520", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_file_recover": "32", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_purge_files": "64", 2024-04-26T11:44:42.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_purge_ops": "8192", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_metrics_update_interval": "2", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_min_caps_per_client": "100", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_numa_node": "-1", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_history_duration": "600", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_history_size": "20", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T11:44:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_log_threshold": "5", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_ping_grace": "15", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_ping_interval": "5", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_max_caps": "30000", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_replay_interval": "1.000000", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T11:44:42.341 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_root_ino_gid": "0", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_root_ino_uid": "0", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_shutdown_check": "0", 2024-04-26T11:44:42.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_skip_ino": "0", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_snap_min_uid": "0", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_snap_rstat": "false", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_symlink_recovery": "true", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_thrash_exports": "0", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_thrash_fragments": "0", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_tick_interval": "5.000000", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_valgrind_exit": "false", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_verify_backtrace": "1", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_verify_scatter": "false", 2024-04-26T11:44:42.343 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_wipe_sessions": "false", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mempool_debug": "false", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "memstore_page_set": "false", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "memstore_page_size": "65536", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_client_bytes": "134217728", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_client_messages": "512", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_disabled_modules": "", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T11:44:42.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_mds_messages": "128", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_mon_messages": "128", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_osd_messages": "8192", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_pool": "true", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_standby_modules": "true", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_stats_period": "5", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_stats_threshold": "5", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_tick_period": "2", 2024-04-26T11:44:42.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_allow_pool_delete": "true", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_bytes": "104857600", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T11:44:42.346 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T11:44:42.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_compact_on_start": "false", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_compact_on_trim": "true", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cpu_threads": "4", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_data_avail_crit": "5", 2024-04-26T11:44:42.348 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_data_avail_warn": "5", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_dump_json": "false", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_extra_checks": "false", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_no_require_quincy": "false", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T11:44:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_election_default_strategy": "1", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_election_timeout": "5.000000", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_enable_op_tracker": "true", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_fake_pool_delete": "false", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_force_quorum_join": "false", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_log_update_period": "5", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_max_detail": "50", 2024-04-26T11:44:42.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_to_clog": "true", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_host": "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_host_override": "", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_initial_members": "", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_lease": "5.000000", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_log_full_interval": "50", 2024-04-26T11:44:42.351 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_log_max": "10000", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_log_max_summary": "50", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_log_epochs": "500", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_osd": "10000", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T11:44:42.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_memory_autotune": "true", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_memory_target": "2147483648", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_digest_period": "5", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_complaint_time": "30", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_history_duration": "600", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_history_size": "20", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T11:44:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_log_threshold": "5", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_cache_size": "500", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T11:44:42.354 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T11:44:42.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_report_timeout": "900", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T11:44:42.356 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_reweight_max_osds": "4", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_scrub_interval": "86400", 2024-04-26T11:44:42.357 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_scrub_max_keys": "100", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_scrub_timeout": "300", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_session_timeout": "300", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_smart_report_timeout": "5", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_stretch_pool_size": "4", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_debug": "false", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T11:44:42.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_tick_interval": "5", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T11:44:42.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_older_version": "true", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T11:44:42.360 INFO:teuthology.orchestra.run.smithi029.stdout: "monmap": "", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_tracing_enabled": "false", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_op_threads": "3", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_cm": "false", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_device_name": "", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T11:44:42.361 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_sl": "3", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_type": "ib", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_reap_threshold": "5", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_before_connect": "false", 2024-04-26T11:44:42.362 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_ipv4": "true", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_ipv6": "false", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_msgr1": "true", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_msgr2": "true", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_port_max": "7568", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_port_min": "6800", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_retry_count": "3", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_retry_delay": "5", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_blackhole_client": "false", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_blackhole_mds": "false", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_blackhole_mgr": "false", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_blackhole_mon": "false", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_blackhole_osd": "false", 2024-04-26T11:44:42.363 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_client_mode": "crc secure", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_cluster_type": "", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_compress_secure": "false", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_crc_data": "true", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_crc_header": "true", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_die_on_bug": "true", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_die_on_old_message": "true", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T11:44:42.364 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_hugepages": "", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_lro": "true", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_pmd": "", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_port_id": "0", 2024-04-26T11:44:42.365 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dump_on_send": "false", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_delay_type": "", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_network_congestion": "0", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_socket_failures": "0", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_max_accept_failures": "4", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_max_backoff": "15.000000", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T11:44:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_osd_compress_mode": "none", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_pq_min_cost": "65536", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_public_type": "", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_service_mode": "crc secure", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_tcp_nodelay": "true", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T11:44:42.367 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_type": "async+posix", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "no_config_file": "false", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_inflight_ops": "1024", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_timeout": "10.000000", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "objectstore_blackhole": "false", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "openssl_engine_opts": "", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T11:44:42.368 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_max_ops": "4", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_slop": "0.020000", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_asio_thread_count": "2", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backfill_scan_max": "512", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backfill_scan_min": "64", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T11:44:42.369 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backoff_on_peering": "false", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_beacon_report_interval": "300", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bench_duration": "30", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_blkin_trace_all": "false", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T11:44:42.370 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_class_update_on_start": "true", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_client_message_cap": "256", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_client_op_priority": "63", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_client_watch_timeout": "30", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_command_max_records": "256", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_compact_on_start": "false", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_crush_update_on_start": "true", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T11:44:42.371 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T11:44:42.372 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T11:44:42.372 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T11:44:42.372 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T11:44:42.372 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T11:44:42.372 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T11:44:42.372 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T11:44:42.372 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T11:44:42.372 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T11:44:42.372 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T11:44:42.372 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T11:44:42.372 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_op_order": "false", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_shutdown": "false", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T11:44:42.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_default_notify_timeout": "30", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T11:44:42.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_enable_op_tracker": "true", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_fast_info": "true", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_fast_shutdown": "true", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_function_tracing": "false", 2024-04-26T11:44:42.375 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_grace": "20", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_interval": "6", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_stale": "600", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T11:44:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_journal_size": "5120", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_kill_backfill_at": "0", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_map_cache_size": "50", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_map_dedup": "true", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_map_message_max": "40", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_attr_name_len": "100", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_attr_size": "0", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_backfills": "1", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_markdown_count": "5", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_markdown_period": "600", 2024-04-26T11:44:42.377 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_object_name_len": "2048", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_object_size": "134217728", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_pgls": "1024", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_push_cost": "8388608", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_push_objects": "10", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_scrubs": "3", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T11:44:42.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_write_size": "90", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_profile": "balanced", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T11:44:42.379 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_base": "805306368", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_target": "4294967296", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_target_autotune": "false", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T11:44:42.380 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_min_recovery_priority": "0", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mon_report_interval": "5", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_num_cache_shards": "32", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_numa_node": "-1", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_objecter_finishers": "1", 2024-04-26T11:44:42.381 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_objectstore": "bluestore", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_objectstore_fuse": "false", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_objectstore_tracing": "false", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_history_duration": "600", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_history_size": "20", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_log_threshold": "5", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_shards": "0", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T11:44:42.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_thread_timeout": "15", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_open_classes_on_start": "true", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_os_flags": "0", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_peering_op_priority": "255", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_delete_priority": "5", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T11:44:42.383 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_crimson": "false", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T11:44:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flags": "0", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_min_size": "0", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_size": "2", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_type": "replicated", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T11:44:42.385 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_cost": "20971520", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_active": "0", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_op_priority": "3", 2024-04-26T11:44:42.386 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_priority": "5", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_repair_during_recovery": "false", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T11:44:42.387 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_cost": "52428800", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_end_hour": "0", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T11:44:42.388 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_priority": "5", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_skip_data_digest": "false", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_smart_report_timeout": "5", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_priority": "5", 2024-04-26T11:44:42.389 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_target_transaction_size": "30", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T11:44:42.390 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tracing": "false", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_use_stale_snap": "false", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_kill_at": "0", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_max_join_drift": "10", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_min": "500", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_min_wait": "0.050000", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_service_trim_max": "500", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T11:44:42.391 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_service_trim_min": "250", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_stash_full_interval": "25", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_trim_max": "500", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_trim_min": "250", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "perf": "true", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "-", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrv": "", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "public_bind_addr": "-", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "public_network": "", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "public_network_interface": "", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "qat_compressor_enabled": "false", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T11:44:42.392 INFO:teuthology.orchestra.run.smithi029.stdout: "rados_mon_op_timeout": "0", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rados_osd_op_timeout": "0", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rados_tracing": "false", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_atime_update_interval": "60", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache": "true", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T11:44:42.393 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_policy": "writearound", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_size": "33554432", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_compression_hint": "none", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_clone_format": "auto", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_data_pool": "", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_features": "61", 2024-04-26T11:44:42.394 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_format": "2", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_map_options": "", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_order": "22", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_pool": "rbd", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_stripe_count": "0", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_io_scheduler": "simple", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T11:44:42.395 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_order": "24", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_pool": "", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_splay_width": "4", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T11:44:42.396 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T11:44:42.397 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T11:44:42.398 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_op_threads": "1", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_plugins": "", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T11:44:42.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T11:44:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T11:44:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T11:44:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T11:44:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T11:44:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T11:44:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T11:44:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T11:44:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T11:44:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T11:44:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T11:44:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T11:44:42.401 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_tracing": "false", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_validate_names": "true", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_validate_pool": "true", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "restapi_base_url": "", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "restapi_log_level": "", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_admin_entry": "admin", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_backend_store": "rados", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_barbican_url": "", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_beast_enable_async": "true", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T11:44:42.402 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_cache_enabled": "true", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_config_store": "rados", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_content_length_compat": "false", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T11:44:42.403 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_cross_domain_policy": "", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T11:44:42.404 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T11:44:42.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T11:44:42.406 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_log_window": "30", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T11:44:42.407 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T11:44:42.408 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dns_name": "", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dns_s3website_name": "", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_ops_log": "false", 2024-04-26T11:44:42.409 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_static_website": "false", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_usage_log": "false", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_expose_bucket": "false", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_extended_http_attrs": "", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_filter": "none", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T11:44:42.410 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_objs": "32", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_init_timeout": "300", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T11:44:42.411 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_password": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_project": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_token": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_user": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_api_version": "2", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T11:44:42.412 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_url": "", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_max_objs": "32", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_max_worker": "3", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T11:44:42.413 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_log_http_headers": "", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T11:44:42.414 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T11:44:42.415 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-26T11:44:42.415 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T11:44:42.415 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_attr_size": "0", 2024-04-26T11:44:42.415 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T11:44:42.415 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T11:44:42.415 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T11:44:42.415 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T11:44:42.415 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T11:44:42.415 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_listing_results": "1000", 2024-04-26T11:44:42.415 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_notify_retries": "10", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T11:44:42.416 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T11:44:42.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_num_control_oids": "8", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_numa_node": "-1", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_op_tracing": "false", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_opa_token": "", 2024-04-26T11:44:42.418 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_opa_url": "", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ops_log_rados": "false", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_print_continue": "true", 2024-04-26T11:44:42.419 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_rados_tracing": "false", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_realm": "", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_realm_id": "", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_region": "", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T11:44:42.420 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_request_uri": "", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_resolve_cname": "false", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_run_sync_thread": "true", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T11:44:42.421 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_script_uri": "", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_service_provider_name": "", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_client_id": "", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_client_secret": "", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_entry": "sts", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_key": "sts", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T11:44:42.422 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_auth_url": "", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_custom_header": "", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_need_stats": "true", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_tenant_name": "", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_url": "", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T11:44:42.423 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_lease_period": "120", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_thread_pool_size": "512", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_comment": "", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_createby": "", 2024-04-26T11:44:42.424 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_encoding": "", 2024-04-26T11:44:42.425 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_flag": "false", 2024-04-26T11:44:42.425 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_origin": "", 2024-04-26T11:44:42.425 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T11:44:42.425 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_tracker": "", 2024-04-26T11:44:42.425 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T11:44:42.425 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T11:44:42.425 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T11:44:42.425 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_usage_max_shards": "32", 2024-04-26T11:44:42.425 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T11:44:42.425 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_use_opa_authz": "false", 2024-04-26T11:44:42.426 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T11:44:42.426 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T11:44:42.426 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T11:44:42.426 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T11:44:42.426 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T11:44:42.426 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T11:44:42.426 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T11:44:42.426 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T11:44:42.426 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_unique_email": "true", 2024-04-26T11:44:42.426 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_verify_ssl": "true", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zone": "", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zone_id": "", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zonegroup": "", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zonegroup_id": "", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_block_size": "4096", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T11:44:42.427 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_partition_filters": "false", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_perf": "false", 2024-04-26T11:44:42.428 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T11:44:42.429 INFO:teuthology.orchestra.run.smithi029.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T11:44:42.429 INFO:teuthology.orchestra.run.smithi029.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T11:44:42.429 INFO:teuthology.orchestra.run.smithi029.stdout: "run_dir": "/var/run/ceph", 2024-04-26T11:44:42.429 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_block_create": "true", 2024-04-26T11:44:42.429 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T11:44:42.429 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T11:44:42.429 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T11:44:42.429 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T11:44:42.429 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_device_size": "53687091200", 2024-04-26T11:44:42.429 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T11:44:42.429 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_main_device_type": "SSD", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_segment_size": "67108864", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "set_keepcaps": "false", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "setgroup": "", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "setuser": "", 2024-04-26T11:44:42.430 INFO:teuthology.orchestra.run.smithi029.stdout: "setuser_match_path": "", 2024-04-26T11:44:42.431 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T11:44:42.431 INFO:teuthology.orchestra.run.smithi029.stdout: "thp": "false", 2024-04-26T11:44:42.431 INFO:teuthology.orchestra.run.smithi029.stdout: "threadpool_default_timeout": "60", 2024-04-26T11:44:42.431 INFO:teuthology.orchestra.run.smithi029.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T11:44:42.431 INFO:teuthology.orchestra.run.smithi029.stdout: "throttler_perf_counter": "true" 2024-04-26T11:44:42.431 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:44:42.434 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T11:44:42.572 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a: {} 2024-04-26T11:44:42.589 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b: {} 2024-04-26T11:44:42.604 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c: {} 2024-04-26T11:44:42.605 INFO:teuthology.orchestra.run.smithi029.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:44:42.606 INFO:teuthology.orchestra.run.smithi029.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:44:42.606 INFO:teuthology.orchestra.run.smithi029.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:44:42.618 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-26T11:44:42.619 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T11:44:42.648 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T11:44:42.648 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-26T11:44:42.648 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T11:44:42.648 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T11:44:42.648 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T11:44:42.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:42.649 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-04-26T11:44:42.649 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T11:44:42.649 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:44:42.649 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:44:42.650 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T11:44:42.650 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T11:44:42.650 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T11:44:42.650 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T11:44:42.650 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T11:44:42.651 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T11:44:42.651 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:44:42.651 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T11:44:42.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:42.652 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T11:44:42.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:44:42.654 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:42.651+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:42.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:42.661 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-04-26T11:44:42.683 INFO:teuthology.orchestra.run.smithi029.stderr:Cannot find device "ceph-brx" 2024-04-26T11:44:42.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:44:42.685 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T11:44:42.685 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T11:44:42.753 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:42.751+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:42.766 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:42.766 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T11:44:42.766 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:42.775 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:42.775 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:42.775 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:44:42.775 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:42.785 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:42.797 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:44:42.825 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:44:42.849 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:44:42.851 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:44:42.851 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:44:42.852 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:44:42.854 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:42.853+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:42.900 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:42.900 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:42.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:42.960 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:42.959+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:43.015 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:43.015 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:43.025 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:44:43.056 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:43.055+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:43.058 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T11:44:43.073 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T11:44:43.073 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T11:44:43.073 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-04-26T11:44:43.073 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T11:44:43.073 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T11:44:43.073 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T11:44:43.073 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T11:44:43.074 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T11:44:43.074 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T11:44:43.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.074 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-04-26T11:44:43.079 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T11:44:43.079 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T11:44:43.079 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T11:44:43.079 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-26T11:44:43.079 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42594sec preferred_lft 42594sec 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T11:44:43.080 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-04-26T11:44:43.081 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T11:44:43.081 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:38:f8:58:dd brd ff:ff:ff:ff:ff:ff 2024-04-26T11:44:43.081 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T11:44:43.081 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-26T11:44:43.081 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T11:44:43.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.081 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-04-26T11:44:43.081 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-26T11:44:43.081 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-04-26T11:44:43.081 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-04-26T11:44:43.082 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-04-26T11:44:43.082 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T11:44:43.082 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-26T11:44:43.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.123 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T11:44:43.139 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:43.139 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:43.149 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:44:43.156 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:43.155+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:43.157 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:44:43.167 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-04-26T11:44:43.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.169 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-04-26T11:44:43.235 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-04-26T11:44:43.235 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T11:44:43.235 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T11:44:43.235 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T11:44:43.235 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T11:44:43.236 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T11:44:43.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.236 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-04-26T11:44:43.237 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-26T11:44:43.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T11:44:43.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T11:44:43.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T11:44:43.237 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-26T11:44:43.252 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:43.252 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:43.257 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:43.256+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:43.261 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:44:43.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.276 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-04-26T11:44:43.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.283 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-04-26T11:44:43.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.333 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-04-26T11:44:43.333 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-26T11:44:43.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T11:44:43.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T11:44:43.333 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-26T11:44:43.358 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:43.355+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:43.362 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:43.363 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:43.369 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T11:44:43.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.369 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-04-26T11:44:43.369 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-26T11:44:43.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T11:44:43.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T11:44:43.370 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T11:44:43.370 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T11:44:43.370 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T11:44:43.370 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-26T11:44:43.372 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:43.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.448 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-04-26T11:44:43.449 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-26T11:44:43.449 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-04-26T11:44:43.449 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T11:44:43.449 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-26T11:44:43.459 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:43.456+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:43.477 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T11:44:43.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T11:44:43.477 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T11:44:43.484 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T11:44:43.484 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T11:44:43.484 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T11:44:43.487 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:43.487 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:43.489 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-26T11:44:43.497 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:43.502 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T11:44:43.502 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T11:44:43.560 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:43.556+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:43.565 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T11:44:43.566 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T11:44:43.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.566 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-26T11:44:43.574 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T11:44:43.574 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T11:44:43.576 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-26T11:44:43.595 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T11:44:43.595 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T11:44:43.601 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:43.601 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:43.611 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:43.654 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T11:44:43.655 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T11:44:43.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:43.655 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-26T11:44:43.661 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:43.659+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:43.691 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-04-26T11:44:43.687+0000 7f2adc0a7640 -1 init, newargv = 0x555d62afbe60 newargc=15 2024-04-26T11:44:43.691 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[19481]: starting ceph client 2024-04-26T11:44:43.703 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[19481]: starting fuse 2024-04-26T11:44:43.762 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:43.761+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:43.765 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:43.765 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:43.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:43.863 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:43.861+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:43.893 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:43.893 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:43.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:43.963 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:43.963+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:44.013 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:44.013 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:44.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:44.064 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:44.064+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:44.133 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:44.133 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:44.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:44:44.164 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:44.164+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:44.261 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:44.266 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:44.263+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:44.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:44:44.367 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:44.367+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:44.377 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:44.386 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:44:44.468 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:44.465+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:44.496 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:44.506 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:44.569 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:44.567+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:44.623 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:44.623 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:44.633 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:44.670 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:44.668+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:44.737 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:44.737 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:44.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:44.763 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-26T11:44:44.771 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:44.769+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:44.782 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T11:44:44.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T11:44:44.795 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T11:44:44.797 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T11:44:44.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:44.798 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-26T11:44:44.804 INFO:teuthology.orchestra.run.smithi029.stdout:52 2024-04-26T11:44:44.804 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-04-26T11:44:44.805 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-04-26T11:44:44.806 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-04-26T11:44:44.855 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:44.855 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:44.863 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:44:44.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:44.872 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:44.868+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:44.930 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.19481.asok 2024-04-26T11:44:44.973 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:44.973+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:44.981 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:44.981 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:44.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:45.017 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:44:45.041 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:44:45.066 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:44:45.068 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:44:45.068 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:44:45.068 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:44:45.074 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:45.073+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:45.098 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:44:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:44:45.099 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:45.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:45.114 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.19481.asok 2024-04-26T11:44:45.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:45.115 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.19481.asok status 2024-04-26T11:44:45.172 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:44:45.175 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:45.173+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:45.215 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:44:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:44:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:44:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:44:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.035058053999997, 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:44:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:44:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:44:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:44:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:44:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.033887382000003, 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:44:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:44:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.032888225000001, 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:44:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.031296490999999, 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:44:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:44:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.804078437999998, 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:44:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:44:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:44:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:44:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.802211229999997, 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:44:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.800478828000003, 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:44:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:44:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.796670869000003, 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.796154276999999, 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:44:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.583895980999998, 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:44:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.782906785000002, 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:44:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:44:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:44:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:44:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:44:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:44:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:44:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:44:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:44:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.782769046999999, 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:44:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:44:45.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.782639897999999, 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:44:45.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:44:45.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.782548510000002, 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:44:45.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:44:45.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.782264187999999, 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:44:45.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:44:45.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.782160709999999, 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:44:45.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.782110361000001, 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.296 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:44:45.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:44:45.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.301 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.782071536, 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:44:45.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.782006934999998, 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.774542173, 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:45.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:45.313 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "dc093b5e41f728edab6e0330295fdf9156d31664", 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.2-1256-gdc093b5e (dc093b5e41f728edab6e0330295fdf9156d31664) reef (stable)", 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "19481", 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-04-26T11:44:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4541, 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4541 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3501606203 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-04-26T11:44:45.317 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3501606203 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4541 192.168.0.1:0/3501606203", 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/3501606203", 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 6, 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 20, 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-04-26T11:44:45.318 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:44:45.319 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:44:45.319 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:45.315+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:45.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:45.319 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-04-26T11:44:45.319 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T11:44:45.327 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-04-26T11:44:45.327 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T11:44:45.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:44:45.328 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T11:44:45.340 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T11:44:45.354 INFO:tasks.workunit:Pulling workunits from ref 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T11:44:45.355 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T11:44:45.355 INFO:tasks.workunit:timeout=3h 2024-04-26T11:44:45.355 INFO:tasks.workunit:cleanup=True 2024-04-26T11:44:45.355 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T11:44:45.363 INFO:teuthology.orchestra.run.smithi029.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T11:44:45.363 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-26T11:44:45.363 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 34h/52d Inode: 1 Links: 2 2024-04-26T11:44:45.363 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:44:45.363 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T11:44:45.363 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-26 11:44:21.423602545 +0000 2024-04-26T11:44:45.363 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-26 11:44:45.339022916 +0000 2024-04-26T11:44:45.363 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-04-26T11:44:45.364 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T11:44:45.364 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T11:44:45.416 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:45.415+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:45.436 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T11:44:45.436 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:44:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:44:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 0 2024-04-26T11:44:45.436 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:44:45.444 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T11:44:45.445 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:44:45.516 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:45.513+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:45.550 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:44:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:44:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:44:45.551 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:44:45.551 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:44:45.560 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:44:45.618 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:45.616+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:45.668 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:44:45.668 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428165+0000", 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.238656142, 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016890498, 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428165+0000", 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428165+0000", 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428162+0000", 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999971 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428188+0000", 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5723000000000001e-05 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428227+0000", 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8986000000000002e-05 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428258+0000", 2024-04-26T11:44:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1560000000000003e-05 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435173+0000", 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069148980000000001 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op must wait for map", 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435179+0000", 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437105+0000", 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019257569999999999 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437181+0000", 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6142000000000004e-05 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437295+0000", 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011382 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440353+0000", 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030587629999999999 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444747+0000", 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004393844 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444911+0000", 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016366800000000001 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445055+0000", 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014426700000000001 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:6 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428308+0000", 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.238513047000001, 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016909055999999999, 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428308+0000", 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428308+0000", 2024-04-26T11:44:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428306+0000", 2024-04-26T11:44:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428321+0000", 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4348999999999999e-05 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428338+0000", 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7124000000000001e-05 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428352+0000", 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4090000000000001e-05 2024-04-26T11:44:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435208+0000", 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068562440000000001 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435214+0000", 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.925e-06 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.439811+0000", 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045973289999999998 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.439908+0000", 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6725999999999995e-05 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440104+0000", 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000195792 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.441753+0000", 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00164924 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445155+0000", 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034015999999999998 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445186+0000", 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1309999999999997e-05 2024-04-26T11:44:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445217+0000", 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0729999999999999e-05 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428365+0000", 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.238455961, 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017817277999999999, 2024-04-26T11:44:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428365+0000", 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428365+0000", 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428364+0000", 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428371+0000", 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9240000000000001e-06 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428390+0000", 2024-04-26T11:44:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9219999999999999e-05 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428403+0000", 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3436e-05 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435247+0000", 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.006843811 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op must wait for map", 2024-04-26T11:44:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435252+0000", 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2109999999999997e-06 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437285+0000", 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020326879999999999 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437419+0000", 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013435000000000001 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.438082+0000", 2024-04-26T11:44:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00066289400000000003 2024-04-26T11:44:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440361+0000", 2024-04-26T11:44:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022786640000000001 2024-04-26T11:44:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446098+0000", 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057374970000000003 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446147+0000", 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8112999999999998e-05 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446182+0000", 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5580000000000002e-05 2024-04-26T11:44:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428419+0000", 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.238401408000001, 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017883838999999999, 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428419+0000", 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428419+0000", 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428418+0000", 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428426+0000", 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2599999999999999e-06 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428441+0000", 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.506e-05 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428471+0000", 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0133000000000001e-05 2024-04-26T11:44:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435286+0000", 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068154390000000004 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435291+0000", 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4920000000000004e-06 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.438436+0000", 2024-04-26T11:44:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0031452939999999999 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.438553+0000", 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000116675 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.438763+0000", 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00020992800000000001 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.441656+0000", 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0028930200000000001 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446221+0000", 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045651779999999996 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446269+0000", 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8331000000000002e-05 2024-04-26T11:44:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446303+0000", 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3989000000000003e-05 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428485+0000", 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.238335432, 2024-04-26T11:44:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021018458, 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428485+0000", 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428485+0000", 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428484+0000", 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428493+0000", 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7469999999999994e-06 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428509+0000", 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:44:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428524+0000", 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.489e-05 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435319+0000", 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067944440000000002 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435322+0000", 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5159999999999999e-06 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440375+0000", 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0050532420000000003 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440464+0000", 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8474999999999996e-05 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440648+0000", 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00018395600000000001 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446510+0000", 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058621089999999999 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449372+0000", 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0028619399999999999 2024-04-26T11:44:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449455+0000", 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3201000000000005e-05 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449504+0000", 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8671000000000002e-05 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428538+0000", 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.238283161999998, 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016610229000000001, 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428538+0000", 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428538+0000", 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428537+0000", 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428544+0000", 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9199999999999998e-06 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428559+0000", 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5013e-05 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428572+0000", 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3502999999999999e-05 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.434480+0000", 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059083180000000001 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op must wait for map", 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.434487+0000", 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9619999999999996e-06 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.436113+0000", 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016251589999999999 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.436369+0000", 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000256159 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.436496+0000", 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012716999999999999 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.439160+0000", 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026638759999999999 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444800+0000", 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0056405250000000004 2024-04-26T11:44:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445110+0000", 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00030924899999999999 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445148+0000", 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8268e-05 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428586+0000", 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.238235205999999, 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016691609, 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428586+0000", 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428586+0000", 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428584+0000", 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428591+0000", 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.64e-06 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428610+0000", 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9369999999999999e-05 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428623+0000", 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2486999999999999e-05 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.434556+0000", 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059330140000000003 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.434561+0000", 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7169999999999999e-06 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437129+0000", 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0025679779999999998 2024-04-26T11:44:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437307+0000", 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017856099999999999 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445277+0000", 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0079699720000000005 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428634+0000", 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.238186496000001, 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021907118999999999, 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428634+0000", 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428634+0000", 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428633+0000", 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428639+0000", 2024-04-26T11:44:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0560000000000001e-06 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428659+0000", 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0097000000000001e-05 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428673+0000", 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.326e-05 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435347+0000", 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066739820000000002 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435350+0000", 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6969999999999999e-06 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.441163+0000", 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058130380000000004 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.441332+0000", 2024-04-26T11:44:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016876099999999999 2024-04-26T11:44:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.450541+0000", 2024-04-26T11:44:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0092092609999999998 2024-04-26T11:44:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428688+0000", 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.238132310000001, 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017212623, 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428688+0000", 2024-04-26T11:44:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428688+0000", 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428687+0000", 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428702+0000", 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4039999999999999e-05 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428717+0000", 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5579000000000001e-05 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428730+0000", 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2619999999999999e-05 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435321+0000", 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065908490000000002 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op must wait for map", 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435328+0000", 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.436804+0000", 2024-04-26T11:44:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014760820000000001 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437054+0000", 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000249886 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445901+0000", 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0088467730000000005 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.431646+0000", 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.235174408999999, 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0061184339999999999, 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431646+0000", 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431646+0000", 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431646+0000", 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431663+0000", 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7017e-05 2024-04-26T11:44:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431690+0000", 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7257e-05 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431717+0000", 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7219000000000001e-05 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.432339+0000", 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000621439 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437765+0000", 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054260589999999996 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-26T11:44:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.443258+0000", 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.223562866999998, 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0036655310000000001, 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443258+0000", 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443258+0000", 2024-04-26T11:44:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443257+0000", 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443282+0000", 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4148999999999999e-05 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443295+0000", 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2962000000000001e-05 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443319+0000", 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4247e-05 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443448+0000", 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012885899999999999 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443467+0000", 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9446e-05 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446897+0000", 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034303369999999999 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446923+0000", 2024-04-26T11:44:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5961000000000001e-05 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444145+0000", 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.222676274000001, 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.005546769, 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444145+0000", 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444145+0000", 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444144+0000", 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444151+0000", 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5830000000000003e-06 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444160+0000", 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7969999999999995e-06 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444189+0000", 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8765e-05 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444459+0000", 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00026953099999999999 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444473+0000", 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4358e-05 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449652+0000", 2024-04-26T11:44:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0051785729999999997 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449691+0000", 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9762999999999999e-05 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-04-26T11:44:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444354+0000", 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.222467262999999, 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00076421799999999999, 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444354+0000", 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444354+0000", 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444353+0000", 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444357+0000", 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2969999999999997e-06 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444365+0000", 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0139999999999998e-06 2024-04-26T11:44:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444373+0000", 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4059999999999999e-06 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444730+0000", 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00035729799999999998 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444738+0000", 2024-04-26T11:44:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8469999999999996e-06 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445118+0000", 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037979099999999998 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(mds.0.3:6 3.1f e18/16 ondisk, result = 0)", 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444381+0000", 2024-04-26T11:44:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.222440263999999, 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00084276900000000005, 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444381+0000", 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444381+0000", 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444380+0000", 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444383+0000", 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0189999999999998e-06 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444403+0000", 2024-04-26T11:44:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0136000000000002e-05 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444408+0000", 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1649999999999999e-06 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445143+0000", 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00073515600000000005 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445149+0000", 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6449999999999999e-06 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445223+0000", 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3943999999999995e-05 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(mds.0.3:28 3.b e18/16 ondisk, result = 0)", 2024-04-26T11:44:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444413+0000", 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.222407973999999, 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00074611700000000003, 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444413+0000", 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444413+0000", 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444413+0000", 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444415+0000", 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0549999999999998e-06 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444421+0000", 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9669999999999998e-06 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444425+0000", 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4469999999999999e-06 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444785+0000", 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00035989399999999998 2024-04-26T11:44:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444795+0000", 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0207000000000001e-05 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445159+0000", 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00036372800000000001 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 3 lcod 18'2)", 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444619+0000", 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.222201751, 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00066424300000000002, 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444619+0000", 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444619+0000", 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444618+0000", 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444623+0000", 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3449999999999999e-06 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444631+0000", 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.602e-06 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444654+0000", 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2548000000000002e-05 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445178+0000", 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00052389400000000001 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445283+0000", 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105417 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444725+0000", 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.222096200999999, 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0050413489999999997, 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444725+0000", 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444725+0000", 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444724+0000", 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444742+0000", 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7711e-05 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444757+0000", 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4808e-05 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444767+0000", 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0617e-05 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444841+0000", 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3584000000000006e-05 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444874+0000", 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3073e-05 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449736+0000", 2024-04-26T11:44:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048618439999999997 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449766+0000", 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0062000000000001e-05 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444782+0000", 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.222038812000001, 2024-04-26T11:44:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0050093949999999998, 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444782+0000", 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444782+0000", 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444782+0000", 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444787+0000", 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7610000000000004e-06 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444795+0000", 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8800000000000008e-06 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444802+0000", 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5740000000000001e-06 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445154+0000", 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00035186000000000001 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445169+0000", 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5114e-05 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449769+0000", 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045998840000000003 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449791+0000", 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2773e-05 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.445789+0000", 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.221031365999998, 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000520182, 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445789+0000", 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445789+0000", 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445789+0000", 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445801+0000", 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1635e-05 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445806+0000", 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8369999999999996e-06 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445814+0000", 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9789999999999993e-06 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446210+0000", 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00039603700000000002 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446216+0000", 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2149999999999998e-06 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446310+0000", 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3708000000000005e-05 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:27.134883+0000", 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.531938083, 2024-04-26T11:44:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002971741, 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134883+0000", 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134883+0000", 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134880+0000", 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999971 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134895+0000", 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.491e-05 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134930+0000", 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5352999999999998e-05 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134946+0000", 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5366000000000002e-05 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.135044+0000", 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.8492999999999994e-05 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.135265+0000", 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000220984 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.135469+0000", 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000203902 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.136915+0000", 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001446054 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.137710+0000", 2024-04-26T11:44:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00079491499999999999 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.137799+0000", 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9371999999999997e-05 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.137854+0000", 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5016000000000003e-05 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:45.769 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:44:45.770 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:45.771 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:45.769+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:45.871 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:45.871+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:45.884 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:45.884 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:45.884 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:44:45.885 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:45.895 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:45.972 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:45.969+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:46.004 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:46.004 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:46.004 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:44:46.004 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:44:46.004 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:46.015 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:46.073 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:46.071+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:46.126 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:46.126 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:44:46.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:44:46.126 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:44:46.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.126 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:46.126 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.719917635999998, 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:46.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:44:46.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:46.132 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.719847143999999, 2024-04-26T11:44:46.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:44:46.133 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.133 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.133 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:46.133 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:46.133 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:46.133 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:44:46.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.133 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:44:46.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.138 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.520297300000003, 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:44:46.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:44:46.144 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.520265580999997, 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:46.145 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:44:46.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:44:46.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.520224012, 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:46.151 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:44:46.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:44:46.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.520096875, 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.157 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:44:46.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:44:46.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.693327194999998, 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:44:46.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:44:46.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.693226607, 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:44:46.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:44:46.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.693157915, 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:44:46.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:44:46.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:44:46.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.693054297, 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:44:46.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:44:46.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:44:46.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:46.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:46.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:44:46.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:44:46.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.692930446999998, 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:44:46.187 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:44:46.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.692898308, 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:44:46.193 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:46.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:44:46.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.199 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.692868215000001, 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:46.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:46.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:44:46.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:44:46.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:46.206 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.692837816000001, 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:46.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:44:46.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:44:46.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:44:46.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.692807160000001, 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:46.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:46.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:44:46.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:44:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:46.219 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.692765291000001, 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:44:46.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:44:46.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:44:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:44:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:44:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:44:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.692731872, 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:44:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:44:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.692583455000001, 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:44:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:44:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:44:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.692464360999999, 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:44:46.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.692358317, 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:46.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:44:46.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:46.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:46.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:46.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:46.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:46.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:44:46.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:44:46.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.251 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:46.251 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:46.251 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:46.253 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:44:46.253 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:46.252+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:46.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:46.354 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:46.353+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:46.370 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:46.370 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:44:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:46.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:46.454 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:46.452+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:46.484 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:46.484 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:46.484 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:44:46.484 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:44:46.484 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:46.494 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:46.555 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:46.555+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:46.607 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:46.607 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:44:46.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:44:46.607 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:44:46.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.607 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:44:46.607 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.427051454999997, 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:44:46.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.425880782999997, 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:46.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:46.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:44:46.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.424881626000001, 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:44:46.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:44:46.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:44:46.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:44:46.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:44:46.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:44:46.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.423289892, 2024-04-26T11:44:46.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:44:46.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:46.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:44:46.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:44:46.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:44:46.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:44:46.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.626 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:44:46.627 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:46.627 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.196071838999998, 2024-04-26T11:44:46.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:44:46.627 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.627 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.627 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:46.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:44:46.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.194204630999998, 2024-04-26T11:44:46.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:44:46.633 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.633 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.633 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:46.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.636 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.192472229000003, 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:46.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:44:46.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:46.641 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.188664269999997, 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:44:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.188147678, 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.975889381999998, 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:44:46.650 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.654 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.174900185999999, 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:46.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:44:46.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.174762447999999, 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:46.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.174633299, 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.665 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:44:46.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:44:46.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.174541910999999, 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:44:46.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:44:46.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.174257589, 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.676 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:44:46.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:44:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.681 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.174154111, 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:46.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:44:46.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.174103762000001, 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:46.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:44:46.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.174064937000001, 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.692 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:44:46.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.174000335999999, 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.166535574000001, 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:44:46.700 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:44:46.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:44:46.703 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.704 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.704 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.704 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:46.704 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:46.704 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:46.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:44:46.706 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:46.704+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:46.806 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:46.805+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:46.820 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:44:46.820 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:44:46.820 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 0 2024-04-26T11:44:46.821 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:44:46.831 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:44:46.908 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:46.904+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:46.940 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:44:46.940 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:44:46.940 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:44:46.941 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:44:46.941 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:44:46.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:44:47.008 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:47.005+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:47.062 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:44:47.062 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:44:47.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:44:47.062 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:44:47.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.062 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:47.062 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428165+0000", 2024-04-26T11:44:47.062 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.630823697, 2024-04-26T11:44:47.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016890498, 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428165+0000", 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428165+0000", 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428162+0000", 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999971 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428188+0000", 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5723000000000001e-05 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428227+0000", 2024-04-26T11:44:47.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8986000000000002e-05 2024-04-26T11:44:47.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.065 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.065 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428258+0000", 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1560000000000003e-05 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435173+0000", 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069148980000000001 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op must wait for map", 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435179+0000", 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:44:47.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437105+0000", 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019257569999999999 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437181+0000", 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6142000000000004e-05 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437295+0000", 2024-04-26T11:44:47.067 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011382 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440353+0000", 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030587629999999999 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444747+0000", 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004393844 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.068 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444911+0000", 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016366800000000001 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445055+0000", 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014426700000000001 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:6 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:47.069 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428308+0000", 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.630680601999998, 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016909055999999999, 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428308+0000", 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.070 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428308+0000", 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428306+0000", 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428321+0000", 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4348999999999999e-05 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.071 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428338+0000", 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7124000000000001e-05 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428352+0000", 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4090000000000001e-05 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435208+0000", 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068562440000000001 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435214+0000", 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.925e-06 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.439811+0000", 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045973289999999998 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.439908+0000", 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6725999999999995e-05 2024-04-26T11:44:47.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440104+0000", 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000195792 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.441753+0000", 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00164924 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:47.074 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445155+0000", 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034015999999999998 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445186+0000", 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1309999999999997e-05 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445217+0000", 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0729999999999999e-05 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.075 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428365+0000", 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.630623516, 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017817277999999999, 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428365+0000", 2024-04-26T11:44:47.076 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.077 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.077 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428365+0000", 2024-04-26T11:44:47.077 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.077 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.077 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428364+0000", 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428371+0000", 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9240000000000001e-06 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428390+0000", 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9219999999999999e-05 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.078 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428403+0000", 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3436e-05 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435247+0000", 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.006843811 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op must wait for map", 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435252+0000", 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2109999999999997e-06 2024-04-26T11:44:47.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437285+0000", 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020326879999999999 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437419+0000", 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013435000000000001 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.438082+0000", 2024-04-26T11:44:47.080 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00066289400000000003 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440361+0000", 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022786640000000001 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446098+0000", 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057374970000000003 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.081 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446147+0000", 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8112999999999998e-05 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446182+0000", 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5580000000000002e-05 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.082 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428419+0000", 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.630568963000002, 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017883838999999999, 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428419+0000", 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.083 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428419+0000", 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428418+0000", 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428426+0000", 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2599999999999999e-06 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.084 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428441+0000", 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.506e-05 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428471+0000", 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0133000000000001e-05 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435286+0000", 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068154390000000004 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435291+0000", 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4920000000000004e-06 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.438436+0000", 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0031452939999999999 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.438553+0000", 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000116675 2024-04-26T11:44:47.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.087 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:47.087 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.438763+0000", 2024-04-26T11:44:47.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00020992800000000001 2024-04-26T11:44:47.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.087 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:47.087 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.441656+0000", 2024-04-26T11:44:47.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0028930200000000001 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446221+0000", 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045651779999999996 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446269+0000", 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8331000000000002e-05 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446303+0000", 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3989000000000003e-05 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428485+0000", 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.630502987, 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021018458, 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.089 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428485+0000", 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428485+0000", 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.090 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428484+0000", 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428493+0000", 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7469999999999994e-06 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428509+0000", 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428524+0000", 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.489e-05 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435319+0000", 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067944440000000002 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435322+0000", 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5159999999999999e-06 2024-04-26T11:44:47.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440375+0000", 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0050532420000000003 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440464+0000", 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8474999999999996e-05 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.440648+0000", 2024-04-26T11:44:47.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00018395600000000001 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446510+0000", 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058621089999999999 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449372+0000", 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0028619399999999999 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:47.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449455+0000", 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3201000000000005e-05 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449504+0000", 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8671000000000002e-05 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:47.095 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428538+0000", 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.630450716999999, 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016610229000000001, 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428538+0000", 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.096 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428538+0000", 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428537+0000", 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428544+0000", 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9199999999999998e-06 2024-04-26T11:44:47.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428559+0000", 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5013e-05 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428572+0000", 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3502999999999999e-05 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.434480+0000", 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059083180000000001 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op must wait for map", 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.434487+0000", 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9619999999999996e-06 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.436113+0000", 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016251589999999999 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.436369+0000", 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000256159 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.436496+0000", 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012716999999999999 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.439160+0000", 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026638759999999999 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444800+0000", 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0056405250000000004 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445110+0000", 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00030924899999999999 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445148+0000", 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8268e-05 2024-04-26T11:44:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428586+0000", 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.630402760999999, 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016691609, 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.102 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428586+0000", 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428586+0000", 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428584+0000", 2024-04-26T11:44:47.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428591+0000", 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.64e-06 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428610+0000", 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9369999999999999e-05 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428623+0000", 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2486999999999999e-05 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.434556+0000", 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059330140000000003 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.434561+0000", 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7169999999999999e-06 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437129+0000", 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0025679779999999998 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437307+0000", 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017856099999999999 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445277+0000", 2024-04-26T11:44:47.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0079699720000000005 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428634+0000", 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.630354051000001, 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021907118999999999, 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.107 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428634+0000", 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428634+0000", 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428633+0000", 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428639+0000", 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0560000000000001e-06 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428659+0000", 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0097000000000001e-05 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428673+0000", 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.326e-05 2024-04-26T11:44:47.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435347+0000", 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066739820000000002 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435350+0000", 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6969999999999999e-06 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.441163+0000", 2024-04-26T11:44:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058130380000000004 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.441332+0000", 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016876099999999999 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.450541+0000", 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0092092609999999998 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.111 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.428688+0000", 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.630299865000001, 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017212623, 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428688+0000", 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428688+0000", 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428687+0000", 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428702+0000", 2024-04-26T11:44:47.113 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4039999999999999e-05 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428717+0000", 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5579000000000001e-05 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.428730+0000", 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2619999999999999e-05 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435321+0000", 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065908490000000002 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op must wait for map", 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.435328+0000", 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.436804+0000", 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014760820000000001 2024-04-26T11:44:47.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437054+0000", 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000249886 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445901+0000", 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0088467730000000005 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.431646+0000", 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.627341963999999, 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0061184339999999999, 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431646+0000", 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431646+0000", 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431646+0000", 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431663+0000", 2024-04-26T11:44:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7017e-05 2024-04-26T11:44:47.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.119 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.119 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431690+0000", 2024-04-26T11:44:47.119 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7257e-05 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.431717+0000", 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7219000000000001e-05 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.432339+0000", 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000621439 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.437765+0000", 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054260589999999996 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.443258+0000", 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.615730421999999, 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0036655310000000001, 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:47.121 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443258+0000", 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443258+0000", 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443257+0000", 2024-04-26T11:44:47.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443282+0000", 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4148999999999999e-05 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443295+0000", 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2962000000000001e-05 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443319+0000", 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4247e-05 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443448+0000", 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012885899999999999 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.443467+0000", 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9446e-05 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.124 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446897+0000", 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034303369999999999 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446923+0000", 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5961000000000001e-05 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-26T11:44:47.125 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444145+0000", 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.614843829000002, 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.005546769, 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444145+0000", 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444145+0000", 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444144+0000", 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444151+0000", 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5830000000000003e-06 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444160+0000", 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7969999999999995e-06 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444189+0000", 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8765e-05 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444459+0000", 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00026953099999999999 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444473+0000", 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4358e-05 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449652+0000", 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0051785729999999997 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449691+0000", 2024-04-26T11:44:47.129 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9762999999999999e-05 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444354+0000", 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.614634817999999, 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00076421799999999999, 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444354+0000", 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444354+0000", 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444353+0000", 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:47.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444357+0000", 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2969999999999997e-06 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444365+0000", 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0139999999999998e-06 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444373+0000", 2024-04-26T11:44:47.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4059999999999999e-06 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444730+0000", 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00035729799999999998 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444738+0000", 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8469999999999996e-06 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.133 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445118+0000", 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037979099999999998 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(mds.0.3:6 3.1f e18/16 ondisk, result = 0)", 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444381+0000", 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.614607819, 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00084276900000000005, 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:47.134 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444381+0000", 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444381+0000", 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444380+0000", 2024-04-26T11:44:47.135 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444383+0000", 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0189999999999998e-06 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444403+0000", 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0136000000000002e-05 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.136 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444408+0000", 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1649999999999999e-06 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445143+0000", 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00073515600000000005 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445149+0000", 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6449999999999999e-06 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445223+0000", 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3943999999999995e-05 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(mds.0.3:28 3.b e18/16 ondisk, result = 0)", 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444413+0000", 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.614575529, 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00074611700000000003, 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:47.138 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444413+0000", 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444413+0000", 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444413+0000", 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444415+0000", 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0549999999999998e-06 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444421+0000", 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9669999999999998e-06 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444425+0000", 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4469999999999999e-06 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444785+0000", 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00035989399999999998 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444795+0000", 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0207000000000001e-05 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445159+0000", 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00036372800000000001 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 3 lcod 18'2)", 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444619+0000", 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.614369306, 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00066424300000000002, 2024-04-26T11:44:47.142 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444619+0000", 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444619+0000", 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444618+0000", 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444623+0000", 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3449999999999999e-06 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444631+0000", 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.602e-06 2024-04-26T11:44:47.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444654+0000", 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2548000000000002e-05 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445178+0000", 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00052389400000000001 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445283+0000", 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105417 2024-04-26T11:44:47.145 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444725+0000", 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.614263756, 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0050413489999999997, 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.146 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444725+0000", 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444725+0000", 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444724+0000", 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444742+0000", 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7711e-05 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444757+0000", 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4808e-05 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444767+0000", 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0617e-05 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444841+0000", 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3584000000000006e-05 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444874+0000", 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3073e-05 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449736+0000", 2024-04-26T11:44:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048618439999999997 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449766+0000", 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0062000000000001e-05 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.444782+0000", 2024-04-26T11:44:47.150 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.614206367000001, 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0050093949999999998, 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444782+0000", 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444782+0000", 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.152 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.152 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444782+0000", 2024-04-26T11:44:47.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:47.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444787+0000", 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7610000000000004e-06 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444795+0000", 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8800000000000008e-06 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.444802+0000", 2024-04-26T11:44:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5740000000000001e-06 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445154+0000", 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00035186000000000001 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445169+0000", 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5114e-05 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449769+0000", 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045998840000000003 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.449791+0000", 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2773e-05 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.155 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:21.445789+0000", 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.613198920999999, 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000520182, 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445789+0000", 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445789+0000", 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445789+0000", 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445801+0000", 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1635e-05 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445806+0000", 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8369999999999996e-06 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.445814+0000", 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9789999999999993e-06 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446210+0000", 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00039603700000000002 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446216+0000", 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2149999999999998e-06 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:21.446310+0000", 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3708000000000005e-05 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-26T11:44:47.159 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:44:27.134883+0000", 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 19.924105638, 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002971741, 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134883+0000", 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:44:47.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134883+0000", 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134880+0000", 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999971 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134895+0000", 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.491e-05 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134930+0000", 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5352999999999998e-05 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.134946+0000", 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5366000000000002e-05 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.135044+0000", 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.8492999999999994e-05 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.135265+0000", 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000220984 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.135469+0000", 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000203902 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.136915+0000", 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001446054 2024-04-26T11:44:47.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.137710+0000", 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00079491499999999999 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.137799+0000", 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9371999999999997e-05 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:44:27.137854+0000", 2024-04-26T11:44:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5016000000000003e-05 2024-04-26T11:44:47.165 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.165 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.165 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.165 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:44:47.165 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:44:47.165 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:44:47.165 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:44:47.167 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:47.164+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:47.167 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:47.268 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:47.267+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:47.283 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:44:47.283 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:47.294 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:47.318 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:44:47.342 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:44:47.362 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:44:47.364 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:44:47.364 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:44:47.365 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:44:47.368 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:47.367+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:47.397 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:47.397 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:47.407 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:47.469 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:47.464+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:47.511 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:47.512 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:47.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:47.570 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:47.567+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:47.637 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:47.637 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:47.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:47.671 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:47.668+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:47.751 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:47.751 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:47.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:47.772 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:44:47.769+0000 7fdc6ad76700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18193) UID: 0 2024-04-26T11:44:47.778 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:44:47.778 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:44:47.778 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-04-26T11:44:47.778 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:44:47.778 INFO:teuthology.orchestra.console.smithi082:Power off 2024-04-26T11:44:47.778 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T11:44:47.803 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-04-26T11:44:47.803 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:44:47.826 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-26T11:44:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:47.873 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:47.870+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:47.880 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:47.974 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:47.972+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:47.996 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:47.996 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:48.006 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:48.075 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:48.072+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:48.112 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:48.112 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:48.121 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:48.176 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:48.174+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:48.225 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:48.225 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:48.235 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:48.255 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:44:48.279 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:48.278+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:48.353 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:48.353 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:48.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:48.378 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:48.376+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:48.474 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:48.474 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:48.479 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:48.476+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:48.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:48.580 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:48.576+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:48.586 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:48.586 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:48.596 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:48.681 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:48.678+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:48.710 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:48.711 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:48.720 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:48.782 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:48.780+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:48.825 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:48.825 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:48.834 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:48.883 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:48.880+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:48.939 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:48.939 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:48.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:48.995 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:48.994+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:49.068 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:49.068 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:49.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:49.084 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:49.082+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:49.185 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:49.184+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:49.187 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:49.187 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:49.190 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:44:49.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:49.286 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:49.282+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:49.348 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:49.348 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:49.358 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:49.377 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:44:49.387 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:49.384+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:49.476 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:49.476 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:49.486 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:49.530 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:49.528+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:49.531 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:44:49.554 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:44:49.576 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:44:49.578 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:44:49.578 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:44:49.578 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:44:49.588 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:49.584+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:49.637 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:49.638 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:49.638 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:44:49.638 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:44:49.638 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:49.647 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:49.690 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:49.688+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:49.752 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.346528581999998, 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:49.753 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:44:49.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.346458089999999, 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:44:49.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:49.764 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.146908246000002, 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:44:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:44:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.146876527000003, 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:49.770 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:44:49.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:44:49.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:44:49.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:44:49.775 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.775 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.146834957999999, 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:44:49.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:44:49.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:44:49.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:44:49.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:44:49.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.781 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.146707821, 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.782 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:49.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:44:49.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:44:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319938141000002, 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.787 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:44:49.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:44:49.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:44:49.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319837552999999, 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.793 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:44:49.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319768861, 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.799 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:44:49.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:44:49.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:44:49.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319665242999999, 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.805 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:44:49.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:44:49.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319541393000002, 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.811 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:44:49.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319509254, 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.817 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319479161, 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:49.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:44:49.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:44:49.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319448762, 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:44:49.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:44:49.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319418106000001, 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:44:49.840 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319376237, 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:44:49.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:44:49.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319342817999999, 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:44:49.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:44:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:44:49.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319194401000001, 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:49.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:49.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:44:49.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:44:49.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:44:49.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:44:49.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.319075306999999, 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.859 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:49.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:44:49.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:44:49.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 28.318969263, 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:49.865 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:44:49.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:44:49.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:44:49.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:49.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:49.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:49.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:44:49.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:44:49.871 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.871 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.871 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.871 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:49.871 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:49.871 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:49.873 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:49.868+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:49.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:49.974 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:49.972+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:49.989 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:49.989 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:49.989 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:44:49.989 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:49.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:50.075 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:50.072+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:50.107 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:50.107 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:50.107 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:44:50.107 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:44:50.108 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:50.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:50.177 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:50.176+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:50.230 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:50.230 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:44:50.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:44:50.230 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:44:50.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.230 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:44:50.230 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:50.230 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.049757071999998, 2024-04-26T11:44:50.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:44:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:44:50.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.234 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.235 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.236 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:44:50.236 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:50.236 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.048586399999998, 2024-04-26T11:44:50.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:44:50.236 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.236 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.236 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:50.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:50.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:44:50.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:44:50.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:44:50.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:44:50.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:44:50.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.047587243000002, 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:44:50.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.045995509000001, 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:44:50.245 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:44:50.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:44:50.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.818777455999999, 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:50.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:44:50.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.816910247999999, 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.255 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:44:50.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.815177845999997, 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:44:50.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:44:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.811369886999998, 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:44:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.810853295000001, 2024-04-26T11:44:50.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.272 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.598594998999999, 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:50.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:44:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:50.277 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.797605803, 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:44:50.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.797468065, 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:44:50.283 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:44:50.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.288 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.289 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.289 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:50.289 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.797338916000001, 2024-04-26T11:44:50.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:44:50.289 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.289 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.289 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:44:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:44:50.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:44:50.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:44:50.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:44:50.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.797247528, 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.295 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:44:50.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:50.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.300 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.796963206000001, 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:50.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.305 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.796859728000001, 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:44:50.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.796809378999999, 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:44:50.311 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:44:50.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.316 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.796770553999998, 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.320 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.796705953, 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:50.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:50.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:44:50.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:44:50.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:44:50.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:44:50.325 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.325 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.789241190999999, 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:50.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.329 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:50.330 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:50.330 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:50.331 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:50.332 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:50.328+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:50.432 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:50.430+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:50.443 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:44:50.444 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:50.453 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:50.533 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:50.532+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:50.559 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:50.559 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:50.559 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:44:50.559 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:44:50.559 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:50.569 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:50.634 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:50.630+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:50.683 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:50.683 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:44:50.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:44:50.683 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:44:50.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.683 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:50.683 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:50.683 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.277262544000003, 2024-04-26T11:44:50.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:44:50.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.277192051999997, 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:50.689 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:44:50.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:44:50.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:44:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.077642208, 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.077610489000001, 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.700 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:44:50.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:44:50.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:44:50.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.077568919999997, 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.077441782999998, 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.711 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:44:50.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:44:50.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:44:50.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.250672102999999, 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:44:50.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:44:50.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:44:50.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.250571515000001, 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:44:50.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:44:50.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:44:50.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:44:50.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.250502823000001, 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:50.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:44:50.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:44:50.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:44:50.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:44:50.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:44:50.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:44:50.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:44:50.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:44:50.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.736 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.250399205000001, 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:50.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:50.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:50.742 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.250275354999999, 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:44:50.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.250243216000001, 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:44:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:44:50.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:44:50.754 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.754 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.754 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.754 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.754 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.250213123000002, 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:44:50.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:44:50.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:44:50.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:44:50.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.250182723999998, 2024-04-26T11:44:50.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:44:50.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:44:50.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.250152067999998, 2024-04-26T11:44:50.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:44:50.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:44:50.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.250110199000002, 2024-04-26T11:44:50.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:44:50.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:50.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.778 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.250076780000001, 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:50.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:50.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.784 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.249928362999999, 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:44:50.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:44:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:50.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:44:50.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.249809269, 2024-04-26T11:44:50.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:44:50.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:44:50.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.249703225000001, 2024-04-26T11:44:50.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:50.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:50.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:50.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:44:50.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:44:50.802 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.802 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.802 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.802 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:50.802 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:50.802 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:50.804 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:50.800+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:50.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:50.905 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:50.904+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:50.924 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:50.924 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:50.924 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:44:50.924 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:50.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:51.006 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:51.004+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:51.045 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:51.045 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:51.045 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:44:51.045 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:44:51.045 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:51.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:51.107 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:51.104+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:51.161 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:44:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:44:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:44:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:44:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.981397567000002, 2024-04-26T11:44:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:44:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:44:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:44:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:44:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:44:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:44:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:44:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.980226895000001, 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:44:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.979227737999999, 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:44:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.977636003999997, 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.750417951000003, 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.181 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:44:51.185 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.748550743000003, 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:44:51.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:44:51.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.746818341000001, 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:44:51.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:44:51.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:44:51.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:44:51.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.194 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.195 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:44:51.195 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:51.195 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.743010382000001, 2024-04-26T11:44:51.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:44:51.195 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.195 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.195 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:51.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:51.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:44:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:44:51.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:44:51.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:44:51.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:44:51.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:44:51.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:44:51.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.742493789999997, 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:51.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:51.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:44:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:44:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:44:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:44:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.530235494000003, 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.205 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.209 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.729246298, 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:44:51.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:44:51.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:44:51.215 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.215 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.215 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.216 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.216 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:51.216 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.72910856, 2024-04-26T11:44:51.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:44:51.216 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.216 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.216 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:44:51.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:44:51.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:44:51.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:44:51.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.221 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.728979411000001, 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:44:51.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:44:51.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.728888023, 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:44:51.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:44:51.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:44:51.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:44:51.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:51.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:44:51.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:44:51.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:51.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.728603701000001, 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.234 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.235 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:51.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:51.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:44:51.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:44:51.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:44:51.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:44:51.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:44:51.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.241 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.728500223000001, 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:51.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:44:51.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:44:51.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:51.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:44:51.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:44:51.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:44:51.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:44:51.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:44:51.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:44:51.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.728449873999999, 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.248 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:44:51.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:44:51.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:51.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:51.253 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.728411049000002, 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:44:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:44:51.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:44:51.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:44:51.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.728346448, 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.720881685999998, 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:51.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:51.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:51.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:51.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:51.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:44:51.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:51.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.265 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:51.266 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:51.266 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:51.266 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:44:51.268 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:51.269 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:51.266+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:51.369 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:51.366+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:51.384 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:51.384 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:51.384 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:44:51.384 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:51.395 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:51.469 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:51.466+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:51.502 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:51.503 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:51.503 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:44:51.503 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:44:51.503 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:51.512 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:51.570 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:51.570+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:51.590 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:44:51.620 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:51.620 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.214897440000001, 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:51.621 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.626 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.214826948000002, 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:44:51.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:44:51.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:44:51.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:44:51.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:51.632 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.015277103999999, 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:44:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.015245385, 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.638 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:44:51.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:44:51.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.015203816000003, 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:44:51.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:44:51.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.015076679000003, 2024-04-26T11:44:51.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:44:51.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:44:51.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:44:51.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.188306999000002, 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:44:51.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.188206410999999, 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:44:51.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:44:51.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.188137719, 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.667 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:44:51.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:44:51.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.188034101, 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:44:51.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:44:51.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:44:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:44:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.187910251000002, 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:51.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:44:51.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:44:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:44:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:44:51.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.187878112, 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:51.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:44:51.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:44:51.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.187848019, 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:51.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:44:51.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:44:51.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:44:51.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:44:51.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.187817620000001, 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.703 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.187786964000001, 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:51.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:44:51.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.709 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.187745095, 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:44:51.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:44:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:44:51.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.715 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.716 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.716 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:51.716 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.187711675999999, 2024-04-26T11:44:51.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:44:51.716 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.716 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.716 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:44:51.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:44:51.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:44:51.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:44:51.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.187563259000001, 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.727 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.187444164999999, 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:51.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:44:51.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.187338121, 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:44:51.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:44:51.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:44:51.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:44:51.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:51.739 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:51.740 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:51.741 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:44:51.742 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:44:51.742 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:51.743 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:51.738+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:51.754 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:44:51.754 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:44:51.754 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:44:51.755 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:44:51.758 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:44:51.758 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:44:51.828 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:44:51.842 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:51.840+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:51.856 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:51.857 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:51.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:51.937 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-26T11:44:51.943 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:51.942+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:51.976 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:51.976 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:51.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:52.044 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:52.040+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:52.092 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:52.092 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:52.102 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:52.149 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:52.148+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:52.218 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:52.218 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:52.228 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:52.247 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:52.246+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:52.331 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:52.332 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:52.341 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:52.387 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:52.384+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:52.448 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:52.448 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:52.449 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:52.444+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:52.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:52.549 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:52.548+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:52.576 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:52.577 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:52.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:52.650 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:52.648+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:52.694 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:52.695 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:52.705 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:52.750 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:52.746+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:52.806 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:52.807 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:52.817 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:52.861 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:52.860+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:52.927 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:52.927 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:52.937 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:52.953 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:52.948+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:53.041 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:53.041 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:53.051 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:53.094 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:53.092+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:53.156 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:53.152+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:53.202 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:53.203 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:53.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:53.256 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:53.254+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:53.329 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:53.329 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:53.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:53.357 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:53.352+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:53.448 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:53.449 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:53.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:53.459 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:53.456+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:53.560 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:53.558+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:53.562 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:53.562 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:53.571 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:53.660 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:53.656+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:53.687 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:53.688 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:53.697 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:53.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:44:53.759 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:44:53.761 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:53.756+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:53.804 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:53.805 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:53.814 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:53.862 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:53.858+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:53.950 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:44:53.963 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:53.960+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:53.966 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:53.967 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:53.974 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:44:53.974 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:44:53.974 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:44:53.974 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:44:53.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:53.977 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:44:53.978 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:44:54.064 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:54.064+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:54.090 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:44:54.090 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:54.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:54.164 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:54.160+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:54.208 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:54.209 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:54.209 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:44:54.209 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:44:54.209 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:54.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:54.265 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:54.262+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:54.331 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:54.331 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:44:54.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:44:54.331 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:44:54.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.331 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:44:54.331 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.152176632, 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.151005959999999, 2024-04-26T11:44:54.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:44:54.337 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.337 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.337 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:54.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:54.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:44:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:44:54.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:44:54.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:44:54.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:44:54.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:44:54.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:44:54.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.343 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.343 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:44:54.343 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:54.344 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.150006802999997, 2024-04-26T11:44:54.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:44:54.344 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.344 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.344 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:54.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:44:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:44:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:44:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:44:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:44:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:44:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:54.349 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.148415069000002, 2024-04-26T11:44:54.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:44:54.350 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.350 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.350 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:54.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:44:54.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:44:54.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.921197016000001, 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:44:54.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:44:54.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.919329808000001, 2024-04-26T11:44:54.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:44:54.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:44:54.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.917597405999999, 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:44:54.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:44:54.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:44:54.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.913789446999999, 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:44:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.913272855000002, 2024-04-26T11:44:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:44:54.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.701014559000001, 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:44:54.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:44:54.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.900025362999997, 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:44:54.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:44:54.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.899887624999998, 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:44:54.385 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.390 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.899758476000002, 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:44:54.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:54.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.899667088000001, 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:44:54.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:44:54.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:44:54.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.899382766000002, 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.401 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.406 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.899279288000002, 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:54.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:44:54.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.899228938999997, 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.899190114, 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:44:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:44:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:44:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:44:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.899125513000001, 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.891660751000003, 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:54.431 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:54.432 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:54.428+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:54.532 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:54.530+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:54.546 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:44:54.547 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:54.556 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:54.633 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:54.630+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:54.660 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:54.660 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:54.660 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:44:54.661 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:44:54.661 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:54.669 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:44:54.734 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:54.732+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:54.781 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:44:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:44:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:44:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.374642268000002, 2024-04-26T11:44:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:44:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:44:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:44:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:44:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:44:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:44:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:44:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:44:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:44:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:44:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:44:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.374571776000003, 2024-04-26T11:44:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:44:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:44:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.175021932, 2024-04-26T11:44:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:44:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:44:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:44:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:44:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:44:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:44:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:44:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:44:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:44:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:44:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:44:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:44:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:44:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:44:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:44:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:44:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.174990213000001, 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.805 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:44:54.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:44:54.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:44:54.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:44:54.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:44:54.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:54.811 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.174948643999997, 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:44:54.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:44:54.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:54.817 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.174821506999997, 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.348051826999999, 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.823 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:44:54.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:44:54.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:44:54.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:44:54.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347951238999997, 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:54.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:54.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:44:54.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:44:54.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:44:54.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:44:54.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:44:54.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:44:54.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:44:54.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.838 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:54.839 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347882546999998, 2024-04-26T11:44:54.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:44:54.839 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.839 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.840 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:54.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:54.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:44:54.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:44:54.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:44:54.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:44:54.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:44:54.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.846 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347778929, 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:54.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:44:54.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:44:54.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:44:54.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:44:54.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:44:54.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:44:54.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:44:54.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:44:54.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:44:54.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:44:54.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.854 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.854 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:54.854 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347655078999999, 2024-04-26T11:44:54.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:44:54.854 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.854 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.854 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:54.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:54.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:44:54.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:44:54.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:44:54.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:44:54.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:44:54.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:44:54.860 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347622940000001, 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:44:54.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:44:54.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347592847000001, 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.872 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347562447999998, 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:44:54.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:44:54.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:44:54.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:54.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:44:54.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:44:54.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:44:54.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:44:54.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:44:54.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:44:54.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:44:54.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:44:54.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:44:54.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:44:54.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347531791999998, 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.880 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:54.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:54.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:44:54.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:44:54.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:44:54.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:44:54.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347489922999998, 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.887 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:54.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:54.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:44:54.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:44:54.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:44:54.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347456504, 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:44:54.895 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:44:54.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:44:54.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347308087000002, 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:44:54.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:44:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:44:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:44:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:44:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:44:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:44:54.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:44:54.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347188993000003, 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:44:54.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:44:54.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:44:54.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.347082948999997, 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:54.914 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:54.915 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:54.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:54.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:54.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:54.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:54.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:54.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:44:54.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:54.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:54.920 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:54.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-26T11:44:54.922 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:54.922+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:54.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:55.022 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:55.018+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:55.036 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:55.036 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:55.036 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:44:55.036 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:55.046 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:55.124 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:55.124+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:55.147 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:55.148 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:55.148 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:44:55.148 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:44:55.148 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:55.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:55.225 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:55.222+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:55.264 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:55.264 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:44:55.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:44:55.264 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:44:55.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.085523983000002, 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:44:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.084353311000001, 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:44:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:44:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:44:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:44:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:44:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:44:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:44:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:44:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.083354153999998, 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:44:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:44:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:44:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:44:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:44:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:44:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:44:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.081762419999997, 2024-04-26T11:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:44:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.854544367000003, 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:44:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:44:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:44:55.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.852677159000002, 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:44:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.850944757000001, 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:44:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.847136798000001, 2024-04-26T11:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:44:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:44:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.846620205999997, 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:44:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.634361910000003, 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:44:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:44:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.833372713999999, 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:44:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:44:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:44:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:44:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.833234976, 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:44:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.833105826999997, 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.833014439000003, 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.832730116999997, 2024-04-26T11:44:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.832626638999997, 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:44:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:44:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:44:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.832576289999999, 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:44:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:44:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:44:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.832537465000001, 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:44:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:44:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.832472864000003, 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.825008101999998, 2024-04-26T11:44:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:44:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:44:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:44:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:55.365 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:55.366 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:55.367 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:55.366+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:55.467 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:55.466+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:55.486 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:55.486 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:55.486 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:44:55.486 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:55.497 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:55.568 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:55.566+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:55.605 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:55.605 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:55.605 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:44:55.605 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:44:55.605 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:55.615 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:55.669 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:55.666+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:55.727 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:55.727 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:44:55.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:44:55.727 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:44:55.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.727 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:55.727 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:55.727 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.321267528, 2024-04-26T11:44:55.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:44:55.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:44:55.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.321197036000001, 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.733 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:55.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:44:55.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:44:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.121647191999998, 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:44:55.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:44:55.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:44:55.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:44:55.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:55.745 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.121615472999999, 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:44:55.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:44:55.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.121573904000002, 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:55.751 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:44:55.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:44:55.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.121446767000002, 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:44:55.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:44:55.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:44:55.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.294677086999997, 2024-04-26T11:44:55.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:44:55.763 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.763 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.763 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:55.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:44:55.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:44:55.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.294576499000001, 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.774 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.294507807000002, 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:55.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:44:55.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:44:55.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:44:55.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:44:55.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:44:55.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:44:55.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:44:55.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.294404188999998, 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:44:55.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:44:55.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:44:55.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:44:55.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:44:55.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.294280338999997, 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:44:55.787 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:44:55.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:44:55.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:44:55.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:44:55.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.793 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.294248199999998, 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:55.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.294218106999999, 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:44:55.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:44:55.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:44:55.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:44:55.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.294187708000003, 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:44:55.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:44:55.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:44:55.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:44:55.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:44:55.811 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.811 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.294157052000003, 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:55.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:44:55.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:44:55.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:44:55.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:55.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:44:55.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:44:55.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:44:55.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.294115183000002, 2024-04-26T11:44:55.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:44:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:44:55.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.825 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.825 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:55.825 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.294081763999998, 2024-04-26T11:44:55.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:44:55.825 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.825 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.825 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:55.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:44:55.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:44:55.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.293933346999999, 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:44:55.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:44:55.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.293814253000001, 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.837 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:44:55.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:44:55.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:44:55.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:44:55.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:44:55.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:44:55.843 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.843 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.293708209000002, 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:44:55.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:55.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:44:55.849 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.850 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:55.850 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:55.850 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:55.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:55.852 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:55.850+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:55.938 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:44:55.953 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:55.952+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:55.968 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:55.968 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:55.968 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:44:55.968 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:55.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:55.978 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:44:56.050 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-26T11:44:56.057 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:56.054+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:56.086 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:56.086 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:56.086 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:44:56.086 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:44:56.086 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:56.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:56.137 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:44:56.157 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:56.156+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:56.163 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:44:56.164 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:44:56.164 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:44:56.164 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:44:56.167 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:44:56.168 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:44:56.201 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:56.202 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:56.212 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:56.259 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:56.258+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:56.339 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:56.360 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:56.358+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:56.449 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:56.449 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:56.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:56.461 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:56.456+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:56.561 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:56.560+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:56.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:56.663 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:56.658+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:56.690 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:56.690 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:56.694 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:44:56.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:56.764 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:56.760+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:56.803 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:56.803 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:56.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:56.865 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:56.864+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:56.922 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:56.922 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:56.932 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:56.966 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:56.962+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:57.050 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:57.050 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:57.060 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:57.067 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:57.066+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:57.168 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:57.166+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:57.172 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:57.172 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:57.181 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:57.269 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:57.264+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:57.289 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:57.289 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:57.298 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:57.370 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:57.368+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:57.413 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:57.413 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:57.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:57.470 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:57.468+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:57.532 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:57.532 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:57.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:57.571 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:57.566+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:57.647 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:57.648 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:57.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:57.694 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:44:57.705 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:57.704+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:57.773 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:57.770+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:57.777 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:57.777 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:57.787 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:57.874 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:57.872+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:57.892 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:57.892 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:57.903 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:57.976 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:57.972+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:58.006 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:58.007 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:58.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:58.077 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:58.074+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:58.132 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:58.132 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:58.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:58.169 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:44:58.183 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:58.182+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:58.279 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:58.274+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:58.294 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:44:58.294 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:44:58.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:58.333 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:44:58.359 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:44:58.359 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:44:58.360 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:44:58.360 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:44:58.362 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:44:58.363 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:44:58.379 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:58.378+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:58.416 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:58.416 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.237443837999997, 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:58.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.236273165999997, 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:44:58.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:44:58.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:44:58.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.235274009000001, 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.426 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:58.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:58.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:44:58.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.233682275, 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:58.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:44:58.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:58.435 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.006464221999998, 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:58.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:44:58.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:44:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:44:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:44:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:44:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:44:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.004597013999998, 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:58.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:58.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:44:58.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:44:58.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:44:58.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:44:58.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:44:58.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:44:58.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:44:58.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:58.446 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.002864612000003, 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:58.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:44:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:44:58.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:44:58.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:44:58.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:44:58.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:44:58.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:44:58.452 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.452 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.452 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.452 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:44:58.453 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:58.453 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.999056652999997, 2024-04-26T11:44:58.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:44:58.453 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.453 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.453 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:58.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:58.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:58.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:44:58.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:44:58.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:44:58.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:44:58.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:44:58.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:44:58.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:44:58.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:44:58.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:44:58.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:44:58.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:44:58.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:44:58.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:44:58.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:44:58.461 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.461 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.461 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.461 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:44:58.461 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:58.462 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.998540061, 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:58.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:44:58.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:44:58.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:44:58.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:44:58.468 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.468 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.468 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.469 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:44:58.469 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:58.469 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.786281764999998, 2024-04-26T11:44:58.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:44:58.469 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.470 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.470 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:58.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:58.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:44:58.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:44:58.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:44:58.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:44:58.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:44:58.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:44:58.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:44:58.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.476 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.985292569000002, 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:44:58.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:44:58.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:44:58.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:44:58.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:44:58.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:44:58.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:58.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:44:58.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:44:58.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:58.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:44:58.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:44:58.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:44:58.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.985154831000003, 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:58.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:58.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:44:58.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:58.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:44:58.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:44:58.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:44:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:44:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:44:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:44:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:44:58.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:58.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:44:58.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:44:58.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:44:58.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:44:58.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.492 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.492 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:58.492 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.985025682, 2024-04-26T11:44:58.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:44:58.492 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.492 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.493 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:44:58.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:44:58.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:44:58.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:44:58.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:44:58.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.498 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.498 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.499 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:58.499 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.984934293999999, 2024-04-26T11:44:58.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:44:58.499 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.499 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.499 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:58.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:44:58.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:44:58.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:44:58.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:44:58.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:44:58.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:44:58.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:58.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:44:58.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:44:58.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.984649972, 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:44:58.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:44:58.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:44:58.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:44:58.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:44:58.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:44:58.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:58.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:44:58.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:44:58.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:58.513 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.984546494, 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.984496145000001, 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:44:58.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:44:58.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:58.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.984457319999997, 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:58.524 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:44:58.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.984392718999999, 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:44:58.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:44:58.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.976927957000001, 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:58.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:44:58.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:58.535 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:58.536 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:58.537 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:58.538 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:58.536+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:58.638 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:58.638+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:58.654 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:58.654 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:58.654 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:44:58.655 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:58.665 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:58.739 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:58.736+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:58.772 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:58.772 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:58.772 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:44:58.772 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:44:58.772 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:58.783 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:58.840 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:58.836+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:58.897 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:58.897 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:44:58.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:44:58.897 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:44:58.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.897 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:58.898 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:58.898 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.490661686999999, 2024-04-26T11:44:58.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:44:58.898 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.898 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:58.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:58.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:58.898 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:44:58.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:44:58.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:44:58.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:44:58.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:44:58.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:44:58.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:44:58.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.490591195, 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:44:58.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:44:58.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:44:58.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:44:58.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:44:58.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:44:58.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:44:58.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:44:58.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:44:58.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:44:58.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:44:58.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:44:58.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:44:58.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:44:58.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:44:58.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.913 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.914 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:58.914 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:58.914 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.291041350999997, 2024-04-26T11:44:58.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:44:58.914 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.914 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:58.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:58.915 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:58.915 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:44:58.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.915 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:58.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:58.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:44:58.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:44:58.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:44:58.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:44:58.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:44:58.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:44:58.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:44:58.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:44:58.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:44:58.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:44:58.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:44:58.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:44:58.926 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.927 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.927 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.927 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:58.927 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:58.927 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.291009631999998, 2024-04-26T11:44:58.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:44:58.928 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.928 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.928 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:58.928 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:58.928 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:58.928 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:44:58.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.929 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:58.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:58.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:44:58.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:58.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:44:58.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:44:58.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:44:58.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:44:58.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:44:58.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:44:58.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.936 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.937 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:58.937 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:58.937 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.290968063000001, 2024-04-26T11:44:58.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:44:58.937 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.937 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.937 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:58.938 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:58.938 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:58.938 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:44:58.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.938 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:58.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:58.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:58.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:58.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:44:58.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:44:58.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:44:58.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:44:58.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:44:58.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:44:58.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:44:58.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:44:58.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:44:58.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:44:58.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:44:58.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:44:58.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:44:58.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:44:58.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:44:58.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:44:58.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:44:58.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:44:58.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:44:58.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:44:58.949 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.949 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.949 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.949 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:58.949 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:58.949 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.290840926000001, 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:44:58.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:44:58.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:44:58.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:44:58.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.464071246000003, 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:58.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:58.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:44:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:44:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:44:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:44:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:44:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:44:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:44:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:44:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463970658000001, 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:44:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463901966000002, 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463798347999997, 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:44:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463674498000003, 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:44:58.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463642358999998, 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:44:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:44:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:44:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:44:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463612265999998, 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:44:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:44:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:44:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463581867000002, 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463551211000002, 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:44:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:44:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:44:59.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:44:59.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463509342000002, 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:44:59.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:44:59.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:44:59.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463475922999997, 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:44:59.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.023 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463327505999999, 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:59.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:44:59.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:59.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:44:59.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463208412, 2024-04-26T11:44:59.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 37.463102368000001, 2024-04-26T11:44:59.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:44:59.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:44:59.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.041 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.041 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.041 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:59.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:44:59.043 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:59.042+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:59.143 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:59.142+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:59.163 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:59.164 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:59.164 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:44:59.164 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:59.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:44:59.245 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:59.244+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:59.285 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:59.285 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:44:59.285 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:44:59.285 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:44:59.285 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:59.294 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:44:59.345 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:59.342+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:59.406 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:44:59.406 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:44:59.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.226237009999998, 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:59.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.225066337999998, 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:44:59.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:44:59.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.224067181000002, 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:44:59.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:44:59.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.222475447000001, 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:59.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:44:59.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:44:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:44:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:44:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:44:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.995257393999999, 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:44:59.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:44:59.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.993390185999999, 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:44:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.991657783999997, 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:44:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.987849824999998, 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:44:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:44:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.987333233000001, 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:44:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.775074936999999, 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:44:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:44:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.974085741000003, 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:44:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.973948002999997, 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.973818854000001, 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:44:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.973727466, 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.973443144000001, 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.973339666000001, 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:44:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:44:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:44:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.973289317000003, 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:44:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:44:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:44:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.973250491999998, 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:44:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.973185891, 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:44:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:44:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 37.965721129000002, 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:44:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:44:59.500 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:44:59.502 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:44:59.502 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:59.502+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:59.603 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:59.600+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:59.623 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:59.623 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:59.623 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:44:59.623 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:59.631 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:44:59.704 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:44:59.702+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:44:59.706 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:44:59.741 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:59.741 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:44:59.742 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:44:59.742 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:44:59.742 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:59.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:44:59.805 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:59.804+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:59.859 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:44:59.859 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:44:59.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:44:59.859 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:44:59.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.859 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.455483729999997, 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:44:59.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:44:59.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:44:59.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.865 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.455413237999998, 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:44:59.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.867 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:59.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:44:59.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:44:59.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:44:59.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:44:59.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:44:59.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.255863394000002, 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:59.872 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:44:59.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:44:59.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.877 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.255831675000003, 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.878 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:44:59.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:44:59.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:44:59.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.255790105999999, 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:44:59.883 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:44:59.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:44:59.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:44:59.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:44:59.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:44:59.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:44:59.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:44:59.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.889 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.889 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:44:59.889 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:59.889 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.255662968999999, 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:44:59.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:44:59.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428893289000001, 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:44:59.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:44:59.900 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428792700999999, 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:59.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.906 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428724009, 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:44:59.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:44:59.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:44:59.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:44:59.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.912 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.913 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:59.913 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428620391000003, 2024-04-26T11:44:59.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:44:59.913 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.913 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.913 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:59.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.918 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428496541000001, 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:44:59.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:44:59.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:44:59.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.924 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428464402000003, 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:44:59.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.930 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428434308999996, 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:44:59.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:44:59.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:44:59.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:44:59.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.42840391, 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:44:59.936 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:44:59.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428373254, 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:44:59.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.947 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428331385, 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428297966000002, 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:44:59.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:59.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428149548999997, 2024-04-26T11:44:59.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.428030454999998, 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.965 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.427924410999999, 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:44:59.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.976 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:44:59.977 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:44:59.977 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:44:59.978 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:44:59.976+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:44:59.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:00.051 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:45:00.080 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:00.080+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:00.120 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:00.120 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:00.120 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:00.121 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:00.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:00.163 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-04-26T11:45:00.181 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:00.180+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:00.239 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:00.239 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:00.239 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:00.239 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:00.239 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:00.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:00.264 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-04-26T11:45:00.282 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:00.278+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:00.352 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 48.172509386000002, 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:00.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:00.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:00.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 48.171338714000001, 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.360 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:00.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 48.170339556999998, 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 48.168747822999997, 2024-04-26T11:45:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.941529770000002, 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.939662562000002, 2024-04-26T11:45:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.937930160000001, 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.934122201000001, 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.933605608999997, 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.721347313000003, 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.920358116999999, 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.920220379, 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.406 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:00.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.920091229999997, 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:00.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:00.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:00.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:00.417 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.417 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.417 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.417 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:00.417 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.919999842000003, 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:00.422 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.919715519999997, 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:00.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:00.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.919612041999997, 2024-04-26T11:45:00.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:00.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.433 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.919561692999999, 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:00.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.919522868000001, 2024-04-26T11:45:00.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:00.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.919458267000003, 2024-04-26T11:45:00.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:00.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.911993504999998, 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:00.447 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.451 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.451 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.451 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:00.451 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:00.451 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:00.451 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:00.453 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:00.448+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:00.454 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:00.554 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:00.552+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:00.566 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:00.566 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:00.577 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:00.603 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:00.627 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:00.627 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:00.628 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:00.628 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:00.631 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:00.632 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:00.655 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:00.654+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:00.682 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:00.683 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:00.692 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:00.756 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:00.752+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:00.796 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:00.796 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:00.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:00.856 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-26T11:45:00.856 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:00.854+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:00.924 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:00.924 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:00.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:00.958 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:00.954+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:01.034 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:01.034 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:01.043 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:45:01.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:01.058 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:01.056+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:01.159 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:01.158+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:01.201 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:01.201 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:01.211 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:01.260 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:01.258+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:01.327 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:01.327 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:01.337 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:01.361 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:01.358+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:01.448 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:01.448 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:01.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:01.462 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:01.458+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:01.563 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:01.560+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:01.572 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:01.572 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:01.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:01.664 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:01.662+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:01.696 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:01.697 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:01.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:01.767 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:01.764+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:01.810 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:01.819 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:01.868 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:01.866+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:01.928 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:01.929 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:01.938 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:01.969 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:01.964+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:02.052 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:02.053 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:02.063 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:02.069 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:02.066+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:02.171 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:02.170+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:02.218 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:02.218 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:02.228 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:02.272 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:02.270+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:02.335 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:02.335 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:02.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:02.373 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:02.368+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:02.459 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:02.459 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:02.469 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:02.474 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:02.472+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:02.575 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:02.574+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:02.576 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:02.576 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:02.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:02.633 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:02.676 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:02.674+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:02.681 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:02.682 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:02.691 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:02.778 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:02.774+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:02.792 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:02.808 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:02.808 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:02.819 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:02.820 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:02.820 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:02.820 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:02.820 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:02.823 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:02.824 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:02.879 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:02.878+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:02.920 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:02.920 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:02.920 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:02.920 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:02.920 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:02.930 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:02.980 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:02.978+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:03.033 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:03.033 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.627700599999997, 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:03.034 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:03.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.627630107999998, 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:03.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:03.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:03.045 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.428080264000002, 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:03.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:03.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.428048545000003, 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.428006975999999, 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.057 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:03.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:03.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.427879838999999, 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:03.063 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:03.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.601110159000001, 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.074 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.601009570999999, 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.080 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.600940878999999, 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:03.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:03.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:03.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:03.086 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.600837261000002, 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:03.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:03.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.092 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.600713411000001, 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:03.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:03.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:03.098 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.600681272000003, 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:03.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:03.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:03.104 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.600651179000003, 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:03.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:03.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:03.110 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.60062078, 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:03.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:03.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:03.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:03.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:03.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:03.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.600590124, 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:03.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:03.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.600548255, 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:03.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:03.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:03.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:03.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:03.128 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.128 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.600514836000002, 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:03.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:03.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:03.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.600366418999997, 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:03.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:03.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:03.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:03.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:03.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:03.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:03.142 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.600247324999998, 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:03.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:03.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.148 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.600141280999999, 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:03.154 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:03.155 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:45:03.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:03.157 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:03.154+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:03.258 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:03.256+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:03.272 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:03.272 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:03.272 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:03.272 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:03.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:03.359 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:03.358+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:03.387 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:03.387 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:03.387 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:03.387 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:03.387 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:03.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:03.460 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:03.456+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:03.504 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:03.504 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:03.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:03.504 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:03.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.504 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.325505626999998, 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:03.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:03.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:03.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:03.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.510 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:03.510 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:03.510 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.324334954999998, 2024-04-26T11:45:03.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:03.512 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.512 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.512 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:03.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:03.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:03.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.323335798000002, 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:03.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:03.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.321744064000001, 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:03.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.094526010999999, 2024-04-26T11:45:03.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.092658802999999, 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:03.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:03.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.090926400999997, 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.087118441999998, 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.086601850000001, 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.874343553999999, 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.073354358000003, 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.073216619999997, 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.073087471000001, 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.072996083, 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.072711761000001, 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.072608283000001, 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.072557934000002, 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.072519108999998, 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.072454508, 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.064989746000002, 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:03.600 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:03.602 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:03.602 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:03.598+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:03.703 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:03.700+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:03.719 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:03.719 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:03.729 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:03.803 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:03.800+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:03.832 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:03.833 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:03.842 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:03.904 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:03.902+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:03.997 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:03.997 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.591851826000003, 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:03.998 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:03.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:04.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.591781333999997, 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:04.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:04.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:04.009 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.39223149, 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:04.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:04.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:04.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:04.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:04.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:04.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:04.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:04.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:04.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.392199771000001, 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:04.016 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:04.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:04.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:04.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:04.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.022 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.022 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:04.022 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:04.022 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.392158201999997, 2024-04-26T11:45:04.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:04.022 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:04.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:04.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.392031064999998, 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:04.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:04.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:04.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.565261384999999, 2024-04-26T11:45:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:04.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:04.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:04.039 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.565160796999997, 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:04.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:04.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:04.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:04.046 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.046 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.046 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.049 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.049 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:04.049 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.565092104999998, 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:04.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:04.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:04.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:04.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:04.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:04.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:04.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:04.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.056 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.564988487000001, 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:04.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:04.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.564864636999999, 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:04.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:04.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.564832498000001, 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:04.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.564802405000002, 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:04.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:04.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.564772005999998, 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:04.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:04.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:04.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.564741349999998, 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:04.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:04.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:04.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:04.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:04.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:04.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:04.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.564699480999998, 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:04.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:04.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.564666062000001, 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:04.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:04.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:04.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.564517645000002, 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:04.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.564398550999996, 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:04.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.564292506999998, 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.117 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:04.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:04.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:04.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:04.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:04.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:04.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:04.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:04.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:04.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:04.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.123 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:04.123 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:04.123 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:04.125 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:45:04.125 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:04.124+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:04.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:04.226 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:04.222+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:04.241 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:04.241 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:04.241 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:04.241 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:04.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:04.326 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:04.322+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:04.403 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:04.404 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:04.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:04.427 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:04.426+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:04.522 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:04.522 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:04.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 52.342122744000001, 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:04.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:04.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:04.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:04.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:04.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:04.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:04.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:04.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 52.340952072, 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:04.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:04.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:04.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:04.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:04.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:04.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:04.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 52.339952914999998, 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.534 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:04.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:04.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:04.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:04.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:04.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 52.338361181000003, 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:04.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:04.543 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 52.111143128000002, 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:04.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:04.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:04.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:04.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:04.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:04.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:04.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:04.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:04.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:04.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:04.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:04.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 52.109275920000002, 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.550 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:04.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:04.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.554 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 52.107543518, 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:04.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:04.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:04.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:04.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:04.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:04.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:04.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:04.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:04.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:04.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:04.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:04.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.560 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.561 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:04.561 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:04.561 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 52.103735559, 2024-04-26T11:45:04.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:04.561 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.561 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.561 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:04.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:04.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:04.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:04.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:04.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:04.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 52.103218966999997, 2024-04-26T11:45:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:04.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:04.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:04.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:04.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:04.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.572 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.572 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:04.572 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:04.572 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.890960671000002, 2024-04-26T11:45:04.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:04.572 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.573 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.573 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:04.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:04.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:04.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:04.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:04.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:04.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:04.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:04.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:04.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:04.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:04.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:04.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:04.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:04.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:04.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:04.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:04.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:04.581 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.581 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.581 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.582 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.582 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:04.582 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.089971474999999, 2024-04-26T11:45:04.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:04.582 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.582 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.583 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:04.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:04.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:04.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:04.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:04.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:04.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:04.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:04.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:04.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:04.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:04.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:04.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:04.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:04.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:04.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:04.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:04.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:04.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:04.590 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.590 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.590 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.591 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.591 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:04.591 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.089833736999999, 2024-04-26T11:45:04.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:04.591 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.591 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.591 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:04.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:04.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:04.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:04.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:04.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:04.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.598 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.598 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.598 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:04.599 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.089704587999996, 2024-04-26T11:45:04.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:04.599 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.599 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.599 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:04.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:04.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:04.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:04.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:04.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:04.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:04.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:04.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:04.606 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.606 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.606 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.607 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.607 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:04.607 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.089613200000002, 2024-04-26T11:45:04.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:04.607 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.607 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:04.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:04.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:04.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:04.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:04.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:04.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:04.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:04.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:04.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:04.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:04.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:04.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:04.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:04.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.614 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.089328878000003, 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:04.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:04.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:04.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:04.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:04.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:04.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:04.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:04.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:04.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:04.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:04.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:04.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:04.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:04.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:04.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:04.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:04.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:04.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:04.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:04.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:04.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:04.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:04.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:04.622 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.622 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.622 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.623 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.623 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:04.623 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.089225399999997, 2024-04-26T11:45:04.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:04.623 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.623 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.624 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:04.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:04.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:04.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:04.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:04.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:04.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:04.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:04.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:04.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:04.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:04.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:04.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:04.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:04.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:04.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:04.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:04.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:04.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:04.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:04.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:04.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.089175050999998, 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:04.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:04.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:04.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:04.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:04.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:04.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:04.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:04.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:04.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:04.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.638 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.089136226000001, 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:04.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:04.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:04.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:04.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:04.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:04.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:04.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:04.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.089071625000003, 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:04.644 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.645 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:04.645 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:04.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:04.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:04.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:04.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.081606862999998, 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:04.649 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:04.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:04.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:04.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:04.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:04.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:04.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:04.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:04.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:04.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:04.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:04.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:04.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:04.653 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:04.655 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:04.652+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:04.656 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:04.756 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:04.752+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:04.770 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:04.771 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:04.781 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:04.825 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:04.857 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:04.852+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:04.891 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:04.891 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:04.900 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:04.957 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:04.954+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:04.982 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:05.006 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:05.006 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:05.006 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:05.006 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:05.009 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:05.010 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:05.049 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:05.049 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:05.058 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:05.056+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:05.059 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:05.158 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:05.154+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:05.176 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:05.177 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:05.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:05.259 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:05.258+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:05.341 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:05.382 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:05.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:05.385 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:05.382+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:05.452 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T11:45:05.452 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:45:05.453 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-26T11:45:05.453 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T11:45:05.485 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:05.482+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:05.536 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:05.537 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:05.546 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:05.593 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:05.591+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:05.663 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:05.663 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:05.673 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:05.689 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:05.683+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:05.769 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:45:05.770 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:45:05.770 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 28, 2024-04-26T11:45:05.770 INFO:teuthology.orchestra.run.smithi029.stdout: "fsid": "6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7", 2024-04-26T11:45:05.770 INFO:teuthology.orchestra.run.smithi029.stdout: "created": "2024-04-26T11:43:59.327999+0000", 2024-04-26T11:45:05.770 INFO:teuthology.orchestra.run.smithi029.stdout: "modified": "2024-04-26T11:45:04.037338+0000", 2024-04-26T11:45:05.770 INFO:teuthology.orchestra.run.smithi029.stdout: "last_up_change": "2024-04-26T11:44:51.639267+0000", 2024-04-26T11:45:05.770 INFO:teuthology.orchestra.run.smithi029.stdout: "last_in_change": "2024-04-26T11:44:00.980949+0000", 2024-04-26T11:45:05.770 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T11:45:05.770 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_num": 5799936, 2024-04-26T11:45:05.770 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_set": [ 2024-04-26T11:45:05.770 INFO:teuthology.orchestra.run.smithi029.stdout: "pglog_hardlimit", 2024-04-26T11:45:05.771 INFO:teuthology.orchestra.run.smithi029.stdout: "purged_snapdirs", 2024-04-26T11:45:05.771 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_deletes", 2024-04-26T11:45:05.771 INFO:teuthology.orchestra.run.smithi029.stdout: "sortbitwise" 2024-04-26T11:45:05.771 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-04-26T11:45:05.771 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_version": 4, 2024-04-26T11:45:05.771 INFO:teuthology.orchestra.run.smithi029.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T11:45:05.771 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T11:45:05.771 INFO:teuthology.orchestra.run.smithi029.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T11:45:05.771 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_snapshot": "", 2024-04-26T11:45:05.771 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_max": 4, 2024-04-26T11:45:05.771 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd": 3, 2024-04-26T11:45:05.772 INFO:teuthology.orchestra.run.smithi029.stdout: "require_min_compat_client": "luminous", 2024-04-26T11:45:05.772 INFO:teuthology.orchestra.run.smithi029.stdout: "min_compat_client": "jewel", 2024-04-26T11:45:05.772 INFO:teuthology.orchestra.run.smithi029.stdout: "require_osd_release": "reef", 2024-04-26T11:45:05.772 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_crimson": false, 2024-04-26T11:45:05.772 INFO:teuthology.orchestra.run.smithi029.stdout: "pools": [ 2024-04-26T11:45:05.772 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.772 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 1, 2024-04-26T11:45:05.772 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": ".mgr", 2024-04-26T11:45:05.772 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2024-04-26T11:44:10.024928+0000", 2024-04-26T11:45:05.772 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-04-26T11:45:05.772 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 1, 2024-04-26T11:45:05.773 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 1, 2024-04-26T11:45:05.774 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 1, 2024-04-26T11:45:05.774 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 1, 2024-04-26T11:45:05.774 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 1, 2024-04-26T11:45:05.774 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2024-04-26T11:45:05.774 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2024-04-26T11:45:05.774 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2024-04-26T11:45:05.774 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2024-04-26T11:45:05.774 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2024-04-26T11:45:05.774 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2024-04-26T11:45:05.774 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2024-04-26T11:45:05.774 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "12", 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2024-04-26T11:45:05.775 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2024-04-26T11:45:05.776 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2024-04-26T11:45:05.776 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2024-04-26T11:45:05.776 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2024-04-26T11:45:05.776 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2024-04-26T11:45:05.777 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2024-04-26T11:45:05.777 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2024-04-26T11:45:05.777 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2024-04-26T11:45:05.777 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:45:05.777 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:45:05.777 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:45:05.777 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2024-04-26T11:45:05.778 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_max": 32, 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 1 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": {} 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "read_balance": { 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "score_acting": 2.9900000095367432, 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "score_stable": 2.9900000095367432, 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T11:45:05.779 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_acting": 2, 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_stable": 2, 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity": 1, 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 2, 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "rbd", 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2024-04-26T11:44:15.295362+0000", 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2024-04-26T11:45:05.780 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 8, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 8, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 8, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 8, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 8, 2024-04-26T11:45:05.781 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "15", 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:45:05.782 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:45:05.783 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:45:05.784 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "options": {}, 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd": {} 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "read_balance": { 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "score_acting": 1.4900000095367432, 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "score_stable": 1.4900000095367432, 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_acting": 1, 2024-04-26T11:45:05.785 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_stable": 1, 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity": 1, 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 3, 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_metadata", 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2024-04-26T11:44:19.992912+0000", 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2024-04-26T11:45:05.786 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2024-04-26T11:45:05.787 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2024-04-26T11:45:05.787 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2024-04-26T11:45:05.787 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:45:05.787 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:45:05.787 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:45:05.787 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 32, 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 32, 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 32, 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 32, 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 32, 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2024-04-26T11:45:05.788 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "18", 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2024-04-26T11:45:05.789 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2024-04-26T11:45:05.790 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2024-04-26T11:45:05.791 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2024-04-26T11:45:05.791 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2024-04-26T11:45:05.791 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2024-04-26T11:45:05.791 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.793 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2024-04-26T11:45:05.793 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_bias": 4, 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 16, 2024-04-26T11:45:05.794 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_priority": 5 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": "cephfs" 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: "read_balance": { 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: "score_acting": 1.690000057220459, 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: "score_stable": 1.690000057220459, 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T11:45:05.795 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity": 1, 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 4, 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_data", 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2024-04-26T11:44:20.415578+0000", 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2024-04-26T11:45:05.796 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 64, 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 64, 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 64, 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 64, 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 64, 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2024-04-26T11:45:05.797 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "19", 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2024-04-26T11:45:05.798 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2024-04-26T11:45:05.799 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2024-04-26T11:45:05.800 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 64, 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "data": "cephfs" 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "read_balance": { 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "score_acting": 1.5800000429153442, 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "score_stable": 1.5800000429153442, 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T11:45:05.801 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_acting": 1.059999942779541, 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_stable": 1.059999942779541, 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity": 1, 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: "osds": [ 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "0a044aa1-7704-498d-af77-565f6fdb2bdc", 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2024-04-26T11:45:05.802 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 8, 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 23, 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6800", 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18212 2024-04-26T11:45:05.803 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6801", 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18212 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6802", 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18212 2024-04-26T11:45:05.804 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6803", 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18212 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6806", 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18212 2024-04-26T11:45:05.805 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6807", 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18212 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6804", 2024-04-26T11:45:05.806 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18212 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6805", 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18212 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.72:6801/18212", 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.72:6803/18212", 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.72:6807/18212", 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.72:6805/18212", 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2024-04-26T11:45:05.807 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "6aad0623-0085-42f2-873e-766474c95e27", 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 0, 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 8, 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 17, 2024-04-26T11:45:05.808 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 23, 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6800", 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18195 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6801", 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18195 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.809 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6802", 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18195 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6803", 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18195 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.810 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6806", 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18195 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6807", 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18195 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.811 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6804", 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18195 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6805", 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18195 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.812 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.82:6801/18195", 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.82:6803/18195", 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.82:6807/18195", 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.82:6805/18195", 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: "exists" 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "1367cc49-5228-4e11-96fc-ffb092dc8397", 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2024-04-26T11:45:05.813 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 8, 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 23, 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6800", 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18323 2024-04-26T11:45:05.814 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6801", 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18323 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6802", 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18323 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.815 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6803", 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18323 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6806", 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18323 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.816 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6807", 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18323 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6804", 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18323 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.817 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6805", 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 18323 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.122:6801/18323", 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.122:6803/18323", 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.122:6807/18323", 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.122:6805/18323", 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.818 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_xinfo": [ 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138322906710015, 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2024-04-26T11:44:06.307476+0000", 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:45:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138322906710015, 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2024-04-26T11:44:06.324325+0000", 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 22 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138322906710015, 2024-04-26T11:45:05.820 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2024-04-26T11:44:06.354056+0000", 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap": [], 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap_items": [], 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap_primaries": [], 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_temp": [], 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_temp": [], 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklist": {}, 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "range_blocklist": {}, 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profiles": { 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "default": { 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-failure-domain": "osd", 2024-04-26T11:45:05.821 INFO:teuthology.orchestra.run.smithi029.stdout: "k": "2", 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "m": "1", 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin": "jerasure", 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "technique": "reed_sol_van" 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps_queue": [], 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "new_removed_snaps": [], 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "new_purged_snaps": [], 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_node_flags": {}, 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "device_class_flags": {}, 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode": { 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_enabled": false, 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_bucket_count": 0, 2024-04-26T11:45:05.822 INFO:teuthology.orchestra.run.smithi029.stdout: "degraded_stretch_mode": 0, 2024-04-26T11:45:05.823 INFO:teuthology.orchestra.run.smithi029.stdout: "recovering_stretch_mode": 0, 2024-04-26T11:45:05.823 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_bucket": 0 2024-04-26T11:45:05.823 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:45:05.823 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:45:05.825 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:05.825 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:05.826 INFO:tasks.thrashosds.thrasher:j is {'epoch': 28, 'fsid': '6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7', 'created': '2024-04-26T11:43:59.327999+0000', 'modified': '2024-04-26T11:45:04.037338+0000', 'last_up_change': '2024-04-26T11:44:51.639267+0000', 'last_in_change': '2024-04-26T11:44:00.980949+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:44:10.024928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:44:15.295362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:44:19.992912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:44:20.415578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '0a044aa1-7704-498d-af77-565f6fdb2bdc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6800', 'nonce': 18212}, {'type': 'v1', 'addr': '172.21.15.72:6801', 'nonce': 18212}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6802', 'nonce': 18212}, {'type': 'v1', 'addr': '172.21.15.72:6803', 'nonce': 18212}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6806', 'nonce': 18212}, {'type': 'v1', 'addr': '172.21.15.72:6807', 'nonce': 18212}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6804', 'nonce': 18212}, {'type': 'v1', 'addr': '172.21.15.72:6805', 'nonce': 18212}]}, 'public_addr': '172.21.15.72:6801/18212', 'cluster_addr': '172.21.15.72:6803/18212', 'heartbeat_back_addr': '172.21.15.72:6807/18212', 'heartbeat_front_addr': '172.21.15.72:6805/18212', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '6aad0623-0085-42f2-873e-766474c95e27', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 23, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6800', 'nonce': 18195}, {'type': 'v1', 'addr': '172.21.15.82:6801', 'nonce': 18195}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6802', 'nonce': 18195}, {'type': 'v1', 'addr': '172.21.15.82:6803', 'nonce': 18195}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6806', 'nonce': 18195}, {'type': 'v1', 'addr': '172.21.15.82:6807', 'nonce': 18195}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6804', 'nonce': 18195}, {'type': 'v1', 'addr': '172.21.15.82:6805', 'nonce': 18195}]}, 'public_addr': '172.21.15.82:6801/18195', 'cluster_addr': '172.21.15.82:6803/18195', 'heartbeat_back_addr': '172.21.15.82:6807/18195', 'heartbeat_front_addr': '172.21.15.82:6805/18195', 'state': ['exists']}, {'osd': 2, 'uuid': '1367cc49-5228-4e11-96fc-ffb092dc8397', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 18323}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 18323}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 18323}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 18323}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 18323}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 18323}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 18323}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 18323}]}, 'public_addr': '172.21.15.122:6801/18323', 'cluster_addr': '172.21.15.122:6803/18323', 'heartbeat_back_addr': '172.21.15.122:6807/18323', 'heartbeat_front_addr': '172.21.15.122:6805/18323', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:44:06.307476+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:44:06.324325+0000', 'dead_epoch': 22}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:44:06.354056+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T11:45:05.826 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-26T11:45:05.826 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:05.826 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:05.819+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:05.926 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:05.922+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:05.985 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:05.985 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:05.996 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:06.043 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:06.042+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:06.115 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:06.116 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:06.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:06.126 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:45:06.128 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:06.127+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:06.228 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:06.227+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:06.237 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:06.238 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:06.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:06.329 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:06.326+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:06.350 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:06.351 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:06.361 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:06.430 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:06.427+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:06.479 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:06.479 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:06.489 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:06.531 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:06.527+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:06.595 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:06.596 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:06.605 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:06.632 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:06.630+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-26T11:45:06.733 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:06.731+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:06.758 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:06.758 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:06.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:06.834 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:06.830+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:06.888 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:06.888 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:06.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:06.936 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:06.931+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:07.008 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:07.008 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:07.011 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:07.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:07.036 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:07.034+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:07.064 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:45:07.128 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:07.129 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:07.137 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:07.134+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:07.137 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:07.166 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:07.190 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:07.195 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:07.195 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:07.238 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:07.238+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:07.254 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:07.254 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:07.254 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:07.255 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:07.265 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:07.338 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:07.335+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:07.374 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:07.375 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:07.375 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:07.375 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:07.375 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:07.385 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:07.439 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:07.438+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:07.498 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:07.498 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:07.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:07.498 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:07.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.498 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:07.498 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:07.498 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.091663089000001, 2024-04-26T11:45:07.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:07.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:07.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:07.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:07.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:07.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:07.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.091592597000002, 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:07.505 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:07.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.510 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.892042752999998, 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:07.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:07.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:07.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:07.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:07.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:07.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:07.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:07.517 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.892011033999999, 2024-04-26T11:45:07.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:07.518 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.518 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.518 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:07.518 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:07.518 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:07.518 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:07.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.518 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:07.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:07.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:07.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.891969465000003, 2024-04-26T11:45:07.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:07.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:07.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:07.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:07.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:07.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:07.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:07.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:07.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:07.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:07.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:07.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:07.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:07.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:07.530 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.530 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.530 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.533 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.891842328000003, 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.065072647999997, 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064972060000002, 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064903368000003, 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064799749999999, 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064675899999997, 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:07.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:07.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064643760999999, 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:07.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:07.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:07.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064613668, 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:07.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:07.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:07.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:07.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:07.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:07.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:07.584 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064583269000003, 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:07.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:07.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:07.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064552612999996, 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:07.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:07.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:07.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:07.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:07.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:07.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:07.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:07.598 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.598 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.598 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.598 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.598 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:07.598 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064510744000003, 2024-04-26T11:45:07.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:07.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:07.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:07.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:07.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:07.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:07.604 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064477324999999, 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064328908, 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064209814000002, 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.064103770000003, 2024-04-26T11:45:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:07.632 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:07.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:07.634 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:07.630+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:07.734 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:07.731+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:07.751 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:07.751 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:07.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:07.834 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:07.830+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:07.870 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:07.871 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:07.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:07.936 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:07.931+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:07.988 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:07.988 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:07.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:07.988 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:07.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.988 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:07.988 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.809402863999999, 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:07.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:07.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:07.992 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.808232191999998, 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:07.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:07.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:07.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.807233035000003, 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:07.997 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:07.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:07.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.805641301000001, 2024-04-26T11:45:08.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:08.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:08.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.578423248, 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:08.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:08.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:08.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:08.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.57655604, 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.010 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:08.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:08.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.574823637999998, 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:08.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:08.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.019 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.019 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:08.019 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:08.019 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.571015678999998, 2024-04-26T11:45:08.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:08.020 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.020 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.020 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:08.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:08.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:08.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.570499087000002, 2024-04-26T11:45:08.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:08.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:08.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:08.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:08.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:08.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:08.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:08.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.358240791, 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:08.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.557251594999997, 2024-04-26T11:45:08.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:08.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:08.038 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.557113856999997, 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:08.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.556984708000002, 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:08.044 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:08.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:08.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:08.050 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.55689332, 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:08.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.556608998000002, 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.056 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:08.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.556505520000002, 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:08.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:08.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.556455171000003, 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:08.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:08.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.556416345999999, 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:08.072 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.556351745000001, 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.548886983000003, 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:08.080 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:08.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:08.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.083 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.084 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:08.085 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:08.086 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:08.082+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:08.186 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:08.183+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:08.202 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:08.203 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:08.213 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:08.287 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:08.286+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:08.322 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:08.322 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:08.322 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:08.322 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:08.322 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:08.331 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:08.388 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:08.386+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:08.441 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:08.441 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:08.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:08.441 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:08.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.441 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:08.441 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:08.441 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.035266897, 2024-04-26T11:45:08.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:08.442 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.442 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:08.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:08.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:08.442 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:08.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.442 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:08.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:08.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:08.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:08.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.035196405000001, 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:08.448 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:08.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:08.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:08.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:08.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:08.455 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.455 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.455 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.455 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:08.455 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:08.455 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.835646560999997, 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:08.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:08.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:08.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:08.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:08.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:08.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:08.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:08.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:08.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:08.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:08.462 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.462 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.462 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.462 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:08.462 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:08.462 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.835614841999998, 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:08.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:08.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:08.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:08.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:08.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:08.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:08.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:08.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:08.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:08.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:08.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:08.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.835573273000001, 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:08.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:08.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:08.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:08.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:08.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:08.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:08.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:08.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:08.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:08.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:08.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:08.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:08.476 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.476 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.476 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.835446136000002, 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:08.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.478 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:08.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:08.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:08.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.483 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.008676456000003, 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:08.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:08.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:08.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:08.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:08.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:08.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:08.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:08.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:08.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:08.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:08.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:08.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:08.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:08.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:08.491 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.008575868000001, 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:08.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:08.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:08.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:08.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:08.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:08.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:08.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:08.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:08.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:08.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:08.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:08.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:08.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:08.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:08.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.008507176000002, 2024-04-26T11:45:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:08.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:08.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:08.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:08.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:08.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.506 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.506 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.506 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:08.506 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.008403557999998, 2024-04-26T11:45:08.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:08.507 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.507 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.507 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:08.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:08.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:08.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:08.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:08.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:08.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:08.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:08.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:08.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:08.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:08.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:08.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:08.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.514 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.514 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:08.514 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.008279708000003, 2024-04-26T11:45:08.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:08.514 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.514 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.514 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:08.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:08.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:08.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:08.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:08.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:08.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.008247568999998, 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:08.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:08.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:08.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:08.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:08.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:08.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:08.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:08.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:08.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:08.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:08.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:08.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:08.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:08.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:08.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:08.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:08.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:08.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:08.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.008217475999999, 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.528 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:08.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:08.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:08.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:08.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:08.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:08.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:08.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:08.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:08.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:08.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:08.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:08.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:08.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:08.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:08.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:08.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:08.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.535 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.008187077000002, 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:08.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:08.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:08.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:08.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:08.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:08.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:08.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:08.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:08.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:08.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:08.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:08.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.008156421000002, 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:08.543 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:08.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:08.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:08.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:08.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:08.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:08.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:08.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:08.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:08.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:08.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:08.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:08.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.550 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.008114552000002, 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:08.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:08.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:08.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:08.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:08.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:08.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:08.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:08.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:08.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:08.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:08.558 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.558 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.558 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.558 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.558 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:08.558 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.008081132999997, 2024-04-26T11:45:08.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:08.558 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.558 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.559 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:08.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:08.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:08.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:08.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:08.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:08.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:08.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:08.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:08.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:08.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:08.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:08.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:08.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:08.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:08.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:08.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:08.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.567 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.568 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.568 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.568 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:08.568 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.007932715999999, 2024-04-26T11:45:08.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:08.568 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.568 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.568 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:08.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:08.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:08.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:08.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:08.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:08.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:08.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:08.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:08.575 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.007813622, 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:08.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:08.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:08.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:08.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:08.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:08.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.007707578000002, 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:08.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:08.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:08.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:08.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:08.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:08.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:08.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:08.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:08.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:08.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:08.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:08.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:08.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:08.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:08.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:08.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:08.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:08.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:08.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:08.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:08.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:08.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:08.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.590 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:08.590 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:08.590 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:08.592 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:08.591+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:08.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:08.693 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:08.687+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:08.709 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:08.709 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:08.709 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:08.709 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:08.719 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:08.794 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:08.790+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:08.826 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:08.826 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:08.826 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:08.826 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:08.826 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:08.836 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:08.894 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:08.891+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:08.945 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:08.945 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.766912490000003, 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:08.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.765741818000002, 2024-04-26T11:45:08.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:08.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.954 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.764742661, 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:08.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.763150926999998, 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.959 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:08.963 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:08.964 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.535932873999997, 2024-04-26T11:45:08.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:08.964 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.964 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.964 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:08.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:08.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.534065666000004, 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:08.969 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:08.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.532333264000002, 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:08.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:08.977 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.528525305000002, 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.528008712999998, 2024-04-26T11:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.315750416999997, 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.514761221000001, 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:08.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.996 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:08.997 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:08.997 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.514623483000001, 2024-04-26T11:45:08.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:08.997 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:08.997 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:08.997 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:08.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:08.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:08.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:08.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:08.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.514494333999998, 2024-04-26T11:45:09.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:09.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:09.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:09.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:09.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:09.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:09.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:09.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:09.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:09.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.514402945999997, 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:09.008 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:09.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:09.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:09.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.514118623999998, 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:09.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:09.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.514015145999998, 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:09.019 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:09.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:09.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:09.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.513964797, 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:09.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:09.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.513925972000003, 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.513861370999997, 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 47.506396608999999, 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:09.041 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:09.043 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:09.043 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:09.039+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:09.078 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:45:09.144 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:09.142+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:09.160 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:09.160 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:09.170 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:09.196 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:09.245 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:09.243+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:09.274 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:09.274 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:09.274 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:09.274 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:09.274 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:09.284 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:09.338 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:09.346 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:09.342+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:09.361 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:09.361 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:09.361 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:09.361 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:09.364 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:09.365 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:09.389 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:09.390 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:09.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:09.447 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:09.446+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:09.520 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:09.520 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:09.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:09.547 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:09.543+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:09.632 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:09.633 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:09.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:09.648 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:09.643+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:09.749 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:09.747+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:09.750 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:09.751 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:09.760 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:09.851 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:09.846+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:09.875 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:09.876 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:09.886 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:09.951 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:09.950+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:09.996 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:09.996 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:10.006 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:10.052 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:10.050+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:45:10.112 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:10.112 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:10.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:10.167 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:10.166+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:10.240 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:10.240 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:10.250 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:10.253 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:10.250+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:10.354 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:10.350+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:10.369 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:10.369 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:10.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:10.455 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:10.454+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:10.537 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:10.537 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:10.546 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:10.556 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:10.551+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:10.657 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:10.654+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:10.663 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:10.663 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:10.673 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:10.758 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:10.758+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:10.826 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T11:45:10.826 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-26T11:45:10.827 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:45:10.827 INFO:teuthology.orchestra.console.smithi082:Power on 2024-04-26T11:45:10.827 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T11:45:10.837 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:10.838 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:10.841 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:10.851 DEBUG:teuthology.orchestra.console.smithi082:power on output: Chassis Power Control: Up/On 2024-04-26T11:45:10.851 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:45:10.862 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:10.862+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:10.876 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-04-26T11:45:10.949 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:10.949 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:10.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:10.962 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:10.958+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:11.064 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:11.059+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:11.074 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:11.074 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:11.084 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:11.164 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:11.162+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:11.193 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:11.193 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:11.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:11.265 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:11.262+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:11.310 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:11.310 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:11.320 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:11.365 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:11.363+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:11.366 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:11.438 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:11.438 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:11.446 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:11.466 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:11.466+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:11.524 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:11.554 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:11.555 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:11.555 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:11.555 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:11.555 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:11.555 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:11.556 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:11.556 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:11.556 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:11.557 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:11.558 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:11.564 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:11.566 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:11.563+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:11.668 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:11.666+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.267967968000001, 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.674 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:11.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:11.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:11.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.267897476000002, 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:11.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:11.685 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.068347631999998, 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:11.686 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:11.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.691 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.068315912999999, 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:11.692 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:11.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:11.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:11.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.697 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.068274344000002, 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:11.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.068147207000003, 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:11.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.709 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.241377526999997, 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:11.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:11.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:11.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.241276939000002, 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:11.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:11.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:11.721 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.241208247000003, 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:11.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:11.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.241104628999999, 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.728 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:11.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.734 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.240980778999997, 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:11.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:11.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.240948639999999, 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:11.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:11.746 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.240918547, 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:11.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.240888148000003, 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.753 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:11.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:11.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:11.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:11.759 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.240857492000004, 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:11.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:11.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.240815623000003, 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:11.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:11.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.240782203999999, 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:11.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:11.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.240633787, 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:11.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:11.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.240514693000002, 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.784 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:11.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:11.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:11.790 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.240408649000003, 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:11.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:11.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:11.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:11.796 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:11.798 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:11.795+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:11.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:11.898 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:11.895+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:11.916 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:11.916 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:11.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:12.000 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:11.998+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:12.033 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:12.033 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:12.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:12.101 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:45:12.102 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:12.099+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:12.154 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.975326748999997, 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.974156077000004, 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.973156920000001, 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.971565185999999, 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.744347132999998, 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.742479924999998, 2024-04-26T11:45:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.740747523000003, 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.736939563999996, 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.736422972, 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.524164675999998, 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.723175480000002, 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.723037742000002, 2024-04-26T11:45:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.722908593, 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.722817204999998, 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.722532883, 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.722429405, 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.722379056000001, 2024-04-26T11:45:12.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:12.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.722340230999997, 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.722275629999999, 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.714810868000001, 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:12.246 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.246 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.246 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.246 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:12.246 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:12.246 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:12.252 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:12.252 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:12.246+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:12.348 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:12.343+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:12.368 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:12.368 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:12.378 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:12.449 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:12.443+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:12.485 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:12.485 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:12.494 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:12.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2024-04-26T11:45:12.554 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:12.554+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.201232646000001, 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.607 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:12.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:12.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:12.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:12.612 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.201162154000002, 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:12.613 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:12.618 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.001612309999999, 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.001580591, 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:12.624 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:12.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:12.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:12.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.629 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.001539022000003, 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.001411885000003, 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.635 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:12.636 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:12.636 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:12.636 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:12.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.636 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:12.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:12.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:12.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:12.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:12.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:12.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:12.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.641 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:12.642 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.174642204999998, 2024-04-26T11:45:12.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:12.642 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.642 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.642 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:12.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:12.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:12.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:12.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:12.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:12.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.174541617000003, 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:12.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:12.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:12.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.174472925000003, 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.659 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.174369306999999, 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:12.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:12.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:12.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:12.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.174245456999998, 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.671 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.174213318, 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:12.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:12.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:12.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:12.677 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.174183225, 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:12.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:12.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:12.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:12.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.174152825999997, 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.683 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:12.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:12.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:12.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:12.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:12.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:12.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:12.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:12.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:12.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:12.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:12.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:12.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:12.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:12.690 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.690 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.690 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.690 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.690 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.174122169999997, 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:12.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:12.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:12.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.174080300999996, 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:12.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:12.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:12.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:12.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:12.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:12.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:12.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:12.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:12.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:12.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.174046881999999, 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:12.708 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.173898465000001, 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:12.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:12.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:12.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:12.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:12.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.714 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.173779371000002, 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:12.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:12.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:12.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.173673327000003, 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:12.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:12.726 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:12.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:12.728 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:12.726+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:12.829 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:12.827+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:12.842 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:12.842 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:12.842 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:12.843 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:12.852 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:12.930 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:12.926+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:12.961 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:12.961 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:12.961 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:12.961 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:12.961 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:12.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:13.031 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:13.031+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:13.083 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:13.083 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:13.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.903575044, 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:13.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:13.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:13.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:13.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:13.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.902404371999999, 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:13.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:13.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:13.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:13.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.901405214999997, 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:13.093 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:13.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:13.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:13.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:13.097 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.899813481000002, 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.672595428000001, 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.670728220000001, 2024-04-26T11:45:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.668995817999999, 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.665187859, 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.664671267000003, 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.452412971000001, 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.651423774999998, 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.651286036999998, 2024-04-26T11:45:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.651156888000003, 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.651065500000001, 2024-04-26T11:45:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.650781178000003, 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.650677700000003, 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.650627350999997, 2024-04-26T11:45:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.650588526, 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.650523925000002, 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 51.643059162999997, 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:13.180 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:13.182 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:45:13.183 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:13.183 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:13.179+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:13.283 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:13.279+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:13.295 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:13.295 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:13.296 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:13.296 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:13.305 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:13.383 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:13.382+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:13.411 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:13.411 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:13.421 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:13.485 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:13.482+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:13.532 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.126886679999998, 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:13.533 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:13.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:13.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.539 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.126816187999999, 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:13.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:13.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.927266344000003, 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.545 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:13.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:13.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:13.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:13.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.551 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.927234624999997, 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:13.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:13.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:13.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:13.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:13.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:13.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:13.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:13.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:13.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:13.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:13.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:13.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:13.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:13.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:13.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:13.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:13.560 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.927193056, 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:13.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.927065919, 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:13.566 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.567 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:13.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:13.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:13.567 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:13.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.567 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:13.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.100296239000002, 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.572 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:13.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.100195651, 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:13.578 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:13.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:13.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:13.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:13.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.100126959000001, 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.590 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.100023341000004, 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:13.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:13.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.099899491000002, 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:13.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:13.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.099867351999997, 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:13.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:13.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:13.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:13.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:13.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:13.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:13.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:13.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:13.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:13.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.099837258999997, 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.099806860000001, 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.621 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.099776204000001, 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:13.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:13.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.627 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.628 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.630 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.630 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:13.630 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.099734335000001, 2024-04-26T11:45:13.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:13.630 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.630 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:13.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.099700916000003, 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:13.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:13.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:13.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:13.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:13.641 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.099552498999998, 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.099433404999999, 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:13.653 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 52.099327361, 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:13.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:13.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:13.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:13.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:13.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:13.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:13.659 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:13.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:13.662 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:13.659+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:13.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:13.762 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:13.759+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:13.780 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:13.780 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:13.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:13.815 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:13.840 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:13.840 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:13.841 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:13.841 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:13.843 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:13.844 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:13.863 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:13.862+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:13.897 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:13.897 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:13.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:13.965 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:13.962+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:14.016 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:14.016 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:14.025 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:14.069 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:14.067+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:14.143 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:14.143 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:14.154 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:14.167 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:14.163+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:14.264 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:14.264 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:14.268 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:14.263+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:14.274 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:14.369 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:14.366+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:14.423 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:14.424 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:14.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:14.483 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:14.482+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:14.550 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:14.550 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:14.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:14.571 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:14.566+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:14.667 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:14.667 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:14.672 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:14.667+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:14.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:14.773 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:14.771+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:14.778 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:14.778 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:14.788 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:14.873 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:14.871+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:14.877 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:45:14.904 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:14.904 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:14.915 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:14.975 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:14.971+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:14.987 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-04-26T11:45:15.020 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:15.020 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:15.030 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:15.075 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:15.074+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:15.139 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:15.140 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:15.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:15.176 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:15.171+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:15.185 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:45:15.268 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:15.268 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:15.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:15.278 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:15.274+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:15.379 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:15.374+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:15.387 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:15.387 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:15.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:15.480 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:15.479+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:15.506 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:15.506 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:15.516 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:15.582 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:15.578+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:15.641 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:15.641 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:15.652 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:15.683 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:15.679+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:15.756 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:15.756 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:15.766 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:15.783 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:15.779+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:15.845 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:15.875 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:15.875 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:15.884 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:15.879+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:15.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:15.985 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:15.982+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:16.002 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:16.003 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:16.003 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:16.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:16.026 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:16.030 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:16.030 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:16.086 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:16.082+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:16.120 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:16.121 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:16.122 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:45:16.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:16.187 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:16.187+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:16.238 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.058393848999998, 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.057223176999997, 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.056224020000002, 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.054632286, 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.827414232999999, 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.825547024999999, 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.823814622999997, 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.820006663999997, 2024-04-26T11:45:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.819490072000001, 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.607231775999999, 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.806242580000003, 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.806104842000003, 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.805975693000001, 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.805884304999999, 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.805599983, 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.805496505000001, 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.805446156000002, 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.805407330999998, 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.80534273, 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.797877968000002, 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:16.334 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:16.338 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:16.339 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:16.331+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:16.436 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:16.431+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:16.455 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:16.456 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:16.456 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:16.456 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:16.466 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:16.538 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:16.538+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:16.569 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:16.570 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:16.580 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:16.639 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:16.635+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:16.689 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:16.689 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:16.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:16.689 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:16.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.689 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:16.689 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:16.689 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.283220345000004, 2024-04-26T11:45:16.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:16.689 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:16.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:16.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:16.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.283149852999998, 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:16.695 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:16.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.700 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.083600008999994, 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.701 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:16.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:16.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:16.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:16.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:16.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:16.706 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.083568290000002, 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:16.707 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:16.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:16.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.083526720999998, 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:16.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:16.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:16.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:16.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:16.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:16.718 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.718 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.718 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.083399584000006, 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.719 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:16.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.724 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.256629904, 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:16.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:16.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:16.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:16.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.256529315999998, 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:16.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:16.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:16.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:16.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:16.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:16.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.256460623999999, 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:16.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.256357006000002, 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:16.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:16.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:16.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:16.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:16.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.256233156, 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:16.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:16.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:16.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:16.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:16.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:16.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:16.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:16.761 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.256201017000002, 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:16.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:16.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:16.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:16.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:16.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:16.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:16.768 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.769 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.769 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.769 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.770 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:16.770 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.256170924000003, 2024-04-26T11:45:16.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:16.770 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.770 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.770 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:16.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:16.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:16.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:16.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:16.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:16.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.256140524999999, 2024-04-26T11:45:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:16.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:16.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:16.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:16.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:16.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:16.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:16.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:16.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:16.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:16.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:16.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:16.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:16.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:16.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:16.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:16.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:16.786 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.787 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.787 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.787 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:16.788 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.256109868999999, 2024-04-26T11:45:16.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:16.788 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.788 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.788 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:16.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:16.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:16.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:16.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:16.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:16.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:16.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:16.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:16.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:16.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:16.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:16.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:16.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:16.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:16.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:16.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:16.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:16.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:16.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:16.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.256067999999999, 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:16.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.256034581000002, 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:16.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:16.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.255886164000003, 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:16.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:16.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:16.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.815 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.255767069999997, 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:16.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.821 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.255661025999999, 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:16.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:16.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:16.828 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:16.828 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:16.829 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:16.827+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:16.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:16.930 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:16.926+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:16.945 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:16.946 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:16.956 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:17.031 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:17.030+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:17.060 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:17.061 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:17.061 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:17.061 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:17.061 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:17.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:17.133 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:17.131+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:17.181 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.001182137000001, 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.000011465, 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.999012308000005, 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.997420574000003, 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.770202521000002, 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.768335312999994, 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.766602911000007, 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.762794951999993, 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.762278359999996, 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.550020063999995, 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.749030867999998, 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.748893129999999, 2024-04-26T11:45:17.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:17.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.748763981000003, 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:17.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:17.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:17.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:17.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.245 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.748672593000002, 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:17.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:17.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.748388271000003, 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:17.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:17.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:17.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:17.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:17.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:17.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:17.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:17.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:17.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:17.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.257 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.748284793000003, 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:17.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:17.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:17.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:17.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:17.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.264 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.264 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:17.264 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.748234443999998, 2024-04-26T11:45:17.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:17.264 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.264 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.264 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:17.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:17.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:17.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:17.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:17.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:17.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:17.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:17.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:17.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:17.270 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.270 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.270 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.270 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.270 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:17.270 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.748195619000001, 2024-04-26T11:45:17.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:17.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.274 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:17.275 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.748131018000002, 2024-04-26T11:45:17.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:17.275 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.275 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:17.275 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:17.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:17.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:17.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:17.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:17.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:17.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:17.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:17.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:17.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 55.740666255999997, 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:17.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:17.283 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:17.285 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:17.286 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:17.283+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:17.386 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:17.386+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:17.403 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:17.403 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:17.413 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:17.486 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:17.483+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:17.522 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:17.523 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:17.523 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:17.523 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:17.523 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:17.532 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:17.588 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:17.586+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:17.639 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.233785355999999, 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:17.640 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:17.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:17.646 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.646 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.646 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.647 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:17.647 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:17.647 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.233714864000007, 2024-04-26T11:45:17.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:17.647 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.647 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:17.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:17.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:17.648 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:17.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.649 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:17.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:17.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:17.653 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.034165020000003, 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:17.654 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:17.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.034133300999997, 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:17.660 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:17.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:17.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:17.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.034091731999993, 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:17.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:17.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.033964595, 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:17.672 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:17.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:17.677 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.207194915000002, 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:17.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:17.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.207094327, 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.684 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:17.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:17.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:17.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:17.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.207025635000001, 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:17.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:17.696 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.206922016999997, 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:17.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:17.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.206798167000002, 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.703 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:17.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:17.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:17.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:17.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:17.709 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.709 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.709 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.709 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.709 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.206766027999997, 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:17.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:17.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:17.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:17.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:17.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:17.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:17.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:17.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:17.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:17.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:17.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:17.716 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.206735934999998, 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:17.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.206705536000001, 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:17.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:17.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.206674880000001, 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:17.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:17.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:17.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.206633011000001, 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:17.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:17.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:17.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:17.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.741 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.206599592000003, 2024-04-26T11:45:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:17.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:17.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:17.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:17.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.206451174999998, 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:17.748 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:17.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.206332080999999, 2024-04-26T11:45:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:17.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:17.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.206226037, 2024-04-26T11:45:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:17.770 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:17.772 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:17.767+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:17.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:17.873 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:17.870+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:17.891 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:17.892 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:17.892 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:17.892 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:17.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:17.974 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:17.971+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:18.007 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:18.008 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:18.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:18.032 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:18.075 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:18.070+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.947692720000006, 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.128 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:18.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:18.132 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.946522048000006, 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:18.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.945522890999996, 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:18.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.943931156999994, 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.141 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:18.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:18.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.716713103999993, 2024-04-26T11:45:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:18.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.714845896, 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.153 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.713113493999998, 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:18.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.709305534999999, 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.158 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:18.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:18.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:18.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:18.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:18.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:18.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:18.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:18.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:18.162 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.708788943000002, 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:18.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:18.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.496530647, 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:18.167 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:18.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:18.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:18.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:18.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:18.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:18.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:18.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:18.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.695541450999997, 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.175 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:18.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.695403712999997, 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.185 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.695274564000002, 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.695183176, 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:18.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:18.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:18.196 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.694898854000002, 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:18.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.694795376000002, 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.694745027000003, 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:18.207 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:18.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:18.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:18.212 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.694706201999999, 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:18.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.694641601000001, 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:18.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.220 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 56.687176839000003, 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:18.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:18.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:18.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:18.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:18.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:18.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:18.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:18.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.224 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:18.224 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:18.224 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:18.224 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:45:18.226 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:18.226 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:18.227 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:18.228 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:18.226+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:18.228 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:18.228 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:18.228 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:18.228 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:18.229 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:18.327 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:18.326+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:18.343 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:18.343 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:18.353 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:18.428 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:18.423+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:18.460 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:18.460 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:18.470 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:18.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~24s 2024-04-26T11:45:18.530 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:18.526+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:18.572 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:18.572 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:18.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:18.631 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:18.626+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:18.699 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:18.699 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:18.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:18.732 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:18.727+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:18.817 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:18.817 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:18.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:18.832 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:18.831+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:18.934 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:18.934 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:18.934 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:18.930+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:18.944 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:18.988 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:45:19.035 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:19.031+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:19.060 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:19.060 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:19.070 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:19.106 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-26T11:45:19.127 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:45:19.136 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:19.131+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:19.180 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:19.180 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:19.189 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:19.207 INFO:teuthology.orchestra.console.smithi082:Power on completed 2024-04-26T11:45:19.237 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:19.234+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:19.291 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:19.291 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:19.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:19.308 DEBUG:teuthology.orchestra.console.smithi082:Waiting for login prompt 2024-04-26T11:45:19.308 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi082 2024-04-26T11:45:19.338 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:19.334+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:19.419 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:19.420 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:19.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:19.439 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:19.435+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:19.540 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:19.538+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:19.581 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:19.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:19.641 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:19.635+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:19.696 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:19.696 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:19.706 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:19.741 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:19.738+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:19.821 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:19.821 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:19.832 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:19.842 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:19.839+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:19.942 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:19.942 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:19.943 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:19.939+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:19.951 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:20.044 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:20.042+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:20.057 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:20.057 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:20.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:20.145 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:20.143+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:20.192 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:20.192 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:20.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:20.230 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:20.247 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:20.243+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:20.307 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:20.307 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:20.316 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:20.348 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:20.346+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:20.369 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:20.399 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:20.402 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:20.402 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:20.426 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:20.426 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:20.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:20.426 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:20.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.426 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.245918351, 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.244747679, 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.243748522000004, 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.242156788000003, 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.014938735000001, 2024-04-26T11:45:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.013071526999994, 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.011339125000006, 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.007531166000007, 2024-04-26T11:45:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.007014573999996, 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.794756277999994, 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 58.993767081999998, 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 58.993629343999999, 2024-04-26T11:45:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 58.993500195000003, 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 58.993408807000002, 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 58.993124485000003, 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 58.993021007000003, 2024-04-26T11:45:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 58.992970657999997, 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 58.992931833, 2024-04-26T11:45:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 58.992867232000002, 2024-04-26T11:45:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 58.985402469999997, 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:20.528 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:20.530 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:20.530 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:20.526+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:20.631 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:20.627+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:20.649 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:20.649 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:20.659 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:20.731 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:20.727+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:20.764 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:20.764 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:20.764 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:20.764 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:20.764 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:20.774 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:20.833 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:20.827+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:20.883 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.477728737999996, 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:20.884 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:20.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:20.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:20.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:20.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:20.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:20.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:20.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.477658246000004, 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:20.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:20.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:20.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:20.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:20.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:20.896 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.278108402000001, 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:20.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:20.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:20.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.278076682999995, 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:20.902 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:20.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:20.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:20.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.907 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.278035114000005, 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:20.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:20.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:20.913 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.277907976999998, 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:20.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:20.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:20.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.451138297, 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.451037708999998, 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450969016999998, 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450865399000001, 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450741549, 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450709410000002, 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450679317000002, 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450648917999999, 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450618261999999, 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450576392999999, 2024-04-26T11:45:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450542974000001, 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450394557000003, 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450275462999997, 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.450169418999998, 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.005 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:21.006 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:21.003+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:21.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:21.107 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:21.106+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:21.122 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:21.122 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:21.122 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:21.122 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:21.132 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:21.140 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:45:21.208 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:21.203+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:21.241 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:21.241 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:21.242 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:21.242 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:21.242 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:21.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:21.309 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:21.306+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:21.365 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.184577954000005, 2024-04-26T11:45:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.183407282000005, 2024-04-26T11:45:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.182408124999995, 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.180816390999993, 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:21.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.953598338000006, 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:21.384 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.951731129999999, 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.949998727999997, 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.946190768999998, 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.945674177000001, 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.733415880999999, 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.410 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.932426685000003, 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:21.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:21.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.932288947000004, 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.416 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:21.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:21.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:21.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:21.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:21.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:21.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:21.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.421 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.932159798000001, 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:21.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.427 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.932068409999999, 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:21.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:21.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:21.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.931784088000001, 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:21.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:21.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:21.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.438 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.931680610000001, 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:21.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:21.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:21.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.931630261000002, 2024-04-26T11:45:21.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:21.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:21.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:21.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:21.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:21.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:21.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:21.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:21.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:21.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:21.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:21.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:21.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:21.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:21.451 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.451 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.451 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.451 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.451 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:21.451 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.931591435999998, 2024-04-26T11:45:21.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:21.452 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.452 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:21.452 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:21.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:21.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:21.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:21.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:21.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:21.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:21.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:21.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:21.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:21.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:21.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.456 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.457 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.457 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.457 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:21.457 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.931526835, 2024-04-26T11:45:21.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:21.457 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.457 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:21.458 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:21.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:21.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:21.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.924062073000002, 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:21.468 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:21.470 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:21.470 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:21.466+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:21.570 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:21.570+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:21.589 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:21.589 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:21.589 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:21.589 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:21.600 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:21.671 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:21.670+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:21.710 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:21.710 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:21.710 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:21.710 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:21.710 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:21.719 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:21.772 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:21.770+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:21.832 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:21.832 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:21.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:21.832 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:21.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.832 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:21.832 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:21.832 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.426192119999996, 2024-04-26T11:45:21.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:21.832 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.832 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.426121628000004, 2024-04-26T11:45:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.226571784000001, 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.226540064999995, 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.226498496000005, 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.226371358999998, 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.399601679, 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.399501090999998, 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.399432398999998, 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.399328781000001, 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.399204931, 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.399172792000002, 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.399142699000002, 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.399112299999999, 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:21.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:21.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.919 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.399081643999999, 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.399039774999999, 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.399006356000001, 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.398857939000003, 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.398738844999997, 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.398632800999998, 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:21.955 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:21.957 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:21.955+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:21.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:22.058 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:22.054+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:22.076 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:22.076 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:22.086 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:22.137 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:45:22.159 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:22.155+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:22.195 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:22.195 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:22.195 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:22.195 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:22.195 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:22.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:22.260 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:22.258+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:22.310 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 70.130554641000003, 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:22.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 70.129383969000003, 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:22.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.319 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 70.128384811999993, 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:22.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:22.323 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 70.126793078000006, 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:22.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.899575025000004, 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:22.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:22.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.332 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:22.333 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:22.333 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.897707816999997, 2024-04-26T11:45:22.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:22.333 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.333 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.333 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:22.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.895975414999995, 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:22.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:22.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:22.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:22.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:22.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:22.341 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.341 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.341 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.892167455999996, 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:22.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:22.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:22.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:22.346 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.346 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.346 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.346 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:22.346 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:22.346 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.891650863999999, 2024-04-26T11:45:22.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:22.346 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:22.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:22.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:22.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:22.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.679392567999997, 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:22.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.878403372000001, 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:22.360 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.878265634000002, 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:22.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:22.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.878136484999999, 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:22.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:22.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:22.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:22.371 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.878045096999998, 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:22.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:22.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.877760774999999, 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:22.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.877657296999999, 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:22.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:22.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:22.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.877606948, 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.877568123000003, 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:22.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.877503521999998, 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:22.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:22.399 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.87003876, 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:22.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:22.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:22.403 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:22.404 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:22.405 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:22.403+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:22.406 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:22.506 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:22.503+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:22.517 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:22.517 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:22.517 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:22.518 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:22.527 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:22.543 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:22.569 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:22.570 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:22.570 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:22.570 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:22.572 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:22.572 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:22.607 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:22.603+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:22.637 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:22.638 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:22.648 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:22.708 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:22.703+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:22.749 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:22.750 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:22.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:22.809 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:22.806+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:22.877 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:22.878 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:22.887 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:22.910 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:22.907+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:22.996 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:22.996 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:23.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:23.011 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:23.010+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:23.112 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:23.110+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:23.115 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:23.115 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:23.125 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:23.213 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:23.210+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:23.242 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:23.243 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:23.253 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:23.313 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:23.314+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:23.363 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:23.363 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:23.373 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:23.414 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:23.410+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:23.481 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:23.482 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:23.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:23.536 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:23.534+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:23.607 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:23.607 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:23.616 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:23.611+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:23.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:23.717 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:23.714+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:23.730 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:23.731 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:23.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:23.818 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:23.815+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:23.893 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:23.893 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:23.903 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:23.950 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:23.947+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:24.020 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:24.018+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:24.022 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:24.022 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:24.032 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:24.121 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:24.119+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:24.143 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:24.144 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:24.150 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:45:24.153 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:24.222 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:24.219+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:24.306 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:24.306 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:24.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:24.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~30s 2024-04-26T11:45:24.363 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:24.362+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:24.423 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:24.422+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:24.434 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:24.434 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:24.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:24.524 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:24.522+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:24.548 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:24.548 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:24.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:24.574 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:24.625 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:24.622+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:24.706 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:24.707 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:24.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:24.730 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:24.753 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:24.756 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:24.757 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:24.762 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:24.759+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:24.827 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:24.822+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:24.832 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:24.833 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:24.833 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:24.833 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:24.843 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:24.928 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:24.923+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:24.953 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:24.953 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:24.953 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:24.953 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:24.953 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:24.963 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:25.029 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:25.023+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:25.068 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:25.068 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:25.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:25.068 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:25.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.068 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.662966566999998, 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:25.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.662896075000006, 2024-04-26T11:45:25.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.463346231000003, 2024-04-26T11:45:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.463314511999997, 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.463272943000007, 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.463145806, 2024-04-26T11:45:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.636376126000002, 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.636275538, 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.636206846, 2024-04-26T11:45:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.636103228000003, 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.635979378000002, 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.635947239000004, 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.635917145999997, 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.635886747000001, 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.635856091000001, 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.635814222, 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.635780803000003, 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.635632385999997, 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.635513291999999, 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:25.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.635407248, 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:25.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:25.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:25.198 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:25.201 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:45:25.201 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:25.199+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:25.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:25.301 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:25.298+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:25.317 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:25.318 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:25.318 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:25.318 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:25.328 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:25.402 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:25.399+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:25.431 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:25.431 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:25.431 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:25.431 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:25.431 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:25.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:25.503 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:25.503+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:25.549 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:25.549 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:25.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:25.549 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:25.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.549 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:25.549 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:25.549 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.368812125000005, 2024-04-26T11:45:25.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:25.549 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.549 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:25.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:25.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:25.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:25.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.367641453000005, 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.554 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.558 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.366642295999995, 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:25.562 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.365050561999993, 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:25.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:25.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:25.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:25.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.567 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.137832509000006, 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:25.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:25.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.572 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.572 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:25.572 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.135965300999999, 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:25.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:25.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:25.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:25.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:25.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.134232898999997, 2024-04-26T11:45:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.130424939999997, 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:25.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:25.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.129908348000001, 2024-04-26T11:45:25.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:25.587 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.587 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.587 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:25.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.917650051999999, 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:25.591 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.116660855999996, 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:25.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:25.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.116523118000003, 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:25.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:25.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:25.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:25.606 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.116393969000001, 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:25.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:25.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:25.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:25.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:25.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:25.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:25.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.116302580999999, 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:25.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:25.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.617 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.116018259000001, 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:25.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:25.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:25.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:25.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:25.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:25.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.115914781000001, 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:25.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:25.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:25.629 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.115864431999995, 2024-04-26T11:45:25.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:25.630 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.630 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.630 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:25.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.115825607000005, 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:25.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.639 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.115761006, 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.108296244000002, 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:25.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:25.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:25.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:25.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:25.647 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.647 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.647 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.647 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:25.647 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:25.647 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:25.649 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:25.649 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:25.647+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:25.750 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:25.750+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:25.760 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:25.761 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:25.761 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:25.761 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:25.770 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:25.850 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:25.847+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:25.878 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:25.879 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:25.879 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:25.879 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:25.879 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:25.888 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:25.953 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:25.947+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:25.995 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:25.995 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:25.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:25.995 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:25.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.995 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.591229915, 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:25.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:25.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:25.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.591159422999993, 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.001 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:26.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:26.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.391609579000004, 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.007 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:26.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.012 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.391577859999998, 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:26.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:26.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.391536290999994, 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:26.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.391409154000002, 2024-04-26T11:45:26.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:26.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:26.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:26.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.564639474000003, 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:26.030 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:26.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:26.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.564538885999994, 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:26.036 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:26.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:26.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:26.042 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.564470193999995, 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:26.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.048 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.564366575999998, 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:26.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:26.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.564242726000003, 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:26.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:26.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:26.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.564210587000005, 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.061 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:26.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:26.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:26.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.067 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.564180493999999, 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:26.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:26.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.073 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.564150095000002, 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:26.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:26.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:26.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.079 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.564119438999995, 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:26.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.564077569999995, 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:26.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.564044151000004, 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:26.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:26.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:26.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.563895733999999, 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:26.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:26.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.56377664, 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:26.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:26.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.109 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.563670595999994, 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:26.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:26.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:26.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:26.115 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:26.116 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:26.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:26.118 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:26.114+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:26.218 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:26.215+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:26.234 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:26.234 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:26.234 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:26.234 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:26.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:26.319 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:26.315+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:26.351 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:26.352 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:26.352 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:26.352 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:26.352 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:26.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:26.419 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:26.418+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:26.472 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 74.291964640000003, 2024-04-26T11:45:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 74.290793968000003, 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 74.289794810999993, 2024-04-26T11:45:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 74.288203077000006, 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 74.060985024000004, 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 74.059117815999997, 2024-04-26T11:45:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 74.057385413999995, 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 74.053577454999996, 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 74.053060862999999, 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.840802566999997, 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.039813370999994, 2024-04-26T11:45:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.039675633000002, 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.525 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.039546483999999, 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.039455095999998, 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.039170773999999, 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.039067295999999, 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.039016946999993, 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.038978122000003, 2024-04-26T11:45:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.038913520999998, 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 65.031448759, 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:26.565 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:26.567 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:26.568 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:26.566+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:26.668 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:26.666+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:26.683 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:26.684 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:26.684 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:26.684 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:26.694 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:26.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:26.769 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:26.766+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:26.804 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:26.804 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:26.804 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:26.804 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:26.804 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:26.814 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:26.869 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:26.866+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:26.894 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:26.920 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:26.920 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:26.920 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:26.920 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:26.922 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:26.923 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:26.929 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:26.929 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:26.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:26.983 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:26.982+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:27.054 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:27.055 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:27.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:27.072 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:27.070+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:27.172 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:27.173 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:27.173 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:27.170+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:27.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:27.202 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:45:27.274 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:27.271+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:27.290 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:27.290 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:27.300 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:27.375 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:27.371+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:27.415 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:27.416 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:27.426 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:27.475 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:27.471+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:27.532 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:27.532 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:27.542 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:27.586 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:27.583+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:27.678 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:27.675+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:27.694 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:27.694 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:27.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:27.779 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:27.774+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:27.823 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:27.823 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:27.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:27.880 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:27.875+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:27.942 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:27.943 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:27.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:27.981 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:27.978+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:28.057 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:28.057 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:28.067 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:28.114 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:28.111+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:28.157 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:45:28.183 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:28.179+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:28.184 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:28.184 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:28.195 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:28.284 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:28.279+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:28.301 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:28.301 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:28.310 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:28.384 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:28.379+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:28.416 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:28.416 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:28.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:28.485 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:28.483+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:28.544 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:28.544 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:28.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:28.603 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:28.602+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:28.664 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:28.664 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:28.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:28.687 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:28.683+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:28.781 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:28.781 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:28.788 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:28.786+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:28.791 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:28.888 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:28.886+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:28.907 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:28.907 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:28.917 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:28.923 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:28.989 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:28.986+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:29.021 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:29.022 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:29.031 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:29.082 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:29.090 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:29.087+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:29.117 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:29.121 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:29.121 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:29.142 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:29.142 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:29.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:29.142 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:29.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.142 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:29.142 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 76.736176839999999, 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:29.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:29.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 76.736106348000007, 2024-04-26T11:45:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 76.536556504000004, 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 76.536524784999997, 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 76.536483215999993, 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 76.536356079000001, 2024-04-26T11:45:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.709586399000003, 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.709485810999993, 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.709417118999994, 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.709313500999997, 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.709189651000003, 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.709157512000004, 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.709127418999998, 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.709097020000002, 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.709066363999995, 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.709024494999994, 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.708991076000004, 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.708842658999998, 2024-04-26T11:45:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.708723565, 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:29.248 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:29.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 67.708617520999994, 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:29.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:29.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:29.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.260 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:29.260 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:29.260 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:29.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:29.262 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:29.262+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:29.362 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:29.358+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:29.377 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:29.377 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:29.377 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:29.377 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:29.387 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:29.463 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:29.462+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:29.491 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:29.491 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:29.491 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:29.491 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:29.491 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:29.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:29.564 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:29.559+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:29.656 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:29.656 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:29.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:29.656 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:29.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.656 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:29.656 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:29.656 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.475900925999994, 2024-04-26T11:45:29.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:29.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:29.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.660 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.474730253999994, 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:29.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.664 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.473731096999998, 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:29.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:29.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.472139362999997, 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:29.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:29.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.244921309999995, 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:29.673 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:29.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:29.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.677 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:29.678 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:29.678 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.243054102000002, 2024-04-26T11:45:29.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:29.678 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.678 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.678 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:29.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:29.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:29.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:29.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:29.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.2413217, 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:29.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:29.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.237513741000001, 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:29.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:29.691 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.236997149000004, 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:29.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:29.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.024738853000002, 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:29.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.223749656999999, 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:29.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:29.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:29.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.223611919000007, 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:29.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:29.710 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.223482770000004, 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:29.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:29.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:29.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.223391382000003, 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.720 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.223107060000004, 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:29.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:29.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:29.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:29.725 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.223003582000004, 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.222953232999998, 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:29.731 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.736 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.222914407999994, 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:29.740 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.222849807000003, 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:29.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:29.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.215385045000005, 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:29.744 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:29.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.748 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:29.748 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:29.748 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:29.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:29.750 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:29.750+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:29.850 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:29.850+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:29.866 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:29.866 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:29.866 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:29.866 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:29.876 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:29.951 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:29.947+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:29.983 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:29.984 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:29.984 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:29.984 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:29.984 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:29.993 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:30.052 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:30.050+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:30.102 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:30.102 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:30.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:30.102 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.698573898999996, 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:30.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:30.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:30.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:30.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:30.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:30.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.108 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.109 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:30.109 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:30.109 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.698503407000004, 2024-04-26T11:45:30.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:30.109 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.109 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.109 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:30.109 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:30.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:30.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:30.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:30.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:30.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:30.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:30.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.498953563000001, 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:30.115 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:30.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:30.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.120 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.498921843999995, 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.121 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:30.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:30.126 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.498880275000005, 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:30.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:30.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.498753137999998, 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.132 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:30.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.137 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671983458, 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:30.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:30.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:30.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:30.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:30.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:30.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:30.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:30.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671882870000005, 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:30.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:30.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671814178000005, 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:30.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.156 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671710559999994, 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:30.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:30.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:30.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.67158671, 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:30.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:30.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:30.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671554571000001, 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:30.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:30.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:30.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671524477999995, 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:30.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:30.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:30.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:30.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671494078999999, 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:30.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:30.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671463423000006, 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.187 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:30.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671421554000005, 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:30.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:30.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:30.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671388135000001, 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:30.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:30.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:30.204 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671239717999995, 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:30.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671120623999997, 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:30.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:30.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:30.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.671014580000005, 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:30.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:30.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.222 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.223 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:30.223 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:30.223 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:30.223 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:45:30.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-26T11:45:30.225 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:30.223+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:30.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:30.325 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:30.322+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:30.342 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:30.342 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:30.342 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:30.342 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:30.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:30.426 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:30.422+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:30.456 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:30.456 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:30.456 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:30.456 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:30.456 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:30.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:30.527 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:30.522+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:30.575 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:30.575 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:30.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:30.575 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:30.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.575 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:30.575 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 78.396552069999998, 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:30.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.579 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 78.395381397999998, 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:30.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 78.394382241000002, 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:30.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 78.392790507000001, 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:30.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:30.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:30.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:30.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:30.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:30.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:30.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:30.593 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.593 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 78.165572453999999, 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:30.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:30.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:30.598 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 78.163705246000006, 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:30.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 78.161972844000005, 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:30.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 78.158164885000005, 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.607 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:30.611 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 78.157648292999994, 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:30.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.615 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.945389997000007, 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:30.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.144400801000003, 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.625 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.144263062999997, 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:30.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.144133913999994, 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.631 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:30.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:30.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:30.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:30.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:30.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.144042526000007, 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:30.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:30.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:30.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:30.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:30.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:30.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.143758203999994, 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:30.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.649 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.143654725999994, 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:30.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:30.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:30.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:30.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.655 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.143604377000003, 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:30.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:30.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:30.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.661 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.661 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.661 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:30.661 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.143565551999998, 2024-04-26T11:45:30.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:30.662 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.662 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:30.662 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:30.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:30.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:30.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.143500950999993, 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.669 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 69.136036188999995, 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:30.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:30.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:30.673 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:30.675 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:30.675 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:30.674+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:30.776 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:30.771+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:30.794 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:30.794 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:30.794 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:30.804 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:30.876 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:30.874+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:30.955 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:31.029 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:31.029 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:31.030 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:31.030 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:31.031 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:31.030+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:31.032 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:31.123 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:31.134 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:31.130+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:31.155 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:31.155 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.747799674000007, 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:31.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:31.157 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:31.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.157 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:31.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:31.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:31.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:31.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:31.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:31.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:31.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:31.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.163 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:31.163 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:31.163 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.747729182, 2024-04-26T11:45:31.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:31.163 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.163 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.163 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:31.163 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:31.163 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:31.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:31.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:31.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:31.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:31.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:31.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:31.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.548179337999997, 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:31.170 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:31.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:31.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:31.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:31.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:31.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.176 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.548147619000005, 2024-04-26T11:45:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:31.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.183 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.548106050000001, 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:31.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:31.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.547978912999994, 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.190 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:31.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:31.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.721209232999996, 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:31.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:31.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:31.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:31.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:31.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:31.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:31.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:31.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:31.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.721108645000001, 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:31.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:31.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:31.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.210 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.210 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.210 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:31.210 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.721039953000002, 2024-04-26T11:45:31.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:31.210 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.210 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:31.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:31.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.720936335000005, 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.217 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:31.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:31.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.720812484999996, 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:31.224 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:31.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:31.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:31.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:31.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:31.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:31.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:31.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.720780345999998, 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.231 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:31.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:31.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:31.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.720750253000006, 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.238 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:31.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:31.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:31.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:31.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:31.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.720719853999995, 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.245 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:31.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:31.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:31.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.720689198000002, 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.252 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:31.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:31.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:31.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:31.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:31.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:31.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:31.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:31.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.720647329000002, 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.259 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:31.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:31.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:31.265 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.720613909999997, 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:31.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:31.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:31.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:31.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:31.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.273 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.273 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.273 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:31.273 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.720465493000006, 2024-04-26T11:45:31.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:31.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:31.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.720346398999993, 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.280 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:31.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:31.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:31.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:31.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:31.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:31.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:31.286 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.720240355000001, 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:31.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:31.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:31.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:31.293 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:31.295 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:45:31.296 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:31.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:31.297 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:31.294+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:31.297 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:31.297 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:31.297 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:31.297 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:31.300 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:31.300 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:31.396 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:31.394+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:31.416 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:31.416 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:31.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:31.497 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:31.494+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:31.535 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:31.535 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:31.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:31.598 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:31.595+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:31.652 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:31.652 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:31.662 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:31.699 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:31.694+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:31.781 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:31.782 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:31.792 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:31.800 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:31.798+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:31.896 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:31.897 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:31.901 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:31.899+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:31.906 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:32.002 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:31.999+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:32.013 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:32.013 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:32.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:32.104 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:32.102+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:32.137 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:32.137 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:32.147 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:32.205 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:32.202+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:32.256 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:32.256 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:32.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:32.307 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:32.306+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:32.407 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:32.403+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:32.419 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:32.419 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:32.429 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:32.509 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:32.506+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:32.546 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:32.546 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:32.557 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:32.610 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:32.607+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:32.663 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:32.664 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:32.673 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:32.711 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:32.707+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:32.778 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:32.778 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:32.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:32.830 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:32.827+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:32.908 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:32.908 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:32.913 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:32.911+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:32.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:33.015 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:33.015+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:33.026 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:33.026 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:33.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:33.116 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:33.115+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:33.140 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:33.150 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:33.217 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:33.211+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:33.265 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:33.266 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:33.276 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:33.296 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:45:33.301 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:33.318 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:33.313+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:33.386 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:33.386 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:33.395 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:33.419 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:33.417+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:33.453 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:33.488 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:33.488 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:33.488 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:33.488 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:33.490 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:33.491 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:33.509 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:33.509 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:33.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:33.509 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:33.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.509 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:33.509 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:33.509 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.103087575000004, 2024-04-26T11:45:33.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:33.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:33.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:33.515 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.103017082999997, 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:33.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.903467238999994, 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.521 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:33.522 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:33.522 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:33.522 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:33.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.522 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:33.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:33.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:33.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:33.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:33.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:33.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:33.527 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.903435520000002, 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:33.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:33.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:33.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:33.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.534 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.903393950999998, 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:33.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:33.540 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.903266814000006, 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:33.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:33.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:33.546 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.076497133999993, 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:33.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:33.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.552 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.076396545999998, 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:33.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:33.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:33.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:33.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:33.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:33.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:33.559 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.559 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.559 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.559 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.559 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:33.559 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.076327853999999, 2024-04-26T11:45:33.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:33.559 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.559 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:33.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:33.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:33.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:33.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:33.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:33.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.566 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.566 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:33.566 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.076224236000002, 2024-04-26T11:45:33.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:33.566 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.566 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:33.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:33.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.076100385999993, 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:33.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:33.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.076068246999995, 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:33.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:33.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:33.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.076038154000003, 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:33.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:33.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.076007755000006, 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:33.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:33.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:33.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:33.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:33.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:33.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.075977098999999, 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:33.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:33.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:33.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:33.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:33.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:33.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:33.606 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.606 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.606 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.606 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.606 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:33.606 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.075935229999999, 2024-04-26T11:45:33.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:33.607 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.607 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.607 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:33.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:33.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.075901810999994, 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:33.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:33.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:33.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:33.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:33.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:33.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.620 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.075753394000003, 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:33.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:33.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:33.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:33.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:33.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:33.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.075634300000004, 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:33.627 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:33.633 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 72.075528255999998, 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:33.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:33.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:33.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:33.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:33.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:33.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:33.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:33.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:33.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:33.640 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.640 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.640 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.640 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:33.640 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:33.640 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:33.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:33.642 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:33.641+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:33.743 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:33.739+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:33.755 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:33.755 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:33.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:33.844 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:33.841+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:33.874 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:33.874 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:33.875 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:33.875 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:33.875 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:33.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:33.945 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:33.943+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:33.996 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:33.996 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:33.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:33.996 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:33.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:33.996 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:33.996 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:33.996 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.815812108000003, 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:33.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:33.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:33.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.814641436000002, 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.001 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:34.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.813642279000007, 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:34.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.812050545000005, 2024-04-26T11:45:34.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:34.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.584832492000004, 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:34.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:34.019 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.582965283999997, 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:34.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:34.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:34.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:34.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:34.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:34.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:34.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:34.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:34.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:34.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.581232881999995, 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.025 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:34.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:34.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:34.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.577424922999995, 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:34.034 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.576908330999998, 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.364650034999997, 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:34.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.563660838999994, 2024-04-26T11:45:34.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:34.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:34.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.563523101000001, 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.049 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:34.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:34.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.563393951999998, 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:34.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:34.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.060 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.563302563999997, 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:34.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.563018241999998, 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.562914763999999, 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:34.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.077 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.562864415000007, 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:34.082 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.562825590000003, 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:34.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:34.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:34.087 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.087 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.087 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.087 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.087 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:34.087 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.562760988999997, 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:34.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.091 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.555296226999999, 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:34.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:34.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:34.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.095 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.096 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.096 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.096 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.096 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:34.097 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:34.098 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:34.095+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:34.198 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:34.195+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:34.216 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:34.216 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:34.226 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:34.300 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:34.297+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:34.333 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:34.333 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:34.343 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:34.401 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:34.399+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:34.456 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.050799194000007, 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:34.457 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:34.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:34.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:34.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:34.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:34.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:34.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:34.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:34.464 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.464 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.464 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.050728702000001, 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:34.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:34.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:34.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:34.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:34.470 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.470 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.470 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.470 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.851178857999997, 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:34.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:34.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.851147139000005, 2024-04-26T11:45:34.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:34.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:34.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.851105570000001, 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:34.482 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:34.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:34.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:34.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:34.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:34.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.850978432999995, 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:34.488 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.024208752999996, 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.024108165000001, 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:34.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.024039473000002, 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.023935855000005, 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.023812004999996, 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:34.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.023779865999998, 2024-04-26T11:45:34.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:34.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:34.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.023749773000006, 2024-04-26T11:45:34.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:34.532 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.532 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.532 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:34.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:34.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:34.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:34.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.023719373999995, 2024-04-26T11:45:34.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:34.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:34.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:34.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:34.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:34.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:34.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:34.545 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.023688718000002, 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.023646849000002, 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:34.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:34.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:34.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:34.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.023613429999997, 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:34.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.023465013000006, 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:34.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.023345918999993, 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.572 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:34.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:34.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:34.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.023239875000002, 2024-04-26T11:45:34.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:34.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:34.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:34.585 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:34.587 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:45:34.587 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:34.583+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:34.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:34.687 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:34.687+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:34.699 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:34.699 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:34.699 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:34.700 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:34.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:34.788 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:34.785+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:34.813 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:34.813 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:34.813 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:34.813 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:34.813 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:34.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:34.890 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:34.887+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:34.930 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:34.930 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:34.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:34.930 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:34.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.930 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:34.930 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:34.930 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.751179496000006, 2024-04-26T11:45:34.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:34.930 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:34.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.750008824000005, 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.939 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.749009666999996, 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:34.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.747417932999994, 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:34.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:34.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:34.948 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.520199880000007, 2024-04-26T11:45:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:34.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.518332672, 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:34.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:34.957 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.958 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.958 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:34.958 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:34.958 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.516600269999998, 2024-04-26T11:45:34.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:34.958 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.958 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:34.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:34.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.512792310999998, 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:34.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:34.967 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.967 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.967 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.967 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:34.967 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:34.967 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.512275719000002, 2024-04-26T11:45:34.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:34.967 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.969 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.969 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:34.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:34.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:34.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:34.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.300017423, 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:34.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:34.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:34.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:34.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:34.977 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.977 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.499028226999997, 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:34.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:34.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:34.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:34.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:34.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:34.984 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.498890489000004, 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:34.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:34.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.498761340000001, 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:34.990 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:34.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:34.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.995 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.498669952, 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:34.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:34.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:34.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:35.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.498385630000001, 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:35.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:35.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:35.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:35.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.498282152000002, 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.007 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:35.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:35.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.013 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.013 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:35.013 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.498231802999996, 2024-04-26T11:45:35.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:35.013 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:35.013 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.013 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:35.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:35.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:35.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:35.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:35.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:35.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:35.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:35.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.498192978000006, 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:35.019 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:35.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:35.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.498128377, 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:35.023 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:35.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:35.027 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 73.490663615000003, 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:35.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:35.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:35.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:35.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:35.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:35.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:35.031 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.031 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:35.031 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.031 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:35.031 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:35.031 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:35.033 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:35.033 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:35.029+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:35.134 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:35.129+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:35.146 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:35.146 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:35.146 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:35.146 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:35.156 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:35.235 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:35.233+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:35.261 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:35.261 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:35.261 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:35.261 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:35.261 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:35.270 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:35.336 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:35.333+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:35.383 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.977811688000003, 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.977741195999997, 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.778191351999993, 2024-04-26T11:45:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.778159633000001, 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.778118063999997, 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.777990927000005, 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.951221247000007, 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.951120658999997, 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.425 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:35.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:35.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:35.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:35.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.431 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.951051966999998, 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:35.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:35.437 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.950948349000001, 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:35.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:35.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.443 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.950824499000007, 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:35.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:35.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.950792359999994, 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:35.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:35.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.950762267000002, 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:35.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:35.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.461 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.950731868000005, 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:35.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:35.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:35.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:35.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.950701211999998, 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:35.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:35.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.950659342999998, 2024-04-26T11:45:35.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:35.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:35.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.950625923999993, 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:35.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:35.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:35.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.486 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.950477507000002, 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:35.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:35.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:35.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:35.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:35.492 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.950358413000004, 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:35.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:35.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.950252368999998, 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:35.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:35.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:35.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:35.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:35.505 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:35.505 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:35.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:35.507 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:35.505+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:35.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:35.607 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:35.605+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:35.622 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:35.623 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:35.623 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:35.623 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:35.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:35.635 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:35.657 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:35.658 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:35.659 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:35.660 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:35.709 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:35.705+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:35.739 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:35.740 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:35.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:35.810 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:35.805+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:35.857 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:35.857 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:35.868 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:35.911 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:35.909+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:35.983 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:35.984 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:35.994 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:36.012 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:36.007+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:36.103 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:36.103 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:36.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-26T11:45:36.113 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:36.109+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:36.114 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:36.214 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:36.213+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:36.222 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:36.222 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:36.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:36.319 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:36.313+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:36.351 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:36.352 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:36.363 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:36.418 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:36.415+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:36.477 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:36.477 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:36.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:36.521 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:36.519+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:36.588 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:45:36.620 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:36.617+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:36.646 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:36.647 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:36.654 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:36.720 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:36.717+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:36.770 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:36.770 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:36.780 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:36.821 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:36.817+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:36.889 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:36.889 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:36.898 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:36.922 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:36.921+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:37.004 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:37.004 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:37.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:37.059 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:37.057+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:37.123 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:37.119+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:37.129 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:37.129 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:37.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:37.224 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:37.221+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:37.248 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:37.248 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:37.258 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:37.326 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:37.323+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:37.407 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:37.407 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:37.417 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:37.427 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:37.421+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:37.507 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:45:37.530 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:37.525+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:37.536 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:37.536 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:37.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:37.629 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:37.625+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:37.649 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:37.649 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:37.659 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:37.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:37.730 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:37.729+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:37.764 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:37.764 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:37.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:37.804 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:37.828 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:37.828 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:37.828 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:37.828 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:37.830 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:37.831 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:37.831 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:37.829+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:37.890 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:37.890 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:37.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:37.932 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:37.929+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:38.005 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:38.006 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:38.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:38.059 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:38.057+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:38.122 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.941916560999999, 2024-04-26T11:45:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.940745888999999, 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.939746732000003, 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.938154998000002, 2024-04-26T11:45:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.710936945, 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.709069736999993, 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.707337335000005, 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.703529376000006, 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.703012783999995, 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.490754487999993, 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.689765292000004, 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.689627553999998, 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.689498404999995, 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.689407016999994, 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.689122694999995, 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:38.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.689019216999995, 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:38.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.688968868000003, 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.688930042999999, 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.688865441999994, 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.681400679999996, 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:38.213 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:38.214 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:38.215 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:38.211+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:38.315 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:38.313+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:38.328 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:38.329 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:38.343 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:38.416 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:38.413+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:38.449 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:38.449 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:38.449 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:38.449 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:38.450 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:38.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:38.518 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:38.513+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:38.564 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.160046043999998, 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.159975552000006, 2024-04-26T11:45:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.960425708000002, 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.960393988999996, 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.960352420000007, 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.960225283, 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.133455603000002, 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.133355015000006, 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.133286322999993, 2024-04-26T11:45:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.133182704999996, 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.133058855000002, 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.133026716000003, 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.635 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:38.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:38.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:38.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.132996622999997, 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:38.641 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.642 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.642 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:38.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:38.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:38.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:38.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.132966224, 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:38.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:38.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:38.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.132935567999994, 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:38.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:38.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:38.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.660 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.660 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:38.660 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.132893698999993, 2024-04-26T11:45:38.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:38.660 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.660 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.660 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:38.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:38.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:38.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:38.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:38.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:38.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:38.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:38.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:38.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:38.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.666 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.132860280000003, 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:38.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:38.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:38.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.672 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.132711862999997, 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:38.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:38.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:38.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:38.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.132592768999999, 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:38.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.684 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.132486725000007, 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:38.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:38.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:38.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:38.690 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:38.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:38.693 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:38.689+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:38.793 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:38.789+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:38.808 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:38.808 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:38.808 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:38.808 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:38.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:38.894 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:38.889+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:38.925 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:38.925 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:38.925 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:38.925 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:38.925 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:38.935 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:38.994 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:38.989+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:39.094 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:39.094 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.914430976000006, 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:39.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.913260304000005, 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:39.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:39.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:39.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:39.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.912261146999995, 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.910669412999994, 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.108 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:39.112 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.683451360000007, 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.116 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.681584151999999, 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:39.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.679851749999997, 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:39.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:39.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.676043790999998, 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:39.125 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:39.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.675527199000001, 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.463268902999999, 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:39.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:39.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:39.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.138 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.662279706999996, 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:39.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:39.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.662141969000004, 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:39.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:39.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:39.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.662012820000001, 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:39.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.661921432, 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:39.154 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.661637110000001, 2024-04-26T11:45:39.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:39.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:39.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.164 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.661533632000001, 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.661483282999995, 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:39.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:39.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:39.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.661444458000005, 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.178 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.661379857, 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:39.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 77.653915095000002, 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:39.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:39.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:39.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:39.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.186 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:39.186 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:39.186 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:39.187 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:39.188 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:39.187+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:39.289 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:39.285+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:39.303 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:39.304 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:39.304 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:39.304 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:39.315 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:39.390 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:39.385+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:39.420 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:39.421 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:39.430 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:39.492 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:39.489+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:39.518 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:45:39.543 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:39.543 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:39.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:39.543 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:39.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.543 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:39.543 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:39.543 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 87.136863622000007, 2024-04-26T11:45:39.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:39.543 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.543 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:39.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:39.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:39.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 87.136793130000001, 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:39.549 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:39.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:39.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:39.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:39.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:39.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:39.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.937243285999998, 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:39.555 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:39.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:39.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:39.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.937211567000006, 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:39.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:39.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:39.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:39.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.937169998000002, 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:39.567 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:39.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.937042860999995, 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:39.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:39.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:39.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:39.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:39.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:39.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:39.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.110273180999997, 2024-04-26T11:45:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:39.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:39.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:39.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.110172593000001, 2024-04-26T11:45:39.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:39.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:39.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:39.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:39.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:39.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:39.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:39.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.592 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.110103901000002, 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:39.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:39.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:39.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:39.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:39.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:39.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:39.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:39.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:39.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:39.598 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.110000283000005, 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.604 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.109876432999997, 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.109844293999998, 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:39.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:39.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:39.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:39.617 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.617 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.617 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.617 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.617 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:39.617 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.109814201000006, 2024-04-26T11:45:39.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.623 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.109783801999995, 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:39.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:39.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:39.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.629 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.109753146000003, 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:39.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:39.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:39.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:39.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:39.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.109711277000002, 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:39.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:39.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:39.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.109677857999998, 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:39.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.109529441000006, 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.109410346999994, 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:39.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.109304303000002, 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:39.661 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:39.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:39.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:39.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:39.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:39.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:39.667 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.667 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.667 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.667 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:39.667 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:39.667 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:39.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:39.669 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:39.665+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:39.769 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:39.765+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:39.788 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:39.788 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:39.788 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:39.788 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:39.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:39.832 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:39.871 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:39.865+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:39.874 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:45:39.904 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:39.904 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:39.904 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:39.904 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:39.904 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:39.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:39.965 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:39.972 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:39.969+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:39.999 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:40.000 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:40.000 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:40.000 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:40.002 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:40.003 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:40.067 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:40.067 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:40.072 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:40.069+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:40.075 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:40.173 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:40.171+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:40.188 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:40.188 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:40.198 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:40.274 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:40.273+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:40.304 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:40.304 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:40.315 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:40.375 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:40.373+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:40.421 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:40.421 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:40.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:40.476 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:40.471+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:40.549 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:40.549 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:40.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:40.578 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:40.575+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:40.668 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:40.668 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:40.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:40.680 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:40.675+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:40.782 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:40.779+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:40.784 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:40.784 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:40.793 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:40.884 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:40.881+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:40.913 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:40.913 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:40.924 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:40.985 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:40.979+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:41.031 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:41.031 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:41.042 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:41.086 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:41.081+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:41.148 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:41.148 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:41.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:41.207 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:41.205+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:41.274 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:41.274 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:41.284 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:41.288 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:41.287+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:41.389 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:41.385+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:41.394 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:41.394 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:41.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:41.490 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:41.485+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:41.513 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:41.514 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:41.523 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:41.591 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:41.587+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:41.642 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:41.642 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:41.652 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:41.692 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:41.689+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:41.793 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:41.793+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:41.802 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:41.802 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:41.812 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:41.887 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:45:41.894 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:41.893+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:41.918 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-04-26T11:45:41.918 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:41.918 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:41.928 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:41.995 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:41.993+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:42.004 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:42.046 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:42.046 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:42.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:42.096 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:42.091+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:42.163 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:42.163 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:42.166 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:42.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:42.196 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:42.195+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:42.200 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:42.200 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:42.202 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:42.203 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:42.276 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:42.276 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:42.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:42.276 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:42.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.276 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:42.276 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.097325042999998, 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:42.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:42.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:42.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:42.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:42.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.096154370999997, 2024-04-26T11:45:42.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.285 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.095155214000002, 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.09356348, 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:42.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:42.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:42.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:42.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:42.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.294 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 89.866345426999999, 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:42.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:42.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 89.864478219000006, 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.299 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:42.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:42.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:42.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:42.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:42.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 89.862745817000004, 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:42.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 89.858937858000004, 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.308 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.312 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 89.858421265999993, 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 89.646162970000006, 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:42.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 80.845173774000003, 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:42.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:42.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:42.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.326 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 80.845036035999996, 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:42.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:42.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 80.844906886999993, 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:42.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 80.844815499000006, 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.337 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 80.844531176999993, 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:42.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:42.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 80.844427698999993, 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:42.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:42.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:42.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:42.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:42.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:42.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:42.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:42.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 80.844377350000002, 2024-04-26T11:45:42.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:42.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:42.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:42.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:42.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:42.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:42.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:42.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:42.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:42.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 80.844338524999998, 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.362 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:42.363 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:42.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:42.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:42.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:42.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:42.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:42.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:42.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:42.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:42.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:42.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 80.844273924000007, 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:42.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 80.836809161999994, 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:42.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:42.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:42.375 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:42.375 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:42.376 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:42.377 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:42.373+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:42.477 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:42.475+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:42.491 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:42.491 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:42.491 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:42.491 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:42.501 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:42.578 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:42.575+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:42.605 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:42.605 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:42.615 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:42.679 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:42.677+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:42.767 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:42.767 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:42.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:42.767 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:42.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.767 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:42.767 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:42.767 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.362934800999994, 2024-04-26T11:45:42.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:42.767 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:42.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:42.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:42.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:42.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:42.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:42.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:42.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:42.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:42.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:42.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:42.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:42.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:42.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:42.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:42.774 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.774 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.774 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.362864309000003, 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:42.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:42.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.163314464999999, 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:42.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:42.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:42.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:42.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:42.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.163282745999993, 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:42.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:42.793 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.163241177000003, 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:42.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:42.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.163114039999996, 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:42.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:42.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:42.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:42.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.805 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.336344359999998, 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:42.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:42.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:42.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:42.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:42.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:42.811 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.336243772000003, 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:42.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:42.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.336175080000004, 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:42.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.336071462000007, 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:42.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:42.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.335947611999998, 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:42.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:42.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:42.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:42.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:42.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:42.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.335915473, 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.836 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:42.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:42.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:42.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:42.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.843 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.844 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.844 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:42.844 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.335885379999993, 2024-04-26T11:45:42.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:42.844 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.844 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.844 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.335854980999997, 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.335824325000004, 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.335782456000004, 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.335749036999999, 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.335600619999994, 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.335481525999995, 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.335375482000003, 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:42.892 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:42.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:42.894 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:42.893+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:42.994 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:42.989+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:43.010 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:43.010 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:43.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:43.051 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:45:43.094 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:43.089+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:43.130 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:43.130 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:43.131 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:43.131 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:43.131 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:43.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:43.196 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:43.193+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:43.249 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:43.249 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:43.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:43.249 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:43.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.249 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:43.250 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:43.250 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 91.069104809999999, 2024-04-26T11:45:43.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:43.250 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.250 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.250 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:43.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:43.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:43.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:43.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:43.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:43.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:43.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:43.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:43.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:43.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:43.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:43.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:43.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:43.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:43.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:43.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:43.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.257 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.258 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:43.258 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:43.258 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 91.067934137999998, 2024-04-26T11:45:43.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:43.258 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.259 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.259 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:43.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:43.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:43.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:43.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:43.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:43.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:43.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:43.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:43.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:43.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:43.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:43.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 91.066934981000003, 2024-04-26T11:45:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:43.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 91.065343247000001, 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:43.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:43.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:43.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:43.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.277 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.277 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:43.277 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.838125194, 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:43.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:43.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:43.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:43.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:43.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:43.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.836257986000007, 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:43.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.834525584000005, 2024-04-26T11:45:43.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:43.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:43.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.830717625000005, 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:43.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.830201032999994, 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:43.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.617942737000007, 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:43.300 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.816953541000004, 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.816815802999997, 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.310 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:43.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:43.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:43.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.816686653999994, 2024-04-26T11:45:43.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:43.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.816595265999993, 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.816310943999994, 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.816207465999994, 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.816157117000003, 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:43.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.816118291999999, 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:43.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.816053690999993, 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:43.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:43.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 81.808588928999995, 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:43.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:43.355 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:43.356 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:43.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:43.358 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:43.355+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:43.458 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:43.453+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:43.473 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:43.473 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:43.473 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:43.473 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:43.484 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:43.559 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:43.555+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:43.594 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:43.594 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:43.604 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:43.659 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:43.657+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:43.711 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.305806125000004, 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:43.712 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:43.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:43.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:43.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:43.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:43.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:43.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:43.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:43.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:43.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:43.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:43.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:43.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:43.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:43.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:43.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:43.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:43.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.720 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:43.720 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:43.720 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.305735632999998, 2024-04-26T11:45:43.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:43.720 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.720 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.720 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:43.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.725 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.106185788999994, 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:43.726 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:43.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:43.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:43.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:43.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:43.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:43.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:43.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:43.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:43.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:43.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:43.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:43.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:43.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:43.733 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.106154070000002, 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:43.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:43.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:43.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:43.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:43.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:43.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:43.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:43.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:43.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:43.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:43.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:43.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:43.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:43.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:43.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.741 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.741 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:43.742 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:43.742 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.106112500999998, 2024-04-26T11:45:43.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:43.742 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.742 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.742 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:43.742 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:43.743 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:43.743 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:43.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.743 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:43.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:43.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:43.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:43.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:43.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:43.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:43.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:43.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:43.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:43.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:43.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:43.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:43.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:43.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:43.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:43.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:43.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:43.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:43.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:43.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:43.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:43.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:43.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:43.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.753 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.754 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.754 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:43.754 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:43.754 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.105985364000006, 2024-04-26T11:45:43.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:43.755 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.755 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.755 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:43.755 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:43.755 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:43.755 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:43.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.756 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:43.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:43.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:43.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:43.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:43.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:43.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:43.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:43.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:43.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:43.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:43.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:43.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:43.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:43.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:43.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:43.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.279215683999993, 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.765 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:43.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:43.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:43.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:43.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:43.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:43.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:43.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:43.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.771 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.279115095999998, 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:43.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:43.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:43.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:43.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:43.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:43.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:43.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:43.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:43.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:43.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:43.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:43.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:43.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:43.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:43.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:43.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:43.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:43.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:43.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:43.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:43.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:43.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.783 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.783 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.783 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:43.783 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.279046403999999, 2024-04-26T11:45:43.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:43.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:43.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.789 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.278942786000002, 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:43.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.795 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.278818935999993, 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:43.801 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.278786796999995, 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:43.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:43.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:43.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:43.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:43.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.807 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.278756704000003, 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:43.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:43.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:43.813 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.278726305000006, 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:43.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:43.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.278695648999999, 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.278653779999999, 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.278620360999994, 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.837 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.278471944000003, 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:43.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:43.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:43.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.278352850000005, 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:43.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:43.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:43.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:43.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.278246805999999, 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.855 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.856 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.856 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:43.856 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:43.856 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:43.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:43.858 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:43.857+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:43.958 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:43.955+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:43.976 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:43.976 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:43.976 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:43.976 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:43.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:44.059 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:44.055+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:44.097 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:44.097 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:44.097 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:44.097 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:44.097 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:44.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:44.160 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:44.157+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:44.204 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:44.221 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:44.221 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:44.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 92.041231233000005, 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:44.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 92.040060561000004, 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.226 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:44.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:44.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.230 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 92.039061403999995, 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:44.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:44.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:44.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:44.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:44.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:44.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:44.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:44.235 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.235 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.235 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 92.037469669999993, 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 91.810251617000006, 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.240 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:44.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 91.808384408999999, 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 91.806652006999997, 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 91.802844047999997, 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 91.802327456, 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 91.590069159999999, 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.789079963999995, 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.788942226000003, 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.788813077, 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.788721688999999, 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.788437367, 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.788333889, 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.788283539999995, 2024-04-26T11:45:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.788244715000005, 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.788180113999999, 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 82.780715352000001, 2024-04-26T11:45:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:44.318 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:44.320 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:44.320 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:44.317+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:44.335 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:44.356 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:44.356 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:44.357 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:44.357 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:44.358 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:44.359 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:44.420 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:44.417+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:44.433 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:44.433 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:44.443 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:44.522 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:44.519+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:44.545 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:44.545 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:44.555 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:44.623 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:44.619+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:44.664 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:44.664 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:44.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:44.727 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:44.721+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:44.789 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:44.789 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:44.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:44.825 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:44.823+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:44.904 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:44.904 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:44.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:44.959 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:44.957+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:45.019 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:45.020 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:45.026 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:45.021+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:45.030 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:45.064 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:45:45.127 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:45.123+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:45.145 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:45.146 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:45.156 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:45.229 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:45.225+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:45.265 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:45.266 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:45.275 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:45.329 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:45.327+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:45.381 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:45.381 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:45.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:45.434 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:45.431+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:45.509 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:45.509 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:45.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:45.532 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:45.531+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:45.623 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:45.623 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:45.634 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:45.635 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:45.629+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:45.734 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:45.729+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:45.743 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:45.743 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:45.750 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:45.837 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:45.833+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:45.866 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:45.866 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:45.876 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:45.937 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:45.937+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:45.985 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:45.985 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:45.996 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:46.039 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:46.035+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:46.067 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:45:46.104 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:46.104 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:46.114 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:46.158 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:46.155+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:46.229 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:46.229 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:46.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:46.244 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:46.243+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:46.346 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:46.343+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:46.352 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:46.352 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:46.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:46.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:46.446 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:46.443+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:46.465 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:46.465 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:46.475 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:46.483 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:46.508 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:46.508 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:46.509 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:46.509 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:46.511 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:46.511 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:46.548 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:46.542+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:46.593 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:46.594 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:46.604 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:46.649 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:46.642+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:46.708 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:46.708 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:46.708 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:46.708 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:46.708 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:46.718 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:46.750 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:46.749+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:46.850 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:46.849+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:46.874 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:46.874 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:46.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:46.874 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:46.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.874 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:46.874 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:46.874 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.468214603999996, 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:46.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.468144112000004, 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:46.880 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:46.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.268594268000001, 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:46.886 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:46.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:46.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.268562548999995, 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:46.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.268520980000005, 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:46.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.268393842999998, 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:46.903 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:46.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:46.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.441624163, 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:46.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:46.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:46.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:46.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:46.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:46.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.441523575000005, 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.915 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.441454883000006, 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.921 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:46.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:46.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:46.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:46.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:46.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:46.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:46.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.441351264999994, 2024-04-26T11:45:46.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:46.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.441227415, 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.933 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:46.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:46.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:46.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:46.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:46.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:46.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:46.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.940 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.441195276000002, 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:46.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.441165182999995, 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:46.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:46.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.441134783999999, 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.953 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:46.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.441104128000006, 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:46.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:46.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:46.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:46.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:46.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:46.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:46.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:46.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.966 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.441062259000006, 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:46.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:46.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.441028840000001, 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:46.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:46.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:46.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.978 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.440880422999996, 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:46.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:46.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:46.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.440761328999997, 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.985 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:46.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.440655285000005, 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:46.991 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:46.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:46.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:46.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:46.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:46.997 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:46.998 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:46.999 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:46.994+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:47.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:47.100 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:47.097+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:47.117 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:47.117 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:47.117 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:47.117 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:47.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:47.201 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:47.194+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:47.237 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:47.237 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:47.237 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:47.237 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:47.237 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:47.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:47.302 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:47.297+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:47.363 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:47.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:47.363 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:47.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.183243959999999, 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:47.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:47.367 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.182073287999998, 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:47.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:47.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:47.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:47.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:47.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:47.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:47.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:47.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:47.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.373 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.373 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:47.373 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:47.373 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.181074131000003, 2024-04-26T11:45:47.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:47.373 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.373 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.374 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:47.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:47.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:47.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:47.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.179482397000001, 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.952264344, 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.950397136000007, 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:47.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:47.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:47.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.948664734000005, 2024-04-26T11:45:47.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:47.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.944856775000005, 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.398 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.944340182999994, 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:47.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.732081887000007, 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:47.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:47.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:47.407 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.931092691000003, 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:47.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.930954952999997, 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.417 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.930825803999994, 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:47.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:47.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.930734416000007, 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:47.423 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:47.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.930450093999994, 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:47.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.930346615999994, 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:47.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:47.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.930296267000003, 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:47.439 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.930257441999998, 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:47.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:47.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.448 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.930192840999993, 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:47.452 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 85.922728078999995, 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:47.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:47.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:47.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:47.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:47.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.456 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:47.456 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:47.456 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:47.458 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:47.458 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:47.457+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:47.559 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:47.554+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:47.573 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:47.573 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:47.573 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:47.573 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:47.583 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:47.660 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:47.657+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:47.692 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:47.692 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:47.692 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:47.692 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:47.692 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:47.702 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:47.762 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:47.758+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:47.812 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:47.812 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:47.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:47.812 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.406443998, 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.813 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:47.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:47.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:47.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:47.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:47.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:47.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:47.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:47.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:47.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:47.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:47.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:47.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:47.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:47.823 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.406373505999994, 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:47.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:47.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:47.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:47.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:47.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:47.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:47.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:47.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:47.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.206823662000005, 2024-04-26T11:45:47.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:47.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:47.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.836 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.206791942999999, 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:47.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:47.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:47.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:47.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:47.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:47.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:47.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:47.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:47.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:47.842 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.843 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.843 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.843 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:47.845 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:47.845 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.206750373999995, 2024-04-26T11:45:47.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:47.845 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.845 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.845 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:47.845 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:47.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:47.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:47.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:47.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:47.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:47.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:47.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.206623237000002, 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:47.852 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:47.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:47.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:47.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:47.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:47.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:47.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:47.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379853557000004, 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.865 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379752968999995, 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:47.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:47.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379684276999996, 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:47.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:47.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:47.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:47.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:47.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:47.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:47.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:47.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:47.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:47.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.878 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379580658999998, 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:47.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:47.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:47.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:47.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:47.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:47.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:47.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379456809000004, 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:47.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:47.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:47.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:47.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:47.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.891 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.891 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.891 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:47.891 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379424670000006, 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:47.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:47.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:47.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:47.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:47.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:47.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:47.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379394576999999, 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:47.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:47.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379364178000003, 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379333521999996, 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:47.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:47.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:47.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:47.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:47.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379291652999996, 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.916 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:47.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:47.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:47.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.922 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.922 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.922 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379258234000005, 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:47.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:47.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.928 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.379109817, 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:47.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:47.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:47.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:47.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:47.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:47.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:47.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:47.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:47.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:47.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:47.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.378990723000001, 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.935 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:47.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.378884678999995, 2024-04-26T11:45:47.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:47.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:47.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:47.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:47.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:47.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:47.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.947 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:47.947 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:47.947 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:47.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-04-26T11:45:47.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:47.950 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:47.945+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:48.049 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:48.042+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:48.063 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:48.064 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:48.064 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:48.064 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:48.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:48.079 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:45:48.150 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:48.146+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:48.179 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:48.179 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:48.179 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:48.179 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:48.179 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:48.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:48.252 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:48.250+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:48.294 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:48.294 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:48.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:48.294 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:48.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 96.114048749000006, 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:48.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 96.112878077000005, 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:48.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:48.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:48.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:48.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 96.111878919999995, 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:48.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:48.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:48.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 96.110287185999994, 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:48.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:48.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.883069133000006, 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.312 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.313 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:48.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.316 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.881201924999999, 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:48.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.879469522999997, 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:48.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.875661563999998, 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:48.325 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:48.329 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.875144972000001, 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:48.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.333 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.662886675999999, 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.337 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.861897479999996, 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.861759742000004, 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:48.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:48.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:48.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:48.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:48.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:48.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:48.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:48.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.349 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.861630593000001, 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:48.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.861539205, 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:48.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:48.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.360 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.861254883000001, 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:48.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:48.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:48.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:48.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.861151405000001, 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.366 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:48.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.861101055999995, 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:48.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.861062231000005, 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:48.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.380 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.86099763, 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:48.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:48.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:48.385 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:48.385 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 86.853532868000002, 2024-04-26T11:45:48.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:48.385 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:48.385 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:48.385 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:48.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:48.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:48.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:48.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:48.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:48.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:48.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:48.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:48.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:48.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:48.391 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.391 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.391 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.391 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:48.391 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:48.391 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:48.392 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:48.390+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:48.393 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:48.495 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:48.493+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:48.511 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:48.511 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:48.511 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:48.511 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:48.512 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:48.521 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:48.596 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:48.590+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:48.631 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:48.631 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:48.631 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:48.631 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:48.631 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:48.640 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:48.641 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:48.674 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:48.675 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:48.675 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:48.675 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:48.677 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:48.677 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:48.696 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:48.693+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:48.749 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:48.749 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:48.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:48.797 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:48.794+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:48.876 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:48.876 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:48.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:48.899 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:48.894+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:48.992 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:48.993 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:48.999 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:48.994+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:49.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:49.077 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:45:49.100 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:49.097+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:49.110 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:49.110 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:49.120 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:49.202 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:49.194+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:49.233 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:49.234 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:49.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:49.301 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:49.298+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:49.356 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:49.356 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:49.367 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:49.418 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:49.414+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:49.485 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:49.485 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:49.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:49.503 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:49.498+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:49.604 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:49.601+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:49.613 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:49.614 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:49.624 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:49.705 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:49.701+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:49.730 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:49.731 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:49.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:49.806 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:49.801+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:49.894 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:49.894 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:49.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:49.907 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:49.905+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:50.008 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:50.002+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:50.020 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:50.020 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:50.030 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:50.109 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:50.105+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:50.133 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:50.133 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:50.143 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:50.210 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:50.206+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:50.244 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:50.244 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:50.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:50.311 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:50.305+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:50.372 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:50.372 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:50.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:50.411 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:50.410+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:50.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:50.512 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:50.506+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:50.609 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:50.609 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:50.613 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:50.609+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:50.619 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:50.679 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:50.714 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:50.713+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:50.736 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:50.736 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:50.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:50.809 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:50.815 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:50.810+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:50.833 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:50.833 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:50.833 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:50.833 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:50.835 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:50.836 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:50.852 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:50.853 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:50.853 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:50.853 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:50.853 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:50.862 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:50.916 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:50.910+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:50.965 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 98.561142090000004, 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 98.561071597999998, 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 98.361521753999995, 2024-04-26T11:45:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 98.361490035000003, 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:50.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:50.988 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 98.361448465999999, 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.989 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:50.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:50.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:50.994 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 98.361321329000006, 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:50.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:50.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:50.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:50.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.000 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.534551648999994, 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.006 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.534451060999999, 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:51.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:51.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:51.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:51.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:51.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:51.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.534382368999999, 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.013 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:51.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.534278751000002, 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.019 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:51.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:51.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.025 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.534154900999994, 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:51.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:51.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:51.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.534122761999996, 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:51.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:51.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:51.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.534092669000003, 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.534062270000007, 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.534031614, 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.533989745, 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:51.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:51.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.533956325999995, 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:51.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.533807909000004, 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:51.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:51.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.533688815000005, 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.075 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:51.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:51.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.533582770999999, 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.081 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:51.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:51.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.087 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.088 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:51.088 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:45:51.090 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:51.089+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:51.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:51.190 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:51.186+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:51.204 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:51.204 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:51.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:51.291 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:51.289+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:51.319 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:51.319 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:51.319 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:51.319 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:51.320 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:51.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:51.392 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:51.390+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:51.442 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:51.442 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:51.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:51.442 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:51.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.443 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:51.443 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:51.443 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.261974906999995, 2024-04-26T11:45:51.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:51.443 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.443 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.443 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:51.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:51.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:51.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:51.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:51.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:51.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:51.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:51.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:51.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.448 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.448 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:51.448 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:51.448 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.260804234999995, 2024-04-26T11:45:51.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:51.449 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.449 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.449 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:51.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:51.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:51.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:51.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.453 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.259805077999999, 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:51.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:51.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:51.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:51.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.458 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.459 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:51.459 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:51.459 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.258213343999998, 2024-04-26T11:45:51.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:51.459 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.459 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.459 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:51.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:51.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:51.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:51.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:51.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:51.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:51.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.464 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.464 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:51.464 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:51.464 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.030995290999996, 2024-04-26T11:45:51.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:51.464 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.464 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:51.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:51.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:51.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:51.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:51.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:51.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:51.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:51.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:51.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:51.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:51.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:51.469 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.469 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.469 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.029128083000003, 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:51.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:51.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:51.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:51.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:51.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:51.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:51.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.027395681000002, 2024-04-26T11:45:51.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:51.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:51.481 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:51.481 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.023587722000002, 2024-04-26T11:45:51.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:51.481 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.481 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.481 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:51.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:51.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:51.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:51.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.485 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.486 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.486 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:51.486 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:51.486 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.023071130000005, 2024-04-26T11:45:51.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:51.486 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.486 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.486 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:51.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:51.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:51.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:51.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:51.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:51.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:51.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 98.810812834000004, 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:51.491 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:51.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:51.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:51.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:51.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:51.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:51.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:51.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:51.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.009823638, 2024-04-26T11:45:51.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:51.497 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.497 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.497 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:51.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:51.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:51.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:51.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:51.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:51.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:51.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:51.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:51.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:51.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:51.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:51.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:51.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:51.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:51.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:51.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:51.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:51.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:51.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:51.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:51.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:51.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:51.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:51.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:51.503 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.009685899999994, 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:51.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:51.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:51.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:51.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:51.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:51.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:51.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:51.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:51.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:51.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:51.509 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.509 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.009556751000005, 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:51.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:51.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:51.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:51.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:51.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:51.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:51.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:51.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:51.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:51.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:51.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:51.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:51.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:51.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:51.516 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.009465363000004, 2024-04-26T11:45:51.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:51.517 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.517 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.517 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:51.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:51.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:51.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:51.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.009181041000005, 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:51.523 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:51.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:51.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:51.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:51.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:51.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:51.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:51.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:51.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.529 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.529 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.530 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:51.530 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.009077563000005, 2024-04-26T11:45:51.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:51.530 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.530 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.530 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:51.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:51.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.009027214, 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:51.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.542 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.542 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.542 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.542 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:51.542 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.008988388999995, 2024-04-26T11:45:51.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:51.542 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.542 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:51.542 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:51.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.008923788000004, 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:51.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:51.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:51.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:51.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:51.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:51.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:51.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:51.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:51.551 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.551 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.551 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.551 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:51.551 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.001459026000006, 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:51.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:51.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:51.555 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:51.557 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:51.558 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:51.554+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:51.658 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:51.654+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:51.673 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:51.673 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:51.674 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:51.683 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:51.759 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:51.757+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:51.796 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:51.797 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:51.797 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:51.797 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:51.797 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:51.806 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:51.860 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:51.854+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:51.916 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:51.916 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:51.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.510478832999993, 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.917 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:51.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:51.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:51.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:51.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:51.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:51.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.923 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.510408341000002, 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.924 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:51.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.929 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.310858496999998, 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.935 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.310826778000006, 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:51.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:51.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:51.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.310785209000002, 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:51.941 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.942 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.942 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:51.942 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:51.942 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:51.942 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:51.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.942 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:51.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:51.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:51.947 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.310658071999995, 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:51.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:51.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.953 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483888391999997, 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:51.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:51.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:51.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:51.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:51.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483787804000002, 2024-04-26T11:45:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483719112000003, 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:51.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:51.970 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483615494000006, 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:51.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:51.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.976 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483491643999997, 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:51.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.982 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483459504999999, 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:51.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:51.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.988 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483429412000007, 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:51.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:51.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:51.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483399012999996, 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:51.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:51.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:51.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:51.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:51.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:51.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:51.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:51.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:51.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:51.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:52.001 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483368357000003, 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:52.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:52.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:52.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.007 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483326488000003, 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:52.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:52.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:52.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483293068999998, 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:52.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:52.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:52.019 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.020 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.020 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.020 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.020 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:52.020 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483144651999993, 2024-04-26T11:45:52.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:52.020 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.020 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.020 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:52.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:52.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:52.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.483025557999994, 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:52.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:52.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.482919514000002, 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:52.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:52.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:52.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.037 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.038 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.038 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:52.039 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:52.038+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:52.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:52.087 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:45:52.140 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:52.137+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:52.160 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:52.160 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:52.160 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:52.160 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:52.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:52.241 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:52.238+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:52.281 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:52.281 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:52.281 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:52.281 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:52.281 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:52.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:52.343 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:52.337+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:52.402 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:52.402 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:52.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:52.402 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 100.222254729, 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:52.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:52.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:52.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:52.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 100.221084057, 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:52.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:52.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:52.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:52.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 100.2200849, 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:52.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:52.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:52.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:52.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:52.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:52.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:52.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:52.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:52.417 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 100.218493166, 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:52.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.991275113, 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:52.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:52.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.989407904999993, 2024-04-26T11:45:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.987675503000006, 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:52.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.983867544000006, 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.983350951999995, 2024-04-26T11:45:52.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:52.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:52.443 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.771092655999993, 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:52.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.970103460000004, 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:52.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:52.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:52.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:52.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:52.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:52.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.969965721999998, 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:52.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:52.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:52.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.969836572999995, 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.969745184999994, 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.464 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:52.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:52.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:52.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.969460862999995, 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:52.469 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:52.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:52.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.969357384999995, 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.475 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:52.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:52.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:52.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:52.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:52.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:52.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:52.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:52.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:52.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.969307036000004, 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:52.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:52.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:52.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:52.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:52.486 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.969268210999999, 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.969203609999994, 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.494 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 90.961738847999996, 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:52.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:52.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:52.497 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.498 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:52.498 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:52.498 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:52.499 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:52.500 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:52.494+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:52.600 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:52.597+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:52.618 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:52.618 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:52.618 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:52.618 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:52.628 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:52.701 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:52.698+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:52.732 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:52.732 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:52.732 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:52.732 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:52.732 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:52.742 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:52.803 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:52.801+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:52.837 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:52.895 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:52.895 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.491769917, 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:52.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:52.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.901 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.49169942499999, 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:52.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:52.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:52.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:52.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:52.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:52.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:52.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:52.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:52.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:52.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:52.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:52.907 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.292149581, 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:52.908 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:52.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.292117862, 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:52.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:52.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:52.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:52.919 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.29207629299999, 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:52.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:52.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.291949156, 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:52.925 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:52.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.465179476000003, 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:52.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:52.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:52.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.465078887999994, 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.937 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:52.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.465010195999994, 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.943 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:52.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:52.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.464906577999997, 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:52.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:52.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.464782728000003, 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:52.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:52.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:52.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:52.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:52.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:52.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:52.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:52.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:52.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:52.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.961 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.464750589000005, 2024-04-26T11:45:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.968 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.968 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.968 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:52.970 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.464720495999998, 2024-04-26T11:45:52.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:52.970 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.970 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.970 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:52.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:52.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:52.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:52.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:52.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:52.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:52.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.464690097000002, 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:52.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:52.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:52.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.464659440999995, 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:52.985 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:52.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:52.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:52.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.991 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.464617571999995, 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:52.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:52.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:52.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:52.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.464584153000004, 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:52.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:53.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:53.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:53.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:53.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:53.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:53.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:53.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:53.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:53.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:53.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:53.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:53.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:53.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:53.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:53.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.464435735999999, 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:53.004 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:53.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:53.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:53.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:53.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:53.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:53.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.010 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.464316642, 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:53.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:53.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:53.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.464210597999994, 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:53.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:53.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:53.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:53.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:53.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:53.023 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:53.023 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:53.024 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:53.024 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:53.018+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:53.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:53.036 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:53.036 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:53.036 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:53.036 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:53.041 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:53.041 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:53.125 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:53.118+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:53.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:53.226 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:53.221+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:53.260 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:53.260 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:53.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:53.326 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:53.321+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:53.382 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:53.382 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:53.393 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:53.435 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:53.433+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:53.512 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:53.512 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:53.522 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:53.528 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:53.525+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:53.629 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:53.629 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:53.629 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:53.622+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:53.639 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:53.731 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:53.725+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:53.742 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:53.742 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:53.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:53.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2024-04-26T11:45:53.832 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:53.826+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:53.869 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:53.869 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:53.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:53.933 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:53.929+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:53.991 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:53.991 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:54.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:54.035 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:54.029+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:54.098 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:45:54.113 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:54.113 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:54.123 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:54.136 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:54.133+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:54.237 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:54.230+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:54.238 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:54.239 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:54.250 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:54.340 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:54.333+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:54.401 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:54.401 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:54.411 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:54.439 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:54.434+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:54.516 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:54.516 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:54.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:54.576 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:54.573+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:54.641 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:54.642 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:54.642 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:54.637+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:54.652 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:54.742 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:54.742+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:54.757 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:54.757 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:54.767 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:54.843 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:54.841+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:54.871 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:54.871 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:54.881 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:54.944 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:54.941+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:54.996 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:54.996 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:55.006 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:55.042 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:55.044 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:55.041+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:55.115 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:55.116 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:55.125 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:45:55.145 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:55.141+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:55.187 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:55.220 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:55.220 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:55.220 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:55.220 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:55.223 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:55.224 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 102.832933363, 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 102.832862871, 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 102.633313027, 2024-04-26T11:45:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 102.63328130799999, 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 102.633239739, 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 102.633112602, 2024-04-26T11:45:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.806342921999999, 2024-04-26T11:45:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.806242334000004, 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.806173642000005, 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.806070023999993, 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.805946173999999, 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.805914035000001, 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.805883941999994, 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.805853542999998, 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.805822887000005, 2024-04-26T11:45:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:55.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:55.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:55.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:55.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:55.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:55.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:55.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:55.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:55.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:55.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:55.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:55.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:55.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:55.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.805781018000005, 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:55.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.805747599, 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:55.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:55.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:55.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:55.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:55.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:55.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:55.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.362 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.362 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:55.362 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.805599181999995, 2024-04-26T11:45:55.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:55.363 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:55.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:55.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:55.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:55.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:55.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:55.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:55.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.370 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.371 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:55.371 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.805480087999996, 2024-04-26T11:45:55.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:55.371 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.371 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.371 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:55.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:55.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:55.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:55.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:55.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.805374044000004, 2024-04-26T11:45:55.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:55.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:55.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:55.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:55.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:55.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:55.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:55.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:55.384 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.384 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.384 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.384 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:55.384 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:55.384 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:55.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:55.388 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:55.381+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:55.486 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:55.486+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:55.504 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:55.504 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:55.504 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:55.504 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:55.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:55.587 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:55.585+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:55.623 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:55.623 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:55.623 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:55.623 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:55.623 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:55.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:55.688 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:55.686+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:55.741 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.561522799, 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:55.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:55.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.560352127, 2024-04-26T11:45:55.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.55935297000001, 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.754 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.557761236, 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.330543183, 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.759 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:55.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:55.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:55.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:55.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:55.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:55.764 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.764 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.764 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.765 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:55.765 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:55.765 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.328675975, 2024-04-26T11:45:55.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:55.765 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.765 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.765 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:55.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:55.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:55.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:55.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:55.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:55.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.770 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.770 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:55.770 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:55.770 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.32694357299999, 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:55.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:55.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:55.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:55.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:55.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:55.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:55.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:55.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:55.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.32313561399999, 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:55.776 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:55.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:55.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:55.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:55.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:55.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:55.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:55.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:55.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:55.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:55.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:55.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:55.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:55.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:55.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:55.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.784 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.785 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:55.785 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:55.785 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.322619022, 2024-04-26T11:45:55.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:55.785 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.785 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:55.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:55.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:55.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:55.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:55.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:55.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:55.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:55.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:55.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:55.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:55.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:55.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:55.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.110360726, 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.794 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:55.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.309371530000007, 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:55.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:55.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:55.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.309233792000001, 2024-04-26T11:45:55.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:55.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:55.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:55.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:55.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:55.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:55.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:55.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.309104642999998, 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:55.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.309013254999996, 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:55.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:55.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:55.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.308728932999998, 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:55.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:55.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:55.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:55.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:55.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.308625454999998, 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:55.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.832 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.308575106000006, 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:55.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:55.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:55.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:55.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.308536281000002, 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:55.838 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:55.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.308471679999997, 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:55.842 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:55.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:55.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:55.846 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 94.301006917999999, 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:55.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:55.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:55.850 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.850 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.850 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.850 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:55.850 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:55.850 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:55.851 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:55.852 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:55.850+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:55.952 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:55.946+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:55.966 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:55.967 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:55.977 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:56.053 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:56.050+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:56.080 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:56.080 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:56.090 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:56.156 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:56.153+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:56.248 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:56.248 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:56.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:56.248 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:56.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.249 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:56.249 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:56.249 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.841726681, 2024-04-26T11:45:56.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:56.249 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.249 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.250 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:56.250 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:56.250 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:56.250 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:56.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.251 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:56.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:56.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:56.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:56.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:56.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.84165618900001, 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:56.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:56.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:56.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:56.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:56.265 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.642106345, 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:56.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:56.267 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:56.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.267 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:56.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:56.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:56.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:56.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:56.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:56.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:56.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:56.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:56.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:56.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:56.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:56.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:56.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:56.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.642074626, 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:56.273 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:56.274 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:56.274 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:56.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.274 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:56.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:56.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:56.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:56.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:56.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:56.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:56.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:56.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:56.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:56.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:56.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:56.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.281 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.64203305700001, 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.282 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:56.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:56.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:56.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:56.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.64190592, 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:56.287 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.292 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.815136240000001, 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:56.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:56.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:56.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.815035652000006, 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:56.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:56.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:56.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:56.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:56.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:56.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:56.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814966960000007, 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:56.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:56.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:56.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:56.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:56.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.314 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814863341999995, 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:56.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814739492000001, 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:56.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:56.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.326 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814707353000003, 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814677259999996, 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:56.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:56.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:56.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814646861, 2024-04-26T11:45:56.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:56.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814616204999993, 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.344 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814574336000007, 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:56.350 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:56.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:56.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814540917000002, 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:56.356 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:56.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:56.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:56.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:56.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:56.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.362 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814392499999997, 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:56.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:56.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:56.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:56.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814273405999998, 2024-04-26T11:45:56.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:56.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:56.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.814167362000006, 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:56.374 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:56.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:56.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:56.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:56.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:56.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:56.380 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.380 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.380 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.380 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:56.380 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:56.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:56.382 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:56.377+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:56.483 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:56.477+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:56.501 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:56.501 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:56.501 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:56.501 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:56.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:56.583 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:56.578+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:56.620 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:56.620 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:56.620 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:56.620 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:56.620 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:56.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:56.684 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:56.681+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:56.738 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:56.738 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:56.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:56.738 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:56.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.738 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:56.738 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:56.738 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 104.557368567, 2024-04-26T11:45:56.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:56.738 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.738 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:56.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:56.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:56.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:56.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:56.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 104.556197895, 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 104.555198738, 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.747 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:56.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:45:56.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:45:56.751 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 104.553607004, 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:45:56.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:45:56.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:45:56.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:45:56.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:45:56.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 104.326388951, 2024-04-26T11:45:56.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:45:56.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:45:56.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:45:56.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:45:56.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:45:56.762 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.762 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.763 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:45:56.763 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:56.763 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 104.32452174300001, 2024-04-26T11:45:56.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:45:56.763 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.763 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.764 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:56.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:45:56.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:45:56.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 104.322789341, 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:45:56.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:45:56.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:45:56.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:45:56.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.772 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.773 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:45:56.773 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:56.773 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 104.318981382, 2024-04-26T11:45:56.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:45:56.773 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:45:56.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:45:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:45:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:45:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:45:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 104.31846478999999, 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:45:56.782 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 104.10620649400001, 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:45:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:45:56.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.305217298000002, 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:45:56.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:56.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.305079559999996, 2024-04-26T11:45:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:45:56.793 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.793 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.793 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:56.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:45:56.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:45:56.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:45:56.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:45:56.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:45:56.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:45:56.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:45:56.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.304950410999993, 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:45:56.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:45:56.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:56.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.304859023000006, 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:45:56.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:45:56.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:45:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.304574701000007, 2024-04-26T11:45:56.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:45:56.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:45:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.814 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.304471222999993, 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:45:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:45:56.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.304420874000002, 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:45:56.820 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:45:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.304382048999997, 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:45:56.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.304317448000006, 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 95.296852685999994, 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:56.834 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:45:56.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:45:56.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:56.837 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:56.838 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:56.839 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:56.839 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:56.837+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:56.940 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:56.937+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:56.954 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:56.954 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:56.955 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:45:56.955 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:56.964 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:57.041 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:57.034+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:57.069 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:45:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:45:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:45:57.070 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:57.079 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:57.142 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:57.138+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:57.149 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:45:57.187 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:45:57.187 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.783637704, 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:57.188 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:45:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:45:57.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:45:57.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:45:57.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:45:57.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:45:57.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.78356721199999, 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.194 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:45:57.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:45:57.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.584017368, 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:57.200 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:45:57.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:57.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:45:57.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:45:57.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:45:57.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:45:57.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:45:57.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:45:57.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:45:57.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.583985649, 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:57.207 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:45:57.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:45:57.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.212 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.58394407999999, 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:45:57.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:45:57.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.583816943, 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:45:57.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:45:57.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:57.224 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.757047263000004, 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:45:57.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:45:57.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.230 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756946674999995, 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:45:57.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756877982999995, 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:45:57.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:45:57.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:45:57.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756774364999998, 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:45:57.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:45:57.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756650515000004, 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:45:57.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:45:57.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:45:57.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756618376000006, 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:45:57.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:45:57.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.260 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756588282999999, 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:57.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.266 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756557884000003, 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:57.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:45:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:45:57.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:45:57.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756527227999996, 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:45:57.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:45:57.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756485358999996, 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.279 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:57.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:45:57.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:45:57.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756451940000005, 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:45:57.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:45:57.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:45:57.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:45:57.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756303523, 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:57.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:45:57.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:45:57.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:45:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756184429000001, 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:45:57.297 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:45:57.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:45:57.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:45:57.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:45:57.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.756078384999995, 2024-04-26T11:45:57.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:45:57.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:45:57.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:45:57.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:45:57.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:45:57.309 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:45:57.310 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:45:57.310 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:45:57.312 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:57.310+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:57.312 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:57.412 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:57.409+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:57.428 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:57.428 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:57.428 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:57.428 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:57.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:57.444 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:57.468 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:57.469 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:57.469 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:57.469 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:57.471 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:57.471 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:57.513 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:57.506+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:57.591 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:57.591 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:57.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:57.613 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:57.610+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:57.708 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:57.708 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:57.714 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:57.714+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:57.717 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:57.815 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:57.810+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:57.834 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:57.834 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:57.845 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:57.916 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:57.917+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:57.950 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:57.950 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:57.962 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:58.018 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:58.014+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:58.069 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:58.070 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:58.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:58.119 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:58.114+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:58.156 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:45:58.198 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:58.198 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:58.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:58.219 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:58.217+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:58.314 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:58.314 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:58.320 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:58.317+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:58.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:58.426 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:58.417+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:58.429 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:58.429 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:58.439 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:58.522 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:58.518+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:58.558 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:58.558 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:58.568 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:58.623 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:58.621+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:58.676 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:58.677 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:58.686 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:58.724 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:58.721+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:58.794 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:58.794 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:58.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:58.825 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:58.818+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:58.923 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:58.923 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:58.927 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:58.925+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:58.933 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:59.029 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:59.026+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:59.044 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:59.044 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:59.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:59.130 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:59.125+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:59.159 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:59.159 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:59.171 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:45:59.231 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:59.226+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:59.286 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:59.287 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:59.297 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:45:59.332 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:59.326+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:59.403 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:59.404 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:59.413 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:45:59.458 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:59.454+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:59.472 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:45:59.534 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:59.533+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:59.569 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:45:59.569 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:45:59.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:45:59.616 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:45:59.636 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:59.633+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:59.639 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:45:59.639 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:45:59.639 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:45:59.639 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:45:59.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2024-04-26T11:45:59.643 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:45:59.644 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:45:59.699 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:59.699 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:59.699 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:45:59.699 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:59.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:45:59.751 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:59.749+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:59.838 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:45:59.838+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:45:59.859 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:59.859 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:45:59.859 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:45:59.860 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:45:59.860 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:45:59.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:45:59.939 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:45:59.937+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:45:59.953 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '7d2137f0a666c92a9411c1af5c33e4968be54da6'. 2024-04-26T11:45:59.953 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-26T11:45:59.953 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T11:45:59.953 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T11:45:59.953 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T11:45:59.953 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-26T11:45:59.954 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 7d2137f0a66 Merge pull request #57086 from zdover23/wip-doc-2024-04-25-backport-57057-to-reef 2024-04-26T11:45:59.959 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.802918577, 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:59.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:45:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:45:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:45:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:45:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:45:59.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:59.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:45:59.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:45:59.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:59.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:45:59.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:45:59.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:45:59.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:45:59.993 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:59.993 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:45:59.993 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.801747905, 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:59.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:59.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:45:59.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:45:59.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:45:59.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:45:59.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:45:59.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:45:59.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:45:59.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:45:59.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:45:59.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:45:59.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:45:59.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:45:59.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:45:59.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:45:59.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:45:59.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:45:59.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:45:59.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:45:59.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:45:59.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:45:59.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:45:59.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:45:59.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:45:59.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:45:59.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:45:59.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:46:00.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:46:00.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:46:00.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.000 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.800748748, 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:00.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:00.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:46:00.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:00.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:46:00.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:46:00.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:46:00.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:46:00.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:46:00.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:46:00.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:46:00.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:46:00.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:46:00.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:46:00.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.008 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.009 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:46:00.009 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:00.009 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.799157014, 2024-04-26T11:46:00.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:46:00.009 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.009 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.009 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:00.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:00.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:46:00.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:00.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:46:00.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:46:00.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:46:00.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:46:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:46:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:46:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:46:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.571938961, 2024-04-26T11:46:00.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:00.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:46:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:46:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:46:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:46:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:46:00.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:46:00.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:46:00.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:46:00.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:46:00.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:46:00.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:46:00.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:46:00.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.019 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.57007175299999, 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:00.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:46:00.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:46:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:46:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:46:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:46:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:46:00.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:46:00.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:46:00.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:46:00.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:46:00.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:46:00.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.025 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.026 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.026 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:46:00.026 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.56833935100001, 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:00.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:46:00.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:46:00.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:46:00.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:46:00.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:00.031 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.56453139200001, 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.035 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.5640148, 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.35175650399999, 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.040 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:00.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:46:00.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:46:00.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:46:00.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:46:00.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:46:00.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 98.550767308000005, 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:00.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:00.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:00.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:00.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:00.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:00.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:00.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:00.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:00.050 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.050 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.050 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.051 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.051 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:00.051 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 98.550629569999998, 2024-04-26T11:46:00.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:00.051 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.051 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.051 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 98.550500420999995, 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:00.056 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.057 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.057 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:00.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:00.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 98.550409032999994, 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:00.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:00.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:00.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:00.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:00.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:00.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:00.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.067 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 98.550124710999995, 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:00.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:00.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 98.550021232999995, 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.073 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:00.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 98.549970884000004, 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:00.083 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 98.549932059, 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:00.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:00.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:00.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:00.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:00.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:00.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 98.549867457999994, 2024-04-26T11:46:00.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:00.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:00.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 98.542402695999996, 2024-04-26T11:46:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.096 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.096 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:00.096 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:00.096 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:00.097 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T11:46:00.097 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T11:46:00.097 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T11:46:00.098 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:00.098 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:00.094+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:00.171 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:46:00.198 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:00.194+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:00.215 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:00.215 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:00.215 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:00.215 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:00.225 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:00.299 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:00.294+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:00.334 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:00.334 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:00.334 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:00.334 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:00.334 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:00.343 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:00.400 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:00.397+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:00.495 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.091535068, 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:46:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:46:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:46:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:46:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:46:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:46:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:46:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:46:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:46:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:46:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:46:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:46:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.09146457600001, 2024-04-26T11:46:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.891914732, 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.891883013, 2024-04-26T11:46:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.89184144399999, 2024-04-26T11:46:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.891714307, 2024-04-26T11:46:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064944627000003, 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064844038999993, 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:00.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064775346999994, 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064671728999997, 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064547879000003, 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064515740000004, 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064485646999998, 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064455248000002, 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064424591999995, 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:46:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064382722999994, 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064349304000004, 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064200886999998, 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.064081793, 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:46:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:46:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.063975748999994, 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:00.644 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:00.646 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:00.642+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:00.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:00.747 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:00.742+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:00.763 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:00.763 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:00.763 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:00.763 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:00.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:00.847 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:00.846+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:00.877 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:00.878 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:00.878 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:00.878 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:00.878 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:00.887 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:00.948 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:00.945+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:01.000 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:01.000 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:01.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:01.000 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:01.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.000 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:01.000 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.819858088, 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:01.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:01.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:01.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:01.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:01.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:01.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.008 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.008 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:46:01.009 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:01.009 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.818687416, 2024-04-26T11:46:01.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:46:01.009 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.009 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.009 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:01.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:01.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:46:01.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:46:01.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:01.014 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.81768825899999, 2024-04-26T11:46:01.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:46:01.014 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.014 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:46:01.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:01.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:46:01.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:46:01.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:46:01.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:46:01.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:46:01.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:46:01.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:46:01.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:46:01.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.019 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.019 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:46:01.019 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.81609652500001, 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:01.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.588878472, 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:46:01.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:46:01.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.028 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.028 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:46:01.028 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:01.028 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.587011264, 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:46:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.585278862, 2024-04-26T11:46:01.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:46:01.034 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.034 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.034 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:01.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:46:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:46:01.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:46:01.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:46:01.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:46:01.038 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.038 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.038 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.038 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:46:01.039 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:01.039 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.581470903, 2024-04-26T11:46:01.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:46:01.039 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.039 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.039 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.043 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.580954311, 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:01.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:46:01.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:46:01.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.048 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.049 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:46:01.049 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:01.049 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.368696015, 2024-04-26T11:46:01.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:46:01.049 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.049 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.049 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:01.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.054 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.054 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:01.054 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.567706818999994, 2024-04-26T11:46:01.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:01.054 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.054 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.054 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:01.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:01.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:01.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:01.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:01.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:01.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:01.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:01.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:01.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:01.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:01.060 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.060 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.060 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.060 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.060 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:01.060 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.567569081000002, 2024-04-26T11:46:01.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:01.061 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.061 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.061 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:01.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:01.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:01.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:01.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:01.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:01.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:01.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.567439931999999, 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:01.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:01.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:01.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:01.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:01.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:01.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:01.074 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.074 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.074 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.074 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.567348543999998, 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:01.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:01.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:01.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:01.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:01.080 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.080 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.080 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.567064221999999, 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:01.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:01.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:01.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:01.086 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.566960743999999, 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:01.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:01.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:01.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:01.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:01.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:01.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:01.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:01.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:01.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:01.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:01.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:01.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:01.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.566910394999994, 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.092 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:01.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:01.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:01.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:01.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:01.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:01.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:01.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:01.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:01.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:01.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:01.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.566871570000004, 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:01.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:01.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:01.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.566806968999998, 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:01.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:01.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:01.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:01.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:01.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:01.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 99.559342207, 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:01.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:46:01.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:46:01.110 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.111 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.111 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.111 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:01.111 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:01.111 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:01.112 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:01.113 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:01.110+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:01.181 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:46:01.214 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:01.209+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:01.229 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:01.229 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:01.229 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:01.229 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:01.239 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:01.314 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:01.310+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:01.343 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:01.343 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:01.343 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:01.343 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:01.343 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:01.352 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:01.418 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:01.410+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:01.464 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:01.464 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:01.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:01.464 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:01.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.464 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:01.464 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.058236966, 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:01.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.058166474, 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.470 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.85861663, 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:01.476 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:01.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:01.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:01.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:01.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:01.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:01.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:01.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:01.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:01.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.482 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.85858491099999, 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:01.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:01.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:01.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:01.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:01.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:01.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:01.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:01.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.858543342, 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:01.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.858416205, 2024-04-26T11:46:01.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:01.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.502 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.031646525, 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:01.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:01.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:01.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:01.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:01.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:01.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:01.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.031545937, 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:01.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:01.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:01.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:01.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.031477245, 2024-04-26T11:46:01.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:01.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:01.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:01.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:01.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:01.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:01.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:01.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:01.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:01.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.03137362699999, 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:01.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:01.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:01.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:01.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:01.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:01.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:01.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:01.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:01.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.031249777, 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.031217638, 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.535 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:01.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:01.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:01.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:01.542 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.542 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.542 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.03118754499999, 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:01.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:01.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:01.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:01.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:01.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:01.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:01.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:01.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:01.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:01.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:01.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:01.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:01.550 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.550 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.550 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.550 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.550 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.031157146, 2024-04-26T11:46:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:01.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:01.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.03112649000001, 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.557 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:01.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:46:01.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:46:01.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:46:01.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:46:01.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:01.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:46:01.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:46:01.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:46:01.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:46:01.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:46:01.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.563 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.03108462100001, 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:01.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:01.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.031051202, 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:01.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.03090278499999, 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:01.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:01.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:01.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:01.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:01.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.030783691, 2024-04-26T11:46:01.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:46:01.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:46:01.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:46:01.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:46:01.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:46:01.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:46:01.588 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.588 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.588 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.030677647, 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:01.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:01.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:01.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.594 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.595 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:01.595 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:01.595 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:01.596 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T11:46:01.596 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:01.594+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:01.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:01.645 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:01.690 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T11:46:01.697 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:01.690+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:01.713 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:01.713 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:01.713 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:01.713 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:01.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:01.741 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T11:46:01.744 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T11:46:01.744 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T11:46:01.792 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:01.797 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:01.794+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:01.813 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T11:46:01.816 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:01.817 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:46:01.817 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T11:46:01.817 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:01.817 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:01.817 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:01.822 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:01.823 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:01.825 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-26T11:46:01.826 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-26T11:46:01.827 DEBUG:teuthology.orchestra.run.smithi029:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d2137f0a666c92a9411c1af5c33e4968be54da6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-26T11:46:01.831 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:01.831 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:01.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:01.842 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir -p fsstress 2024-04-26T11:46:01.845 INFO:tasks.workunit.client.0.smithi029.stderr:+ pushd fsstress 2024-04-26T11:46:01.847 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T11:46:01.847 INFO:tasks.workunit.client.0.smithi029.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-26T11:46:01.899 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:01.894+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:01.976 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:01.976 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:01.977 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:02.022 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:02.018+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:02.090 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:02.090 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:02.100 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:02.101 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:02.097+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:02.201 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:02.198+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:02.210 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:02.210 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:02.220 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:02.302 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:02.298+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:02.372 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:02.373 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:02.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:02.403 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:02.398+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:02.501 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:02.501 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:02.504 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:02.501+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:02.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:02.569 INFO:tasks.workunit.client.0.smithi029.stderr:+ tar xzf ltp-full.tgz 2024-04-26T11:46:02.605 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:02.601+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:02.680 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:02.681 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:02.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:02.706 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:02.702+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:02.793 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:02.794 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:02.803 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:02.850 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:02.846+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:02.908 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:02.905+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:02.926 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:02.926 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:02.936 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:03.009 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:03.006+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:03.036 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:03.036 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:03.046 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:03.110 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:03.106+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:03.194 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:46:03.204 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:03.204 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:03.211 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:03.206+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:03.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:03.312 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:03.306+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:03.346 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:03.346 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:03.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:03.413 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:03.410+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:03.474 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:03.474 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:03.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:03.514 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:03.510+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:03.589 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:03.589 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:03.590 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:46:03.599 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:03.645 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:03.642+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:03.707 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:03.708 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:03.716 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:03.710+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:03.717 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:03.817 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:03.813+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:03.824 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:03.833 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:03.833 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:03.842 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:03.918 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:03.914+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:03.943 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:03.944 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:03.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:03.977 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:04.002 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:04.003 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:04.003 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:04.003 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:04.005 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:04.006 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:04.018 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:04.014+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:04.080 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:04.080 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:04.080 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:04.080 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:04.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:04.120 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:04.114+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:04.200 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:04.200 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:04.200 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:04.200 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:04.200 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:04.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:04.219 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:04.214+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:04.312 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.131923137, 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:04.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.130752465, 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:46:04.317 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:46:04.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:46:04.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:46:04.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.12975330800001, 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.322 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:46:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:46:04.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.128161574, 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.326 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:46:04.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.331 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:46:04.331 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:04.331 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.900943521, 2024-04-26T11:46:04.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:46:04.331 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.331 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.331 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:46:04.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:46:04.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.335 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.89907631299999, 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.339 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.89734391099999, 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:46:04.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:46:04.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:46:04.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:46:04.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:46:04.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:46:04.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:46:04.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:46:04.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:46:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.89353595199999, 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.349 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.89301936, 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:46:04.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.680761064, 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.354 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:46:04.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:46:04.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:46:04.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:46:04.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:46:04.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:46:04.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:46:04.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:46:04.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:46:04.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:46:04.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 102.87977186800001, 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:04.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:04.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 102.87963413, 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.365 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.365 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:04.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:04.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 102.879504981, 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.370 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:04.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:04.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.375 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 102.879413593, 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:04.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:04.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:04.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:04.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:04.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 102.879129271, 2024-04-26T11:46:04.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:04.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 102.879025793, 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:04.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:04.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 102.87897544400001, 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:04.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:04.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:04.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:04.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:04.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.397 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.398 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.398 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:04.398 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 102.878936619, 2024-04-26T11:46:04.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:04.398 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.398 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:04.398 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:04.401 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 102.878872018, 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.405 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 102.871407256, 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055606780000000003, 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:46:04.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438350+0000", 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438349+0000", 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438359+0000", 2024-04-26T11:46:04.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4569999999999994e-06 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438646+0000", 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028704300000000001 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438659+0000", 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3325e-05 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:04.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.438748+0000", 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8930000000000004e-05 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443911+0000", 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051625689999999997 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:04.409 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:04.411 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:04.412 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:04.405+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:04.512 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:04.509+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:04.533 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:04.533 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:04.533 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:04.534 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:04.544 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:04.613 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:04.606+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:04.648 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:04.648 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:04.648 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:04.648 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:04.648 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:04.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:04.713 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:04.710+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:04.766 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:04.766 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:04.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:04.766 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:04.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.766 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:04.766 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:04.766 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.36021458099999, 2024-04-26T11:46:04.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:46:04.766 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.766 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:46:04.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.360144089, 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:04.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:04.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:04.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:04.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:04.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:04.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.778 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.778 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.778 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:04.778 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:04.779 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.160594245, 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:04.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:04.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:04.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:04.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:04.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:04.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:04.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:04.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.16056252600001, 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:04.786 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:04.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:04.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:04.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:04.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:04.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:04.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.160520957, 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:04.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:04.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:04.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.799 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.800 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.16039382, 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.801 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:04.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:04.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:04.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:04.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:04.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:04.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:04.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.807 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.808 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:04.808 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33362414, 2024-04-26T11:46:04.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:04.808 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.808 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.808 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:04.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:04.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:04.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:04.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:04.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:04.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:04.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.333523552, 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:04.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:04.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:04.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:04.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:04.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:04.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:04.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33345486, 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:04.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.826 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33335124200001, 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:04.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:04.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.333227392, 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:04.838 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.333195253, 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:04.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:04.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:04.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:04.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33316515999999, 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:04.844 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.333134761, 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:04.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:04.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:04.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:04.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:04.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:04.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:04.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:04.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:04.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:04.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:04.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:04.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:04.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.333104105, 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:46:04.857 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:46:04.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:46:04.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:46:04.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:46:04.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.333062236, 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:04.863 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:04.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.333028817, 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.874 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33288039999999, 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.880 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33276130599999, 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:46:04.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:46:04.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:46:04.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:46:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.332655262, 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:04.886 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:04.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:04.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:04.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:04.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:04.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:04.892 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.892 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.892 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.892 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:04.892 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:04.892 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:04.894 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:04.895 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:04.889+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:04.994 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:04.989+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:05.008 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:05.009 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:05.009 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:05.009 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:05.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:05.096 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:05.090+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:05.125 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:05.125 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:05.126 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:05.126 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:05.126 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:05.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:05.197 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:05.190+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:05.249 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:05.249 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.06914455899999, 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:05.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:05.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.254 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.254 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:46:05.254 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:05.254 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.06797388699999, 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:46:05.258 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.06697473, 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:46:05.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:88 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'58, mlcod=11'52)", 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.065382996, 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056093530000000001, 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181596+0000", 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181594+0000", 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181606+0000", 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1342000000000001e-05 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181629+0000", 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3266999999999999e-05 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181657+0000", 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7664000000000001e-05 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181750+0000", 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3412000000000006e-05 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.181786+0000", 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5626000000000001e-05 2024-04-26T11:46:05.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187177+0000", 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053915600000000001 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187205+0000", 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.838164943, 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:05.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:46:05.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:46:05.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.836297735, 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:05.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:46:05.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:46:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.834565333, 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:46:05.277 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:46:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:46:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:46:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:46:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.830757374, 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.287 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:46:05.287 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:05.287 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.830240782, 2024-04-26T11:46:05.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:46:05.287 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.287 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.287 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:05.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:05.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:46:05.291 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.292 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.293 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:46:05.293 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:05.293 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.617982486, 2024-04-26T11:46:05.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:46:05.293 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.294 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.294 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:05.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:05.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:46:05.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:46:05.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.81699329, 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:05.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:05.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.304 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.305 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:05.305 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.81685555200001, 2024-04-26T11:46:05.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:05.305 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.305 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.305 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:05.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:05.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:05.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:05.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:05.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:05.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:05.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:05.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:05.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.816726403, 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:05.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:05.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:05.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:05.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:05.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.816635015, 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.816350693, 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.816247215, 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:05.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:05.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:05.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:05.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:05.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.336 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.816196866, 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:05.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.81615804099999, 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.342 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:05.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:05.346 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 103.81609344, 2024-04-26T11:46:05.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:05.347 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.347 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:05.347 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:05.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:05.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:05.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:54 3.14 e48/16 3:2e2fa760:::200.00000001:head v 48'18, mlcod=47'16)", 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:04.911001+0000", 2024-04-26T11:46:05.351 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33597811700000002, 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060071480000000003, 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.911001+0000", 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.911001+0000", 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:05.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.910998+0000", 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912176+0000", 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001177783 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912194+0000", 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8275e-05 2024-04-26T11:46:05.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912201+0000", 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5799999999999997e-06 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912361+0000", 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016040800000000001 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912428+0000", 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6475000000000003e-05 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.916957+0000", 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045290160000000003 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.917008+0000", 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0861e-05 2024-04-26T11:46:05.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.356 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:05.356 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:05.356 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:05.358 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:05.358 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:05.353+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:05.458 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:05.454+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:05.483 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:05.483 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:05.483 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:05.483 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:05.493 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:05.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~71s 2024-04-26T11:46:05.559 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:05.557+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:05.604 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:46:05.606 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:05.606 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:05.606 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:05.606 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:05.606 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:05.616 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:05.660 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:05.657+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:05.725 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.319877096, 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:05.726 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:46:05.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:46:05.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:46:05.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:46:05.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:46:05.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:46:05.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.31980660399999, 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:05.732 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:05.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:05.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:05.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:05.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:05.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.12025676, 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.741 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:05.742 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:05.742 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:05.742 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:05.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.742 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:05.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:05.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:05.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:05.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:05.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.120225041, 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:05.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:05.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.12018347199999, 2024-04-26T11:46:05.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:05.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:05.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.120056335, 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:05.759 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:05.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:05.764 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.293286655, 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:05.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.29318606699999, 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:05.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:05.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:05.776 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.29311737499999, 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.782 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.293013757, 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:05.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:05.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.292889907, 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:05.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:05.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.794 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.292857768, 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:05.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:05.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.800 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.292827675, 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:05.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:05.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:05.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.292797276, 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:05.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.29276661999999, 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:05.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.818 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.29272475099999, 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:05.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.292691332, 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:05.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:05.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:05.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:05.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:05.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:05.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.292542915, 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.831 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:05.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.292423821, 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:46:05.837 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:46:05.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.29231777699999, 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:05.843 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:05.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:05.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:05.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:05.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:05.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:05.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:05.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:05.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:05.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:05.850 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:05.850 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:05.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:05.852 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:05.849+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:05.952 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:05.946+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:05.970 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:05.970 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:05.970 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:05.970 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:05.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:06.001 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:46:06.008 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:06.053 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:06.049+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:06.094 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:06.095 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:06.095 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:06.095 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:06.095 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:06.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:06.145 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:06.153 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:06.150+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:06.171 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:06.171 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:06.171 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:06.172 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:06.175 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:06.176 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:06.214 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:06.214 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:06.225 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:06.270 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:06.266+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:06.337 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:06.338 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:06.348 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:06.355 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:06.350+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:06.451 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:06.451 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:06.456 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:06.453+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:06.461 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:06.557 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:06.553+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:06.575 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:06.575 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:06.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:06.658 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:06.653+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:06.713 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:06.714 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:06.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:06.759 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:06.754+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:06.825 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:06.826 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:06.836 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:06.860 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:06.857+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:06.941 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:06.941 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:06.950 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:06.961 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:06.958+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:07.062 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:07.058+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:07.066 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:07.066 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:07.076 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:07.164 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:07.158+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:07.230 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:07.230 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:07.240 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:07.264 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:07.261+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:07.350 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:07.350 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:07.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:07.407 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:07.405+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:07.465 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:07.461+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:07.485 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:07.486 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:07.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:07.566 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:07.561+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:07.605 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:07.605 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:07.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:07.667 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:07.665+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:07.769 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:07.765+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:07.773 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:07.773 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:07.783 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:07.869 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:07.866+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:07.904 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:07.904 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:07.915 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:07.970 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:07.965+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:08.015 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:46:08.069 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:08.070 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:08.070 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:08.066+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:08.080 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:08.171 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:08.169+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:08.177 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:08.183 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:08.183 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:08.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:08.272 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:08.266+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:08.314 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:08.314 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:08.322 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:08.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:08.351 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:08.351 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:08.351 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:08.351 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:08.354 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:08.354 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:08.373 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:08.369+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:08.430 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:08.431 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:08.431 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:08.431 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:08.431 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:08.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:08.474 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:08.469+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:08.550 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.37010254400001, 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:08.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:08.555 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.368931872, 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:46:08.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:46:08.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:46:08.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:46:08.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:46:08.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:46:08.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.36793271499999, 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:46:08.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:46:08.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:46:08.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:46:08.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.564 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.13912292800001, 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:46:08.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:110 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'72, mlcod=11'67)", 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.13725572, 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005725562, 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410681+0000", 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410680+0000", 2024-04-26T11:46:08.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410690+0000", 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0356e-05 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410712+0000", 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2107999999999999e-05 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.410722+0000", 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7019999999999996e-06 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412630+0000", 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019083049999999999 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412669+0000", 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8245999999999999e-05 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416357+0000", 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036881029999999999 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416407+0000", 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9926000000000003e-05 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.573 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.135523318, 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:46:08.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:46:08.577 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.131715359, 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.131198767, 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.582 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:46:08.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:46:08.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:144 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'102, mlcod=11'98)", 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 115.918940471, 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056935190000000002, 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628996+0000", 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.628994+0000", 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629064+0000", 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9595e-05 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629096+0000", 2024-04-26T11:46:08.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2363000000000002e-05 2024-04-26T11:46:08.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629115+0000", 2024-04-26T11:46:08.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8425999999999999e-05 2024-04-26T11:46:08.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629180+0000", 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4764000000000005e-05 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.629234+0000", 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4048000000000002e-05 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634633+0000", 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053993219999999998 2024-04-26T11:46:08.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.634690+0000", 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6861000000000003e-05 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.117951275, 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:08.591 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:08.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:08.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:08.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:08.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:08.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:08.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:08.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:08.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:08.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:08.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:08.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:08.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:08.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:08.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:08.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:08.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.599 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.117813537, 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:08.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:08.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:08.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.117684388, 2024-04-26T11:46:08.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:08.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:08.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:08.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.117593, 2024-04-26T11:46:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:08.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:08.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:08.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.117308678, 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:08.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:08.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:08.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:08.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:08.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:08.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.1172052, 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.623 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:08.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:08.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:08.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:08.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:08.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:08.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:08.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.629 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.630 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:08.630 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:08.630 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.117154851, 2024-04-26T11:46:08.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:08.630 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.630 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:08.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:08.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:08.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.635 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.11711602600001, 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:08.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.640 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:08.640 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:08.640 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 107.117051425, 2024-04-26T11:46:08.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:08.640 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.640 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:08.640 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:08.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:08.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:08.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:08.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:08.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:08.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:08.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.645 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.645 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:54 3.14 e48/16 3:2e2fa760:::200.00000001:head v 48'18, mlcod=47'16)", 2024-04-26T11:46:08.645 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:04.911001+0000", 2024-04-26T11:46:08.646 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.6369361019999999, 2024-04-26T11:46:08.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060071480000000003, 2024-04-26T11:46:08.646 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.646 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.646 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.911001+0000", 2024-04-26T11:46:08.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.911001+0000", 2024-04-26T11:46:08.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.910998+0000", 2024-04-26T11:46:08.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:08.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912176+0000", 2024-04-26T11:46:08.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001177783 2024-04-26T11:46:08.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912194+0000", 2024-04-26T11:46:08.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8275e-05 2024-04-26T11:46:08.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912201+0000", 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5799999999999997e-06 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912361+0000", 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016040800000000001 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912428+0000", 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6475000000000003e-05 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.916957+0000", 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045290160000000003 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.917008+0000", 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0861e-05 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.652 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:1155 4.1 4:8244f5f1:::10000000767.00000000:head [write 0~2800] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.4973535820000001, 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070178860000000001, 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 1155 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050581+0000", 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050594+0000", 2024-04-26T11:46:08.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2754e-05 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050631+0000", 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7524999999999997e-05 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050645+0000", 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3696999999999999e-05 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050715+0000", 2024-04-26T11:46:08.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9716999999999997e-05 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050966+0000", 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025080600000000001 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.051104+0000", 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013872299999999999 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:08.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.052461+0000", 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00135641 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057493+0000", 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050319279999999997 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057558+0000", 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5137999999999999e-05 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:08.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057601+0000", 2024-04-26T11:46:08.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3158999999999998e-05 2024-04-26T11:46:08.658 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.658 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.658 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.658 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:08.658 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:08.658 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:08.660 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:08.660 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:08.654+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:08.760 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:08.754+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:08.780 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:08.780 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:08.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:08.780 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:2201 4.5 4:a181e62e:::10000000bdb.00000000:head [write 0~129 in=129b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:46:08.780 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:08.779537+0000", 2024-04-26T11:46:08.780 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00084768799999999998, 2024-04-26T11:46:08.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088891700000000003, 2024-04-26T11:46:08.780 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:08.780 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 2201 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:08.779537+0000", 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:08.779537+0000", 2024-04-26T11:46:08.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:08.779535+0000", 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:08.779547+0000", 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1426999999999999e-05 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:08.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:08.779577+0000", 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:08.779596+0000", 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9020000000000001e-05 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:08.779715+0000", 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011930399999999999 2024-04-26T11:46:08.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:08.779931+0000", 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000215205 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:08.780134+0000", 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020328499999999999 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:08.784 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:46:08.785 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-26T11:46:08.785 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:08.791 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:08.862 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:08.858+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:08.897 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:08.898 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:08.898 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:08.898 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:08.898 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:08.908 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:08.963 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:08.961+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:09.020 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:46:09.064 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:09.058+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:09.066 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:09.066 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.66168805300001, 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:46:09.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.072 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.661617561, 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.073 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:09.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:09.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:09.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:09.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:09.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.462067717, 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:09.079 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:09.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.080 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:09.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:09.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:09.085 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.085 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.085 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.085 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:09.085 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:09.086 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.462035998, 2024-04-26T11:46:09.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:09.086 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.086 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.086 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:09.086 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:09.086 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:09.086 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:09.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.086 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:09.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:09.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:09.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:09.091 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.461994429, 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:09.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:09.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:09.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:09.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:09.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:09.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.097 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.46186729199999, 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:09.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:09.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:09.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.635097612, 2024-04-26T11:46:09.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:09.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:09.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:09.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:09.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.109 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.634997024, 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:09.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:09.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:09.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.115 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.634928332, 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:09.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:09.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:09.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:09.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:09.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.634824714, 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:09.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:09.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.634700864, 2024-04-26T11:46:09.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:09.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:09.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:09.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.634668725, 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:09.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:09.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:09.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:09.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.63463863200001, 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:09.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.148 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.63460823299999, 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:09.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:09.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.634577577, 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.155 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:09.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.634535708, 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:09.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:09.167 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.634502289, 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:09.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.173 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.63435387200001, 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:09.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:09.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:09.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:09.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.179 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.63423477800001, 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:09.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:46:09.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:46:09.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:46:09.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:46:09.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:46:09.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.634128734, 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:09.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:09.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.191 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:09.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:09.194 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:09.189+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:09.294 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:09.289+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:09.310 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:09.310 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:09.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.310 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4541.0:2379 4.d e50/17 4:b24d2352:::10000000ca3.00000000:head v 50'37, mlcod=50'35)", 2024-04-26T11:46:09.310 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:09.309975+0000", 2024-04-26T11:46:09.310 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00010086000000000001, 2024-04-26T11:46:09.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000145377, 2024-04-26T11:46:09.310 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.310 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.309975+0000", 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.309975+0000", 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.309973+0000", 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.309985+0000", 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2149e-05 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.310011+0000", 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5833000000000002e-05 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.310022+0000", 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1069e-05 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.310070+0000", 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7403e-05 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.310083+0000", 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3662999999999999e-05 2024-04-26T11:46:09.313 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.314 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.314 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:46:09.314 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 1 2024-04-26T11:46:09.314 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:09.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:09.395 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:09.393+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:09.433 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:09.433 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:09.433 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:09.433 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:09.433 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:09.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:09.496 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:09.493+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:09.552 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:09.553 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:09.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:09.553 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:09.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.553 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:09.553 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:09.553 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.372061503, 2024-04-26T11:46:09.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:09.553 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.553 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.553 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:46:09.558 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:09.558 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.370890831, 2024-04-26T11:46:09.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:46:09.558 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.558 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.558 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:46:09.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:46:09.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.369891674, 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:46:09.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.141081887, 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:09.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:46:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.137482277, 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005777478, 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412413+0000", 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412412+0000", 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412508+0000", 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6322000000000004e-05 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412568+0000", 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9308000000000002e-05 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.412579+0000", 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413780+0000", 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001200612 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.413845+0000", 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5061999999999995e-05 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418134+0000", 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042888709999999997 2024-04-26T11:46:09.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418191+0000", 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6996000000000001e-05 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.133674318, 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:46:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:46:09.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:46:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:117 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'79, mlcod=11'69)", 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.13315772599999, 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065580839999999996, 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416738+0000", 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416737+0000", 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416756+0000", 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8698e-05 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416767+0000", 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1377e-05 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416784+0000", 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6317999999999999e-05 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418232+0000", 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014485539999999999 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.418265+0000", 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3042e-05 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423258+0000", 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049927269999999998 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423296+0000", 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8109999999999999e-05 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.119910234, 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.585 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:09.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:09.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:09.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:09.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:09.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.119772496, 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:09.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:09.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.11964334699999, 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:09.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.11955195900001, 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:09.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:09.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:09.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.11926763699999, 2024-04-26T11:46:09.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:09.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.11916415899999, 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.619 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:09.619 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.11911381, 2024-04-26T11:46:09.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:09.619 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.619 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.619 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:09.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.626 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.119074985, 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:09.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.630 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 108.11901038400001, 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:09.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:54 3.14 e48/16 3:2e2fa760:::200.00000001:head v 48'18, mlcod=47'16)", 2024-04-26T11:46:09.634 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:04.911001+0000", 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.6388950610000004, 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060071480000000003, 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.911001+0000", 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.911001+0000", 2024-04-26T11:46:09.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.910998+0000", 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912176+0000", 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001177783 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912194+0000", 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8275e-05 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912201+0000", 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5799999999999997e-06 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912361+0000", 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016040800000000001 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.912428+0000", 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6475000000000003e-05 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.916957+0000", 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045290160000000003 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:04.917008+0000", 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0861e-05 2024-04-26T11:46:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:1155 4.1 4:8244f5f1:::10000000767.00000000:head [write 0~2800] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.4993125410000001, 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070178860000000001, 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:09.639 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 1155 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050581+0000", 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050594+0000", 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2754e-05 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050631+0000", 2024-04-26T11:46:09.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7524999999999997e-05 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050645+0000", 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3696999999999999e-05 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050715+0000", 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9716999999999997e-05 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050966+0000", 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025080600000000001 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.051104+0000", 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013872299999999999 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.052461+0000", 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00135641 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057493+0000", 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050319279999999997 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057558+0000", 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5137999999999999e-05 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057601+0000", 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3158999999999998e-05 2024-04-26T11:46:09.644 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2276 4.1f 4:f8a565cb:::10000000c36.00000000:head [write 0~515] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:09.015618+0000", 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.534277263, 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070555339999999996, 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:09.645 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2276 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015618+0000", 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015618+0000", 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015616+0000", 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015630+0000", 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.384e-05 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015655+0000", 2024-04-26T11:46:09.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5182e-05 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015671+0000", 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5457000000000001e-05 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015791+0000", 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120449 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.016037+0000", 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024579000000000002 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.016714+0000", 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067672299999999995 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.019974+0000", 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003259718 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.022582+0000", 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026085829999999998 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.022643+0000", 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0637000000000002e-05 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.022674+0000", 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1270999999999999e-05 2024-04-26T11:46:09.650 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:09.132496+0000", 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41739984299999999, 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072175479999999998, 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2315 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.132496+0000", 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.132496+0000", 2024-04-26T11:46:09.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.132494+0000", 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133559+0000", 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001065751 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133594+0000", 2024-04-26T11:46:09.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4393000000000001e-05 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133608+0000", 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.437e-05 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133700+0000", 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1836000000000006e-05 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:09.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133880+0000", 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000180077 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.134036+0000", 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000155857 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.137220+0000", 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031843459999999998 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.139592+0000", 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023711980000000001 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.139661+0000", 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9086999999999998e-05 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.139713+0000", 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2793000000000001e-05 2024-04-26T11:46:09.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.657 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:09.657 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:09.657 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:09.659 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:09.659 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:09.653+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:09.759 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:09.754+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:09.787 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:09.787 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:09.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:2568 4.35 4:ac545e33:::10000000d61.00000000:head [write 0~1684 in=1684b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:09.786945+0000", 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00092878899999999996, 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097296800000000005, 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 2568 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:09.786945+0000", 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:09.786945+0000", 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:09.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:09.786943+0000", 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:09.786956+0000", 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3247e-05 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:09.786988+0000", 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1149000000000003e-05 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:09.787002+0000", 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4177e-05 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:09.787082+0000", 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0698000000000006e-05 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:09.787277+0000", 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019498700000000001 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.791 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:09.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:09.792 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:46:09.792 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-26T11:46:09.792 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:09.798 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:09.861 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:09.854+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:09.902 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:09.902 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:09.902 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:09.902 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:09.902 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:09.912 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:09.961 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:09.957+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:10.020 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.61509320499999, 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:46:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:46:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:46:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:46:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:46:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:46:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:46:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:46:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.615022713, 2024-04-26T11:46:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.415472869, 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.41544115000001, 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.415399581, 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.046 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:10.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:10.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.415272444, 2024-04-26T11:46:10.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:10.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:10.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.588502764, 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:10.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:10.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:10.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.588402176, 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:10.064 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:10.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.070 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.588333484, 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:10.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:10.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:10.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.076 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:10.077 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.58822986600001, 2024-04-26T11:46:10.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:10.077 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.077 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.077 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:10.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:10.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.082 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.588106016, 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:10.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:10.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:10.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.588073877, 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:10.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:10.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:10.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:10.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.58804378400001, 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:10.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:10.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:10.100 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.588013385, 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:10.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:10.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.587982729, 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.112 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.58794086, 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:10.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:10.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:10.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.587907441, 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:10.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:10.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:10.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.58775902399999, 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:10.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:10.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.58763992999999, 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.131 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:46:10.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:46:10.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:46:10.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:46:10.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:46:10.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:46:10.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:46:10.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:46:10.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:46:10.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:46:10.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:46:10.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.138 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.139 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.139 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:10.139 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 108.587533886, 2024-04-26T11:46:10.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:10.139 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:10.139 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.139 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:10.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:10.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:10.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:10.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:10.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:10.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:10.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:10.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:10.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:10.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:10.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:10.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:10.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:10.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:10.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.148 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:10.148 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:10.148 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:10.151 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:10.146+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:10.151 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:10.251 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:10.246+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:10.266 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:10.267 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:10.267 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:10.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:10.352 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:10.349+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:10.356 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:10.386 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:10.387 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:10.387 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:10.387 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:10.387 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:10.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:10.453 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:10.446+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:10.504 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:10.504 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 118.323170666, 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:10.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 118.321999994, 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:46:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.510 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.510 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:10.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:46:10.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:46:10.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:46:10.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:46:10.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:46:10.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:46:10.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:46:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 118.321000837, 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:46:10.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 118.09219105, 2024-04-26T11:46:10.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:46:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:46:10.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:46:10.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:46:10.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:46:10.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:46:10.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:46:10.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:46:10.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 118.084783481, 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 109.071019397, 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.529 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:10.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:10.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:10.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:10.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:10.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:10.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:10.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:10.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:10.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.535 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 109.07088165899999, 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:10.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:10.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:10.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:10.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:10.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:10.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:10.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:10.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:10.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.541 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 109.07075251000001, 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:10.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:10.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:10.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:10.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:10.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:10.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:10.547 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.548 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.548 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.548 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:10.548 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 109.070661122, 2024-04-26T11:46:10.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:10.548 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.548 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:10.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:10.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:10.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:10.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:10.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:10.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:10.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:10.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:10.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.555 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 109.07037680000001, 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:10.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:10.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:10.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:10.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:10.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:10.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:10.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:10.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:10.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.561 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 109.07027332200001, 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:10.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 109.070222973, 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.567 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:10.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:10.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:10.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:10.572 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 109.070184148, 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:10.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:10.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 109.070119547, 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.576 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:10.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:1155 4.1 4:8244f5f1:::10000000767.00000000:head [write 0~2800] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.450421704, 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070178860000000001, 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:10.580 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 1155 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050581+0000", 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050594+0000", 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2754e-05 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050631+0000", 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7524999999999997e-05 2024-04-26T11:46:10.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050645+0000", 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3696999999999999e-05 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050715+0000", 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9716999999999997e-05 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050966+0000", 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025080600000000001 2024-04-26T11:46:10.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.051104+0000", 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013872299999999999 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.052461+0000", 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00135641 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057493+0000", 2024-04-26T11:46:10.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050319279999999997 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057558+0000", 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5137999999999999e-05 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057601+0000", 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3158999999999998e-05 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.586 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2276 4.1f 4:f8a565cb:::10000000c36.00000000:head [write 0~515] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:46:10.586 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:09.015618+0000", 2024-04-26T11:46:10.586 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.485386426, 2024-04-26T11:46:10.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070555339999999996, 2024-04-26T11:46:10.586 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.586 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.586 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:10.586 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:10.586 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:10.586 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2276 2024-04-26T11:46:10.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015618+0000", 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015618+0000", 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015616+0000", 2024-04-26T11:46:10.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015630+0000", 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.384e-05 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015655+0000", 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5182e-05 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015671+0000", 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5457000000000001e-05 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015791+0000", 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120449 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.016037+0000", 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024579000000000002 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.016714+0000", 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067672299999999995 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.019974+0000", 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003259718 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.022582+0000", 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026085829999999998 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.022643+0000", 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0637000000000002e-05 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.022674+0000", 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1270999999999999e-05 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:09.132496+0000", 2024-04-26T11:46:10.591 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.368509006, 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072175479999999998, 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2315 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.132496+0000", 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.132496+0000", 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.132494+0000", 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133559+0000", 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001065751 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133594+0000", 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4393000000000001e-05 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133608+0000", 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.437e-05 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133700+0000", 2024-04-26T11:46:10.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1836000000000006e-05 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133880+0000", 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000180077 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.134036+0000", 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000155857 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.137220+0000", 2024-04-26T11:46:10.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031843459999999998 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.139592+0000", 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023711980000000001 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.139661+0000", 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9086999999999998e-05 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.139713+0000", 2024-04-26T11:46:10.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2793000000000001e-05 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~3763435 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47579247899999999, 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025884015, 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025210+0000", 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033624+0000", 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084137780000000002 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033667+0000", 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3615999999999997e-05 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033685+0000", 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7555999999999999e-05 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033843+0000", 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015836100000000001 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034073+0000", 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022992100000000001 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034439+0000", 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036520999999999998 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050786+0000", 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016347662999999998 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050990+0000", 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020404599999999999 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051050+0000", 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9357000000000001e-05 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051096+0000", 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6854000000000002e-05 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2658 4.1c 4:3ac8fbef:::10000000dba.00000000:head [write 0~2397] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40341241700000002, 2024-04-26T11:46:10.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074151010000000003, 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2658 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097591+0000", 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097602+0000", 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1e-05 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097627+0000", 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5463e-05 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097644+0000", 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6549999999999999e-05 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097728+0000", 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4244000000000002e-05 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097973+0000", 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024436199999999998 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.104744+0000", 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0067715420000000002 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.104812+0000", 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7485999999999997e-05 2024-04-26T11:46:10.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.105008+0000", 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196004 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2659 4.23 4:c40e78fc:::10000000dbb.00000000:head [write 0~1710] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.099004+0000", 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40200059900000001, 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068180070000000001, 2024-04-26T11:46:10.607 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2659 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099004+0000", 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:10.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099004+0000", 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099002+0000", 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099016+0000", 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4070000000000001e-05 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:10.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099039+0000", 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3269e-05 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099054+0000", 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4486e-05 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099165+0000", 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000110862 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099470+0000", 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00030479999999999998 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.105689+0000", 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0062189999999999997 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.105744+0000", 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5024e-05 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:10.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:10.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.105822+0000", 2024-04-26T11:46:10.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8678999999999997e-05 2024-04-26T11:46:10.612 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.612 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.612 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.612 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:10.612 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:10.612 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:10.613 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:10.613 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:10.614 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:10.615 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:10.609+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:10.615 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:10.615 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:10.615 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:10.616 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:10.616 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:10.714 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:10.709+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:10.733 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:10.733 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:10.743 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:10.815 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:10.810+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:10.841 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:10.841 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:10.851 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:10.916 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:10.910+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:10.954 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:10.955 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:10.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:11.018 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:11.013+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:11.034 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:46:11.081 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:11.082 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:11.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:11.118 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:11.114+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:11.208 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:11.208 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:11.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:11.219 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:11.214+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:11.320 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:11.317+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:11.322 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:11.322 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:11.332 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:11.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~77s 2024-04-26T11:46:11.421 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:11.417+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:11.449 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:11.449 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:11.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:11.522 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:11.518+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:11.560 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:11.560 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:11.570 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:11.623 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:11.618+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:11.673 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:11.673 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:11.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:11.725 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:11.721+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:11.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:11.825 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:11.822+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:11.926 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:11.922+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:11.979 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:11.980 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:11.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:12.027 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:12.022+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:12.040 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:46:12.092 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:12.093 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:12.103 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:12.129 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:12.125+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:12.230 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:12.226+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:12.231 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:12.232 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:12.242 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:12.330 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:12.326+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:12.354 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:12.354 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:12.364 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:12.432 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:12.429+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:12.472 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:12.472 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:12.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:12.533 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:12.526+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:12.605 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:12.605 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:12.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:12.617 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:12.634 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:12.630+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:12.728 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:12.728 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:12.735 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:12.730+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:12.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:12.771 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:12.801 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:12.802 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:12.802 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:12.802 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:12.806 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:12.806 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:12.836 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:12.833+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:12.843 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 120.66277277, 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:12.847 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:86 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'56, mlcod=11'51)", 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 120.661602098, 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073960120000000004, 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:12.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179005+0000", 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179004+0000", 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179014+0000", 2024-04-26T11:46:12.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179037+0000", 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2889999999999999e-05 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179048+0000", 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0674e-05 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179187+0000", 2024-04-26T11:46:12.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013863600000000001 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.179228+0000", 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-05 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186358+0000", 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071294210000000004 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186401+0000", 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3031000000000002e-05 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:87 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'57, mlcod=11'51)", 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 120.66060294099999, 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007170142, 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180004+0000", 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180003+0000", 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180061+0000", 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8693999999999997e-05 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180085+0000", 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3362000000000001e-05 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180095+0000", 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180206+0000", 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111152 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.180247+0000", 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1476000000000001e-05 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187106+0000", 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006858327 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.187174+0000", 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8693000000000001e-05 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 120.431793154, 2024-04-26T11:46:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:46:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:46:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:46:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:46:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:116 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'78, mlcod=11'69)", 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 120.424385585, 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070332859999999997, 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416221+0000", 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416228+0000", 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416241+0000", 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416248+0000", 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0169999999999999e-06 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417659+0000", 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014112420000000001 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.417687+0000", 2024-04-26T11:46:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.817e-05 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423180+0000", 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054922030000000002 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.423255+0000", 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5127000000000001e-05 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.41062150099999, 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.410483763, 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:12.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:12.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:12.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:12.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:12.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:12.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.410354614, 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:12.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:12.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.410263226, 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:12.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:12.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:12.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:12.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:12.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:12.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.888 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:12.888 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:12.888 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.409978904, 2024-04-26T11:46:12.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:12.888 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.888 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.889 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:12.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:12.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.409875426, 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:12.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:12.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:12.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:12.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.40982507699999, 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:12.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:12.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:12.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:12.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.907 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.409786252, 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 111.409721651, 2024-04-26T11:46:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:1155 4.1 4:8244f5f1:::10000000767.00000000:head [write 0~2800] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 6.7900238079999999, 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070178860000000001, 2024-04-26T11:46:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 1155 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050583+0000", 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050581+0000", 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050594+0000", 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2754e-05 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050631+0000", 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7524999999999997e-05 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050645+0000", 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3696999999999999e-05 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050715+0000", 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9716999999999997e-05 2024-04-26T11:46:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.050966+0000", 2024-04-26T11:46:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025080600000000001 2024-04-26T11:46:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.051104+0000", 2024-04-26T11:46:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013872299999999999 2024-04-26T11:46:12.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.052461+0000", 2024-04-26T11:46:12.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00135641 2024-04-26T11:46:12.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:12.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057493+0000", 2024-04-26T11:46:12.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050319279999999997 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057558+0000", 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5137999999999999e-05 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:06.057601+0000", 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3158999999999998e-05 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2276 4.1f 4:f8a565cb:::10000000c36.00000000:head [write 0~515] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:09.015618+0000", 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.8249885300000002, 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070555339999999996, 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2276 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015618+0000", 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015618+0000", 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015616+0000", 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015630+0000", 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.384e-05 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015655+0000", 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5182e-05 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015671+0000", 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5457000000000001e-05 2024-04-26T11:46:12.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.015791+0000", 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120449 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.016037+0000", 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024579000000000002 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.016714+0000", 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067672299999999995 2024-04-26T11:46:12.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.019974+0000", 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003259718 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.022582+0000", 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026085829999999998 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.022643+0000", 2024-04-26T11:46:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0637000000000002e-05 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.022674+0000", 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1270999999999999e-05 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:09.132496+0000", 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.7081111099999999, 2024-04-26T11:46:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072175479999999998, 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2315 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.132496+0000", 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.132496+0000", 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.132494+0000", 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133559+0000", 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001065751 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133594+0000", 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4393000000000001e-05 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133608+0000", 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.437e-05 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133700+0000", 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1836000000000006e-05 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.133880+0000", 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000180077 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.134036+0000", 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000155857 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.137220+0000", 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031843459999999998 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.139592+0000", 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023711980000000001 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.139661+0000", 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9086999999999998e-05 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:09.139713+0000", 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2793000000000001e-05 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.932 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~3763435 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8153945829999998, 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025884015, 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025210+0000", 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033624+0000", 2024-04-26T11:46:12.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084137780000000002 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033667+0000", 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3615999999999997e-05 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033685+0000", 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7555999999999999e-05 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033843+0000", 2024-04-26T11:46:12.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015836100000000001 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034073+0000", 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022992100000000001 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034439+0000", 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036520999999999998 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050786+0000", 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016347662999999998 2024-04-26T11:46:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050990+0000", 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020404599999999999 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051050+0000", 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9357000000000001e-05 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051096+0000", 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6854000000000002e-05 2024-04-26T11:46:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2658 4.1c 4:3ac8fbef:::10000000dba.00000000:head [write 0~2397] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.7430145210000001, 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074151010000000003, 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2658 2024-04-26T11:46:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097591+0000", 2024-04-26T11:46:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097602+0000", 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1e-05 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097627+0000", 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5463e-05 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097644+0000", 2024-04-26T11:46:12.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6549999999999999e-05 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097728+0000", 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4244000000000002e-05 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097973+0000", 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024436199999999998 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.104744+0000", 2024-04-26T11:46:12.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0067715420000000002 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.104812+0000", 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7485999999999997e-05 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.105008+0000", 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196004 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2659 4.23 4:c40e78fc:::10000000dbb.00000000:head [write 0~1710] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.099004+0000", 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.7416027029999999, 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068180070000000001, 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2659 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:12.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099004+0000", 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099004+0000", 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099002+0000", 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099016+0000", 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4070000000000001e-05 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099039+0000", 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3269e-05 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099054+0000", 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4486e-05 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099165+0000", 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000110862 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.099470+0000", 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00030479999999999998 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.105689+0000", 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0062189999999999997 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.105744+0000", 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5024e-05 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.105822+0000", 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8678999999999997e-05 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:12.947 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:12.949 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:12.950 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:12.945+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:13.050 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:13.045+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:13.067 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:13.067 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:13.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.067 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:3807 4.30 4:0ca8a0e2:::10000001256.00000000:head [write 0~1026 in=1026b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:13.067 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:13.067312+0000", 2024-04-26T11:46:13.067 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00037539799999999999, 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00041615199999999998, 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 3807 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:13.067312+0000", 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:13.067312+0000", 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:13.067310+0000", 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:13.067322+0000", 2024-04-26T11:46:13.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2245999999999999e-05 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:13.067352+0000", 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9533e-05 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:13.067366+0000", 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4686e-05 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:13.067434+0000", 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7601999999999994e-05 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:13.067652+0000", 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000218412 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-26T11:46:13.071 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:13.078 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:13.150 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:13.146+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:13.185 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:13.186 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:13.186 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:13.186 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:13.186 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:13.196 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:13.251 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:13.246+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:13.310 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:13.310 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:13.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:13.310 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:13.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.310 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:13.310 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:13.310 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.902169593, 2024-04-26T11:46:13.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:46:13.310 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:46:13.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:46:13.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:46:13.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:46:13.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.902099101, 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.316 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:13.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.321 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.702549257, 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.322 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:13.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:13.327 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.702517538, 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:13.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:13.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:13.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.70247596900001, 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:13.333 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:13.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:13.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.338 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.702348832, 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:13.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:13.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:13.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:13.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:13.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.875579152, 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:13.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:13.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:13.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:13.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:13.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.87547856400001, 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:13.352 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:13.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:13.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:13.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:13.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:13.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:13.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:13.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:13.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:13.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.87540987200001, 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.359 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:13.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:13.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:13.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:13.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:13.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:13.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:13.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.87530625399999, 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:13.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:13.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:13.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:13.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:13.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:13.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:13.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:13.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:13.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:13.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:13.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.875182404, 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.374 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:13.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:13.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:13.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.875150265, 2024-04-26T11:46:13.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:13.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:13.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:13.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.875120172, 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:13.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:13.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:13.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:13.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:13.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.875089773, 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:13.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:13.399 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.87505911700001, 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:46:13.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.87501724800001, 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.406 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:13.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.412 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.874983829, 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:13.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:13.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.418 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.874835412, 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:13.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:13.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.874716318, 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:46:13.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:46:13.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 111.87461027400001, 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:13.431 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:13.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:13.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:13.437 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:13.439 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:13.434+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:13.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:13.539 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:13.534+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:13.566 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:4004 4.15 4:a8dca995:::10000001324.00000000:head [write 0~438 in=438b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.565829+0000", 2024-04-26T11:46:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00127944, 2024-04-26T11:46:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001312931, 2024-04-26T11:46:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 4004 2024-04-26T11:46:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.565829+0000", 2024-04-26T11:46:13.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.565829+0000", 2024-04-26T11:46:13.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.565827+0000", 2024-04-26T11:46:13.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:13.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.565839+0000", 2024-04-26T11:46:13.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1868999999999999e-05 2024-04-26T11:46:13.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.565861+0000", 2024-04-26T11:46:13.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1690000000000001e-05 2024-04-26T11:46:13.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.565871+0000", 2024-04-26T11:46:13.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0961999999999999e-05 2024-04-26T11:46:13.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.565957+0000", 2024-04-26T11:46:13.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5513999999999995e-05 2024-04-26T11:46:13.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.566155+0000", 2024-04-26T11:46:13.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019794999999999999 2024-04-26T11:46:13.578 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.578 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.578 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.579 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.579 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:46:13.579 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 1 2024-04-26T11:46:13.579 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:13.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:13.640 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:13.634+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:13.684 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:13.684 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:13.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:13.741 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:13.738+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:13.797 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 121.617335838, 2024-04-26T11:46:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 121.386356222, 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:46:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.804 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.804 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:13.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:13.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.808 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.36518456899999, 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:13.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:13.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:13.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:13.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:13.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:13.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:13.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:13.814 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.365046831, 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.364917682, 2024-04-26T11:46:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:13.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:13.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:13.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:13.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:13.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.364826294, 2024-04-26T11:46:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.364541972, 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.364438494, 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.36438814500001, 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.36434932, 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 112.364284719, 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~3763435 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.7699576509999999, 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025884015, 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025210+0000", 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033624+0000", 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084137780000000002 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033667+0000", 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3615999999999997e-05 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033685+0000", 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7555999999999999e-05 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033843+0000", 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015836100000000001 2024-04-26T11:46:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034073+0000", 2024-04-26T11:46:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022992100000000001 2024-04-26T11:46:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034439+0000", 2024-04-26T11:46:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036520999999999998 2024-04-26T11:46:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050786+0000", 2024-04-26T11:46:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016347662999999998 2024-04-26T11:46:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050990+0000", 2024-04-26T11:46:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020404599999999999 2024-04-26T11:46:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051050+0000", 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9357000000000001e-05 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051096+0000", 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6854000000000002e-05 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2658 4.1c 4:3ac8fbef:::10000000dba.00000000:head [write 0~2397] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.6975775889999998, 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074151010000000003, 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2658 2024-04-26T11:46:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097591+0000", 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097602+0000", 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1e-05 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097627+0000", 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5463e-05 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097644+0000", 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6549999999999999e-05 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097728+0000", 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4244000000000002e-05 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097973+0000", 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024436199999999998 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.104744+0000", 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0067715420000000002 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.104812+0000", 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7485999999999997e-05 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.105008+0000", 2024-04-26T11:46:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196004 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3763 4.2a 4:54c908b0:::10000001228.00000000:head [write 0~966] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:12.933880+0000", 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.86129051999999995, 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074570590000000003, 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3763 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933880+0000", 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933880+0000", 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933878+0000", 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933889+0000", 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1691e-05 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933911+0000", 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1628e-05 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933934+0000", 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3099999999999999e-05 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.934053+0000", 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011855599999999999 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.934459+0000", 2024-04-26T11:46:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000406661 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.934811+0000", 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00035212999999999998 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.936477+0000", 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001665304 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.941164+0000", 2024-04-26T11:46:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004687709 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.941228+0000", 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3911999999999994e-05 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.941337+0000", 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000108282 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3846 4.2 4:42323a98:::1000000127e.00000000:head [write 0~1562] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63594970900000003, 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010084601, 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3846 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159214+0000", 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999938 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159229+0000", 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4737e-05 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159249+0000", 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9698999999999999e-05 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159264+0000", 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.482e-05 2024-04-26T11:46:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159361+0000", 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7941000000000003e-05 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159584+0000", 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022279900000000001 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159789+0000", 2024-04-26T11:46:13.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020488200000000001 2024-04-26T11:46:13.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161711+0000", 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019214010000000001 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169027+0000", 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073162640000000003 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169153+0000", 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000126148 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169305+0000", 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015201 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3847 4.33 4:ce75a82d:::1000000127f.00000000:head [write 0~1713] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63361461699999999, 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012299123, 2024-04-26T11:46:13.879 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3847 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161554+0000", 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161566+0000", 2024-04-26T11:46:13.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2318e-05 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161583+0000", 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7238999999999999e-05 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161594+0000", 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1049999999999999e-05 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161718+0000", 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012344499999999999 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161952+0000", 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00023438800000000001 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173488+0000", 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011536141999999999 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173634+0000", 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014584999999999999 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173855+0000", 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022062199999999999 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.884 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3849 4.2a 4:5538d2f6:::10000001281.00000000:head [write 0~1619] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62914821099999996, 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012744805, 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3849 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166020+0000", 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:13.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166032+0000", 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1617000000000001e-05 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166060+0000", 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8305000000000001e-05 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166072+0000", 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1790000000000001e-05 2024-04-26T11:46:13.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166170+0000", 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7869999999999996e-05 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166400+0000", 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000230225 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166599+0000", 2024-04-26T11:46:13.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000199309 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169074+0000", 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024746099999999999 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178631+0000", 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0095572379999999992 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178704+0000", 2024-04-26T11:46:13.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3087e-05 2024-04-26T11:46:13.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178767+0000", 2024-04-26T11:46:13.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2619000000000005e-05 2024-04-26T11:46:13.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.890 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3850 4.24 4:25f4c4ee:::10000001282.00000000:head [write 0~1303] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62679852599999997, 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010335007, 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3850 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168370+0000", 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168380+0000", 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6700000000000006e-06 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168401+0000", 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1486000000000001e-05 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168411+0000", 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9569999999999997e-06 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168519+0000", 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010799800000000001 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168680+0000", 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000161223 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168842+0000", 2024-04-26T11:46:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016166999999999999 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170758+0000", 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001916261 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178472+0000", 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0077135160000000001 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178606+0000", 2024-04-26T11:46:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000134535 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178707+0000", 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100061 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3851 4.27 4:e5b002c9:::10000001283.00000000:head [write 0~1601] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62472614800000004, 2024-04-26T11:46:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090274799999999992, 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3851 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170442+0000", 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170453+0000", 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1022000000000001e-05 2024-04-26T11:46:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170475+0000", 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2209999999999999e-05 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170490+0000", 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4632e-05 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170561+0000", 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1180999999999995e-05 2024-04-26T11:46:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170827+0000", 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00026568199999999999 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.171005+0000", 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000178476 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173616+0000", 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026110090000000001 2024-04-26T11:46:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179233+0000", 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056164120000000003 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179351+0000", 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011789400000000001 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179471+0000", 2024-04-26T11:46:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120745 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3852 4.3f 4:fc632f0d:::10000001284.00000000:head [write 0~1546] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.172423+0000", 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62274657099999997, 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074005360000000001, 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3852 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172423+0000", 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172423+0000", 2024-04-26T11:46:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172422+0000", 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172433+0000", 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1168e-05 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172456+0000", 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2677e-05 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172467+0000", 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1174e-05 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172561+0000", 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4135000000000006e-05 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172868+0000", 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00030679999999999998 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179501+0000", 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066330540000000002 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179644+0000", 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000143344 2024-04-26T11:46:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179824+0000", 2024-04-26T11:46:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017992400000000001 2024-04-26T11:46:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:13.907 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:13.909 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:13.909 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:13.902+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:14.010 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:14.006+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:14.024 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:14.024 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:14.024 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:14.024 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:14.035 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:14.053 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:46:14.111 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:14.106+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:14.154 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:14.154 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:14.164 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:14.212 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:14.209+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:14.276 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:14.276 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:14.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.870757739, 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.277 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:46:14.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.87068724700001, 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:14.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.671137403, 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.288 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.671105684, 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.67106411499999, 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.670936978, 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.844167298, 2024-04-26T11:46:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.84406671000001, 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:14.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:14.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.84399801799999, 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:14.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:14.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:14.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:14.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:14.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:14.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:14.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.8438944, 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:14.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:14.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:14.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:14.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.84377055, 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:14.341 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:14.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:14.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:14.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:14.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:14.347 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.347 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.347 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.843738411, 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:14.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:14.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.843708318, 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:14.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:14.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.843677919, 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:14.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:14.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.84364726299999, 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:46:14.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.371 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.84360539399999, 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:14.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:14.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:14.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.843571975, 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:14.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:14.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:14.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.383 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.843423558, 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:14.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:14.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.389 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.843304464, 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:46:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:46:14.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:46:14.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:46:14.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:46:14.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.84319841999999, 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:14.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:14.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:14.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:14.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:14.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:14.402 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.402 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.402 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.402 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:14.402 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:14.402 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:14.403 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:14.398+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:14.404 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:14.504 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:14.498+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:14.522 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:14.522 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:14.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.522 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:4380 4.1c 4:3a917e84:::100000014b8.00000000:head [write 0~1227 in=1227b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:14.522 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:14.520891+0000", 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0019237939999999999, 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019665770000000002, 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 4380 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:14.520891+0000", 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:14.520891+0000", 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:14.520890+0000", 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:14.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:14.520902+0000", 2024-04-26T11:46:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2183e-05 2024-04-26T11:46:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:14.520932+0000", 2024-04-26T11:46:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0753000000000002e-05 2024-04-26T11:46:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:14.520954+0000", 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1826000000000001e-05 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:14.521059+0000", 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000104805 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:14.521282+0000", 2024-04-26T11:46:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022266899999999999 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:14.522772+0000", 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001490157 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 1 2024-04-26T11:46:14.527 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:14.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:14.606 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:14.601+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:14.637 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:14.638 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:14.638 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:14.638 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:14.638 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:14.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:14.707 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:14.702+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:14.805 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:14.805 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:14.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:14.805 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:14.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.805 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:14.805 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:14.805 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 122.623432919, 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:14.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:14.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:14.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:14.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:14.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:14.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.811 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.811 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:46:14.812 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:14.812 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 122.392453303, 2024-04-26T11:46:14.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:46:14.812 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.812 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.812 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:14.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:14.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:46:14.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:46:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:46:14.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:14.816 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.37128165, 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:14.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:14.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:14.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:14.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:14.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:14.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:14.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:14.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:14.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.824 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.824 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:14.824 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.37114391199999, 2024-04-26T11:46:14.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:14.824 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.824 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.824 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:14.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:14.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:14.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:14.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:14.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:14.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:14.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:14.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:14.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.37101476300001, 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:14.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:14.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:14.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:14.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:14.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:14.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:14.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.370923375, 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:14.836 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:14.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.842 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.842 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.842 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:14.842 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.370639053, 2024-04-26T11:46:14.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.37053557500001, 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:14.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.370485226, 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:14.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.859 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.370446401, 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:14.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:14.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:14.863 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 113.3703818, 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:14.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~3763435 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7760547320000004, 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025884015, 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025210+0000", 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033624+0000", 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084137780000000002 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033667+0000", 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3615999999999997e-05 2024-04-26T11:46:14.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033685+0000", 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7555999999999999e-05 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033843+0000", 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015836100000000001 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034073+0000", 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022992100000000001 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034439+0000", 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036520999999999998 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050786+0000", 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016347662999999998 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050990+0000", 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020404599999999999 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051050+0000", 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9357000000000001e-05 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051096+0000", 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6854000000000002e-05 2024-04-26T11:46:14.872 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2658 4.1c 4:3ac8fbef:::10000000dba.00000000:head [write 0~2397] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7036746699999998, 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074151010000000003, 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:14.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2658 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:14.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097591+0000", 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097602+0000", 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1e-05 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097627+0000", 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5463e-05 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097644+0000", 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6549999999999999e-05 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097728+0000", 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4244000000000002e-05 2024-04-26T11:46:14.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097973+0000", 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024436199999999998 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.104744+0000", 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0067715420000000002 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.104812+0000", 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7485999999999997e-05 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.105008+0000", 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196004 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3763 4.2a 4:54c908b0:::10000001228.00000000:head [write 0~966] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:12.933880+0000", 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.8673876009999999, 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074570590000000003, 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3763 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933880+0000", 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933880+0000", 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933878+0000", 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:14.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933889+0000", 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1691e-05 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933911+0000", 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1628e-05 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933934+0000", 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3099999999999999e-05 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.934053+0000", 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011855599999999999 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.934459+0000", 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000406661 2024-04-26T11:46:14.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.934811+0000", 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00035212999999999998 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.936477+0000", 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001665304 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.941164+0000", 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004687709 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.941228+0000", 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3911999999999994e-05 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.941337+0000", 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000108282 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.884 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3846 4.2 4:42323a98:::1000000127e.00000000:head [write 0~1562] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.64204679, 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010084601, 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3846 2024-04-26T11:46:14.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159214+0000", 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999938 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159229+0000", 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4737e-05 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159249+0000", 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9698999999999999e-05 2024-04-26T11:46:14.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159264+0000", 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.482e-05 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159361+0000", 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7941000000000003e-05 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159584+0000", 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022279900000000001 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159789+0000", 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020488200000000001 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161711+0000", 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019214010000000001 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169027+0000", 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073162640000000003 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169153+0000", 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000126148 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169305+0000", 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015201 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.890 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3847 4.33 4:ce75a82d:::1000000127f.00000000:head [write 0~1713] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.6397116980000002, 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012299123, 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:14.891 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3847 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161554+0000", 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161566+0000", 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2318e-05 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161583+0000", 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7238999999999999e-05 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161594+0000", 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1049999999999999e-05 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161718+0000", 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012344499999999999 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161952+0000", 2024-04-26T11:46:14.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00023438800000000001 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173488+0000", 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011536141999999999 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173634+0000", 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014584999999999999 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173855+0000", 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022062199999999999 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3849 4.2a 4:5538d2f6:::10000001281.00000000:head [write 0~1619] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.635245292, 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012744805, 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.896 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3849 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:14.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166020+0000", 2024-04-26T11:46:14.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:14.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166032+0000", 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1617000000000001e-05 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166060+0000", 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8305000000000001e-05 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166072+0000", 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1790000000000001e-05 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166170+0000", 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7869999999999996e-05 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166400+0000", 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000230225 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166599+0000", 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000199309 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169074+0000", 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024746099999999999 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178631+0000", 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0095572379999999992 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178704+0000", 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3087e-05 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178767+0000", 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2619000000000005e-05 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3850 4.24 4:25f4c4ee:::10000001282.00000000:head [write 0~1303] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:14.902 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.632895607, 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010335007, 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3850 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168370+0000", 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168380+0000", 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6700000000000006e-06 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168401+0000", 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1486000000000001e-05 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168411+0000", 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9569999999999997e-06 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168519+0000", 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010799800000000001 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168680+0000", 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000161223 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168842+0000", 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016166999999999999 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170758+0000", 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001916261 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178472+0000", 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0077135160000000001 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178606+0000", 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000134535 2024-04-26T11:46:14.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178707+0000", 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100061 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3851 4.27 4:e5b002c9:::10000001283.00000000:head [write 0~1601] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.630823229, 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090274799999999992, 2024-04-26T11:46:14.908 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.909 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.909 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:14.909 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:14.909 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:14.909 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3851 2024-04-26T11:46:14.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.909 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:14.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:14.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170442+0000", 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170453+0000", 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1022000000000001e-05 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170475+0000", 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2209999999999999e-05 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170490+0000", 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4632e-05 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170561+0000", 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1180999999999995e-05 2024-04-26T11:46:14.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170827+0000", 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00026568199999999999 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.171005+0000", 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000178476 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:14.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173616+0000", 2024-04-26T11:46:14.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026110090000000001 2024-04-26T11:46:14.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179233+0000", 2024-04-26T11:46:14.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056164120000000003 2024-04-26T11:46:14.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179351+0000", 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011789400000000001 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179471+0000", 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120745 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3852 4.3f 4:fc632f0d:::10000001284.00000000:head [write 0~1546] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:14.915 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.172423+0000", 2024-04-26T11:46:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.628843652, 2024-04-26T11:46:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074005360000000001, 2024-04-26T11:46:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3852 2024-04-26T11:46:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172423+0000", 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172423+0000", 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172422+0000", 2024-04-26T11:46:14.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172433+0000", 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1168e-05 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172456+0000", 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2677e-05 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172467+0000", 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1174e-05 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172561+0000", 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4135000000000006e-05 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172868+0000", 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00030679999999999998 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179501+0000", 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066330540000000002 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179644+0000", 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000143344 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179824+0000", 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017992400000000001 2024-04-26T11:46:14.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.921 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.921 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.921 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:14.921 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:14.921 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:14.921 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:14.923 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:14.918+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:14.923 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:15.023 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:15.018+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:15.043 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:15.043 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:15.043 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:15.043 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:46:15.054 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:15.073 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:15.106 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:15.106 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:15.107 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:15.107 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:15.109 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:15.110 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:15.124 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:15.118+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:15.160 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:15.160 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:15.170 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:15.226 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:15.222+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:15.287 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:15.287 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:15.298 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:15.342 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:15.338+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:15.411 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:15.411 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:15.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:15.428 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:15.422+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:15.524 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:15.524 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:15.528 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:15.522+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:15.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:15.629 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:15.622+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:15.640 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:15.640 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:15.650 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:15.730 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:15.726+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:15.769 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:15.769 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:15.780 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:15.832 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:15.826+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:15.886 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:15.887 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:15.898 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:15.933 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:15.929+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:16.034 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:16.030+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:16.054 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:16.055 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:16.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:16.134 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:16.129+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:16.181 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:16.181 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:16.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:16.235 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:16.230+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:16.336 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:16.330+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:16.357 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:16.357 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:16.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:16.437 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:16.433+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:16.474 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:16.474 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:16.484 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:16.538 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:16.533+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:16.605 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:16.605 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:16.616 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:16.639 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:16.634+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:16.729 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:16.729 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:16.740 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:16.740 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:16.734+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:16.842 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:16.838+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:16.851 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:16.852 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:16.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:16.942 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:16.937+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:16.978 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:16.978 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:16.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:17.043 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:17.038+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:17.063 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:46:17.110 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:17.143 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:17.141+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:17.159 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:17.159 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:17.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:17.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-04-26T11:46:17.244 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:17.238+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:17.266 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 125.10804718999999, 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.289 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.294 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:109 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'71, mlcod=11'67)", 2024-04-26T11:46:17.294 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:17.294 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 124.87706757399999, 2024-04-26T11:46:17.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075353649999999996, 2024-04-26T11:46:17.294 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.294 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.294 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408814+0000", 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408813+0000", 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408908+0000", 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5397999999999997e-05 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408935+0000", 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6693999999999999e-05 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.408946+0000", 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0677e-05 2024-04-26T11:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409006+0000", 2024-04-26T11:46:17.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0378999999999999e-05 2024-04-26T11:46:17.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.409033+0000", 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7010000000000001e-05 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416261+0000", 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072276199999999997 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.416349+0000", 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8582e-05 2024-04-26T11:46:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 115.855895921, 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 115.85575818300001, 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.304 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:17.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.309 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 115.855629034, 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:17.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:17.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:17.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:17.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:17.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:17.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.315 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 115.855537646, 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:17.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 115.855253324, 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.321 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.326 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 115.855149846, 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:17.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:17.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:17.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:17.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:17.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:17.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 115.855099497, 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:17.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:17.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:17.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:17.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:17.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.338 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 115.85506067199999, 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:17.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:17.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 115.854996071, 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:17.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:17.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:17.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:17.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:17.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:17.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:17.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.347 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~3763435 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.2606690030000003, 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025884015, 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025210+0000", 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033624+0000", 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084137780000000002 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033667+0000", 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3615999999999997e-05 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033685+0000", 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7555999999999999e-05 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033843+0000", 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015836100000000001 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034073+0000", 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022992100000000001 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034439+0000", 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036520999999999998 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050786+0000", 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016347662999999998 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050990+0000", 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020404599999999999 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051050+0000", 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9357000000000001e-05 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051096+0000", 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6854000000000002e-05 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.352 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:2658 4.1c 4:3ac8fbef:::10000000dba.00000000:head [write 0~2397] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.1882889409999997, 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074151010000000003, 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2658 2024-04-26T11:46:17.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097592+0000", 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097591+0000", 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097602+0000", 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1e-05 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097627+0000", 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5463e-05 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097644+0000", 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6549999999999999e-05 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097728+0000", 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4244000000000002e-05 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.097973+0000", 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024436199999999998 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.104744+0000", 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0067715420000000002 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.104812+0000", 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7485999999999997e-05 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.105008+0000", 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196004 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3763 4.2a 4:54c908b0:::10000001228.00000000:head [write 0~966] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:12.933880+0000", 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.3520018719999998, 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074570590000000003, 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3763 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.358 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933880+0000", 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933880+0000", 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933878+0000", 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:17.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933889+0000", 2024-04-26T11:46:17.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1691e-05 2024-04-26T11:46:17.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933911+0000", 2024-04-26T11:46:17.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1628e-05 2024-04-26T11:46:17.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.933934+0000", 2024-04-26T11:46:17.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3099999999999999e-05 2024-04-26T11:46:17.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.934053+0000", 2024-04-26T11:46:17.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011855599999999999 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.934459+0000", 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000406661 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.934811+0000", 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00035212999999999998 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.936477+0000", 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001665304 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.941164+0000", 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004687709 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.941228+0000", 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3911999999999994e-05 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:12.941337+0000", 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000108282 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3846 4.2 4:42323a98:::1000000127e.00000000:head [write 0~1562] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1266610610000001, 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010084601, 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.364 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3846 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159214+0000", 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999938 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159229+0000", 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4737e-05 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159249+0000", 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9698999999999999e-05 2024-04-26T11:46:17.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159264+0000", 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.482e-05 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159361+0000", 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7941000000000003e-05 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159584+0000", 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022279900000000001 2024-04-26T11:46:17.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159789+0000", 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020488200000000001 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161711+0000", 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019214010000000001 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169027+0000", 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073162640000000003 2024-04-26T11:46:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169153+0000", 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000126148 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169305+0000", 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015201 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3847 4.33 4:ce75a82d:::1000000127f.00000000:head [write 0~1713] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.124325969, 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012299123, 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3847 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161554+0000", 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161566+0000", 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2318e-05 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161583+0000", 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7238999999999999e-05 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161594+0000", 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1049999999999999e-05 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161718+0000", 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012344499999999999 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161952+0000", 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00023438800000000001 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173488+0000", 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011536141999999999 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173634+0000", 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014584999999999999 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173855+0000", 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022062199999999999 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3849 4.2a 4:5538d2f6:::10000001281.00000000:head [write 0~1619] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:17.374 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1198595630000003, 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012744805, 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3849 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166020+0000", 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166032+0000", 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1617000000000001e-05 2024-04-26T11:46:17.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166060+0000", 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8305000000000001e-05 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166072+0000", 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1790000000000001e-05 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166170+0000", 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7869999999999996e-05 2024-04-26T11:46:17.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166400+0000", 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000230225 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166599+0000", 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000199309 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169074+0000", 2024-04-26T11:46:17.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024746099999999999 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178631+0000", 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0095572379999999992 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178704+0000", 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3087e-05 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178767+0000", 2024-04-26T11:46:17.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2619000000000005e-05 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3850 4.24 4:25f4c4ee:::10000001282.00000000:head [write 0~1303] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1175098779999999, 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010335007, 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:17.380 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3850 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168370+0000", 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168380+0000", 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6700000000000006e-06 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168401+0000", 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1486000000000001e-05 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168411+0000", 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9569999999999997e-06 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168519+0000", 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010799800000000001 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168680+0000", 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000161223 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168842+0000", 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016166999999999999 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170758+0000", 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001916261 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178472+0000", 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0077135160000000001 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178606+0000", 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000134535 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178707+0000", 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100061 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3851 4.27 4:e5b002c9:::10000001283.00000000:head [write 0~1601] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1154374999999996, 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090274799999999992, 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3851 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170442+0000", 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170453+0000", 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1022000000000001e-05 2024-04-26T11:46:17.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170475+0000", 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2209999999999999e-05 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170490+0000", 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4632e-05 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170561+0000", 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1180999999999995e-05 2024-04-26T11:46:17.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170827+0000", 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00026568199999999999 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.171005+0000", 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000178476 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173616+0000", 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026110090000000001 2024-04-26T11:46:17.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179233+0000", 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056164120000000003 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179351+0000", 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011789400000000001 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179471+0000", 2024-04-26T11:46:17.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120745 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3852 4.3f 4:fc632f0d:::10000001284.00000000:head [write 0~1546] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.172423+0000", 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1134579230000003, 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074005360000000001, 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:17.391 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3852 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172423+0000", 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172423+0000", 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172422+0000", 2024-04-26T11:46:17.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172433+0000", 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1168e-05 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172456+0000", 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2677e-05 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172467+0000", 2024-04-26T11:46:17.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1174e-05 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172561+0000", 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4135000000000006e-05 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.172868+0000", 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00030679999999999998 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179501+0000", 2024-04-26T11:46:17.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066330540000000002 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179644+0000", 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000143344 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179824+0000", 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017992400000000001 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:17.395 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:17.396 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:17.396 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:17.398 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:17.398 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:17.398 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:17.393+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:17.399 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:17.399 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:17.399 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:17.399 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:17.498 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:17.493+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:17.520 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:17.520 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:17.520 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:17.520 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:17.530 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:17.599 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:17.594+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:17.638 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:17.639 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:17.639 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:17.639 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:17.639 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:17.649 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:17.700 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:17.697+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:17.759 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:17.759 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.353429754, 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:17.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:46:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:46:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:46:17.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:46:17.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:46:17.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:46:17.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:46:17.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:46:17.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.766 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.353359262, 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:17.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:17.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:17.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:17.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:17.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:17.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:17.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:17.772 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.15380941799999, 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:17.773 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:17.774 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:17.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.774 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:17.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:17.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:17.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:17.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:17.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.153777699, 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:17.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.15373613, 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.785 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:17.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:17.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.15360899300001, 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.791 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.32683931299999, 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:17.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:17.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.326738725, 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:17.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:17.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.326670033, 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:17.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:17.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:17.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.326566415, 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.815 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:17.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:17.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:17.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:17.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.822 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.32644256499999, 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:17.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:17.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:17.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.828 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.326410426, 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:17.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:17.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:17.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:17.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:17.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:17.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:17.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:17.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.326380333, 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:17.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:17.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:17.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.32634993400001, 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:17.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:17.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.326319278, 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.847 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:17.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:46:17.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:46:17.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.326277409, 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:17.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:17.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:17.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.32624398999999, 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:17.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.326095573, 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.865 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:17.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:17.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.325976479, 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:46:17.871 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:46:17.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:46:17.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:17.877 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.325870435, 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:17.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:17.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:17.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:17.883 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:17.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:17.886 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:17.881+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:17.986 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:17.982+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:18.002 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:5681 4.2a 4:56047cab:::10000001a28.00000000:head [write 0~4810 in=4810b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:18.001124+0000", 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001830136, 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001869395, 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 5681 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.001124+0000", 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.001124+0000", 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.001122+0000", 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.001159+0000", 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759000000000002e-05 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.001186+0000", 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6346000000000002e-05 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.001199+0000", 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3115999999999999e-05 2024-04-26T11:46:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.001301+0000", 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010172500000000001 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.001616+0000", 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00031547999999999998 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.001928+0000", 2024-04-26T11:46:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00031240800000000002 2024-04-26T11:46:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:46:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 1 2024-04-26T11:46:18.007 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:18.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:18.066 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:46:18.087 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:18.081+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:18.123 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:18.123 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:18.123 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:18.123 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:18.123 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:18.132 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:18.188 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:18.185+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:18.250 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:18.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:18.250 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:18.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.250 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:18.250 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:18.250 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 126.068817247, 2024-04-26T11:46:18.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:18.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.255 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.255 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.255 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.255 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:18.255 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.816665978, 2024-04-26T11:46:18.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:18.255 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.255 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:18.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:18.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:18.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:18.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:18.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.81652824, 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.261 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.267 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.267 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:18.267 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.81639909099999, 2024-04-26T11:46:18.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:18.267 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.268 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.268 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:18.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:18.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:18.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.81630770300001, 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.273 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:18.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.278 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.81602338099999, 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:18.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.284 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.81591990299999, 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:18.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:18.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:18.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:18.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:18.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.815869554, 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:18.290 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:18.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.815830729, 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 116.81576612800001, 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:18.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~3763435 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.2214390599999998, 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025884015, 2024-04-26T11:46:18.304 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025210+0000", 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033624+0000", 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084137780000000002 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033667+0000", 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3615999999999997e-05 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033685+0000", 2024-04-26T11:46:18.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7555999999999999e-05 2024-04-26T11:46:18.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033843+0000", 2024-04-26T11:46:18.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015836100000000001 2024-04-26T11:46:18.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034073+0000", 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022992100000000001 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034439+0000", 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036520999999999998 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050786+0000", 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016347662999999998 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050990+0000", 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020404599999999999 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051050+0000", 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9357000000000001e-05 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051096+0000", 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6854000000000002e-05 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3846 4.2 4:42323a98:::1000000127e.00000000:head [write 0~1562] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.0874311179999996, 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010084601, 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.310 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.311 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:18.311 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:18.311 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:18.311 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3846 2024-04-26T11:46:18.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.311 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:18.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159214+0000", 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999938 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159229+0000", 2024-04-26T11:46:18.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4737e-05 2024-04-26T11:46:18.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159249+0000", 2024-04-26T11:46:18.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9698999999999999e-05 2024-04-26T11:46:18.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159264+0000", 2024-04-26T11:46:18.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.482e-05 2024-04-26T11:46:18.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159361+0000", 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7941000000000003e-05 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159584+0000", 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022279900000000001 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159789+0000", 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020488200000000001 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161711+0000", 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019214010000000001 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169027+0000", 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073162640000000003 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169153+0000", 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000126148 2024-04-26T11:46:18.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169305+0000", 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015201 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3847 4.33 4:ce75a82d:::1000000127f.00000000:head [write 0~1713] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:18.317 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.0850960260000004, 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012299123, 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3847 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161554+0000", 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161566+0000", 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2318e-05 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161583+0000", 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7238999999999999e-05 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161594+0000", 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1049999999999999e-05 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161718+0000", 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012344499999999999 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161952+0000", 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00023438800000000001 2024-04-26T11:46:18.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173488+0000", 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011536141999999999 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173634+0000", 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014584999999999999 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173855+0000", 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022062199999999999 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3849 4.2a 4:5538d2f6:::10000001281.00000000:head [write 0~1619] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.0806296199999998, 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012744805, 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:18.323 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3849 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:18.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166020+0000", 2024-04-26T11:46:18.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:18.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166032+0000", 2024-04-26T11:46:18.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1617000000000001e-05 2024-04-26T11:46:18.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166060+0000", 2024-04-26T11:46:18.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8305000000000001e-05 2024-04-26T11:46:18.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166072+0000", 2024-04-26T11:46:18.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1790000000000001e-05 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166170+0000", 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7869999999999996e-05 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166400+0000", 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000230225 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166599+0000", 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000199309 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169074+0000", 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024746099999999999 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178631+0000", 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0095572379999999992 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178704+0000", 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3087e-05 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178767+0000", 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2619000000000005e-05 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.329 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3850 4.24 4:25f4c4ee:::10000001282.00000000:head [write 0~1303] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.0782799350000003, 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010335007, 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3850 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168370+0000", 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168380+0000", 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6700000000000006e-06 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168401+0000", 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1486000000000001e-05 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168411+0000", 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9569999999999997e-06 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168519+0000", 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010799800000000001 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168680+0000", 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000161223 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168842+0000", 2024-04-26T11:46:18.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016166999999999999 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170758+0000", 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001916261 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178472+0000", 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0077135160000000001 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178606+0000", 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000134535 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178707+0000", 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100061 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3851 4.27 4:e5b002c9:::10000001283.00000000:head [write 0~1601] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:18.335 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.076207557, 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090274799999999992, 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3851 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170442+0000", 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170453+0000", 2024-04-26T11:46:18.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1022000000000001e-05 2024-04-26T11:46:18.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170475+0000", 2024-04-26T11:46:18.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2209999999999999e-05 2024-04-26T11:46:18.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170490+0000", 2024-04-26T11:46:18.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4632e-05 2024-04-26T11:46:18.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170561+0000", 2024-04-26T11:46:18.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1180999999999995e-05 2024-04-26T11:46:18.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170827+0000", 2024-04-26T11:46:18.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00026568199999999999 2024-04-26T11:46:18.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.171005+0000", 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000178476 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173616+0000", 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026110090000000001 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179233+0000", 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056164120000000003 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179351+0000", 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011789400000000001 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179471+0000", 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120745 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.341 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:5659 4.3 4:c3e6c56c:::10000001a0e.00000000:head [write 0~2233] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:17.932627+0000", 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31402409399999998, 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082750700000000007, 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:18.342 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 5659 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932627+0000", 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932627+0000", 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932625+0000", 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932639+0000", 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3307e-05 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932666+0000", 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7160000000000001e-05 2024-04-26T11:46:18.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932678+0000", 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2496e-05 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932769+0000", 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1131000000000006e-05 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.933001+0000", 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000231549 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.933195+0000", 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000194153 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.936346+0000", 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031514440000000002 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.940802+0000", 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044556259999999999 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.940869+0000", 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6661000000000004e-05 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.940902+0000", 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3683000000000003e-05 2024-04-26T11:46:18.347 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:5663 4.3e 4:7c52bdec:::10000001a12.00000000:head [write 0~3730] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:17.941638+0000", 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30501299799999998, 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0089315330000000002, 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:18.348 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 5663 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941638+0000", 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941638+0000", 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941637+0000", 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941647+0000", 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.011e-05 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941666+0000", 2024-04-26T11:46:18.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.895e-05 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941677+0000", 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.042e-05 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941810+0000", 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013376800000000001 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.942096+0000", 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028589099999999998 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.950253+0000", 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0081567930000000007 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.950365+0000", 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011194200000000001 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.950570+0000", 2024-04-26T11:46:18.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000205062 2024-04-26T11:46:18.353 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.353 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.353 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.353 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4541.0:5664 4.25 e52/17 4:a7e350a3:::10000001a13.00000000:head v 52'80, mlcod=52'78)", 2024-04-26T11:46:18.353 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:17.945317+0000", 2024-04-26T11:46:18.353 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.301334553, 2024-04-26T11:46:18.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0078815610000000005, 2024-04-26T11:46:18.354 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.354 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.354 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945317+0000", 2024-04-26T11:46:18.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945317+0000", 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945316+0000", 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945329+0000", 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2761e-05 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945346+0000", 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7748999999999999e-05 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945355+0000", 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1939999999999998e-06 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945445+0000", 2024-04-26T11:46:18.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9899000000000001e-05 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945500+0000", 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5346999999999997e-05 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.953141+0000", 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076410820000000004 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.953198+0000", 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7469000000000002e-05 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:5665 4.8 4:113b52bd:::10000001a14.00000000:head [write 0~885] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:17.946449+0000", 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30020244099999999, 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076094860000000004, 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 5665 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.946449+0000", 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:18.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.946449+0000", 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.946448+0000", 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.946456+0000", 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1780000000000003e-06 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.946476+0000", 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9859000000000001e-05 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.946485+0000", 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2769999999999994e-06 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:18.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.946551+0000", 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6381e-05 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.946684+0000", 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013211899999999999 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.946798+0000", 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114141 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.950113+0000", 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033157870000000002 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.953882+0000", 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003768675 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.953963+0000", 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0870000000000003e-05 2024-04-26T11:46:18.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:18.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:18.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:18.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.954059+0000", 2024-04-26T11:46:18.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5507000000000006e-05 2024-04-26T11:46:18.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.364 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:18.364 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:18.364 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:18.366 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:18.366 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:18.362+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:18.466 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:18.462+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:18.483 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:18.483 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:18.484 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:18.484 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:18.494 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:18.567 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:18.562+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:18.596 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:18.596 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:18.606 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:18.668 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:18.664+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:18.761 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.355794016, 2024-04-26T11:46:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:46:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:46:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:46:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.355723524, 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.15617367999999, 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.156141961, 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.156100392, 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.15597325500001, 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.32920357499999, 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.329102987, 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.329034295, 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.328930677, 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.32880682699999, 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.328774688, 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.328744595, 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.32871419600001, 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.32868354, 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.328641671, 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.328608252, 2024-04-26T11:46:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.328459835, 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.32834074100001, 2024-04-26T11:46:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.328234697, 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:18.881 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:18.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:18.883 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:18.876+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:18.983 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:18.980+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:18.999 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:18.999 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:18.999 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:18.999 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:19.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:19.084 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:19.078+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:19.105 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:19.106 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:19.106 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:19.106 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:19.106 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:19.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:19.185 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:19.182+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:19.225 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4165.0:85 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'55, mlcod=11'50)", 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 127.04520554200001, 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085186229999999995, 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177834+0000", 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177833+0000", 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177841+0000", 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177855+0000", 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.417e-05 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177877+0000", 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1146999999999999e-05 2024-04-26T11:46:19.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.177991+0000", 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114364 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.178035+0000", 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3618999999999997e-05 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186253+0000", 2024-04-26T11:46:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082183129999999997 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:12.186353+0000", 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9977999999999997e-05 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.793054273, 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017676453000000002, 2024-04-26T11:46:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429985+0000", 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429983+0000", 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.429997+0000", 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3699999999999999e-05 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430065+0000", 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7713999999999996e-05 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430096+0000", 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1569000000000002e-05 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.434835+0000", 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047390080000000003 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.435971+0000", 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001136034 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436151+0000", 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017989500000000001 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.439331+0000", 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003179393 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447402+0000", 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080713360000000001 2024-04-26T11:46:19.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447589+0000", 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000186894 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447662+0000", 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3070000000000003e-05 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.235 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.792916535, 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017695295999999999, 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430123+0000", 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430122+0000", 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430131+0000", 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3449999999999995e-06 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430162+0000", 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0281999999999999e-05 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430205+0000", 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3637000000000003e-05 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436676+0000", 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064709290000000003 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436835+0000", 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158803 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436968+0000", 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013278699999999999 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442008+0000", 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050406009999999996 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447734+0000", 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057257000000000002 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447781+0000", 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447819+0000", 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7369000000000001e-05 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.240 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.792787386, 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346321000000001, 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430252+0000", 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430251+0000", 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430268+0000", 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7130999999999999e-05 2024-04-26T11:46:19.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430302+0000", 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3677000000000003e-05 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430328+0000", 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5982999999999998e-05 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436650+0000", 2024-04-26T11:46:19.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063220050000000003 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436769+0000", 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011903100000000001 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.436866+0000", 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6644000000000005e-05 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.442190+0000", 2024-04-26T11:46:19.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053242480000000002 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447407+0000", 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052172579999999998 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447468+0000", 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0862000000000001e-05 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447599+0000", 2024-04-26T11:46:19.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000130586 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.792695998, 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017525473, 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430344+0000", 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430343+0000", 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:19.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430351+0000", 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430602+0000", 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025091499999999999 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430616+0000", 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3906999999999999e-05 2024-04-26T11:46:19.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437720+0000", 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007104033 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437809+0000", 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9322999999999998e-05 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437957+0000", 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014749199999999999 2024-04-26T11:46:19.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443600+0000", 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056435909999999999 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447719+0000", 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004118526 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447817+0000", 2024-04-26T11:46:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8577000000000002e-05 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447869+0000", 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2012999999999998e-05 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.792411676, 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013040090000000001, 2024-04-26T11:46:19.251 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430628+0000", 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430627+0000", 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430650+0000", 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2853e-05 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430668+0000", 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8403e-05 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430685+0000", 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116e-05 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430819+0000", 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013339100000000001 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431200+0000", 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00038090900000000002 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431410+0000", 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021046199999999999 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437495+0000", 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060850940000000001 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443447+0000", 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059516760000000004 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443624+0000", 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017724400000000001 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.443668+0000", 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4094000000000002e-05 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.792308198, 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358424999999999, 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430732+0000", 2024-04-26T11:46:19.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430731+0000", 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430739+0000", 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0919999999999998e-06 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430753+0000", 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4092e-05 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430768+0000", 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5485000000000002e-05 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432457+0000", 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001688569 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.432604+0000", 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014676899999999999 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.433503+0000", 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089943900000000003 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437501+0000", 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039980730000000004 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.446847+0000", 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093460139999999997 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447046+0000", 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019916500000000001 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447090+0000", 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3761000000000003e-05 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.79225784899999, 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017169174999999998, 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430782+0000", 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430781+0000", 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430787+0000", 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430800+0000", 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430811+0000", 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0402e-05 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437670+0000", 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068598130000000002 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437861+0000", 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000190695 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.437985+0000", 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012364200000000001 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444070+0000", 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060848760000000003 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447897+0000", 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278069999999999 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447930+0000", 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2508000000000001e-05 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.447951+0000", 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1163999999999999e-05 2024-04-26T11:46:19.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.792219024, 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013679787000000001, 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430821+0000", 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430820+0000", 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430829+0000", 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5119999999999997e-06 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430856+0000", 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6855e-05 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430867+0000", 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430952+0000", 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5348999999999999e-05 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431196+0000", 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000243575 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.444501+0000", 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013304501 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.270 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 117.792154423, 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098105150000000006, 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430885+0000", 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430884+0000", 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430891+0000", 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430910+0000", 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9293999999999999e-05 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.430920+0000", 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.927e-06 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431461+0000", 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054085299999999999 2024-04-26T11:46:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.431666+0000", 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000204565 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:44:21.440696+0000", 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090302009999999999 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.274 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~3763435 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1978273549999994, 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025884015, 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:19.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025210+0000", 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033624+0000", 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084137780000000002 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033667+0000", 2024-04-26T11:46:19.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3615999999999997e-05 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033685+0000", 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7555999999999999e-05 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033843+0000", 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015836100000000001 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034073+0000", 2024-04-26T11:46:19.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022992100000000001 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034439+0000", 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036520999999999998 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050786+0000", 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016347662999999998 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050990+0000", 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020404599999999999 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051050+0000", 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9357000000000001e-05 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051096+0000", 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6854000000000002e-05 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3846 4.2 4:42323a98:::1000000127e.00000000:head [write 0~1562] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 6.063819413, 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010084601, 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3846 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.280 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159220+0000", 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159214+0000", 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999938 2024-04-26T11:46:19.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159229+0000", 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4737e-05 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159249+0000", 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9698999999999999e-05 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159264+0000", 2024-04-26T11:46:19.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.482e-05 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159361+0000", 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7941000000000003e-05 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159584+0000", 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022279900000000001 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.159789+0000", 2024-04-26T11:46:19.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020488200000000001 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161711+0000", 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019214010000000001 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169027+0000", 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073162640000000003 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169153+0000", 2024-04-26T11:46:19.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000126148 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169305+0000", 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015201 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3847 4.33 4:ce75a82d:::1000000127f.00000000:head [write 0~1713] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 6.061484321, 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012299123, 2024-04-26T11:46:19.285 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3847 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161555+0000", 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161554+0000", 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161566+0000", 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2318e-05 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161583+0000", 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7238999999999999e-05 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161594+0000", 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1049999999999999e-05 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161718+0000", 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012344499999999999 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.161952+0000", 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00023438800000000001 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173488+0000", 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011536141999999999 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173634+0000", 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014584999999999999 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173855+0000", 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022062199999999999 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3849 4.2a 4:5538d2f6:::10000001281.00000000:head [write 0~1619] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 6.0570179150000003, 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012744805, 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.290 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3849 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166022+0000", 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166020+0000", 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166032+0000", 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1617000000000001e-05 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166060+0000", 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8305000000000001e-05 2024-04-26T11:46:19.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166072+0000", 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1790000000000001e-05 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166170+0000", 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7869999999999996e-05 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166400+0000", 2024-04-26T11:46:19.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000230225 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.166599+0000", 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000199309 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.169074+0000", 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024746099999999999 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178631+0000", 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0095572379999999992 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178704+0000", 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3087e-05 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178767+0000", 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2619000000000005e-05 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3850 4.24 4:25f4c4ee:::10000001282.00000000:head [write 0~1303] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 6.0546682299999999, 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010335007, 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3850 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168372+0000", 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168370+0000", 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168380+0000", 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6700000000000006e-06 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168401+0000", 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1486000000000001e-05 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168411+0000", 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9569999999999997e-06 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168519+0000", 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010799800000000001 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168680+0000", 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000161223 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.168842+0000", 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016166999999999999 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170758+0000", 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001916261 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178472+0000", 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0077135160000000001 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178606+0000", 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000134535 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.178707+0000", 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100061 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:3851 4.27 4:e5b002c9:::10000001283.00000000:head [write 0~1601] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 6.0525958519999996, 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090274799999999992, 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.301 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3851 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170444+0000", 2024-04-26T11:46:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170442+0000", 2024-04-26T11:46:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170453+0000", 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1022000000000001e-05 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170475+0000", 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2209999999999999e-05 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170490+0000", 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4632e-05 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170561+0000", 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1180999999999995e-05 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.170827+0000", 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00026568199999999999 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.171005+0000", 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000178476 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.173616+0000", 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026110090000000001 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179233+0000", 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056164120000000003 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179351+0000", 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011789400000000001 2024-04-26T11:46:19.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:13.179471+0000", 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120745 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:5659 4.3 4:c3e6c56c:::10000001a0e.00000000:head [write 0~2233] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:17.932627+0000", 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.2904123890000001, 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082750700000000007, 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.307 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 5659 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932627+0000", 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932627+0000", 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932625+0000", 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932639+0000", 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3307e-05 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932666+0000", 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7160000000000001e-05 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932678+0000", 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2496e-05 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.932769+0000", 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1131000000000006e-05 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.933001+0000", 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000231549 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.933195+0000", 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000194153 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.936346+0000", 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031514440000000002 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.940802+0000", 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044556259999999999 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.940869+0000", 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6661000000000004e-05 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.940902+0000", 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3683000000000003e-05 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:5663 4.3e 4:7c52bdec:::10000001a12.00000000:head [write 0~3730] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:17.941638+0000", 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.2814012930000001, 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0089315330000000002, 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 5663 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941638+0000", 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941638+0000", 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941637+0000", 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:19.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941647+0000", 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.011e-05 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941666+0000", 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.895e-05 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941677+0000", 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.042e-05 2024-04-26T11:46:19.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.941810+0000", 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013376800000000001 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.942096+0000", 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028589099999999998 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.950253+0000", 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0081567930000000007 2024-04-26T11:46:19.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.950365+0000", 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011194200000000001 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.950570+0000", 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000205062 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4541.0:5664 4.25 e52/17 4:a7e350a3:::10000001a13.00000000:head v 52'80, mlcod=52'78)", 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:17.945317+0000", 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.277722848, 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0078815610000000005, 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945317+0000", 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945317+0000", 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945316+0000", 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945329+0000", 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2761e-05 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945346+0000", 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7748999999999999e-05 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945355+0000", 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1939999999999998e-06 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945445+0000", 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9899000000000001e-05 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.945500+0000", 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5346999999999997e-05 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.953141+0000", 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076410820000000004 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:17.953198+0000", 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7469000000000002e-05 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:179 3.1a 3:5e41ab69:::200.00000005:head [write 2422262~1772042 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:18.375959+0000", 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.84708074200000005, 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012062389999999999, 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.375959+0000", 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.375959+0000", 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.375957+0000", 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.378550+0000", 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002593021 2024-04-26T11:46:19.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.378579+0000", 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9285000000000002e-05 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.378598+0000", 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8686e-05 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.378688+0000", 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0835999999999996e-05 2024-04-26T11:46:19.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.378826+0000", 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013735700000000001 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.387792+0000", 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0089661870000000005 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.387869+0000", 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6890000000000004e-05 2024-04-26T11:46:19.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:19.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:19.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:19.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:18.388021+0000", 2024-04-26T11:46:19.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015258200000000001 2024-04-26T11:46:19.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.326 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:19.326 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:19.326 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:19.328 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:19.328 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:19.326+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:19.400 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:19.429 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:19.426+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:19.451 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:19.452 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:19.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:19.452 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:6190 4.25 4:a79b379f:::10000001c60.00000000:head [write 0~2420 in=2420b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:46:19.452 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:19.450332+0000", 2024-04-26T11:46:19.452 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0015233569999999999, 2024-04-26T11:46:19.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001557265, 2024-04-26T11:46:19.453 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:19.453 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:19.453 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:19.453 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:19.453 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:19.453 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 6190 2024-04-26T11:46:19.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:19.454 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:19.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:19.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:19.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:19.450332+0000", 2024-04-26T11:46:19.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:19.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:19.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:19.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:19.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:19.450332+0000", 2024-04-26T11:46:19.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:19.450331+0000", 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:19.450342+0000", 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1365999999999999e-05 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:19.450366+0000", 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3810000000000001e-05 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:19.450378+0000", 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1800000000000001e-05 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:19.450457+0000", 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9635000000000006e-05 2024-04-26T11:46:19.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:19.450662+0000", 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020519000000000001 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:19.450870+0000", 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020803 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:19.460 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:46:19.461 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-26T11:46:19.461 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:19.463 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:19.530 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:19.530+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:19.569 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:19.577 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:19.577 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:19.577 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:19.577 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:19.577 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:19.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:19.594 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:19.599 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:19.599 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:19.631 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:19.624+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:19.689 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:19.689 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:19.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:19.732 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:19.730+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:19.814 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:19.814 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:19.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:19.832 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:19.828+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:19.929 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:19.929 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:19.934 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:19.934+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:19.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:20.035 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:20.034+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:20.048 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:20.048 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:20.059 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:20.080 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:46:20.136 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:20.134+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:20.183 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:20.183 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:20.194 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:20.237 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:20.232+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:20.302 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:20.302 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:20.312 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:20.338 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:20.332+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:20.420 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:20.420 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:20.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:20.475 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:20.472+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:20.539 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:20.536+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:20.549 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:20.549 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:20.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:20.640 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:20.636+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:20.666 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:20.666 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:20.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:20.741 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:20.742+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:20.790 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:20.790 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:20.800 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:20.842 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:20.842+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:20.927 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:20.927 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:20.941 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:20.943 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:20.940+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:21.044 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:21.040+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:21.074 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:46:21.095 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:21.096 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:21.106 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:21.144 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:21.140+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:21.214 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:21.214 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:21.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:21.245 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:21.246+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:21.343 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:21.343 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:21.346 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:21.340+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:21.353 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:21.447 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:21.444+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:21.456 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:21.456 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:21.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:21.553 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:21.546+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:21.565 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:21.565 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:21.575 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:21.600 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:21.650 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:21.650+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:21.694 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:21.694 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:21.704 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:21.751 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:21.748+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:21.755 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:21.786 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:21.786 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:21.787 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:21.787 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:21.790 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:21.791 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:21.804 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:21.804 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:21.804 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:21.804 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:21.804 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:21.814 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:21.851 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:21.850+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:21.921 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 129.51410344499999, 2024-04-26T11:46:21.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021279783, 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 116 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402157+0000", 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402156+0000", 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402166+0000", 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:46:21.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402185+0000", 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879000000000001e-05 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402198+0000", 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2870999999999999e-05 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415642+0000", 2024-04-26T11:46:21.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013444101 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415696+0000", 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3922000000000003e-05 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.415781+0000", 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4623000000000006e-05 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417240+0000", 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001458956 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423307+0000", 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060674359999999998 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423386+0000", 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8695000000000005e-05 2024-04-26T11:46:21.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423437+0000", 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0569000000000003e-05 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 129.514032953, 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.927 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:21.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:21.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 129.31448310900001, 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:21.933 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:21.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:21.939 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 129.31445138999999, 2024-04-26T11:46:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.940 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:21.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:21.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:21.945 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 129.314409821, 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:21.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 129.31428268400001, 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.951 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:21.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:21.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:21.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:21.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:21.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.48751300399999, 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:21.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:21.965 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.966 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:21.966 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.487412416, 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:21.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:21.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:21.972 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.487343724, 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:21.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:21.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:21.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:21.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:21.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:21.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:21.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:21.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:21.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:21.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:21.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:21.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:21.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:21.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:21.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:21.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:21.980 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.487240106, 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:21.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:21.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:21.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.987 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:21.987 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:21.987 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.48711625599999, 2024-04-26T11:46:21.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:21.987 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.988 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.988 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:21.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:21.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:21.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:21.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:21.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:21.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:21.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:21.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:21.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:21.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:21.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:21.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:21.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:21.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.48708411699999, 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:21.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:22.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.487054024, 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:22.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:22.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:22.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:22.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:22.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:22.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:22.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:22.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:22.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:22.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:22.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:22.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:22.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.48702362500001, 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:22.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:22.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:22.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:22.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:22.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:22.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:22.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:22.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:22.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:22.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:22.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:22.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:22.019 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.019 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.019 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.019 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:22.019 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:22.019 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.486992969, 2024-04-26T11:46:22.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021224060999999999, 2024-04-26T11:46:22.020 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.020 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.020 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:22.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:22.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429267+0000", 2024-04-26T11:46:22.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429271+0000", 2024-04-26T11:46:22.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0430000000000001e-06 2024-04-26T11:46:22.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429279+0000", 2024-04-26T11:46:22.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.32e-06 2024-04-26T11:46:22.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429287+0000", 2024-04-26T11:46:22.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9300000000000003e-06 2024-04-26T11:46:22.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429355+0000", 2024-04-26T11:46:22.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8269999999999995e-05 2024-04-26T11:46:22.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:22.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429362+0000", 2024-04-26T11:46:22.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4590000000000003e-06 2024-04-26T11:46:22.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438643+0000", 2024-04-26T11:46:22.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092816310000000003 2024-04-26T11:46:22.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.438800+0000", 2024-04-26T11:46:22.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015644899999999999 2024-04-26T11:46:22.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.439002+0000", 2024-04-26T11:46:22.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020257399999999999 2024-04-26T11:46:22.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444004+0000", 2024-04-26T11:46:22.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050015789999999999 2024-04-26T11:46:22.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450378+0000", 2024-04-26T11:46:22.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063741559999999997 2024-04-26T11:46:22.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450431+0000", 2024-04-26T11:46:22.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3359999999999997e-05 2024-04-26T11:46:22.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450491+0000", 2024-04-26T11:46:22.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9899999999999999e-05 2024-04-26T11:46:22.034 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.035 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.035 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.035 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:22.035 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:22.036 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.4869511, 2024-04-26T11:46:22.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:22.036 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.036 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.036 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:22.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:22.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:22.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:22.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:22.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:22.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:22.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:22.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:22.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:22.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:22.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:22.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:22.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:22.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:22.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:22.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:22.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:22.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:22.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:22.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:22.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:22.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:22.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:22.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:22.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:22.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:22.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:22.048 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.048 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.048 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.049 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:22.049 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:22.049 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.48691768099999, 2024-04-26T11:46:22.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:22.050 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.050 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.050 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:22.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:22.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:22.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:22.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:22.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:22.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:22.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:22.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:22.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:22.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:22.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:22.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:22.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:22.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:22.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:22.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:22.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:22.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:22.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:22.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:22.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:22.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:22.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:22.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:22.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:22.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:22.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:22.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:22.062 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.062 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.062 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.062 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:22.062 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:22.062 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.486769264, 2024-04-26T11:46:22.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:22.063 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.063 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.063 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:22.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:22.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:22.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:22.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:22.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:22.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:22.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:22.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:22.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:22.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:22.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:22.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:22.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:22.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.48665017, 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021163646000000001, 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.071 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.072 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:22.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429610+0000", 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429609+0000", 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429616+0000", 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.17e-06 2024-04-26T11:46:22.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429633+0000", 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6339999999999999e-05 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429648+0000", 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5639000000000001e-05 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429731+0000", 2024-04-26T11:46:22.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3034999999999994e-05 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429741+0000", 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4860000000000003e-06 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441574+0000", 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011833112999999999 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441751+0000", 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177076 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441832+0000", 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1377000000000004e-05 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444444+0000", 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026116899999999998 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450680+0000", 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062362759999999998 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450725+0000", 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4795000000000001e-05 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450774+0000", 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8625999999999998e-05 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.078 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 120.486544126, 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:22.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:22.084 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.085 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.085 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.085 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.085 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.085 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:22.086 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:22.087 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:22.080+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:22.187 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:22.186+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:22.230 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:22.230 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:22.230 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:22.230 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:22.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:22.289 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:22.284+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:22.355 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:22.355 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:22.355 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:22.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:22.390 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:22.390+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:22.470 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~3763435 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.441381454, 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025884015, 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025210+0000", 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:22.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033624+0000", 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084137780000000002 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033667+0000", 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3615999999999997e-05 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033685+0000", 2024-04-26T11:46:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7555999999999999e-05 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033843+0000", 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015836100000000001 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034073+0000", 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022992100000000001 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034439+0000", 2024-04-26T11:46:22.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036520999999999998 2024-04-26T11:46:22.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050786+0000", 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016347662999999998 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050990+0000", 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020404599999999999 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051050+0000", 2024-04-26T11:46:22.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9357000000000001e-05 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051096+0000", 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6854000000000002e-05 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 1969839~2260 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153829+0000", 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31276496500000001, 2024-04-26T11:46:22.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025802383000000002, 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153829+0000", 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153829+0000", 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153828+0000", 2024-04-26T11:46:22.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153837+0000", 2024-04-26T11:46:22.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7630000000000006e-06 2024-04-26T11:46:22.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153852+0000", 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5495999999999999e-05 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153866+0000", 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.168938+0000", 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071823999999999 2024-04-26T11:46:22.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169015+0000", 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7287999999999996e-05 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169121+0000", 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010598399999999999 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172497+0000", 2024-04-26T11:46:22.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033757140000000001 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179559+0000", 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070622039999999999 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179600+0000", 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1323999999999999e-05 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179631+0000", 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0945999999999998e-05 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1972099~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31271760599999998, 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025931514999999999, 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153886+0000", 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0913999999999999e-05 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153920+0000", 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3272999999999998e-05 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153937+0000", 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7564999999999999e-05 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169624+0000", 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015686933 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169681+0000", 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6400000000000002e-05 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169758+0000", 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7483000000000003e-05 2024-04-26T11:46:22.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172501+0000", 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027433689999999998 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179725+0000", 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072240020000000002 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179780+0000", 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4635999999999997e-05 2024-04-26T11:46:22.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179808+0000", 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7691e-05 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1973496~2264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31264191099999999, 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030663559999999999, 2024-04-26T11:46:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.489 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.489 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:22.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:22.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153951+0000", 2024-04-26T11:46:22.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153957+0000", 2024-04-26T11:46:22.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1739999999999999e-06 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153968+0000", 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1017e-05 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153976+0000", 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2879999999999993e-06 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170293+0000", 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016316695999999999 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170386+0000", 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3617999999999997e-05 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170496+0000", 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010992700000000001 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173869+0000", 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033733280000000001 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184540+0000", 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010670134 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184586+0000", 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6422999999999999e-05 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184616+0000", 2024-04-26T11:46:22.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9580000000000001e-05 2024-04-26T11:46:22.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.494 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.494 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:200 3.1d 3:bec1251c:::200.00000007:head [write 1975760~2260 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.494 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31260903099999998, 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030773467999999998, 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153984+0000", 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153993+0000", 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1540000000000008e-06 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154002+0000", 2024-04-26T11:46:22.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7369999999999995e-06 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154011+0000", 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0170000000000002e-06 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171052+0000", 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017040783 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171136+0000", 2024-04-26T11:46:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.365e-05 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171242+0000", 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000106031 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173881+0000", 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026397769999999998 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184694+0000", 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010812158000000001 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184732+0000", 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8892e-05 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184758+0000", 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840999999999999e-05 2024-04-26T11:46:22.499 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1978020~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31257525200000003, 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030901964000000001, 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154018+0000", 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154033+0000", 2024-04-26T11:46:22.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4654000000000001e-05 2024-04-26T11:46:22.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154086+0000", 2024-04-26T11:46:22.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2899000000000003e-05 2024-04-26T11:46:22.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154093+0000", 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5859999999999999e-06 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171777+0000", 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683871 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171904+0000", 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012735900000000001 2024-04-26T11:46:22.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172029+0000", 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012449100000000001 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174739+0000", 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027096870000000001 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184832+0000", 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010093903 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184893+0000", 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0130000000000002e-05 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184921+0000", 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7973000000000001e-05 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1979436~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31249397400000001, 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034499354000000003, 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:22.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154099+0000", 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154105+0000", 2024-04-26T11:46:22.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7089999999999999e-06 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154122+0000", 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6691e-05 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154146+0000", 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4868e-05 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172574+0000", 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018427437000000001 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172670+0000", 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6331999999999999e-05 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172783+0000", 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011317800000000001 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174754+0000", 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019702119999999998 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188511+0000", 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013757261 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188567+0000", 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6199999999999997e-05 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188599+0000", 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2194999999999999e-05 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1980845~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31243736999999999, 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034666348, 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.511 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154161+0000", 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9370000000000003e-06 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154194+0000", 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3262000000000001e-05 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154208+0000", 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4402e-05 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173340+0000", 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019131771999999998 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173425+0000", 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4824e-05 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173542+0000", 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117219 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176087+0000", 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025445770000000001 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188717+0000", 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012630529 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188777+0000", 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9500000000000003e-05 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188823+0000", 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5927999999999998e-05 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.516 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1982267~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31237898200000003, 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034714166999999997, 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154214+0000", 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154225+0000", 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0983e-05 2024-04-26T11:46:22.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154241+0000", 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5279999999999999e-05 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154247+0000", 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174079+0000", 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019832341999999999 2024-04-26T11:46:22.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174164+0000", 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4934999999999999e-05 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174285+0000", 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120363 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176979+0000", 2024-04-26T11:46:22.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002694372 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188863+0000", 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011884174000000001 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188897+0000", 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3602000000000001e-05 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188929+0000", 2024-04-26T11:46:22.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2191999999999999e-05 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31234121799999998, 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31231449, 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:22.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:22.532 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.312283539, 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:22.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:22.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:22.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.537 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1987909~13798 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30268714499999999, 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034314545000000002, 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163904+0000", 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999971 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163938+0000", 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4056000000000001e-05 2024-04-26T11:46:22.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163960+0000", 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1875999999999999e-05 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163991+0000", 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1010000000000003e-05 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177034+0000", 2024-04-26T11:46:22.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013042974000000001 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177111+0000", 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7484999999999994e-05 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177242+0000", 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013064000000000001 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179664+0000", 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024220829999999998 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198125+0000", 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018461154 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198169+0000", 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3863999999999999e-05 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198221+0000", 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2052999999999998e-05 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 2001707~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30219516299999999, 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034073882999999999, 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.543 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164396+0000", 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164412+0000", 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5223e-05 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164434+0000", 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2609e-05 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164445+0000", 2024-04-26T11:46:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0876999999999999e-05 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177847+0000", 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013402084999999999 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177930+0000", 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2981999999999999e-05 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178031+0000", 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100801 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179670+0000", 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016392830000000001 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198303+0000", 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018633060999999999 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198384+0000", 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0953999999999998e-05 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198473+0000", 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8257999999999994e-05 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 2004206~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29541285099999998, 2024-04-26T11:46:22.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027463373999999999, 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171179+0000", 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171189+0000", 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2730000000000008e-06 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171200+0000", 2024-04-26T11:46:22.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.189e-05 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171210+0000", 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7399999999999999e-06 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178664+0000", 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074535740000000001 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178779+0000", 2024-04-26T11:46:22.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115003 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178873+0000", 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4405000000000002e-05 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181676+0000", 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028023100000000001 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198539+0000", 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016863083000000001 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198587+0000", 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7987e-05 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198644+0000", 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7812999999999997e-05 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 2005622~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29510450700000002, 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027474261, 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171495+0000", 2024-04-26T11:46:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3199999999999996e-06 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171524+0000", 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9317999999999999e-05 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171531+0000", 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.097e-06 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179855+0000", 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0083235180000000002 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179919+0000", 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3711e-05 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180042+0000", 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012306700000000001 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184773+0000", 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047314549999999999 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198750+0000", 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013976908 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198848+0000", 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7818000000000004e-05 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198964+0000", 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115831 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 2007045~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29494929399999997, 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027470530999999999, 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171644+0000", 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171649+0000", 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5550000000000002e-06 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171658+0000", 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9870000000000005e-06 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171663+0000", 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3900000000000003e-06 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180535+0000", 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0088724760000000007 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180625+0000", 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9833999999999994e-05 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180725+0000", 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100033 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184783+0000", 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040582450000000003 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199021+0000", 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0142376 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199063+0000", 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2144999999999997e-05 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199115+0000", 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2046000000000003e-05 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:213 3.1d 3:bec1251c:::200.00000007:head [write 2008450~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.294571203, 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027287391000000001, 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172022+0000", 2024-04-26T11:46:22.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172027+0000", 2024-04-26T11:46:22.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4750000000000001e-06 2024-04-26T11:46:22.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172042+0000", 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4725e-05 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172046+0000", 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.98e-06 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181210+0000", 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0091635090000000002 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181281+0000", 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0920000000000005e-05 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181379+0000", 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8411000000000004e-05 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184792+0000", 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034134030000000002 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199215+0000", 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014422524000000001 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199274+0000", 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9543999999999998e-05 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199310+0000", 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5577999999999997e-05 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:214 3.1d 3:bec1251c:::200.00000007:head [write 2009870~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29435115299999998, 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027163974, 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172242+0000", 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172248+0000", 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2910000000000004e-06 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172268+0000", 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9309000000000001e-05 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172273+0000", 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2050000000000001e-06 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181724+0000", 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0094516909999999999 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181794+0000", 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9102000000000003e-05 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181891+0000", 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7853e-05 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.185719+0000", 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278710000000001 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199338+0000", 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013618518 2024-04-26T11:46:22.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199384+0000", 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5806999999999997e-05 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199407+0000", 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3045999999999999e-05 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:215 3.1d 3:bec1251c:::200.00000007:head [write 2011271~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172677+0000", 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29391659399999998, 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026863475000000001, 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172677+0000", 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172677+0000", 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172676+0000", 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172685+0000", 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.064e-06 2024-04-26T11:46:22.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172696+0000", 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0849999999999999e-05 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172704+0000", 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7630000000000006e-06 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.183773+0000", 2024-04-26T11:46:22.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011068023 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.183879+0000", 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010641099999999999 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184019+0000", 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013972999999999999 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:22.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.187518+0000", 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034989750000000001 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199457+0000", 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011939297 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199505+0000", 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8469e-05 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:22.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:22.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:22.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199541+0000", 2024-04-26T11:46:22.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5346999999999999e-05 2024-04-26T11:46:22.581 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.581 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.581 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.581 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:22.581 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:22.581 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:22.583 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:22.584 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:22.582+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:22.683 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:22.680+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:22.698 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:22.699 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:22.699 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:22.699 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:22.715 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:22.784 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:22.780+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:22.821 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:22.821 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:22.821 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:22.821 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:22.821 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:22.831 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:22.885 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:22.886+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:22.949 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:22.950 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:22.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:22.950 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:22.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.950 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:22.950 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:22.950 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.541701961, 2024-04-26T11:46:22.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:22.950 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.950 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:22.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.34215211700001, 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:22.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:22.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:22.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:22.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.34212039799999, 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:22.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:22.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.342078829, 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:22.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:22.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.34195169200001, 2024-04-26T11:46:22.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:22.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.515182012, 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.979 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:22.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:22.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:22.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.515081424, 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:22.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:22.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:22.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:22.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.515012732, 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:22.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:22.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:22.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:22.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:22.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:22.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:22.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:22.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:22.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:22.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:22.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:22.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.51490911400001, 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:23.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:23.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:23.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:23.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:23.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:23.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:23.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:23.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:23.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:23.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:23.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:23.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:23.007 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.514785264, 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:23.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:23.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:23.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:23.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:23.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:23.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:23.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:23.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:23.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:23.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:23.015 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.015 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.015 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.015 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:23.015 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.514753125, 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:23.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:23.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:23.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:23.021 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.51472303200001, 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:23.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:23.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:23.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:23.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:23.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:23.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:23.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:23.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.514692633, 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.029 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:23.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:23.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:23.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:23.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:23.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:23.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:23.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:23.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:23.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:23.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:23.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.037 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.514620108, 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:23.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:23.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:23.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:23.044 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.044 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.044 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.044 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:23.045 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:23.045 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.514586689, 2024-04-26T11:46:23.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:23.045 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.045 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.045 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:23.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:23.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:23.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:23.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:23.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:23.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:23.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:23.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:23.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:23.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:23.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:23.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:23.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:23.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:23.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:23.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:23.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:23.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:23.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:23.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:23.055 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.055 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.055 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.51443827200001, 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:23.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:23.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:23.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:23.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.514213134, 2024-04-26T11:46:23.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:23.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:23.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:23.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:23.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:23.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:23.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:23.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:23.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:23.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:23.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:23.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:185 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.79230856400000005, 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042806678000000001, 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151613+0000", 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999928 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152126+0000", 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051282900000000002 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152158+0000", 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2268999999999999e-05 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152173+0000", 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4780000000000001e-05 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152350+0000", 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017709600000000001 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152645+0000", 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029497600000000002 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194252+0000", 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041607102999999999 2024-04-26T11:46:23.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194330+0000", 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8029999999999997e-05 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194427+0000", 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6892000000000007e-05 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.075 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:7127 4.1e 4:7b6a0e51:::10000002096.00000000:head [write 0~1041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T11:46:23.075 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:23.075 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.78931083700000004, 2024-04-26T11:46:23.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029239364, 2024-04-26T11:46:23.075 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.075 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.075 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:23.075 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:23.076 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:23.076 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 7127 2024-04-26T11:46:23.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.076 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:23.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:23.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154616+0000", 2024-04-26T11:46:23.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:23.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154631+0000", 2024-04-26T11:46:23.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4786999999999999e-05 2024-04-26T11:46:23.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154655+0000", 2024-04-26T11:46:23.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3978999999999999e-05 2024-04-26T11:46:23.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154669+0000", 2024-04-26T11:46:23.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4022999999999999e-05 2024-04-26T11:46:23.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154746+0000", 2024-04-26T11:46:23.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6947999999999996e-05 2024-04-26T11:46:23.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154945+0000", 2024-04-26T11:46:23.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000198736 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183781+0000", 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028835980000000001 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183812+0000", 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1214000000000003e-05 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183858+0000", 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5933999999999998e-05 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:205 3.1d e54/16 3:bec1251c:::200.00000007:head v 54'25, mlcod=54'13)", 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.76905373600000004, 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02133869, 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.088 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:23.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174885+0000", 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9329999999999996e-06 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174895+0000", 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0068000000000001e-05 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174913+0000", 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8012e-05 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183499+0000", 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0085865509999999996 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183515+0000", 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6215999999999999e-05 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.196178+0000", 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012662058 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.196214+0000", 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6665999999999998e-05 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.094 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:23.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:46:23.097 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:23.094+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:23.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:23.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2024-04-26T11:46:23.197 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:23.192+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:23.210 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:23.210 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:23.210 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:23.210 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:23.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:23.298 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:23.292+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:23.322 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:23.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:23.322 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:23.322 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:23.322 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:23.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:23.400 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:23.398+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:23.449 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:23.449 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~3763435 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.421989312000001, 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025884015, 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025210+0000", 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033624+0000", 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084137780000000002 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033667+0000", 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3615999999999997e-05 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033685+0000", 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7555999999999999e-05 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033843+0000", 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015836100000000001 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034073+0000", 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022992100000000001 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034439+0000", 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036520999999999998 2024-04-26T11:46:23.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050786+0000", 2024-04-26T11:46:23.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016347662999999998 2024-04-26T11:46:23.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050990+0000", 2024-04-26T11:46:23.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020404599999999999 2024-04-26T11:46:23.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051050+0000", 2024-04-26T11:46:23.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9357000000000001e-05 2024-04-26T11:46:23.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051096+0000", 2024-04-26T11:46:23.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6854000000000002e-05 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 1969839~2260 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153829+0000", 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.2933728229999999, 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025802383000000002, 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153829+0000", 2024-04-26T11:46:23.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153829+0000", 2024-04-26T11:46:23.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153828+0000", 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153837+0000", 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7630000000000006e-06 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153852+0000", 2024-04-26T11:46:23.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5495999999999999e-05 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153866+0000", 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.168938+0000", 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071823999999999 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169015+0000", 2024-04-26T11:46:23.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7287999999999996e-05 2024-04-26T11:46:23.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169121+0000", 2024-04-26T11:46:23.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010598399999999999 2024-04-26T11:46:23.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172497+0000", 2024-04-26T11:46:23.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033757140000000001 2024-04-26T11:46:23.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179559+0000", 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070622039999999999 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179600+0000", 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1323999999999999e-05 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179631+0000", 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0945999999999998e-05 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1972099~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.293325464, 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025931514999999999, 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:23.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:23.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:23.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:23.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153886+0000", 2024-04-26T11:46:23.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0913999999999999e-05 2024-04-26T11:46:23.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153920+0000", 2024-04-26T11:46:23.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3272999999999998e-05 2024-04-26T11:46:23.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153937+0000", 2024-04-26T11:46:23.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7564999999999999e-05 2024-04-26T11:46:23.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169624+0000", 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015686933 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169681+0000", 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6400000000000002e-05 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169758+0000", 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7483000000000003e-05 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172501+0000", 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027433689999999998 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179725+0000", 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072240020000000002 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179780+0000", 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4635999999999997e-05 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179808+0000", 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7691e-05 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1973496~2264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.293249769, 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030663559999999999, 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.482 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153951+0000", 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153957+0000", 2024-04-26T11:46:23.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1739999999999999e-06 2024-04-26T11:46:23.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153968+0000", 2024-04-26T11:46:23.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1017e-05 2024-04-26T11:46:23.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153976+0000", 2024-04-26T11:46:23.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2879999999999993e-06 2024-04-26T11:46:23.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170293+0000", 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016316695999999999 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170386+0000", 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3617999999999997e-05 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170496+0000", 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010992700000000001 2024-04-26T11:46:23.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173869+0000", 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033733280000000001 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184540+0000", 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010670134 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184586+0000", 2024-04-26T11:46:23.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6422999999999999e-05 2024-04-26T11:46:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184616+0000", 2024-04-26T11:46:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9580000000000001e-05 2024-04-26T11:46:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:200 3.1d 3:bec1251c:::200.00000007:head [write 1975760~2260 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.507 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:23.507 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.293216889, 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030773467999999998, 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153984+0000", 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153993+0000", 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1540000000000008e-06 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154002+0000", 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7369999999999995e-06 2024-04-26T11:46:23.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154011+0000", 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0170000000000002e-06 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171052+0000", 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017040783 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171136+0000", 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.365e-05 2024-04-26T11:46:23.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171242+0000", 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000106031 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173881+0000", 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026397769999999998 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184694+0000", 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010812158000000001 2024-04-26T11:46:23.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184732+0000", 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8892e-05 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184758+0000", 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840999999999999e-05 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1978020~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.29318311, 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030901964000000001, 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:23.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154018+0000", 2024-04-26T11:46:23.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154033+0000", 2024-04-26T11:46:23.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4654000000000001e-05 2024-04-26T11:46:23.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154086+0000", 2024-04-26T11:46:23.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2899000000000003e-05 2024-04-26T11:46:23.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154093+0000", 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5859999999999999e-06 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171777+0000", 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683871 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171904+0000", 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012735900000000001 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172029+0000", 2024-04-26T11:46:23.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012449100000000001 2024-04-26T11:46:23.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174739+0000", 2024-04-26T11:46:23.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027096870000000001 2024-04-26T11:46:23.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184832+0000", 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010093903 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184893+0000", 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0130000000000002e-05 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184921+0000", 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7973000000000001e-05 2024-04-26T11:46:23.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1979436~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.2931018320000001, 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034499354000000003, 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:23.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154099+0000", 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154105+0000", 2024-04-26T11:46:23.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7089999999999999e-06 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154122+0000", 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6691e-05 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154146+0000", 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4868e-05 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172574+0000", 2024-04-26T11:46:23.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018427437000000001 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172670+0000", 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6331999999999999e-05 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172783+0000", 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011317800000000001 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174754+0000", 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019702119999999998 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188511+0000", 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013757261 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188567+0000", 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6199999999999997e-05 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188599+0000", 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2194999999999999e-05 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1980845~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.293045228, 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034666348, 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:23.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:23.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154161+0000", 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9370000000000003e-06 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154194+0000", 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3262000000000001e-05 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154208+0000", 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4402e-05 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173340+0000", 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019131771999999998 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173425+0000", 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4824e-05 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173542+0000", 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117219 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176087+0000", 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025445770000000001 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188717+0000", 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012630529 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188777+0000", 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9500000000000003e-05 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188823+0000", 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5927999999999998e-05 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1982267~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.29298684, 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034714166999999997, 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154214+0000", 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154225+0000", 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0983e-05 2024-04-26T11:46:23.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154241+0000", 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5279999999999999e-05 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154247+0000", 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174079+0000", 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019832341999999999 2024-04-26T11:46:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174164+0000", 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4934999999999999e-05 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174285+0000", 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120363 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176979+0000", 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002694372 2024-04-26T11:46:23.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188863+0000", 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011884174000000001 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188897+0000", 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3602000000000001e-05 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188929+0000", 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2191999999999999e-05 2024-04-26T11:46:23.534 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.292949076, 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:23.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:23.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:23.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:23.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.2929223480000001, 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.541 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:23.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:23.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:23.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:23.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:23.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.292891397, 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:23.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:23.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:23.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:23.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:23.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:23.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:23.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:23.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:23.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1987909~13798 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.2832950030000001, 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034314545000000002, 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.553 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163904+0000", 2024-04-26T11:46:23.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999971 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163938+0000", 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4056000000000001e-05 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163960+0000", 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1875999999999999e-05 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163991+0000", 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1010000000000003e-05 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177034+0000", 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013042974000000001 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177111+0000", 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7484999999999994e-05 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177242+0000", 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013064000000000001 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179664+0000", 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024220829999999998 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198125+0000", 2024-04-26T11:46:23.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018461154 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198169+0000", 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3863999999999999e-05 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198221+0000", 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2052999999999998e-05 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 2001707~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.2828030209999999, 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034073882999999999, 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164396+0000", 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164412+0000", 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5223e-05 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164434+0000", 2024-04-26T11:46:23.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2609e-05 2024-04-26T11:46:23.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164445+0000", 2024-04-26T11:46:23.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0876999999999999e-05 2024-04-26T11:46:23.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177847+0000", 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013402084999999999 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177930+0000", 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2981999999999999e-05 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178031+0000", 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100801 2024-04-26T11:46:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179670+0000", 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016392830000000001 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198303+0000", 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018633060999999999 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198384+0000", 2024-04-26T11:46:23.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0953999999999998e-05 2024-04-26T11:46:23.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198473+0000", 2024-04-26T11:46:23.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8257999999999994e-05 2024-04-26T11:46:23.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.565 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 2004206~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.276020709, 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027463373999999999, 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171179+0000", 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171189+0000", 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2730000000000008e-06 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171200+0000", 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.189e-05 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171210+0000", 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7399999999999999e-06 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178664+0000", 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074535740000000001 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178779+0000", 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115003 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178873+0000", 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4405000000000002e-05 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181676+0000", 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028023100000000001 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198539+0000", 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016863083000000001 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198587+0000", 2024-04-26T11:46:23.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7987e-05 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198644+0000", 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7812999999999997e-05 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 2005622~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.571 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.275712365, 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027474261, 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171495+0000", 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3199999999999996e-06 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171524+0000", 2024-04-26T11:46:23.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9317999999999999e-05 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171531+0000", 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.097e-06 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179855+0000", 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0083235180000000002 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179919+0000", 2024-04-26T11:46:23.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3711e-05 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180042+0000", 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012306700000000001 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184773+0000", 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047314549999999999 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198750+0000", 2024-04-26T11:46:23.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013976908 2024-04-26T11:46:23.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198848+0000", 2024-04-26T11:46:23.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7818000000000004e-05 2024-04-26T11:46:23.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198964+0000", 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115831 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 2007045~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.275557152, 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027470530999999999, 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.577 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.578 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:23.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171644+0000", 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171649+0000", 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5550000000000002e-06 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171658+0000", 2024-04-26T11:46:23.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9870000000000005e-06 2024-04-26T11:46:23.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171663+0000", 2024-04-26T11:46:23.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3900000000000003e-06 2024-04-26T11:46:23.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180535+0000", 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0088724760000000007 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180625+0000", 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9833999999999994e-05 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180725+0000", 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100033 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184783+0000", 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040582450000000003 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199021+0000", 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0142376 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199063+0000", 2024-04-26T11:46:23.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2144999999999997e-05 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199115+0000", 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2046000000000003e-05 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:213 3.1d 3:bec1251c:::200.00000007:head [write 2008450~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.275179061, 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027287391000000001, 2024-04-26T11:46:23.583 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172022+0000", 2024-04-26T11:46:23.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172027+0000", 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4750000000000001e-06 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172042+0000", 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4725e-05 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172046+0000", 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.98e-06 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181210+0000", 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0091635090000000002 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181281+0000", 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0920000000000005e-05 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181379+0000", 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8411000000000004e-05 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184792+0000", 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034134030000000002 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199215+0000", 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014422524000000001 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199274+0000", 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9543999999999998e-05 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199310+0000", 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5577999999999997e-05 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:214 3.1d 3:bec1251c:::200.00000007:head [write 2009870~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:23.588 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.274959011, 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027163974, 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172242+0000", 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172248+0000", 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2910000000000004e-06 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172268+0000", 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9309000000000001e-05 2024-04-26T11:46:23.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172273+0000", 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2050000000000001e-06 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181724+0000", 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0094516909999999999 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181794+0000", 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9102000000000003e-05 2024-04-26T11:46:23.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181891+0000", 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7853e-05 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.185719+0000", 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278710000000001 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199338+0000", 2024-04-26T11:46:23.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013618518 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199384+0000", 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5806999999999997e-05 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199407+0000", 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3045999999999999e-05 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:215 3.1d 3:bec1251c:::200.00000007:head [write 2011271~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172677+0000", 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.2745244520000001, 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026863475000000001, 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172677+0000", 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:23.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172677+0000", 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172676+0000", 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172685+0000", 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.064e-06 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:23.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172696+0000", 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0849999999999999e-05 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172704+0000", 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7630000000000006e-06 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.183773+0000", 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011068023 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:23.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.183879+0000", 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010641099999999999 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184019+0000", 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013972999999999999 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.187518+0000", 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034989750000000001 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:23.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199457+0000", 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011939297 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199505+0000", 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8469e-05 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199541+0000", 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5346999999999999e-05 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.599 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:23.599 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:23.599 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:23.600 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:23.601 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:23.598+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:23.701 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:23.698+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4541.0:7673 4.1d e54/17 4:b8e71c69:::100000022f3.00000000:head v 54'113, mlcod=54'111)", 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:23.716700+0000", 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000593489, 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064034499999999996, 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:23.716700+0000", 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:23.716700+0000", 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:23.716699+0000", 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:23.716714+0000", 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5404e-05 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:23.716734+0000", 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0029000000000001e-05 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:23.716746+0000", 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1668000000000001e-05 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:23.716791+0000", 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4663000000000003e-05 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:23.716812+0000", 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1353999999999999e-05 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-26T11:46:23.720 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:23.727 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:23.792 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:23.802 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:23.802+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:23.837 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:23.837 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:23.837 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:23.837 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:23.837 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:23.848 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:23.903 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:23.900+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:23.938 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:23.962 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:23.962 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:23.962 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:23.962 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:23.963 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:23.963 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:23.966 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:23.966 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:23.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:24.015 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:24.012+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:24.088 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:24.088 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:24.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:24.100 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:46:24.105 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:24.100+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:24.203 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:24.203 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:24.205 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:24.200+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:24.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:24.307 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:24.300+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:24.364 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:24.365 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:24.375 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:24.421 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:24.422+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:24.505 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:24.505 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:24.508 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:24.506+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:24.515 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:24.610 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:24.604+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:24.616 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:24.616 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:24.625 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:24.710 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:24.710+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:24.733 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:24.733 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:24.743 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:24.811 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:24.810+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:24.855 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:24.856 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:24.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:24.912 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:24.910+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:24.972 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:24.972 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:24.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:25.013 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:25.014+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:25.090 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:25.090 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:25.101 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:25.114 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:25.108+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:25.215 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:25.214+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:25.217 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:25.217 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:25.228 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:25.316 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:25.312+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:25.331 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:25.331 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:25.341 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:25.417 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:25.412+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:25.438 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:25.438 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:25.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:25.518 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:25.518+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:25.567 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:25.567 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:25.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:25.619 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:25.618+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:25.686 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:25.686 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:25.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:25.720 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:25.716+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:25.810 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:25.810 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:25.821 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:25.821 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:25.816+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:25.922 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:25.922+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:25.938 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:25.939 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:25.949 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:25.968 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:26.022 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:26.016+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:26.057 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:26.057 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:26.068 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:26.115 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:46:26.127 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:26.126+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:26.132 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:26.158 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:26.158 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:26.158 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:26.158 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:26.161 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:26.162 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:26.190 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:26.190 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:26.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:26.190 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:26.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.190 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 133.78465543499999, 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:26.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:26.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.196 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 133.585105591, 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.197 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:26.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:26.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:26.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:26.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 133.58507387200001, 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:26.203 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:26.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 133.58503230299999, 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.209 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:26.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:26.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:26.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:26.216 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 133.584905166, 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:26.217 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:26.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.758135486, 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:26.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.75803489800001, 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.75796620600001, 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:26.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.75786258799999, 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.757738738, 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.757706599, 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.757676506, 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.757646107, 2024-04-26T11:46:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.75757358200001, 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0213257, 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429308+0000", 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429313+0000", 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429324+0000", 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0533000000000001e-05 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429334+0000", 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429505+0000", 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171106 2024-04-26T11:46:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429519+0000", 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3946e-05 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440226+0000", 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010707532000000001 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440332+0000", 2024-04-26T11:46:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106117 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440440+0000", 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107558 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444010+0000", 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035703340000000001 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450528+0000", 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065176349999999999 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450578+0000", 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560999999999999e-05 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450635+0000", 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6447999999999999e-05 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.757540163, 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.757391746, 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 124.75716660800001, 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:185 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.0352620379999999, 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042806678000000001, 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151613+0000", 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999928 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152126+0000", 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051282900000000002 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152158+0000", 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2268999999999999e-05 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152173+0000", 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4780000000000001e-05 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152350+0000", 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017709600000000001 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152645+0000", 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029497600000000002 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194252+0000", 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041607102999999999 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194330+0000", 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8029999999999997e-05 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194427+0000", 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6892000000000007e-05 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:7127 4.1e 4:7b6a0e51:::10000002096.00000000:head [write 0~1041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.0322643109999996, 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029239364, 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 7127 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154616+0000", 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154631+0000", 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4786999999999999e-05 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154655+0000", 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3978999999999999e-05 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154669+0000", 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4022999999999999e-05 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154746+0000", 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6947999999999996e-05 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154945+0000", 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000198736 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183781+0000", 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028835980000000001 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183812+0000", 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1214000000000003e-05 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183858+0000", 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5933999999999998e-05 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:205 3.1d e54/16 3:bec1251c:::200.00000007:head v 54'25, mlcod=54'13)", 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.0120072100000002, 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02133869, 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174885+0000", 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9329999999999996e-06 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174895+0000", 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0068000000000001e-05 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174913+0000", 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8012e-05 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183499+0000", 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0085865509999999996 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183515+0000", 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6215999999999999e-05 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.196178+0000", 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012662058 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.196214+0000", 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6665999999999998e-05 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.313 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:26.315 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:26.314+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:26.315 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:26.418 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:26.412+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:26.432 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:26.432 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:26.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:26.519 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:26.516+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:26.546 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:26.547 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:26.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:26.622 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:26.622+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:26.713 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~3763435 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.685153731, 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025884015, 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025212+0000", 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.025210+0000", 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033624+0000", 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084137780000000002 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033667+0000", 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3615999999999997e-05 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033685+0000", 2024-04-26T11:46:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7555999999999999e-05 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.033843+0000", 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015836100000000001 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034073+0000", 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022992100000000001 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.034439+0000", 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036520999999999998 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050786+0000", 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016347662999999998 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.050990+0000", 2024-04-26T11:46:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020404599999999999 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051050+0000", 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9357000000000001e-05 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:10.051096+0000", 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6854000000000002e-05 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 1969839~2260 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153829+0000", 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5565372420000001, 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025802383000000002, 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153829+0000", 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153829+0000", 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153828+0000", 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153837+0000", 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7630000000000006e-06 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153852+0000", 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5495999999999999e-05 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153866+0000", 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.168938+0000", 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071823999999999 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169015+0000", 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7287999999999996e-05 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169121+0000", 2024-04-26T11:46:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010598399999999999 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172497+0000", 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033757140000000001 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179559+0000", 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070622039999999999 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179600+0000", 2024-04-26T11:46:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1323999999999999e-05 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179631+0000", 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0945999999999998e-05 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1972099~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5564898830000002, 2024-04-26T11:46:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025931514999999999, 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153876+0000", 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153886+0000", 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0913999999999999e-05 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153920+0000", 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3272999999999998e-05 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153937+0000", 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7564999999999999e-05 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169624+0000", 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015686933 2024-04-26T11:46:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169681+0000", 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6400000000000002e-05 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.169758+0000", 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7483000000000003e-05 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172501+0000", 2024-04-26T11:46:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027433689999999998 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179725+0000", 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072240020000000002 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179780+0000", 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4635999999999997e-05 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179808+0000", 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7691e-05 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1973496~2264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5564141879999998, 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030663559999999999, 2024-04-26T11:46:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153951+0000", 2024-04-26T11:46:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153957+0000", 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1739999999999999e-06 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153968+0000", 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1017e-05 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153976+0000", 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2879999999999993e-06 2024-04-26T11:46:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170293+0000", 2024-04-26T11:46:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016316695999999999 2024-04-26T11:46:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170386+0000", 2024-04-26T11:46:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3617999999999997e-05 2024-04-26T11:46:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170496+0000", 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010992700000000001 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173869+0000", 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033733280000000001 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184540+0000", 2024-04-26T11:46:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010670134 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184586+0000", 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6422999999999999e-05 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184616+0000", 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9580000000000001e-05 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:200 3.1d 3:bec1251c:::200.00000007:head [write 1975760~2260 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5563813079999997, 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030773467999999998, 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153984+0000", 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153993+0000", 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1540000000000008e-06 2024-04-26T11:46:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154002+0000", 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7369999999999995e-06 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154011+0000", 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0170000000000002e-06 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171052+0000", 2024-04-26T11:46:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017040783 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171136+0000", 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.365e-05 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171242+0000", 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000106031 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173881+0000", 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026397769999999998 2024-04-26T11:46:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184694+0000", 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010812158000000001 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184732+0000", 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8892e-05 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184758+0000", 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840999999999999e-05 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1978020~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.556347529, 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030901964000000001, 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154018+0000", 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154033+0000", 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4654000000000001e-05 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154086+0000", 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2899000000000003e-05 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154093+0000", 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5859999999999999e-06 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171777+0000", 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683871 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171904+0000", 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012735900000000001 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172029+0000", 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012449100000000001 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174739+0000", 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027096870000000001 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184832+0000", 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010093903 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184893+0000", 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0130000000000002e-05 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184921+0000", 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7973000000000001e-05 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1979436~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5562662510000003, 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034499354000000003, 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154099+0000", 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154105+0000", 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7089999999999999e-06 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154122+0000", 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6691e-05 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154146+0000", 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4868e-05 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172574+0000", 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018427437000000001 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172670+0000", 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6331999999999999e-05 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172783+0000", 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011317800000000001 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174754+0000", 2024-04-26T11:46:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019702119999999998 2024-04-26T11:46:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188511+0000", 2024-04-26T11:46:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013757261 2024-04-26T11:46:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188567+0000", 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6199999999999997e-05 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188599+0000", 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2194999999999999e-05 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1980845~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5562096470000002, 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034666348, 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154161+0000", 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9370000000000003e-06 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154194+0000", 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3262000000000001e-05 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154208+0000", 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4402e-05 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173340+0000", 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019131771999999998 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173425+0000", 2024-04-26T11:46:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4824e-05 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173542+0000", 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117219 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176087+0000", 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025445770000000001 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188717+0000", 2024-04-26T11:46:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012630529 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188777+0000", 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9500000000000003e-05 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188823+0000", 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5927999999999998e-05 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1982267~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.556151259, 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034714166999999997, 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154214+0000", 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154225+0000", 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0983e-05 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154241+0000", 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5279999999999999e-05 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154247+0000", 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174079+0000", 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019832341999999999 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174164+0000", 2024-04-26T11:46:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4934999999999999e-05 2024-04-26T11:46:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174285+0000", 2024-04-26T11:46:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120363 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176979+0000", 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002694372 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188863+0000", 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011884174000000001 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188897+0000", 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3602000000000001e-05 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188929+0000", 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2191999999999999e-05 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.556113495, 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.556086767, 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5560558159999998, 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1987909~13798 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5464594219999999, 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034314545000000002, 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163904+0000", 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999971 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163938+0000", 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4056000000000001e-05 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163960+0000", 2024-04-26T11:46:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1875999999999999e-05 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163991+0000", 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1010000000000003e-05 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177034+0000", 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013042974000000001 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177111+0000", 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7484999999999994e-05 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177242+0000", 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013064000000000001 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179664+0000", 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024220829999999998 2024-04-26T11:46:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198125+0000", 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018461154 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198169+0000", 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3863999999999999e-05 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198221+0000", 2024-04-26T11:46:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2052999999999998e-05 2024-04-26T11:46:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 2001707~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5459674400000001, 2024-04-26T11:46:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034073882999999999, 2024-04-26T11:46:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164396+0000", 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164412+0000", 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5223e-05 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164434+0000", 2024-04-26T11:46:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2609e-05 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164445+0000", 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0876999999999999e-05 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177847+0000", 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013402084999999999 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177930+0000", 2024-04-26T11:46:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2981999999999999e-05 2024-04-26T11:46:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178031+0000", 2024-04-26T11:46:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100801 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179670+0000", 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016392830000000001 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198303+0000", 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018633060999999999 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198384+0000", 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0953999999999998e-05 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198473+0000", 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8257999999999994e-05 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 2004206~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5391851279999997, 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027463373999999999, 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171179+0000", 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171189+0000", 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2730000000000008e-06 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171200+0000", 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.189e-05 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171210+0000", 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7399999999999999e-06 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178664+0000", 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074535740000000001 2024-04-26T11:46:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178779+0000", 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115003 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178873+0000", 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4405000000000002e-05 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181676+0000", 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028023100000000001 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198539+0000", 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016863083000000001 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198587+0000", 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7987e-05 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198644+0000", 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7812999999999997e-05 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 2005622~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5388767840000002, 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027474261, 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171495+0000", 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3199999999999996e-06 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171524+0000", 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9317999999999999e-05 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171531+0000", 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.097e-06 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179855+0000", 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0083235180000000002 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179919+0000", 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3711e-05 2024-04-26T11:46:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180042+0000", 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012306700000000001 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184773+0000", 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047314549999999999 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198750+0000", 2024-04-26T11:46:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013976908 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198848+0000", 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7818000000000004e-05 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198964+0000", 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115831 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 2007045~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.538721571, 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027470530999999999, 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171644+0000", 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171649+0000", 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5550000000000002e-06 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171658+0000", 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9870000000000005e-06 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171663+0000", 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3900000000000003e-06 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180535+0000", 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0088724760000000007 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180625+0000", 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9833999999999994e-05 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180725+0000", 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100033 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184783+0000", 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040582450000000003 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199021+0000", 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0142376 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199063+0000", 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2144999999999997e-05 2024-04-26T11:46:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199115+0000", 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2046000000000003e-05 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:213 3.1d 3:bec1251c:::200.00000007:head [write 2008450~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.53834348, 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027287391000000001, 2024-04-26T11:46:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172022+0000", 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172027+0000", 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4750000000000001e-06 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172042+0000", 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4725e-05 2024-04-26T11:46:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172046+0000", 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.98e-06 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181210+0000", 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0091635090000000002 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181281+0000", 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0920000000000005e-05 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181379+0000", 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8411000000000004e-05 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184792+0000", 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034134030000000002 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199215+0000", 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014422524000000001 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199274+0000", 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9543999999999998e-05 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199310+0000", 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5577999999999997e-05 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:214 3.1d 3:bec1251c:::200.00000007:head [write 2009870~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5381234299999997, 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027163974, 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172242+0000", 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172248+0000", 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2910000000000004e-06 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172268+0000", 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9309000000000001e-05 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172273+0000", 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2050000000000001e-06 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181724+0000", 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0094516909999999999 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181794+0000", 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9102000000000003e-05 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181891+0000", 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7853e-05 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.185719+0000", 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278710000000001 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199338+0000", 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013618518 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199384+0000", 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5806999999999997e-05 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199407+0000", 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3045999999999999e-05 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:215 3.1d 3:bec1251c:::200.00000007:head [write 2011271~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172677+0000", 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.5376888710000003, 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026863475000000001, 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172677+0000", 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172677+0000", 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172676+0000", 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172685+0000", 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.064e-06 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172696+0000", 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0849999999999999e-05 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172704+0000", 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7630000000000006e-06 2024-04-26T11:46:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.183773+0000", 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011068023 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.183879+0000", 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010641099999999999 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184019+0000", 2024-04-26T11:46:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013972999999999999 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.187518+0000", 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034989750000000001 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199457+0000", 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011939297 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199505+0000", 2024-04-26T11:46:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8469e-05 2024-04-26T11:46:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199541+0000", 2024-04-26T11:46:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5346999999999999e-05 2024-04-26T11:46:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:26.829 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:26.831 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:26.831 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:26.830+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:26.932 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:26.928+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:26.947 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:8766 4.39 4:9cfbdd3d:::10000002816.00000000:head [write 0~6175 in=6175b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:26.946742+0000", 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001393519, 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014309979999999999, 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:26.948 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 8766 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:26.946742+0000", 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:26.946742+0000", 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:26.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:26.946741+0000", 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:26.946758+0000", 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7206000000000001e-05 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:26.946782+0000", 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4406e-05 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:26.946794+0000", 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.198e-05 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:26.946868+0000", 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3724000000000001e-05 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:26.947079+0000", 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000210776 2024-04-26T11:46:26.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.952 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:26.952 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.952 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:26.952 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:46:26.952 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-26T11:46:26.952 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:26.958 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:27.039 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:27.038+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:27.060 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:27.061 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:27.070 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:27.105 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:46:27.140 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:27.136+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:27.179 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:27.179 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:27.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:27.179 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:27.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.179 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:27.179 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:27.179 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.77401892099999, 2024-04-26T11:46:27.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:27.179 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:27.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.574469077, 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:27.185 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:27.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:27.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.190 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.57443735800001, 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:27.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:27.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:27.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:27.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:27.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:27.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.57439578899999, 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.197 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.202 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.574268652, 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.203 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:27.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:27.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.747498972, 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:27.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:27.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:27.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:27.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:27.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:27.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:27.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:27.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:27.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:27.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:27.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:27.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:27.215 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.74739838399999, 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:27.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:27.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:27.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:27.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:27.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.221 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.74732969199999, 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:27.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.747226074, 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:27.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:27.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:27.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:27.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.747102224, 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:27.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:27.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.747070085, 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.242 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.747039992, 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.248 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.747009593, 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.254 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:27.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.746903649, 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:27.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:27.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:27.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.746755232, 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:27.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:27.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:27.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:27.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 125.74653009399999, 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:27.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:185 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.0246255240000002, 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042806678000000001, 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151613+0000", 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999928 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152126+0000", 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051282900000000002 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152158+0000", 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2268999999999999e-05 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152173+0000", 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4780000000000001e-05 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152350+0000", 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017709600000000001 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152645+0000", 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029497600000000002 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194252+0000", 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041607102999999999 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194330+0000", 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8029999999999997e-05 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194427+0000", 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6892000000000007e-05 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:7127 4.1e 4:7b6a0e51:::10000002096.00000000:head [write 0~1041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T11:46:27.282 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.0216277969999998, 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029239364, 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 7127 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154616+0000", 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154631+0000", 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4786999999999999e-05 2024-04-26T11:46:27.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154655+0000", 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3978999999999999e-05 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154669+0000", 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4022999999999999e-05 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154746+0000", 2024-04-26T11:46:27.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6947999999999996e-05 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154945+0000", 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000198736 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183781+0000", 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028835980000000001 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183812+0000", 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1214000000000003e-05 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183858+0000", 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5933999999999998e-05 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:205 3.1d e54/16 3:bec1251c:::200.00000007:head v 54'25, mlcod=54'13)", 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.0013706960000004, 2024-04-26T11:46:27.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02133869, 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174885+0000", 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9329999999999996e-06 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174895+0000", 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0068000000000001e-05 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174913+0000", 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8012e-05 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183499+0000", 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0085865509999999996 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183515+0000", 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6215999999999999e-05 2024-04-26T11:46:27.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.196178+0000", 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012662058 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.196214+0000", 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6665999999999998e-05 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:244 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.025569463000000001, 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021751777, 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150675+0000", 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151110+0000", 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00043525500000000001 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151131+0000", 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0922000000000001e-05 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151142+0000", 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1048e-05 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151265+0000", 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012325199999999999 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151504+0000", 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023862300000000001 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172057+0000", 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020553364000000001 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172197+0000", 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013953300000000001 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:27.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172428+0000", 2024-04-26T11:46:27.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231788 2024-04-26T11:46:27.296 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.296 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.296 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.296 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.296 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.296 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:27.298 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:27.298+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:27.298 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:27.399 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:27.398+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:27.417 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:27.417 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:27.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.417 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4541.0:8915 4.3d e56/17 4:be835699:::100000028d0.00000000:head v 56'128, mlcod=56'126)", 2024-04-26T11:46:27.417 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.416306+0000", 2024-04-26T11:46:27.417 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0012414069999999999, 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012719739999999999, 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.416306+0000", 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.416306+0000", 2024-04-26T11:46:27.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.416305+0000", 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.416343+0000", 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8386999999999997e-05 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.416358+0000", 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5143000000000001e-05 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.416366+0000", 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.746e-06 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.416466+0000", 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9782000000000001e-05 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.416520+0000", 2024-04-26T11:46:27.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4379000000000002e-05 2024-04-26T11:46:27.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.421 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.421 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:46:27.421 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 1 2024-04-26T11:46:27.421 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:27.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:27.500 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:27.498+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:27.542 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:27.543 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:27.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:27.601 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:27.596+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:27.657 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1973496~2264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.5009408869999996, 2024-04-26T11:46:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030663559999999999, 2024-04-26T11:46:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153951+0000", 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153957+0000", 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1739999999999999e-06 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153968+0000", 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1017e-05 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153976+0000", 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2879999999999993e-06 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170293+0000", 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016316695999999999 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170386+0000", 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3617999999999997e-05 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170496+0000", 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010992700000000001 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173869+0000", 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033733280000000001 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184540+0000", 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010670134 2024-04-26T11:46:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184586+0000", 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6422999999999999e-05 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184616+0000", 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9580000000000001e-05 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:200 3.1d 3:bec1251c:::200.00000007:head [write 1975760~2260 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.5009080069999996, 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030773467999999998, 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153984+0000", 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153993+0000", 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1540000000000008e-06 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154002+0000", 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7369999999999995e-06 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154011+0000", 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0170000000000002e-06 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171052+0000", 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017040783 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171136+0000", 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.365e-05 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171242+0000", 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000106031 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173881+0000", 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026397769999999998 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184694+0000", 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010812158000000001 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184732+0000", 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8892e-05 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184758+0000", 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840999999999999e-05 2024-04-26T11:46:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1978020~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.5008742279999998, 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030901964000000001, 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154018+0000", 2024-04-26T11:46:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154033+0000", 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4654000000000001e-05 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154086+0000", 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2899000000000003e-05 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154093+0000", 2024-04-26T11:46:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5859999999999999e-06 2024-04-26T11:46:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171777+0000", 2024-04-26T11:46:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683871 2024-04-26T11:46:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171904+0000", 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012735900000000001 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172029+0000", 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012449100000000001 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174739+0000", 2024-04-26T11:46:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027096870000000001 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184832+0000", 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010093903 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184893+0000", 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0130000000000002e-05 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184921+0000", 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7973000000000001e-05 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1979436~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.5007929500000001, 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034499354000000003, 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154099+0000", 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154105+0000", 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7089999999999999e-06 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154122+0000", 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6691e-05 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154146+0000", 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4868e-05 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172574+0000", 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018427437000000001 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172670+0000", 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6331999999999999e-05 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172783+0000", 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011317800000000001 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174754+0000", 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019702119999999998 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188511+0000", 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013757261 2024-04-26T11:46:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188567+0000", 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6199999999999997e-05 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188599+0000", 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2194999999999999e-05 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1980845~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.5007363460000001, 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034666348, 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154161+0000", 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9370000000000003e-06 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154194+0000", 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3262000000000001e-05 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154208+0000", 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4402e-05 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173340+0000", 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019131771999999998 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173425+0000", 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4824e-05 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173542+0000", 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117219 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176087+0000", 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025445770000000001 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188717+0000", 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012630529 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188777+0000", 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9500000000000003e-05 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188823+0000", 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5927999999999998e-05 2024-04-26T11:46:27.684 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1982267~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.5006779579999998, 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034714166999999997, 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154214+0000", 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154225+0000", 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0983e-05 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154241+0000", 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5279999999999999e-05 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154247+0000", 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174079+0000", 2024-04-26T11:46:27.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019832341999999999 2024-04-26T11:46:27.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174164+0000", 2024-04-26T11:46:27.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4934999999999999e-05 2024-04-26T11:46:27.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174285+0000", 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120363 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176979+0000", 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002694372 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188863+0000", 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011884174000000001 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188897+0000", 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3602000000000001e-05 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188929+0000", 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2191999999999999e-05 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.5006401939999998, 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:27.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:27.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:27.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:27.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:27.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:27.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:27.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.5006134659999999, 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:27.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:27.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.5005825149999996, 2024-04-26T11:46:27.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:27.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:27.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:27.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1987909~13798 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.4909861209999997, 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034314545000000002, 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.708 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163904+0000", 2024-04-26T11:46:27.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999971 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163938+0000", 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4056000000000001e-05 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163960+0000", 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1875999999999999e-05 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163991+0000", 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1010000000000003e-05 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177034+0000", 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013042974000000001 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177111+0000", 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7484999999999994e-05 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177242+0000", 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013064000000000001 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179664+0000", 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024220829999999998 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198125+0000", 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018461154 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198169+0000", 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3863999999999999e-05 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198221+0000", 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2052999999999998e-05 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.713 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 2001707~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.4904941389999999, 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034073882999999999, 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164396+0000", 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164412+0000", 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5223e-05 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164434+0000", 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2609e-05 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164445+0000", 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0876999999999999e-05 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177847+0000", 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013402084999999999 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177930+0000", 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2981999999999999e-05 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178031+0000", 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100801 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179670+0000", 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016392830000000001 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198303+0000", 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018633060999999999 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198384+0000", 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0953999999999998e-05 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198473+0000", 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8257999999999994e-05 2024-04-26T11:46:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 2004206~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.4837118269999996, 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027463373999999999, 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171179+0000", 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171189+0000", 2024-04-26T11:46:27.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2730000000000008e-06 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171200+0000", 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.189e-05 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171210+0000", 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7399999999999999e-06 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178664+0000", 2024-04-26T11:46:27.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074535740000000001 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178779+0000", 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115003 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178873+0000", 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4405000000000002e-05 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181676+0000", 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028023100000000001 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198539+0000", 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016863083000000001 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198587+0000", 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7987e-05 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198644+0000", 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7812999999999997e-05 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 2005622~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.483403483, 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027474261, 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171495+0000", 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3199999999999996e-06 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171524+0000", 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9317999999999999e-05 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171531+0000", 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.097e-06 2024-04-26T11:46:27.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179855+0000", 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0083235180000000002 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179919+0000", 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3711e-05 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180042+0000", 2024-04-26T11:46:27.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012306700000000001 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184773+0000", 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047314549999999999 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198750+0000", 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013976908 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198848+0000", 2024-04-26T11:46:27.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7818000000000004e-05 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198964+0000", 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115831 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 2007045~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.4832482699999998, 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027470530999999999, 2024-04-26T11:46:27.729 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171644+0000", 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171649+0000", 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5550000000000002e-06 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171658+0000", 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9870000000000005e-06 2024-04-26T11:46:27.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171663+0000", 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3900000000000003e-06 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180535+0000", 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0088724760000000007 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180625+0000", 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9833999999999994e-05 2024-04-26T11:46:27.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180725+0000", 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100033 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184783+0000", 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040582450000000003 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199021+0000", 2024-04-26T11:46:27.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0142376 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199063+0000", 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2144999999999997e-05 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199115+0000", 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2046000000000003e-05 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:213 3.1d 3:bec1251c:::200.00000007:head [write 2008450~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.4828701789999998, 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027287391000000001, 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172022+0000", 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172027+0000", 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4750000000000001e-06 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172042+0000", 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4725e-05 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172046+0000", 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.98e-06 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181210+0000", 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0091635090000000002 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181281+0000", 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0920000000000005e-05 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181379+0000", 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8411000000000004e-05 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184792+0000", 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034134030000000002 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199215+0000", 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014422524000000001 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199274+0000", 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9543999999999998e-05 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199310+0000", 2024-04-26T11:46:27.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5577999999999997e-05 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:214 3.1d 3:bec1251c:::200.00000007:head [write 2009870~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.4826501289999996, 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027163974, 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172242+0000", 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:27.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172248+0000", 2024-04-26T11:46:27.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2910000000000004e-06 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172268+0000", 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9309000000000001e-05 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172273+0000", 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2050000000000001e-06 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181724+0000", 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0094516909999999999 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181794+0000", 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9102000000000003e-05 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181891+0000", 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7853e-05 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.185719+0000", 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278710000000001 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199338+0000", 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013618518 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199384+0000", 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5806999999999997e-05 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199407+0000", 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3045999999999999e-05 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:262 3.0 3:02ac1934:::200.00000009:head [write 1776456~2270 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.152908+0000", 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50198515300000002, 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029798290000000002, 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.746 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152908+0000", 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152908+0000", 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152907+0000", 2024-04-26T11:46:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152917+0000", 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5889999999999992e-06 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152942+0000", 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5228e-05 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152949+0000", 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.175600+0000", 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022651158000000001 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.175667+0000", 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6265000000000003e-05 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.175758+0000", 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1479999999999998e-05 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.178930+0000", 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031715290000000002 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182566+0000", 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036364639999999998 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182646+0000", 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0048000000000003e-05 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182706+0000", 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9941000000000001e-05 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:263 3.0 3:02ac1934:::200.00000009:head [write 1778726~2262 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50193747399999999, 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029890064000000001, 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152960+0000", 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6710000000000004e-06 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152983+0000", 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2614000000000001e-05 2024-04-26T11:46:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152990+0000", 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8399999999999997e-06 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.176273+0000", 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023282694999999999 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.176419+0000", 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000145983 2024-04-26T11:46:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.176558+0000", 2024-04-26T11:46:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000139925 2024-04-26T11:46:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.179043+0000", 2024-04-26T11:46:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002484703 2024-04-26T11:46:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182768+0000", 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037244980000000001 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182802+0000", 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4378000000000002e-05 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182845+0000", 2024-04-26T11:46:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3393999999999998e-05 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:264 3.0 3:02ac1934:::200.00000009:head [write 1780988~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.152996+0000", 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50189712099999995, 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030043411999999999, 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152996+0000", 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152996+0000", 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152995+0000", 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153006+0000", 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0448999999999999e-05 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153018+0000", 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2539e-05 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153025+0000", 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7569999999999998e-06 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177093+0000", 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024068161000000001 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177166+0000", 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3078999999999996e-05 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177257+0000", 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1283e-05 2024-04-26T11:46:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.179052+0000", 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017950279999999999 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182915+0000", 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038630539999999999 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182989+0000", 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3226000000000007e-05 2024-04-26T11:46:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183039+0000", 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0433000000000003e-05 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:265 3.0 3:02ac1934:::200.00000009:head [write 1782390~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50186235599999995, 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030158497999999999, 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153035+0000", 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.78e-06 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153047+0000", 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2337000000000001e-05 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153053+0000", 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177982+0000", 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024928649000000001 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.178087+0000", 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010525 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.178253+0000", 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016530399999999999 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182484+0000", 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004231472 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183109+0000", 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00062506300000000003 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183153+0000", 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3355000000000001e-05 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183189+0000", 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6427999999999997e-05 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:27.767 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:27.769 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:27.769 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:27.766+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:27.872 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:27.868+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:27.889 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:9062 4.32 4.4702d032 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:27.889625+0000", 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.9910999999999999e-05, 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013119299999999999, 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:27.890 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 9062 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.889625+0000", 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.889625+0000", 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.889622+0000", 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.889646+0000", 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3686e-05 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.889676+0000", 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0193e-05 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.889690+0000", 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3706000000000001e-05 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.889748+0000", 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8190999999999999e-05 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.893 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:27.894 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:46:27.894 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-26T11:46:27.895 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:27.906 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:27.973 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:27.969+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:28.012 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:28.013 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:28.013 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:28.013 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:28.013 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:28.023 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:28.074 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:28.073+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:28.134 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:28.134 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.72874606900001, 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:28.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:28.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:28.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:28.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:28.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.52919622499999, 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:28.140 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.529164506, 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.146 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:28.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:28.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:28.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.52912293700001, 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:28.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:28.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.52899579999999, 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.157 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:28.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:28.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.70222612000001, 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.168 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.702125532, 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:28.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:28.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.174 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.70205684, 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:28.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:28.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:28.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.701953222, 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:28.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:28.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:28.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.70182937200001, 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:28.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:28.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:28.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:28.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.70179723299999, 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:28.195 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:28.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:28.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:28.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:28.201 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.70176714, 2024-04-26T11:46:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.202 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:28.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:28.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:28.208 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.701736741, 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:28.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.70163079700001, 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.215 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:28.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:28.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:28.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.70148238, 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:28.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:28.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.701257242, 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:28.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:28.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:28.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:185 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.9793526720000001, 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042806678000000001, 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.234 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151613+0000", 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999928 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152126+0000", 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051282900000000002 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152158+0000", 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2268999999999999e-05 2024-04-26T11:46:28.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152173+0000", 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4780000000000001e-05 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152350+0000", 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017709600000000001 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152645+0000", 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029497600000000002 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194252+0000", 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041607102999999999 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194330+0000", 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8029999999999997e-05 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194427+0000", 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6892000000000007e-05 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:7127 4.1e 4:7b6a0e51:::10000002096.00000000:head [write 0~1041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.9763549449999998, 2024-04-26T11:46:28.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029239364, 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 7127 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154616+0000", 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154631+0000", 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4786999999999999e-05 2024-04-26T11:46:28.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154655+0000", 2024-04-26T11:46:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3978999999999999e-05 2024-04-26T11:46:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154669+0000", 2024-04-26T11:46:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4022999999999999e-05 2024-04-26T11:46:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154746+0000", 2024-04-26T11:46:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6947999999999996e-05 2024-04-26T11:46:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154945+0000", 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000198736 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183781+0000", 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028835980000000001 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183812+0000", 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1214000000000003e-05 2024-04-26T11:46:28.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183858+0000", 2024-04-26T11:46:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5933999999999998e-05 2024-04-26T11:46:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:205 3.1d e54/16 3:bec1251c:::200.00000007:head v 54'25, mlcod=54'13)", 2024-04-26T11:46:28.245 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.9560978440000003, 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02133869, 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174885+0000", 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9329999999999996e-06 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174895+0000", 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0068000000000001e-05 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174913+0000", 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8012e-05 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183499+0000", 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0085865509999999996 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183515+0000", 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6215999999999999e-05 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.196178+0000", 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012662058 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.196214+0000", 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6665999999999998e-05 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.249 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:244 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.98029661099999998, 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021751777, 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:28.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:28.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:28.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:28.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150675+0000", 2024-04-26T11:46:28.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:28.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:28.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151110+0000", 2024-04-26T11:46:28.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00043525500000000001 2024-04-26T11:46:28.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:28.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151131+0000", 2024-04-26T11:46:28.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0922000000000001e-05 2024-04-26T11:46:28.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:28.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151142+0000", 2024-04-26T11:46:28.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1048e-05 2024-04-26T11:46:28.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:28.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151265+0000", 2024-04-26T11:46:28.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012325199999999999 2024-04-26T11:46:28.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:28.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151504+0000", 2024-04-26T11:46:28.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023862300000000001 2024-04-26T11:46:28.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:28.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172057+0000", 2024-04-26T11:46:28.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020553364000000001 2024-04-26T11:46:28.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:28.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172197+0000", 2024-04-26T11:46:28.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013953300000000001 2024-04-26T11:46:28.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:28.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:28.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:28.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172428+0000", 2024-04-26T11:46:28.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231788 2024-04-26T11:46:28.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.260 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:28.260 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:28.260 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:28.261 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:28.264 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:28.256+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:28.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:28.364 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:28.361+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:28.383 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:28.383 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:28.383 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:28.383 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:28.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:28.430 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:28.458 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:28.459 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:28.459 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:28.459 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:28.463 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:28.463 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:28.464 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:28.461+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:28.499 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:28.499 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:28.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:28.565 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:28.561+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:28.612 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:28.612 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:28.622 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:28.670 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:28.669+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:28.748 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:28.748 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:28.759 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:28.768 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:28.764+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:28.867 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:28.867 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:28.869 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:28.865+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:28.877 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:28.970 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:28.969+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:28.986 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:28.986 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:28.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:29.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2024-04-26T11:46:29.073 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:29.069+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:29.115 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:29.115 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:29.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:46:29.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:29.175 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:29.172+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:29.229 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:29.229 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:29.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:29.273 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:29.268+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:29.348 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:29.348 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:29.358 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:29.374 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:29.373+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:29.475 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:29.473+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:29.476 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:29.476 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:29.486 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:29.576 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:29.573+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:29.636 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:29.636 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:29.646 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:29.677 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:29.677+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:29.752 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:29.752 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:29.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:29.778 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:29.772+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:29.879 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:29.876+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:29.884 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:29.884 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:29.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:29.980 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:29.977+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:30.044 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:30.044 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:30.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:30.081 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:30.076+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:30.116 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:46:30.177 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:30.177 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:30.181 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:30.176+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:30.188 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:30.283 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:30.281+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:30.303 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:30.303 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:30.313 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:30.384 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:30.380+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:30.419 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:30.419 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:30.429 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:30.466 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:30.484 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:30.481+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:30.534 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:30.534 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:30.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:30.585 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:30.580+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:30.619 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:30.645 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:30.645 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:30.645 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:30.645 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:30.647 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:30.648 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:30.663 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10010 4.2d 4:b66d5661:::10000002de0.00000000:head [write 0~11933 in=11933b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:30.662833+0000", 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0015855859999999999, 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016030899999999999, 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10010 2024-04-26T11:46:30.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:30.662833+0000", 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:30.662833+0000", 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:30.662831+0000", 2024-04-26T11:46:30.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:30.662854+0000", 2024-04-26T11:46:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2892999999999999e-05 2024-04-26T11:46:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:30.662882+0000", 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8160000000000001e-05 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:30.662899+0000", 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7271000000000001e-05 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:30.662983+0000", 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4061999999999996e-05 2024-04-26T11:46:30.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:30.663191+0000", 2024-04-26T11:46:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020809499999999999 2024-04-26T11:46:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:46:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 1 2024-04-26T11:46:30.668 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:30.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:30.686 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:30.685+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:30.787 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:30.785+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:30.826 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:30.826 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:30.827 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:30.827 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:30.827 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:30.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:30.888 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:30.884+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:30.945 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:30.945 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:30.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:30.946 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:30.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.946 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1973496~2264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:30.946 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:30.946 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7898353799999995, 2024-04-26T11:46:30.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030663559999999999, 2024-04-26T11:46:30.946 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:30.946 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:30.946 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:30.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:30.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:30.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:30.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:30.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:30.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153951+0000", 2024-04-26T11:46:30.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:30.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:30.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153957+0000", 2024-04-26T11:46:30.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1739999999999999e-06 2024-04-26T11:46:30.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153968+0000", 2024-04-26T11:46:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1017e-05 2024-04-26T11:46:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153976+0000", 2024-04-26T11:46:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2879999999999993e-06 2024-04-26T11:46:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170293+0000", 2024-04-26T11:46:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016316695999999999 2024-04-26T11:46:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170386+0000", 2024-04-26T11:46:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3617999999999997e-05 2024-04-26T11:46:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170496+0000", 2024-04-26T11:46:30.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010992700000000001 2024-04-26T11:46:30.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:30.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173869+0000", 2024-04-26T11:46:30.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033733280000000001 2024-04-26T11:46:30.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:30.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184540+0000", 2024-04-26T11:46:30.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010670134 2024-04-26T11:46:30.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:30.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184586+0000", 2024-04-26T11:46:30.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6422999999999999e-05 2024-04-26T11:46:30.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:30.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184616+0000", 2024-04-26T11:46:30.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9580000000000001e-05 2024-04-26T11:46:30.953 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.953 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:30.953 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.953 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:200 3.1d 3:bec1251c:::200.00000007:head [write 1975760~2260 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:30.953 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:30.953 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7898025000000004, 2024-04-26T11:46:30.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030773467999999998, 2024-04-26T11:46:30.953 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:30.953 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:30.954 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:30.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:30.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:30.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:30.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:30.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153984+0000", 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153993+0000", 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1540000000000008e-06 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:30.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154002+0000", 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7369999999999995e-06 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154011+0000", 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0170000000000002e-06 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171052+0000", 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017040783 2024-04-26T11:46:30.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:30.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171136+0000", 2024-04-26T11:46:30.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.365e-05 2024-04-26T11:46:30.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:30.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171242+0000", 2024-04-26T11:46:30.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000106031 2024-04-26T11:46:30.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173881+0000", 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026397769999999998 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184694+0000", 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010812158000000001 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184732+0000", 2024-04-26T11:46:30.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8892e-05 2024-04-26T11:46:30.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:30.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184758+0000", 2024-04-26T11:46:30.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840999999999999e-05 2024-04-26T11:46:30.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.959 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:30.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.960 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1978020~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:30.960 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:30.960 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7897687209999997, 2024-04-26T11:46:30.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030901964000000001, 2024-04-26T11:46:30.960 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:30.960 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:30.960 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:30.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:30.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:30.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:30.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:30.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:30.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154018+0000", 2024-04-26T11:46:30.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:30.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:30.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154033+0000", 2024-04-26T11:46:30.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4654000000000001e-05 2024-04-26T11:46:30.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154086+0000", 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2899000000000003e-05 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154093+0000", 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5859999999999999e-06 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:30.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171777+0000", 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683871 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171904+0000", 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012735900000000001 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172029+0000", 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012449100000000001 2024-04-26T11:46:30.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174739+0000", 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027096870000000001 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184832+0000", 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010093903 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:30.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184893+0000", 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0130000000000002e-05 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184921+0000", 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7973000000000001e-05 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.966 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1979436~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.789687443, 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034499354000000003, 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154099+0000", 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154105+0000", 2024-04-26T11:46:30.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7089999999999999e-06 2024-04-26T11:46:30.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:30.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154122+0000", 2024-04-26T11:46:30.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6691e-05 2024-04-26T11:46:30.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:30.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154146+0000", 2024-04-26T11:46:30.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4868e-05 2024-04-26T11:46:30.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:30.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172574+0000", 2024-04-26T11:46:30.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018427437000000001 2024-04-26T11:46:30.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:30.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172670+0000", 2024-04-26T11:46:30.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6331999999999999e-05 2024-04-26T11:46:30.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:30.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172783+0000", 2024-04-26T11:46:30.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011317800000000001 2024-04-26T11:46:30.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:30.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174754+0000", 2024-04-26T11:46:30.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019702119999999998 2024-04-26T11:46:30.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:30.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188511+0000", 2024-04-26T11:46:30.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013757261 2024-04-26T11:46:30.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:30.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188567+0000", 2024-04-26T11:46:30.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6199999999999997e-05 2024-04-26T11:46:30.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:30.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188599+0000", 2024-04-26T11:46:30.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2194999999999999e-05 2024-04-26T11:46:30.973 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.973 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:30.973 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.973 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1980845~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:30.973 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:30.974 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7896308390000009, 2024-04-26T11:46:30.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034666348, 2024-04-26T11:46:30.974 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:30.974 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:30.974 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:30.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:30.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:30.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:30.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:30.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:30.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:30.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:30.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:30.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154161+0000", 2024-04-26T11:46:30.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9370000000000003e-06 2024-04-26T11:46:30.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:30.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154194+0000", 2024-04-26T11:46:30.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3262000000000001e-05 2024-04-26T11:46:30.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:30.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154208+0000", 2024-04-26T11:46:30.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4402e-05 2024-04-26T11:46:30.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:30.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173340+0000", 2024-04-26T11:46:30.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019131771999999998 2024-04-26T11:46:30.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:30.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173425+0000", 2024-04-26T11:46:30.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4824e-05 2024-04-26T11:46:30.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:30.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173542+0000", 2024-04-26T11:46:30.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117219 2024-04-26T11:46:30.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176087+0000", 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025445770000000001 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188717+0000", 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012630529 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188777+0000", 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9500000000000003e-05 2024-04-26T11:46:30.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:30.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188823+0000", 2024-04-26T11:46:30.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5927999999999998e-05 2024-04-26T11:46:30.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.980 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:30.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.980 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1982267~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:30.980 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:30.981 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7895724509999997, 2024-04-26T11:46:30.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034714166999999997, 2024-04-26T11:46:30.981 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:30.981 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:30.981 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:30.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:30.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:30.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154214+0000", 2024-04-26T11:46:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:30.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154225+0000", 2024-04-26T11:46:30.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0983e-05 2024-04-26T11:46:30.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:30.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154241+0000", 2024-04-26T11:46:30.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5279999999999999e-05 2024-04-26T11:46:30.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:30.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154247+0000", 2024-04-26T11:46:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:46:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174079+0000", 2024-04-26T11:46:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019832341999999999 2024-04-26T11:46:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174164+0000", 2024-04-26T11:46:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4934999999999999e-05 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174285+0000", 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120363 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176979+0000", 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002694372 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188863+0000", 2024-04-26T11:46:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011884174000000001 2024-04-26T11:46:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188897+0000", 2024-04-26T11:46:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3602000000000001e-05 2024-04-26T11:46:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:30.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188929+0000", 2024-04-26T11:46:30.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2191999999999999e-05 2024-04-26T11:46:30.987 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.987 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:30.987 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.987 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:30.987 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:30.987 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7895346869999997, 2024-04-26T11:46:30.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:30.988 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:30.988 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:30.988 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:30.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:30.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:30.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:30.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:30.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:30.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:30.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:30.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:30.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:30.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:30.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:30.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:30.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:30.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:30.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:30.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:30.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:30.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:30.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:30.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:30.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:30.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:30.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:30.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:30.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:30.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:30.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:30.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:30.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:30.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:30.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:30.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:30.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:30.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:30.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:30.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:30.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:30.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.994 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:30.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:30.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7895079589999998, 2024-04-26T11:46:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:30.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:30.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:30.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:30.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:30.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:30.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:30.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:30.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:30.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:30.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:30.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:30.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:30.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:30.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:30.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:30.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:30.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:30.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:30.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:30.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:31.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.001 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7894770080000004, 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:31.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:31.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:31.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:31.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:31.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:31.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:31.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:31.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:31.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:31.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:31.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.008 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.008 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1987909~13798 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.008 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:31.008 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7798806139999996, 2024-04-26T11:46:31.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034314545000000002, 2024-04-26T11:46:31.008 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.008 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.009 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:31.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:31.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163904+0000", 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999971 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163938+0000", 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4056000000000001e-05 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163960+0000", 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1875999999999999e-05 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163991+0000", 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1010000000000003e-05 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177034+0000", 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013042974000000001 2024-04-26T11:46:31.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177111+0000", 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7484999999999994e-05 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177242+0000", 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013064000000000001 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179664+0000", 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024220829999999998 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198125+0000", 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018461154 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198169+0000", 2024-04-26T11:46:31.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3863999999999999e-05 2024-04-26T11:46:31.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198221+0000", 2024-04-26T11:46:31.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2052999999999998e-05 2024-04-26T11:46:31.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.014 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.015 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 2001707~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.015 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:31.015 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7793886319999999, 2024-04-26T11:46:31.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034073882999999999, 2024-04-26T11:46:31.015 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.015 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.015 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:31.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:31.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164396+0000", 2024-04-26T11:46:31.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164412+0000", 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5223e-05 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164434+0000", 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2609e-05 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164445+0000", 2024-04-26T11:46:31.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0876999999999999e-05 2024-04-26T11:46:31.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177847+0000", 2024-04-26T11:46:31.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013402084999999999 2024-04-26T11:46:31.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177930+0000", 2024-04-26T11:46:31.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2981999999999999e-05 2024-04-26T11:46:31.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178031+0000", 2024-04-26T11:46:31.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100801 2024-04-26T11:46:31.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179670+0000", 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016392830000000001 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198303+0000", 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018633060999999999 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198384+0000", 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0953999999999998e-05 2024-04-26T11:46:31.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198473+0000", 2024-04-26T11:46:31.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8257999999999994e-05 2024-04-26T11:46:31.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.021 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.021 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 2004206~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7726063199999995, 2024-04-26T11:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027463373999999999, 2024-04-26T11:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:31.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171179+0000", 2024-04-26T11:46:31.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:31.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171189+0000", 2024-04-26T11:46:31.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2730000000000008e-06 2024-04-26T11:46:31.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171200+0000", 2024-04-26T11:46:31.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.189e-05 2024-04-26T11:46:31.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171210+0000", 2024-04-26T11:46:31.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7399999999999999e-06 2024-04-26T11:46:31.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178664+0000", 2024-04-26T11:46:31.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074535740000000001 2024-04-26T11:46:31.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178779+0000", 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115003 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178873+0000", 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4405000000000002e-05 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181676+0000", 2024-04-26T11:46:31.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028023100000000001 2024-04-26T11:46:31.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198539+0000", 2024-04-26T11:46:31.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016863083000000001 2024-04-26T11:46:31.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198587+0000", 2024-04-26T11:46:31.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7987e-05 2024-04-26T11:46:31.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198644+0000", 2024-04-26T11:46:31.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7812999999999997e-05 2024-04-26T11:46:31.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.028 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 2005622~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7722979760000008, 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027474261, 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171495+0000", 2024-04-26T11:46:31.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3199999999999996e-06 2024-04-26T11:46:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171524+0000", 2024-04-26T11:46:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9317999999999999e-05 2024-04-26T11:46:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171531+0000", 2024-04-26T11:46:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.097e-06 2024-04-26T11:46:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179855+0000", 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0083235180000000002 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179919+0000", 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3711e-05 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180042+0000", 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012306700000000001 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184773+0000", 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047314549999999999 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198750+0000", 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013976908 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198848+0000", 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7818000000000004e-05 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198964+0000", 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115831 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.035 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 2007045~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.035 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:31.035 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7721427629999997, 2024-04-26T11:46:31.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027470530999999999, 2024-04-26T11:46:31.035 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.035 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.035 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171644+0000", 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:31.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171649+0000", 2024-04-26T11:46:31.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5550000000000002e-06 2024-04-26T11:46:31.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171658+0000", 2024-04-26T11:46:31.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9870000000000005e-06 2024-04-26T11:46:31.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171663+0000", 2024-04-26T11:46:31.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3900000000000003e-06 2024-04-26T11:46:31.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180535+0000", 2024-04-26T11:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0088724760000000007 2024-04-26T11:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180625+0000", 2024-04-26T11:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9833999999999994e-05 2024-04-26T11:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180725+0000", 2024-04-26T11:46:31.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100033 2024-04-26T11:46:31.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184783+0000", 2024-04-26T11:46:31.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040582450000000003 2024-04-26T11:46:31.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199021+0000", 2024-04-26T11:46:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0142376 2024-04-26T11:46:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199063+0000", 2024-04-26T11:46:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2144999999999997e-05 2024-04-26T11:46:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199115+0000", 2024-04-26T11:46:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2046000000000003e-05 2024-04-26T11:46:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:213 3.1d 3:bec1251c:::200.00000007:head [write 2008450~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7717646719999998, 2024-04-26T11:46:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027287391000000001, 2024-04-26T11:46:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.043 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:31.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:31.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172022+0000", 2024-04-26T11:46:31.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172027+0000", 2024-04-26T11:46:31.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4750000000000001e-06 2024-04-26T11:46:31.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172042+0000", 2024-04-26T11:46:31.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4725e-05 2024-04-26T11:46:31.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172046+0000", 2024-04-26T11:46:31.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.98e-06 2024-04-26T11:46:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181210+0000", 2024-04-26T11:46:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0091635090000000002 2024-04-26T11:46:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181281+0000", 2024-04-26T11:46:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0920000000000005e-05 2024-04-26T11:46:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181379+0000", 2024-04-26T11:46:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8411000000000004e-05 2024-04-26T11:46:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184792+0000", 2024-04-26T11:46:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034134030000000002 2024-04-26T11:46:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199215+0000", 2024-04-26T11:46:31.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014422524000000001 2024-04-26T11:46:31.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199274+0000", 2024-04-26T11:46:31.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9543999999999998e-05 2024-04-26T11:46:31.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199310+0000", 2024-04-26T11:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5577999999999997e-05 2024-04-26T11:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:214 3.1d 3:bec1251c:::200.00000007:head [write 2009870~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7715446220000004, 2024-04-26T11:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027163974, 2024-04-26T11:46:31.050 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.050 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.050 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:31.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172242+0000", 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172248+0000", 2024-04-26T11:46:31.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2910000000000004e-06 2024-04-26T11:46:31.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172268+0000", 2024-04-26T11:46:31.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9309000000000001e-05 2024-04-26T11:46:31.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172273+0000", 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2050000000000001e-06 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181724+0000", 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0094516909999999999 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181794+0000", 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9102000000000003e-05 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181891+0000", 2024-04-26T11:46:31.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7853e-05 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.185719+0000", 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278710000000001 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199338+0000", 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013618518 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199384+0000", 2024-04-26T11:46:31.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5806999999999997e-05 2024-04-26T11:46:31.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199407+0000", 2024-04-26T11:46:31.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3045999999999999e-05 2024-04-26T11:46:31.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.056 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.057 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:262 3.0 3:02ac1934:::200.00000009:head [write 1776456~2270 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:31.057 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.152908+0000", 2024-04-26T11:46:31.057 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.790879646, 2024-04-26T11:46:31.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029798290000000002, 2024-04-26T11:46:31.057 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.058 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.058 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152908+0000", 2024-04-26T11:46:31.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152908+0000", 2024-04-26T11:46:31.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152907+0000", 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152917+0000", 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5889999999999992e-06 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152942+0000", 2024-04-26T11:46:31.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5228e-05 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152949+0000", 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.175600+0000", 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022651158000000001 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.175667+0000", 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6265000000000003e-05 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.175758+0000", 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1479999999999998e-05 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.178930+0000", 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031715290000000002 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182566+0000", 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036364639999999998 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182646+0000", 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0048000000000003e-05 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182706+0000", 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9941000000000001e-05 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.063 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:263 3.0 3:02ac1934:::200.00000009:head [write 1778726~2262 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.7908319669999999, 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029890064000000001, 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152960+0000", 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6710000000000004e-06 2024-04-26T11:46:31.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152983+0000", 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2614000000000001e-05 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152990+0000", 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8399999999999997e-06 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.176273+0000", 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023282694999999999 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.176419+0000", 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000145983 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.176558+0000", 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000139925 2024-04-26T11:46:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.179043+0000", 2024-04-26T11:46:31.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002484703 2024-04-26T11:46:31.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182768+0000", 2024-04-26T11:46:31.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037244980000000001 2024-04-26T11:46:31.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182802+0000", 2024-04-26T11:46:31.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4378000000000002e-05 2024-04-26T11:46:31.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182845+0000", 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3393999999999998e-05 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:264 3.0 3:02ac1934:::200.00000009:head [write 1780988~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.152996+0000", 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.7907916139999998, 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030043411999999999, 2024-04-26T11:46:31.070 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152996+0000", 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152996+0000", 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152995+0000", 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153006+0000", 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0448999999999999e-05 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153018+0000", 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2539e-05 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153025+0000", 2024-04-26T11:46:31.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7569999999999998e-06 2024-04-26T11:46:31.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177093+0000", 2024-04-26T11:46:31.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024068161000000001 2024-04-26T11:46:31.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177166+0000", 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3078999999999996e-05 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177257+0000", 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1283e-05 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.179052+0000", 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017950279999999999 2024-04-26T11:46:31.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182915+0000", 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038630539999999999 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182989+0000", 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3226000000000007e-05 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183039+0000", 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0433000000000003e-05 2024-04-26T11:46:31.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:265 3.0 3:02ac1934:::200.00000009:head [write 1782390~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.7907568490000001, 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030158497999999999, 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153035+0000", 2024-04-26T11:46:31.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.78e-06 2024-04-26T11:46:31.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153047+0000", 2024-04-26T11:46:31.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2337000000000001e-05 2024-04-26T11:46:31.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153053+0000", 2024-04-26T11:46:31.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2024-04-26T11:46:31.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177982+0000", 2024-04-26T11:46:31.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024928649000000001 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.178087+0000", 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010525 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.178253+0000", 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016530399999999999 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182484+0000", 2024-04-26T11:46:31.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004231472 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183109+0000", 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00062506300000000003 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183153+0000", 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3355000000000001e-05 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183189+0000", 2024-04-26T11:46:31.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6427999999999997e-05 2024-04-26T11:46:31.082 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.082 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.082 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.082 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.082 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.082 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:31.084 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:31.084 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:31.080+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:31.184 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:31.180+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:31.203 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:31.203 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:31.203 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:31.213 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:31.285 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:31.280+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:31.318 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:31.318 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:31.319 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:31.319 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:31.319 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:31.329 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:31.386 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:31.380+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:31.442 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:31.442 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:31.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:31.442 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:31.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.442 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:31.442 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:31.442 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.036581552, 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:31.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:31.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 138.83703170800001, 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.448 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:31.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 138.83699998899999, 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.454 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:31.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:31.459 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 138.83695842, 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:31.460 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 138.83683128300001, 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:31.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:31.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:31.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:31.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:31.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:31.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:31.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.473 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:31.473 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:31.473 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.010061603, 2024-04-26T11:46:31.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:31.473 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.473 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.473 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:31.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:31.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:31.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:31.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:31.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:31.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:31.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:31.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:31.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:31.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:31.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:31.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.00996101499999, 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.480 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:31.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:31.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:31.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:31.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:31.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:31.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:31.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:31.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:31.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:31.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:31.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:31.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:31.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:31.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:31.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:31.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:31.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:31.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:31.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:31.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:31.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:31.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:31.487 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.487 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.487 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.009892323, 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:31.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:31.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:31.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:31.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:31.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:31.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.00978870500001, 2024-04-26T11:46:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.00966485500001, 2024-04-26T11:46:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:31.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:31.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:31.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:31.509 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.509 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.510 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.510 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:31.510 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:31.510 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.009632716, 2024-04-26T11:46:31.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:31.510 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.510 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.510 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:31.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:31.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:31.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:31.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:31.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:31.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:31.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:31.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:31.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:31.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:31.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:31.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:31.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:31.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:31.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.00960262300001, 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:31.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:31.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:31.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.00957222400001, 2024-04-26T11:46:31.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:31.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:31.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:31.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:31.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:31.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:31.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:31.531 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:31.532 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.00946628, 2024-04-26T11:46:31.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:31.532 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.532 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.532 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:31.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:31.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:31.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:31.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:31.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:31.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:31.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:31.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:31.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:31.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:31.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:31.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:31.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:31.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:31.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:31.538 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.00931786300001, 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:31.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:31.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:31.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:31.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:31.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:31.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:31.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:31.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:31.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:31.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:31.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:31.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:31.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:31.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:31.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:31.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:31.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:31.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:31.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.546 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.546 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:31.547 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:31.547 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.00909272499999, 2024-04-26T11:46:31.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:31.547 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.547 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.547 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:31.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:31.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:31.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:31.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:185 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2871881550000008, 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042806678000000001, 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:31.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151613+0000", 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999928 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152126+0000", 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051282900000000002 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152158+0000", 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2268999999999999e-05 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152173+0000", 2024-04-26T11:46:31.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4780000000000001e-05 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152350+0000", 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017709600000000001 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152645+0000", 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029497600000000002 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194252+0000", 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041607102999999999 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194330+0000", 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8029999999999997e-05 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194427+0000", 2024-04-26T11:46:31.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6892000000000007e-05 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:7127 4.1e 4:7b6a0e51:::10000002096.00000000:head [write 0~1041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2841904280000005, 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029239364, 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.559 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:31.560 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:31.560 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:31.560 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 7127 2024-04-26T11:46:31.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.560 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:31.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154616+0000", 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154631+0000", 2024-04-26T11:46:31.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4786999999999999e-05 2024-04-26T11:46:31.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154655+0000", 2024-04-26T11:46:31.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3978999999999999e-05 2024-04-26T11:46:31.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154669+0000", 2024-04-26T11:46:31.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4022999999999999e-05 2024-04-26T11:46:31.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154746+0000", 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6947999999999996e-05 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154945+0000", 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000198736 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183781+0000", 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028835980000000001 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183812+0000", 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1214000000000003e-05 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183858+0000", 2024-04-26T11:46:31.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5933999999999998e-05 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:205 3.1d e54/16 3:bec1251c:::200.00000007:head v 54'25, mlcod=54'13)", 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2639333270000002, 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02133869, 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.565 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174875+0000", 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174885+0000", 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9329999999999996e-06 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174895+0000", 2024-04-26T11:46:31.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0068000000000001e-05 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.174913+0000", 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8012e-05 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183499+0000", 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0085865509999999996 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183515+0000", 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6215999999999999e-05 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.196178+0000", 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012662058 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.196214+0000", 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6665999999999998e-05 2024-04-26T11:46:31.569 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.570 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.570 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.570 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:244 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:31.570 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:31.570 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.2881320939999998, 2024-04-26T11:46:31.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021751777, 2024-04-26T11:46:31.570 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:31.570 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.570 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:31.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150675+0000", 2024-04-26T11:46:31.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:31.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:31.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151110+0000", 2024-04-26T11:46:31.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00043525500000000001 2024-04-26T11:46:31.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:31.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151131+0000", 2024-04-26T11:46:31.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0922000000000001e-05 2024-04-26T11:46:31.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151142+0000", 2024-04-26T11:46:31.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1048e-05 2024-04-26T11:46:31.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:31.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151265+0000", 2024-04-26T11:46:31.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012325199999999999 2024-04-26T11:46:31.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:31.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151504+0000", 2024-04-26T11:46:31.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023862300000000001 2024-04-26T11:46:31.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172057+0000", 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020553364000000001 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172197+0000", 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013953300000000001 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:31.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172428+0000", 2024-04-26T11:46:31.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231788 2024-04-26T11:46:31.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.576 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:31.576 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:31.576 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:31.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:31.578 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:31.572+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:31.679 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:31.672+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:31.699 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:31.699 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:31.699 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:31.699 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:31.711 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:31.779 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:31.777+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:31.813 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:31.813 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:31.813 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:31.813 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:31.813 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:31.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:31.881 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:31.877+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:31.933 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1973496~2264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7770505839999995, 2024-04-26T11:46:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030663559999999999, 2024-04-26T11:46:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153952+0000", 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153951+0000", 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153957+0000", 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1739999999999999e-06 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153968+0000", 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1017e-05 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153976+0000", 2024-04-26T11:46:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2879999999999993e-06 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170293+0000", 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016316695999999999 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170386+0000", 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3617999999999997e-05 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.170496+0000", 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010992700000000001 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173869+0000", 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033733280000000001 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184540+0000", 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010670134 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184586+0000", 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6422999999999999e-05 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184616+0000", 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9580000000000001e-05 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:200 3.1d 3:bec1251c:::200.00000007:head [write 1975760~2260 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7770177040000004, 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030773467999999998, 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153985+0000", 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153984+0000", 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.153993+0000", 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1540000000000008e-06 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154002+0000", 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7369999999999995e-06 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154011+0000", 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0170000000000002e-06 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171052+0000", 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017040783 2024-04-26T11:46:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171136+0000", 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.365e-05 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171242+0000", 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000106031 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173881+0000", 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026397769999999998 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184694+0000", 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010812158000000001 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184732+0000", 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8892e-05 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184758+0000", 2024-04-26T11:46:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840999999999999e-05 2024-04-26T11:46:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1978020~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7769839249999997, 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030901964000000001, 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154019+0000", 2024-04-26T11:46:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154018+0000", 2024-04-26T11:46:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154033+0000", 2024-04-26T11:46:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4654000000000001e-05 2024-04-26T11:46:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154086+0000", 2024-04-26T11:46:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2899000000000003e-05 2024-04-26T11:46:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154093+0000", 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5859999999999999e-06 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171777+0000", 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683871 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171904+0000", 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012735900000000001 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172029+0000", 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012449100000000001 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174739+0000", 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027096870000000001 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184832+0000", 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010093903 2024-04-26T11:46:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184893+0000", 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0130000000000002e-05 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184921+0000", 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7973000000000001e-05 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1979436~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.776902647, 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034499354000000003, 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154100+0000", 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154099+0000", 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154105+0000", 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7089999999999999e-06 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154122+0000", 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6691e-05 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154146+0000", 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4868e-05 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172574+0000", 2024-04-26T11:46:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018427437000000001 2024-04-26T11:46:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172670+0000", 2024-04-26T11:46:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6331999999999999e-05 2024-04-26T11:46:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172783+0000", 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011317800000000001 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174754+0000", 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019702119999999998 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188511+0000", 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013757261 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188567+0000", 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6199999999999997e-05 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188599+0000", 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2194999999999999e-05 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1980845~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7768460430000008, 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034666348, 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154156+0000", 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154161+0000", 2024-04-26T11:46:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9370000000000003e-06 2024-04-26T11:46:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154194+0000", 2024-04-26T11:46:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3262000000000001e-05 2024-04-26T11:46:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154208+0000", 2024-04-26T11:46:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4402e-05 2024-04-26T11:46:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173340+0000", 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019131771999999998 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173425+0000", 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4824e-05 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.173542+0000", 2024-04-26T11:46:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117219 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176087+0000", 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025445770000000001 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188717+0000", 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012630529 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188777+0000", 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9500000000000003e-05 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188823+0000", 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5927999999999998e-05 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1982267~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7767876549999997, 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034714166999999997, 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154215+0000", 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154214+0000", 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154225+0000", 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0983e-05 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154241+0000", 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5279999999999999e-05 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154247+0000", 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174079+0000", 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019832341999999999 2024-04-26T11:46:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174164+0000", 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4934999999999999e-05 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174285+0000", 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120363 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176979+0000", 2024-04-26T11:46:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002694372 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188863+0000", 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011884174000000001 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188897+0000", 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3602000000000001e-05 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.188929+0000", 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2191999999999999e-05 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7767498909999997, 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7767231629999998, 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7766922120000004, 2024-04-26T11:46:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1987909~13798 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7670958179999996, 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034314545000000002, 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163907+0000", 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163904+0000", 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999971 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163938+0000", 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4056000000000001e-05 2024-04-26T11:46:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163960+0000", 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1875999999999999e-05 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.163991+0000", 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1010000000000003e-05 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177034+0000", 2024-04-26T11:46:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013042974000000001 2024-04-26T11:46:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177111+0000", 2024-04-26T11:46:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7484999999999994e-05 2024-04-26T11:46:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177242+0000", 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013064000000000001 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179664+0000", 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024220829999999998 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198125+0000", 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018461154 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198169+0000", 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3863999999999999e-05 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198221+0000", 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2052999999999998e-05 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 2001707~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7666038359999998, 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034073882999999999, 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164399+0000", 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164396+0000", 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164412+0000", 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5223e-05 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164434+0000", 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2609e-05 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.164445+0000", 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0876999999999999e-05 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177847+0000", 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013402084999999999 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.177930+0000", 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2981999999999999e-05 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178031+0000", 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100801 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179670+0000", 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016392830000000001 2024-04-26T11:46:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198303+0000", 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018633060999999999 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198384+0000", 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0953999999999998e-05 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198473+0000", 2024-04-26T11:46:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8257999999999994e-05 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 2004206~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7598215239999995, 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027463373999999999, 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171181+0000", 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171179+0000", 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171189+0000", 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2730000000000008e-06 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171200+0000", 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.189e-05 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171210+0000", 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7399999999999999e-06 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178664+0000", 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074535740000000001 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178779+0000", 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115003 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.178873+0000", 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4405000000000002e-05 2024-04-26T11:46:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181676+0000", 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028023100000000001 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198539+0000", 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016863083000000001 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198587+0000", 2024-04-26T11:46:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7987e-05 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198644+0000", 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7812999999999997e-05 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 2005622~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7595131800000008, 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027474261, 2024-04-26T11:46:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171489+0000", 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171495+0000", 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3199999999999996e-06 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171524+0000", 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9317999999999999e-05 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171531+0000", 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.097e-06 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179855+0000", 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0083235180000000002 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179919+0000", 2024-04-26T11:46:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3711e-05 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180042+0000", 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012306700000000001 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184773+0000", 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047314549999999999 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198750+0000", 2024-04-26T11:46:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013976908 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198848+0000", 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7818000000000004e-05 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198964+0000", 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115831 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 2007045~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7593579669999997, 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027470530999999999, 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171645+0000", 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171644+0000", 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171649+0000", 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5550000000000002e-06 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171658+0000", 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9870000000000005e-06 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.171663+0000", 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3900000000000003e-06 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180535+0000", 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0088724760000000007 2024-04-26T11:46:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180625+0000", 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9833999999999994e-05 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.180725+0000", 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100033 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184783+0000", 2024-04-26T11:46:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040582450000000003 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199021+0000", 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0142376 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199063+0000", 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2144999999999997e-05 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199115+0000", 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2046000000000003e-05 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:213 3.1d 3:bec1251c:::200.00000007:head [write 2008450~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7589798759999997, 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027287391000000001, 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172023+0000", 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172022+0000", 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172027+0000", 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4750000000000001e-06 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172042+0000", 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4725e-05 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172046+0000", 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.98e-06 2024-04-26T11:46:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181210+0000", 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0091635090000000002 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181281+0000", 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0920000000000005e-05 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181379+0000", 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8411000000000004e-05 2024-04-26T11:46:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.184792+0000", 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034134030000000002 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199215+0000", 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014422524000000001 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199274+0000", 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9543999999999998e-05 2024-04-26T11:46:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199310+0000", 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5577999999999997e-05 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:214 3.1d 3:bec1251c:::200.00000007:head [write 2009870~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7587598260000004, 2024-04-26T11:46:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027163974, 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172243+0000", 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172242+0000", 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172248+0000", 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2910000000000004e-06 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172268+0000", 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9309000000000001e-05 2024-04-26T11:46:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.172273+0000", 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2050000000000001e-06 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181724+0000", 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0094516909999999999 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181794+0000", 2024-04-26T11:46:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9102000000000003e-05 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.181891+0000", 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7853e-05 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.185719+0000", 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038278710000000001 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199338+0000", 2024-04-26T11:46:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013618518 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199384+0000", 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5806999999999997e-05 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.199407+0000", 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3045999999999999e-05 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:262 3.0 3:02ac1934:::200.00000009:head [write 1776456~2270 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.152908+0000", 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7780948500000004, 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029798290000000002, 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152908+0000", 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152908+0000", 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152907+0000", 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152917+0000", 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5889999999999992e-06 2024-04-26T11:46:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152942+0000", 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5228e-05 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152949+0000", 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.175600+0000", 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022651158000000001 2024-04-26T11:46:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.175667+0000", 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6265000000000003e-05 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.175758+0000", 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1479999999999998e-05 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.178930+0000", 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031715290000000002 2024-04-26T11:46:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182566+0000", 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036364639999999998 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182646+0000", 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0048000000000003e-05 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182706+0000", 2024-04-26T11:46:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9941000000000001e-05 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:263 3.0 3:02ac1934:::200.00000009:head [write 1778726~2262 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7780471709999999, 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029890064000000001, 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152955+0000", 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152960+0000", 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6710000000000004e-06 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152983+0000", 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2614000000000001e-05 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152990+0000", 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8399999999999997e-06 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.176273+0000", 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023282694999999999 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.176419+0000", 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000145983 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.176558+0000", 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000139925 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.179043+0000", 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002484703 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182768+0000", 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037244980000000001 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182802+0000", 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4378000000000002e-05 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182845+0000", 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3393999999999998e-05 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:264 3.0 3:02ac1934:::200.00000009:head [write 1780988~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.152996+0000", 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7780068179999997, 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030043411999999999, 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152996+0000", 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152996+0000", 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.152995+0000", 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153006+0000", 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0448999999999999e-05 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153018+0000", 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2539e-05 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153025+0000", 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7569999999999998e-06 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177093+0000", 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024068161000000001 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177166+0000", 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3078999999999996e-05 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177257+0000", 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1283e-05 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.179052+0000", 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017950279999999999 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182915+0000", 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038630539999999999 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182989+0000", 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3226000000000007e-05 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183039+0000", 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0433000000000003e-05 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:265 3.0 3:02ac1934:::200.00000009:head [write 1782390~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7779720530000001, 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030158497999999999, 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153030+0000", 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153035+0000", 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.78e-06 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153047+0000", 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2337000000000001e-05 2024-04-26T11:46:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.153053+0000", 2024-04-26T11:46:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2024-04-26T11:46:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.177982+0000", 2024-04-26T11:46:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024928649000000001 2024-04-26T11:46:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.178087+0000", 2024-04-26T11:46:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010525 2024-04-26T11:46:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.178253+0000", 2024-04-26T11:46:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016530399999999999 2024-04-26T11:46:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.182484+0000", 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004231472 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183109+0000", 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00062506300000000003 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183153+0000", 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3355000000000001e-05 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:27.183189+0000", 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6427999999999997e-05 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:32.048 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:32.050 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:32.050 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:32.044+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:32.131 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:46:32.150 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:32.149+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:32.165 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:291 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-set-vals in=143822b,omap-rm-keys in=25459b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.015001577, 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015034522, 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:32.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:32.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151067+0000", 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151620+0000", 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00055239000000000004 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151648+0000", 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8396000000000001e-05 2024-04-26T11:46:32.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151674+0000", 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5683000000000001e-05 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151780+0000", 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010609500000000001 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151979+0000", 2024-04-26T11:46:32.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019890899999999999 2024-04-26T11:46:32.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.170 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.170 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:46:32.170 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-26T11:46:32.170 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:32.176 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:32.251 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:32.248+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:32.281 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:32.281 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:32.281 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:32.281 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:32.281 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:32.291 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:32.296 INFO:tasks.workunit.client.0.smithi029.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-26T11:46:32.302 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T11:46:32.302 INFO:tasks.workunit.client.0.smithi029.stderr:+ make 2024-04-26T11:46:32.336 INFO:tasks.workunit.client.0.smithi029.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-26T11:46:32.353 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:32.349+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:32.394 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:32.394 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.988952668, 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021405014, 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:32.395 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 117 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402227+0000", 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402226+0000", 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402249+0000", 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2855999999999999e-05 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402270+0000", 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0588e-05 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.402282+0000", 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2703e-05 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416073+0000", 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013790894 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416176+0000", 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102416 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.416340+0000", 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016417600000000001 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.417968+0000", 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628443 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423524+0000", 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055560180000000002 2024-04-26T11:46:32.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423584+0000", 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0078000000000003e-05 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.423632+0000", 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7913e-05 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.78940282400001, 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:32.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:32.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.78937110499999, 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:32.406 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:32.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:32.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:32.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.789329536, 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:32.412 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:32.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:32.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.417 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.789202399, 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:32.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.96243271899999, 2024-04-26T11:46:32.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022114136999999999, 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428747+0000", 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428745+0000", 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428759+0000", 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3883000000000001e-05 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428807+0000", 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8238999999999997e-05 2024-04-26T11:46:32.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428823+0000", 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5965999999999999e-05 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428894+0000", 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1512000000000002e-05 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428900+0000", 2024-04-26T11:46:32.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2620000000000004e-06 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440095+0000", 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01119412 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440246+0000", 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015157699999999999 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.440392+0000", 2024-04-26T11:46:32.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000146083 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445160+0000", 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047677919999999999 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450622+0000", 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054618449999999999 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450671+0000", 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9438999999999999e-05 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450861+0000", 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019001200000000001 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:32.429 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.96233213100001, 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:32.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:32.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.962263439, 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:32.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:32.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:32.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:32.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:32.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:32.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.962159821, 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:32.442 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:32.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:32.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:32.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.96203597100001, 2024-04-26T11:46:32.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:32.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:32.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:32.455 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.96200383199999, 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:32.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:32.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:32.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.961973739, 2024-04-26T11:46:32.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:32.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:32.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:32.467 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.96194334, 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:32.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:32.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:32.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.96183739599999, 2024-04-26T11:46:32.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022070355999999999, 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429343+0000", 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429342+0000", 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429367+0000", 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5522999999999999e-05 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429379+0000", 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1683e-05 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429386+0000", 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.306e-06 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429542+0000", 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015593000000000001 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429556+0000", 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3934000000000001e-05 2024-04-26T11:46:32.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443598+0000", 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014041734 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443704+0000", 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105783 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443807+0000", 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103484 2024-04-26T11:46:32.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445031+0000", 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012236040000000001 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451323+0000", 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062918510000000002 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451373+0000", 2024-04-26T11:46:32.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0430999999999999e-05 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451413+0000", 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9703000000000003e-05 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.961688979, 2024-04-26T11:46:32.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022043177000000001, 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429491+0000", 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429490+0000", 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429504+0000", 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3966e-05 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429516+0000", 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1888999999999999e-05 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429526+0000", 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3600000000000002e-06 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429639+0000", 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113451 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429649+0000", 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005e-05 2024-04-26T11:46:32.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444019+0000", 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014369662 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444127+0000", 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108632 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148567 2024-04-26T11:46:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445311+0000", 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010351710000000001 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451455+0000", 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061440399999999999 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451503+0000", 2024-04-26T11:46:32.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7422000000000001e-05 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451534+0000", 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1619999999999999e-05 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:32.485 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.96146384100001, 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02152082, 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429716+0000", 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429715+0000", 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429757+0000", 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2239e-05 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429780+0000", 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869000000000001e-05 2024-04-26T11:46:32.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429793+0000", 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2554e-05 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432274+0000", 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002481633 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.432286+0000", 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1409e-05 2024-04-26T11:46:32.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442809+0000", 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010522864999999999 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442931+0000", 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012221500000000001 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443074+0000", 2024-04-26T11:46:32.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143034 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444958+0000", 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018840459999999999 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450831+0000", 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058729740000000004 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451034+0000", 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020255100000000001 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451237+0000", 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020341099999999999 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:185 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:32.491 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.239559270999999, 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042806678000000001, 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151613+0000", 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999928 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152126+0000", 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051282900000000002 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152158+0000", 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2268999999999999e-05 2024-04-26T11:46:32.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152173+0000", 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4780000000000001e-05 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152350+0000", 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017709600000000001 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152645+0000", 2024-04-26T11:46:32.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029497600000000002 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194252+0000", 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041607102999999999 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194330+0000", 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8029999999999997e-05 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194427+0000", 2024-04-26T11:46:32.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6892000000000007e-05 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:7127 4.1e 4:7b6a0e51:::10000002096.00000000:head [write 0~1041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.236561544000001, 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029239364, 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 7127 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154616+0000", 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154631+0000", 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4786999999999999e-05 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154655+0000", 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3978999999999999e-05 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154669+0000", 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4022999999999999e-05 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154746+0000", 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6947999999999996e-05 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154945+0000", 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000198736 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183781+0000", 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028835980000000001 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183812+0000", 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1214000000000003e-05 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183858+0000", 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5933999999999998e-05 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.500 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:244 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.24050321, 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021751777, 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150677+0000", 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.150675+0000", 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151110+0000", 2024-04-26T11:46:32.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00043525500000000001 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151131+0000", 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0922000000000001e-05 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151142+0000", 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1048e-05 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151265+0000", 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012325199999999999 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.151504+0000", 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023862300000000001 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172057+0000", 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020553364000000001 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172197+0000", 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013953300000000001 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:27.172428+0000", 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231788 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.505 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:291 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-set-vals in=143822b,omap-rm-keys in=25459b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.24011060100000001, 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029817972000000002, 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:32.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151067+0000", 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151620+0000", 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00055239000000000004 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151648+0000", 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8396000000000001e-05 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151674+0000", 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5683000000000001e-05 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151780+0000", 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010609500000000001 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151979+0000", 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019890899999999999 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.180710+0000", 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028731406000000001 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.180777+0000", 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7104e-05 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:32.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.180887+0000", 2024-04-26T11:46:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110179 2024-04-26T11:46:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:32.510 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:32.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:32.513 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:32.508+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:32.612 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:32.609+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:32.719 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:32.721 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:32.721 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:32.721 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:32.722 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:32.717+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:32.822 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:32.816+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:32.833 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:32.833 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:32.833 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:32.833 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:32.833 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:32.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:32.874 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:32.899 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:32.899 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:32.899 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:32.899 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:32.903 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:32.903 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:32.923 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:32.921+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:33.001 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:33.002 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:33.008 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:33.024 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:33.020+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:33.123 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:46:33.125 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:33.121+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:33.128 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:33.128 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:33.139 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:33.226 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:33.220+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:33.243 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:33.244 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:33.253 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:33.326 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:33.324+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:33.361 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:33.361 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:33.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:33.427 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:33.420+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:33.485 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:33.486 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:33.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:33.528 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:33.524+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:33.603 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:33.603 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:33.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:33.629 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:33.625+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:33.730 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:33.724+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:33.762 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:33.762 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:33.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:33.831 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:33.829+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:33.887 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:33.887 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:33.896 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:33.931 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:33.928+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:34.008 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:34.008 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:34.017 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:34.032 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:34.032+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:34.086 INFO:tasks.workunit.client.0.smithi029.stderr:++ readlink -f fsstress 2024-04-26T11:46:34.089 INFO:tasks.workunit.client.0.smithi029.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-26T11:46:34.089 INFO:tasks.workunit.client.0.smithi029.stderr:+ popd 2024-04-26T11:46:34.091 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T11:46:34.091 INFO:tasks.workunit.client.0.smithi029.stderr:+ popd 2024-04-26T11:46:34.092 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-26T11:46:34.092 INFO:tasks.workunit.client.0.smithi029.stderr:++ mktemp -d -p . 2024-04-26T11:46:34.095 INFO:tasks.workunit.client.0.smithi029.stderr:+ T=./tmp.FxRW8rlRQc 2024-04-26T11:46:34.095 INFO:tasks.workunit.client.0.smithi029.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.FxRW8rlRQc -l 1 -n 1000 -p 10 -v 2024-04-26T11:46:34.100 INFO:tasks.workunit.client.0.smithi029.stdout:seed = 1714032765 2024-04-26T11:46:34.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/0: rmdir - no directory 2024-04-26T11:46:34.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/1: dread - no filename 2024-04-26T11:46:34.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/2: stat - no entries 2024-04-26T11:46:34.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/3: dwrite - no filename 2024-04-26T11:46:34.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/4: fdatasync - no filename 2024-04-26T11:46:34.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/5: dwrite - no filename 2024-04-26T11:46:34.104 INFO:tasks.workunit.client.0.smithi029.stdout:1/0: mknod c0 1 2024-04-26T11:46:34.104 INFO:tasks.workunit.client.0.smithi029.stdout:1/1: rmdir - no directory 2024-04-26T11:46:34.104 INFO:tasks.workunit.client.0.smithi029.stdout:1/2: fsync - no filename 2024-04-26T11:46:34.105 INFO:tasks.workunit.client.0.smithi029.stdout:0/6: getdents . 0 2024-04-26T11:46:34.105 INFO:tasks.workunit.client.0.smithi029.stdout:0/7: write - no filename 2024-04-26T11:46:34.105 INFO:tasks.workunit.client.0.smithi029.stdout:0/8: rename - no filename 2024-04-26T11:46:34.105 INFO:tasks.workunit.client.0.smithi029.stdout:0/9: chown . 1637264 1 2024-04-26T11:46:34.105 INFO:tasks.workunit.client.0.smithi029.stdout:3/0: rmdir - no directory 2024-04-26T11:46:34.105 INFO:tasks.workunit.client.0.smithi029.stdout:3/1: write - no filename 2024-04-26T11:46:34.105 INFO:tasks.workunit.client.0.smithi029.stdout:3/2: fsync - no filename 2024-04-26T11:46:34.105 INFO:tasks.workunit.client.0.smithi029.stdout:3/3: dwrite - no filename 2024-04-26T11:46:34.105 INFO:tasks.workunit.client.0.smithi029.stdout:3/4: rename - no filename 2024-04-26T11:46:34.106 INFO:tasks.workunit.client.0.smithi029.stdout:4/0: readlink - no filename 2024-04-26T11:46:34.106 INFO:tasks.workunit.client.0.smithi029.stdout:1/3: creat f1 x:0 0 0 2024-04-26T11:46:34.106 INFO:tasks.workunit.client.0.smithi029.stdout:0/10: creat f0 x:0 0 0 2024-04-26T11:46:34.107 INFO:tasks.workunit.client.0.smithi029.stdout:3/5: mkdir d0 0 2024-04-26T11:46:34.107 INFO:tasks.workunit.client.0.smithi029.stdout:1/4: dread - f1 zero size 2024-04-26T11:46:34.107 INFO:tasks.workunit.client.0.smithi029.stdout:3/6: chown d0 3148 1 2024-04-26T11:46:34.108 INFO:tasks.workunit.client.0.smithi029.stdout:3/7: write - no filename 2024-04-26T11:46:34.108 INFO:tasks.workunit.client.0.smithi029.stdout:2/0: write - no filename 2024-04-26T11:46:34.108 INFO:tasks.workunit.client.0.smithi029.stdout:2/1: fdatasync - no filename 2024-04-26T11:46:34.108 INFO:tasks.workunit.client.0.smithi029.stdout:2/2: write - no filename 2024-04-26T11:46:34.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/5: stat f1 0 2024-04-26T11:46:34.109 INFO:tasks.workunit.client.0.smithi029.stdout:4/1: symlink l0 0 2024-04-26T11:46:34.109 INFO:tasks.workunit.client.0.smithi029.stdout:4/2: write - no filename 2024-04-26T11:46:34.109 INFO:tasks.workunit.client.0.smithi029.stdout:0/11: link f0 f1 0 2024-04-26T11:46:34.111 INFO:tasks.workunit.client.0.smithi029.stdout:2/3: mkdir d0 0 2024-04-26T11:46:34.111 INFO:tasks.workunit.client.0.smithi029.stdout:2/4: dwrite - no filename 2024-04-26T11:46:34.111 INFO:tasks.workunit.client.0.smithi029.stdout:2/5: dwrite - no filename 2024-04-26T11:46:34.111 INFO:tasks.workunit.client.0.smithi029.stdout:2/6: dread - no filename 2024-04-26T11:46:34.111 INFO:tasks.workunit.client.0.smithi029.stdout:2/7: readlink - no filename 2024-04-26T11:46:34.112 INFO:tasks.workunit.client.0.smithi029.stdout:3/8: mkdir d0/d1 0 2024-04-26T11:46:34.112 INFO:tasks.workunit.client.0.smithi029.stdout:3/9: link - no file 2024-04-26T11:46:34.112 INFO:tasks.workunit.client.0.smithi029.stdout:4/3: creat f1 x:0 0 0 2024-04-26T11:46:34.112 INFO:tasks.workunit.client.0.smithi029.stdout:4/4: rmdir - no directory 2024-04-26T11:46:34.112 INFO:tasks.workunit.client.0.smithi029.stdout:2/8: chown d0 0 1 2024-04-26T11:46:34.112 INFO:tasks.workunit.client.0.smithi029.stdout:2/9: dread - no filename 2024-04-26T11:46:34.112 INFO:tasks.workunit.client.0.smithi029.stdout:2/10: write - no filename 2024-04-26T11:46:34.112 INFO:tasks.workunit.client.0.smithi029.stdout:2/11: dwrite - no filename 2024-04-26T11:46:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:0/12: creat f2 x:0 0 0 2024-04-26T11:46:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:1/6: write f1 [321070,73261] 0 2024-04-26T11:46:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:4/5: dread - f1 zero size 2024-04-26T11:46:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:3/10: mknod d0/d1/c2 1 2024-04-26T11:46:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:6/0: dwrite - no filename 2024-04-26T11:46:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:4/6: mknod c2 1 2024-04-26T11:46:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:6/1: mknod c0 1 2024-04-26T11:46:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:2/12: rmdir d0 0 2024-04-26T11:46:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:3/11: rename d0 to d0/d3 22 2024-04-26T11:46:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:4/7: dread - f1 zero size 2024-04-26T11:46:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:1/7: write f1 [256777,8304] 0 2024-04-26T11:46:34.115 INFO:tasks.workunit.client.0.smithi029.stdout:3/12: stat d0/d1 0 2024-04-26T11:46:34.115 INFO:tasks.workunit.client.0.smithi029.stdout:7/0: mknod c0 1 2024-04-26T11:46:34.115 INFO:tasks.workunit.client.0.smithi029.stdout:7/1: rmdir - no directory 2024-04-26T11:46:34.115 INFO:tasks.workunit.client.0.smithi029.stdout:7/2: fdatasync - no filename 2024-04-26T11:46:34.115 INFO:tasks.workunit.client.0.smithi029.stdout:7/3: dread - no filename 2024-04-26T11:46:34.115 INFO:tasks.workunit.client.0.smithi029.stdout:0/13: link f2 f3 0 2024-04-26T11:46:34.115 INFO:tasks.workunit.client.0.smithi029.stdout:2/13: symlink l1 0 2024-04-26T11:46:34.115 INFO:tasks.workunit.client.0.smithi029.stdout:6/2: symlink l1 0 2024-04-26T11:46:34.116 INFO:tasks.workunit.client.0.smithi029.stdout:4/8: fdatasync f1 0 2024-04-26T11:46:34.116 INFO:tasks.workunit.client.0.smithi029.stdout:3/13: creat d0/f4 x:0 0 0 2024-04-26T11:46:34.118 INFO:tasks.workunit.client.0.smithi029.stdout:7/4: symlink l1 0 2024-04-26T11:46:34.118 INFO:tasks.workunit.client.0.smithi029.stdout:7/5: read - no filename 2024-04-26T11:46:34.118 INFO:tasks.workunit.client.0.smithi029.stdout:7/6: truncate - no filename 2024-04-26T11:46:34.119 INFO:tasks.workunit.client.0.smithi029.stdout:8/0: chown . 338913 1 2024-04-26T11:46:34.119 INFO:tasks.workunit.client.0.smithi029.stdout:8/1: readlink - no filename 2024-04-26T11:46:34.119 INFO:tasks.workunit.client.0.smithi029.stdout:6/3: creat f2 x:0 0 0 2024-04-26T11:46:34.119 INFO:tasks.workunit.client.0.smithi029.stdout:7/7: mknod c2 1 2024-04-26T11:46:34.119 INFO:tasks.workunit.client.0.smithi029.stdout:7/8: truncate - no filename 2024-04-26T11:46:34.119 INFO:tasks.workunit.client.0.smithi029.stdout:7/9: dwrite - no filename 2024-04-26T11:46:34.119 INFO:tasks.workunit.client.0.smithi029.stdout:7/10: dread - no filename 2024-04-26T11:46:34.120 INFO:tasks.workunit.client.0.smithi029.stdout:7/11: mknod c3 1 2024-04-26T11:46:34.120 INFO:tasks.workunit.client.0.smithi029.stdout:7/12: dwrite - no filename 2024-04-26T11:46:34.120 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:34.120 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:34.121 INFO:tasks.workunit.client.0.smithi029.stdout:4/9: write f1 [350524,85771] 0 2024-04-26T11:46:34.121 INFO:tasks.workunit.client.0.smithi029.stdout:1/8: dread f1 [0,4194304] 0 2024-04-26T11:46:34.122 INFO:tasks.workunit.client.0.smithi029.stdout:9/0: dread - no filename 2024-04-26T11:46:34.122 INFO:tasks.workunit.client.0.smithi029.stdout:9/1: dread - no filename 2024-04-26T11:46:34.122 INFO:tasks.workunit.client.0.smithi029.stdout:9/2: read - no filename 2024-04-26T11:46:34.122 INFO:tasks.workunit.client.0.smithi029.stdout:9/3: link - no file 2024-04-26T11:46:34.122 INFO:tasks.workunit.client.0.smithi029.stdout:9/4: dwrite - no filename 2024-04-26T11:46:34.123 INFO:tasks.workunit.client.0.smithi029.stdout:9/5: mknod c0 1 2024-04-26T11:46:34.123 INFO:tasks.workunit.client.0.smithi029.stdout:9/6: write - no filename 2024-04-26T11:46:34.123 INFO:tasks.workunit.client.0.smithi029.stdout:9/7: truncate - no filename 2024-04-26T11:46:34.123 INFO:tasks.workunit.client.0.smithi029.stdout:9/8: dwrite - no filename 2024-04-26T11:46:34.123 INFO:tasks.workunit.client.0.smithi029.stdout:9/9: stat - no entries 2024-04-26T11:46:34.123 INFO:tasks.workunit.client.0.smithi029.stdout:7/13: stat l1 0 2024-04-26T11:46:34.123 INFO:tasks.workunit.client.0.smithi029.stdout:7/14: fsync - no filename 2024-04-26T11:46:34.123 INFO:tasks.workunit.client.0.smithi029.stdout:2/14: rename l1 to l2 0 2024-04-26T11:46:34.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/15: truncate - no filename 2024-04-26T11:46:34.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/16: dwrite - no filename 2024-04-26T11:46:34.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/17: truncate - no filename 2024-04-26T11:46:34.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/18: write - no filename 2024-04-26T11:46:34.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/19: dwrite - no filename 2024-04-26T11:46:34.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/20: dread - no filename 2024-04-26T11:46:34.124 INFO:tasks.workunit.client.0.smithi029.stdout:4/10: mkdir d3 0 2024-04-26T11:46:34.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/21: mknod c3 1 2024-04-26T11:46:34.125 INFO:tasks.workunit.client.0.smithi029.stdout:1/9: rename f1 to f2 0 2024-04-26T11:46:34.126 INFO:tasks.workunit.client.0.smithi029.stdout:9/10: creat f1 x:0 0 0 2024-04-26T11:46:34.126 INFO:tasks.workunit.client.0.smithi029.stdout:7/15: chown l1 165 1 2024-04-26T11:46:34.126 INFO:tasks.workunit.client.0.smithi029.stdout:7/16: truncate - no filename 2024-04-26T11:46:34.126 INFO:tasks.workunit.client.0.smithi029.stdout:7/17: truncate - no filename 2024-04-26T11:46:34.126 INFO:tasks.workunit.client.0.smithi029.stdout:4/11: symlink d3/l4 0 2024-04-26T11:46:34.127 INFO:tasks.workunit.client.0.smithi029.stdout:8/2: creat f0 x:0 0 0 2024-04-26T11:46:34.129 INFO:tasks.workunit.client.0.smithi029.stdout:1/10: dread f2 [0,4194304] 0 2024-04-26T11:46:34.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:34.131 INFO:tasks.workunit.client.0.smithi029.stdout:4/12: link f1 d3/f5 0 2024-04-26T11:46:34.134 INFO:tasks.workunit.client.0.smithi029.stdout:0/14: dwrite f0 [0,4194304] 0 2024-04-26T11:46:34.134 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:34.133+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:34.134 INFO:tasks.workunit.client.0.smithi029.stdout:3/14: dwrite d0/f4 [0,4194304] 0 2024-04-26T11:46:34.134 INFO:tasks.workunit.client.0.smithi029.stdout:4/13: unlink d3/l4 0 2024-04-26T11:46:34.135 INFO:tasks.workunit.client.0.smithi029.stdout:0/15: dread - f2 zero size 2024-04-26T11:46:34.136 INFO:tasks.workunit.client.0.smithi029.stdout:6/4: dwrite f2 [0,4194304] 0 2024-04-26T11:46:34.139 INFO:tasks.workunit.client.0.smithi029.stdout:0/16: write f0 [1190139,86741] 0 2024-04-26T11:46:34.142 INFO:tasks.workunit.client.0.smithi029.stdout:8/3: dwrite f0 [0,4194304] 0 2024-04-26T11:46:34.145 INFO:tasks.workunit.client.0.smithi029.stdout:8/4: write f0 [135984,75163] 0 2024-04-26T11:46:34.148 INFO:tasks.workunit.client.0.smithi029.stdout:3/15: dwrite d0/f4 [0,4194304] 0 2024-04-26T11:46:34.149 INFO:tasks.workunit.client.0.smithi029.stdout:3/16: mknod d0/d1/c5 1 2024-04-26T11:46:34.150 INFO:tasks.workunit.client.0.smithi029.stdout:3/17: mknod d0/d1/c6 1 2024-04-26T11:46:34.151 INFO:tasks.workunit.client.0.smithi029.stdout:3/18: write d0/f4 [1172314,125856] 0 2024-04-26T11:46:34.152 INFO:tasks.workunit.client.0.smithi029.stdout:8/5: dread f0 [0,4194304] 0 2024-04-26T11:46:34.154 INFO:tasks.workunit.client.0.smithi029.stdout:0/17: rename f1 to f4 0 2024-04-26T11:46:34.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/18: chown f4 355380 1 2024-04-26T11:46:34.156 INFO:tasks.workunit.client.0.smithi029.stdout:0/19: chown f4 45 1 2024-04-26T11:46:34.157 INFO:tasks.workunit.client.0.smithi029.stdout:8/6: dread f0 [0,4194304] 0 2024-04-26T11:46:34.161 INFO:tasks.workunit.client.0.smithi029.stdout:7/18: getdents . 0 2024-04-26T11:46:34.161 INFO:tasks.workunit.client.0.smithi029.stdout:1/11: getdents . 0 2024-04-26T11:46:34.162 INFO:tasks.workunit.client.0.smithi029.stdout:9/11: fsync f1 0 2024-04-26T11:46:34.162 INFO:tasks.workunit.client.0.smithi029.stdout:7/19: mknod c4 1 2024-04-26T11:46:34.162 INFO:tasks.workunit.client.0.smithi029.stdout:9/12: mknod c2 1 2024-04-26T11:46:34.162 INFO:tasks.workunit.client.0.smithi029.stdout:4/14: rmdir d3 39 2024-04-26T11:46:34.163 INFO:tasks.workunit.client.0.smithi029.stdout:8/7: write f0 [4850392,89740] 0 2024-04-26T11:46:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:9/13: dread - f1 zero size 2024-04-26T11:46:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:0/20: rename f2 to f5 0 2024-04-26T11:46:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:2/22: stat l2 0 2024-04-26T11:46:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:9/14: fsync f1 0 2024-04-26T11:46:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:7/20: creat f5 x:0 0 0 2024-04-26T11:46:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:1/12: dread f2 [0,4194304] 0 2024-04-26T11:46:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:3/19: creat d0/d1/f7 x:0 0 0 2024-04-26T11:46:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:0/21: symlink l6 0 2024-04-26T11:46:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:8/8: creat f1 x:0 0 0 2024-04-26T11:46:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:2/23: creat f4 x:0 0 0 2024-04-26T11:46:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:8/9: stat f1 0 2024-04-26T11:46:34.166 INFO:tasks.workunit.client.0.smithi029.stdout:9/15: write f1 [159717,109430] 0 2024-04-26T11:46:34.166 INFO:tasks.workunit.client.0.smithi029.stdout:0/22: rename f4 to f7 0 2024-04-26T11:46:34.166 INFO:tasks.workunit.client.0.smithi029.stdout:3/20: creat d0/d1/f8 x:0 0 0 2024-04-26T11:46:34.166 INFO:tasks.workunit.client.0.smithi029.stdout:4/15: link l0 d3/l6 0 2024-04-26T11:46:34.166 INFO:tasks.workunit.client.0.smithi029.stdout:2/24: chown l2 226079974 1 2024-04-26T11:46:34.167 INFO:tasks.workunit.client.0.smithi029.stdout:1/13: dread f2 [0,4194304] 0 2024-04-26T11:46:34.167 INFO:tasks.workunit.client.0.smithi029.stdout:8/10: chown f1 740 1 2024-04-26T11:46:34.167 INFO:tasks.workunit.client.0.smithi029.stdout:2/25: write f4 [295957,32875] 0 2024-04-26T11:46:34.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/16: creat d3/f7 x:0 0 0 2024-04-26T11:46:34.167 INFO:tasks.workunit.client.0.smithi029.stdout:3/21: symlink d0/l9 0 2024-04-26T11:46:34.167 INFO:tasks.workunit.client.0.smithi029.stdout:9/16: link f1 f3 0 2024-04-26T11:46:34.167 INFO:tasks.workunit.client.0.smithi029.stdout:1/14: fsync f2 0 2024-04-26T11:46:34.168 INFO:tasks.workunit.client.0.smithi029.stdout:7/21: fsync f5 0 2024-04-26T11:46:34.168 INFO:tasks.workunit.client.0.smithi029.stdout:3/22: dread - d0/d1/f7 zero size 2024-04-26T11:46:34.168 INFO:tasks.workunit.client.0.smithi029.stdout:0/23: truncate f3 506414 0 2024-04-26T11:46:34.168 INFO:tasks.workunit.client.0.smithi029.stdout:7/22: creat f6 x:0 0 0 2024-04-26T11:46:34.168 INFO:tasks.workunit.client.0.smithi029.stdout:7/23: chown f5 13 1 2024-04-26T11:46:34.168 INFO:tasks.workunit.client.0.smithi029.stdout:3/23: creat d0/d1/fa x:0 0 0 2024-04-26T11:46:34.169 INFO:tasks.workunit.client.0.smithi029.stdout:0/24: fdatasync f3 0 2024-04-26T11:46:34.169 INFO:tasks.workunit.client.0.smithi029.stdout:7/24: creat f7 x:0 0 0 2024-04-26T11:46:34.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/24: symlink d0/lb 0 2024-04-26T11:46:34.170 INFO:tasks.workunit.client.0.smithi029.stdout:9/17: dread f1 [0,4194304] 0 2024-04-26T11:46:34.172 INFO:tasks.workunit.client.0.smithi029.stdout:6/5: fsync f2 0 2024-04-26T11:46:34.172 INFO:tasks.workunit.client.0.smithi029.stdout:3/25: unlink d0/d1/f7 0 2024-04-26T11:46:34.172 INFO:tasks.workunit.client.0.smithi029.stdout:9/18: mkdir d4 0 2024-04-26T11:46:34.173 INFO:tasks.workunit.client.0.smithi029.stdout:3/26: mkdir d0/dc 0 2024-04-26T11:46:34.175 INFO:tasks.workunit.client.0.smithi029.stdout:9/19: mkdir d4/d5 0 2024-04-26T11:46:34.175 INFO:tasks.workunit.client.0.smithi029.stdout:3/27: mknod d0/d1/cd 1 2024-04-26T11:46:34.176 INFO:tasks.workunit.client.0.smithi029.stdout:3/28: mkdir d0/de 0 2024-04-26T11:46:34.177 INFO:tasks.workunit.client.0.smithi029.stdout:9/20: write f3 [65621,76309] 0 2024-04-26T11:46:34.177 INFO:tasks.workunit.client.0.smithi029.stdout:2/26: fsync f4 0 2024-04-26T11:46:34.178 INFO:tasks.workunit.client.0.smithi029.stdout:8/11: dwrite f1 [0,4194304] 0 2024-04-26T11:46:34.178 INFO:tasks.workunit.client.0.smithi029.stdout:8/12: rmdir - no directory 2024-04-26T11:46:34.178 INFO:tasks.workunit.client.0.smithi029.stdout:8/13: stat f0 0 2024-04-26T11:46:34.179 INFO:tasks.workunit.client.0.smithi029.stdout:3/29: truncate d0/d1/f8 938577 0 2024-04-26T11:46:34.180 INFO:tasks.workunit.client.0.smithi029.stdout:1/15: dwrite f2 [0,4194304] 0 2024-04-26T11:46:34.180 INFO:tasks.workunit.client.0.smithi029.stdout:2/27: write f4 [1002635,54916] 0 2024-04-26T11:46:34.180 INFO:tasks.workunit.client.0.smithi029.stdout:2/28: rmdir - no directory 2024-04-26T11:46:34.180 INFO:tasks.workunit.client.0.smithi029.stdout:8/14: creat f2 x:0 0 0 2024-04-26T11:46:34.180 INFO:tasks.workunit.client.0.smithi029.stdout:8/15: rmdir - no directory 2024-04-26T11:46:34.181 INFO:tasks.workunit.client.0.smithi029.stdout:8/16: read f0 [2352464,9053] 0 2024-04-26T11:46:34.181 INFO:tasks.workunit.client.0.smithi029.stdout:3/30: chown d0/d1/f8 505435 1 2024-04-26T11:46:34.181 INFO:tasks.workunit.client.0.smithi029.stdout:2/29: write f4 [1504455,124977] 0 2024-04-26T11:46:34.181 INFO:tasks.workunit.client.0.smithi029.stdout:8/17: stat f2 0 2024-04-26T11:46:34.182 INFO:tasks.workunit.client.0.smithi029.stdout:3/31: chown d0/dc 1 1 2024-04-26T11:46:34.184 INFO:tasks.workunit.client.0.smithi029.stdout:6/6: dread f2 [0,4194304] 0 2024-04-26T11:46:34.185 INFO:tasks.workunit.client.0.smithi029.stdout:2/30: rename f4 to f5 0 2024-04-26T11:46:34.186 INFO:tasks.workunit.client.0.smithi029.stdout:6/7: link l1 l3 0 2024-04-26T11:46:34.187 INFO:tasks.workunit.client.0.smithi029.stdout:6/8: fdatasync f2 0 2024-04-26T11:46:34.188 INFO:tasks.workunit.client.0.smithi029.stdout:4/17: write d3/f5 [1123216,68181] 0 2024-04-26T11:46:34.189 INFO:tasks.workunit.client.0.smithi029.stdout:7/25: getdents . 0 2024-04-26T11:46:34.190 INFO:tasks.workunit.client.0.smithi029.stdout:4/18: mkdir d3/d8 0 2024-04-26T11:46:34.191 INFO:tasks.workunit.client.0.smithi029.stdout:4/19: mkdir d3/d9 0 2024-04-26T11:46:34.192 INFO:tasks.workunit.client.0.smithi029.stdout:1/16: dwrite f2 [0,4194304] 0 2024-04-26T11:46:34.192 INFO:tasks.workunit.client.0.smithi029.stdout:1/17: readlink - no filename 2024-04-26T11:46:34.193 INFO:tasks.workunit.client.0.smithi029.stdout:4/20: chown d3/f5 0 1 2024-04-26T11:46:34.193 INFO:tasks.workunit.client.0.smithi029.stdout:1/18: mkdir d3 0 2024-04-26T11:46:34.194 INFO:tasks.workunit.client.0.smithi029.stdout:3/32: dwrite d0/f4 [0,4194304] 0 2024-04-26T11:46:34.195 INFO:tasks.workunit.client.0.smithi029.stdout:1/19: write f2 [422615,5088] 0 2024-04-26T11:46:34.196 INFO:tasks.workunit.client.0.smithi029.stdout:4/21: creat d3/d8/fa x:0 0 0 2024-04-26T11:46:34.196 INFO:tasks.workunit.client.0.smithi029.stdout:3/33: unlink d0/f4 0 2024-04-26T11:46:34.197 INFO:tasks.workunit.client.0.smithi029.stdout:1/20: chown f2 1177 1 2024-04-26T11:46:34.197 INFO:tasks.workunit.client.0.smithi029.stdout:6/9: dread f2 [0,4194304] 0 2024-04-26T11:46:34.198 INFO:tasks.workunit.client.0.smithi029.stdout:1/21: chown f2 197456 1 2024-04-26T11:46:34.198 INFO:tasks.workunit.client.0.smithi029.stdout:3/34: chown d0/lb 1 1 2024-04-26T11:46:34.199 INFO:tasks.workunit.client.0.smithi029.stdout:4/22: write d3/f5 [260625,48284] 0 2024-04-26T11:46:34.200 INFO:tasks.workunit.client.0.smithi029.stdout:9/21: truncate f3 228672 0 2024-04-26T11:46:34.200 INFO:tasks.workunit.client.0.smithi029.stdout:6/10: link f2 f4 0 2024-04-26T11:46:34.202 INFO:tasks.workunit.client.0.smithi029.stdout:2/31: rename f5 to f6 0 2024-04-26T11:46:34.206 INFO:tasks.workunit.client.0.smithi029.stdout:6/11: symlink l5 0 2024-04-26T11:46:34.206 INFO:tasks.workunit.client.0.smithi029.stdout:4/23: mkdir d3/d8/db 0 2024-04-26T11:46:34.206 INFO:tasks.workunit.client.0.smithi029.stdout:3/35: write d0/d1/f8 [28620,81885] 0 2024-04-26T11:46:34.206 INFO:tasks.workunit.client.0.smithi029.stdout:7/26: dwrite f6 [0,4194304] 0 2024-04-26T11:46:34.206 INFO:tasks.workunit.client.0.smithi029.stdout:6/12: read f4 [1940872,109135] 0 2024-04-26T11:46:34.206 INFO:tasks.workunit.client.0.smithi029.stdout:7/27: rename f7 to f8 0 2024-04-26T11:46:34.207 INFO:tasks.workunit.client.0.smithi029.stdout:4/24: rename d3/l6 to d3/d8/lc 0 2024-04-26T11:46:34.207 INFO:tasks.workunit.client.0.smithi029.stdout:6/13: readlink l1 0 2024-04-26T11:46:34.208 INFO:tasks.workunit.client.0.smithi029.stdout:3/36: creat d0/dc/ff x:0 0 0 2024-04-26T11:46:34.209 INFO:tasks.workunit.client.0.smithi029.stdout:8/18: dwrite f1 [4194304,4194304] 0 2024-04-26T11:46:34.210 INFO:tasks.workunit.client.0.smithi029.stdout:8/19: mknod c3 1 2024-04-26T11:46:34.211 INFO:tasks.workunit.client.0.smithi029.stdout:4/25: creat d3/fd x:0 0 0 2024-04-26T11:46:34.212 INFO:tasks.workunit.client.0.smithi029.stdout:3/37: rename d0 to d0/dc/d10 22 2024-04-26T11:46:34.212 INFO:tasks.workunit.client.0.smithi029.stdout:8/20: chown f1 222912 1 2024-04-26T11:46:34.212 INFO:tasks.workunit.client.0.smithi029.stdout:4/26: stat d3/d8 0 2024-04-26T11:46:34.213 INFO:tasks.workunit.client.0.smithi029.stdout:6/14: write f4 [4337246,36396] 0 2024-04-26T11:46:34.215 INFO:tasks.workunit.client.0.smithi029.stdout:3/38: symlink d0/l11 0 2024-04-26T11:46:34.216 INFO:tasks.workunit.client.0.smithi029.stdout:1/22: dwrite f2 [0,4194304] 0 2024-04-26T11:46:34.218 INFO:tasks.workunit.client.0.smithi029.stdout:6/15: symlink l6 0 2024-04-26T11:46:34.219 INFO:tasks.workunit.client.0.smithi029.stdout:3/39: fdatasync d0/d1/fa 0 2024-04-26T11:46:34.220 INFO:tasks.workunit.client.0.smithi029.stdout:4/27: rename d3/fd to d3/d9/fe 0 2024-04-26T11:46:34.224 INFO:tasks.workunit.client.0.smithi029.stdout:7/28: dwrite f5 [0,4194304] 0 2024-04-26T11:46:34.226 INFO:tasks.workunit.client.0.smithi029.stdout:0/25: dwrite f3 [0,4194304] 0 2024-04-26T11:46:34.226 INFO:tasks.workunit.client.0.smithi029.stdout:9/22: dwrite f1 [0,4194304] 0 2024-04-26T11:46:34.226 INFO:tasks.workunit.client.0.smithi029.stdout:1/23: truncate f2 1691596 0 2024-04-26T11:46:34.228 INFO:tasks.workunit.client.0.smithi029.stdout:0/26: chown f7 5 1 2024-04-26T11:46:34.228 INFO:tasks.workunit.client.0.smithi029.stdout:9/23: write f1 [4288535,68788] 0 2024-04-26T11:46:34.228 INFO:tasks.workunit.client.0.smithi029.stdout:8/21: dread f1 [0,4194304] 0 2024-04-26T11:46:34.231 INFO:tasks.workunit.client.0.smithi029.stdout:7/29: rename f5 to f9 0 2024-04-26T11:46:34.231 INFO:tasks.workunit.client.0.smithi029.stdout:6/16: dread f2 [0,4194304] 0 2024-04-26T11:46:34.235 INFO:tasks.workunit.client.0.smithi029.stdout:4/28: link l0 d3/d8/lf 0 2024-04-26T11:46:34.235 INFO:tasks.workunit.client.0.smithi029.stdout:7/30: fsync f6 0 2024-04-26T11:46:34.235 INFO:tasks.workunit.client.0.smithi029.stdout:1/24: getdents d3 0 2024-04-26T11:46:34.235 INFO:tasks.workunit.client.0.smithi029.stdout:9/24: creat d4/d5/f6 x:0 0 0 2024-04-26T11:46:34.235 INFO:tasks.workunit.client.0.smithi029.stdout:6/17: mkdir d7 0 2024-04-26T11:46:34.235 INFO:tasks.workunit.client.0.smithi029.stdout:1/25: mknod d3/c4 1 2024-04-26T11:46:34.235 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:34.233+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:34.236 INFO:tasks.workunit.client.0.smithi029.stdout:0/27: dread f3 [0,4194304] 0 2024-04-26T11:46:34.236 INFO:tasks.workunit.client.0.smithi029.stdout:8/22: dread f1 [0,4194304] 0 2024-04-26T11:46:34.237 INFO:tasks.workunit.client.0.smithi029.stdout:4/29: unlink d3/d9/fe 0 2024-04-26T11:46:34.238 INFO:tasks.workunit.client.0.smithi029.stdout:1/26: dread f2 [0,4194304] 0 2024-04-26T11:46:34.238 INFO:tasks.workunit.client.0.smithi029.stdout:9/25: unlink f3 0 2024-04-26T11:46:34.238 INFO:tasks.workunit.client.0.smithi029.stdout:3/40: dread d0/d1/f8 [0,4194304] 0 2024-04-26T11:46:34.238 INFO:tasks.workunit.client.0.smithi029.stdout:6/18: write f4 [3403042,53990] 0 2024-04-26T11:46:34.239 INFO:tasks.workunit.client.0.smithi029.stdout:8/23: symlink l4 0 2024-04-26T11:46:34.239 INFO:tasks.workunit.client.0.smithi029.stdout:4/30: chown d3/f7 13201 1 2024-04-26T11:46:34.240 INFO:tasks.workunit.client.0.smithi029.stdout:8/24: creat f5 x:0 0 0 2024-04-26T11:46:34.240 INFO:tasks.workunit.client.0.smithi029.stdout:8/25: rmdir - no directory 2024-04-26T11:46:34.240 INFO:tasks.workunit.client.0.smithi029.stdout:1/27: write f2 [313083,79220] 0 2024-04-26T11:46:34.241 INFO:tasks.workunit.client.0.smithi029.stdout:9/26: mkdir d4/d5/d7 0 2024-04-26T11:46:34.241 INFO:tasks.workunit.client.0.smithi029.stdout:8/26: write f5 [167505,102528] 0 2024-04-26T11:46:34.243 INFO:tasks.workunit.client.0.smithi029.stdout:9/27: creat d4/f8 x:0 0 0 2024-04-26T11:46:34.243 INFO:tasks.workunit.client.0.smithi029.stdout:8/27: creat f6 x:0 0 0 2024-04-26T11:46:34.245 INFO:tasks.workunit.client.0.smithi029.stdout:9/28: write d4/f8 [367048,44621] 0 2024-04-26T11:46:34.251 INFO:tasks.workunit.client.0.smithi029.stdout:7/31: dwrite f9 [0,4194304] 0 2024-04-26T11:46:34.253 INFO:tasks.workunit.client.0.smithi029.stdout:0/28: dwrite f5 [0,4194304] 0 2024-04-26T11:46:34.256 INFO:tasks.workunit.client.0.smithi029.stdout:3/41: truncate d0/d1/f8 725103 0 2024-04-26T11:46:34.257 INFO:tasks.workunit.client.0.smithi029.stdout:8/28: dread f5 [0,4194304] 0 2024-04-26T11:46:34.258 INFO:tasks.workunit.client.0.smithi029.stdout:6/19: dwrite f2 [0,4194304] 0 2024-04-26T11:46:34.259 INFO:tasks.workunit.client.0.smithi029.stdout:0/29: symlink l8 0 2024-04-26T11:46:34.259 INFO:tasks.workunit.client.0.smithi029.stdout:4/31: dwrite d3/f5 [0,4194304] 0 2024-04-26T11:46:34.259 INFO:tasks.workunit.client.0.smithi029.stdout:1/28: dwrite f2 [0,4194304] 0 2024-04-26T11:46:34.260 INFO:tasks.workunit.client.0.smithi029.stdout:6/20: mknod d7/c8 1 2024-04-26T11:46:34.260 INFO:tasks.workunit.client.0.smithi029.stdout:3/42: creat d0/f12 x:0 0 0 2024-04-26T11:46:34.261 INFO:tasks.workunit.client.0.smithi029.stdout:7/32: getdents . 0 2024-04-26T11:46:34.261 INFO:tasks.workunit.client.0.smithi029.stdout:4/32: rmdir d3/d8 39 2024-04-26T11:46:34.262 INFO:tasks.workunit.client.0.smithi029.stdout:7/33: write f6 [1591796,61609] 0 2024-04-26T11:46:34.262 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:34.263 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:34.263 INFO:tasks.workunit.client.0.smithi029.stdout:3/43: write d0/dc/ff [916854,27912] 0 2024-04-26T11:46:34.263 INFO:tasks.workunit.client.0.smithi029.stdout:7/34: symlink la 0 2024-04-26T11:46:34.264 INFO:tasks.workunit.client.0.smithi029.stdout:9/29: dwrite f1 [0,4194304] 0 2024-04-26T11:46:34.266 INFO:tasks.workunit.client.0.smithi029.stdout:6/21: truncate f2 2537785 0 2024-04-26T11:46:34.266 INFO:tasks.workunit.client.0.smithi029.stdout:9/30: mknod d4/c9 1 2024-04-26T11:46:34.267 INFO:tasks.workunit.client.0.smithi029.stdout:3/44: write d0/dc/ff [505384,61783] 0 2024-04-26T11:46:34.268 INFO:tasks.workunit.client.0.smithi029.stdout:4/33: creat d3/d8/db/f10 x:0 0 0 2024-04-26T11:46:34.270 INFO:tasks.workunit.client.0.smithi029.stdout:9/31: write d4/d5/f6 [1028289,102607] 0 2024-04-26T11:46:34.271 INFO:tasks.workunit.client.0.smithi029.stdout:0/30: dread f7 [0,4194304] 0 2024-04-26T11:46:34.271 INFO:tasks.workunit.client.0.smithi029.stdout:3/45: write d0/dc/ff [1471597,98033] 0 2024-04-26T11:46:34.272 INFO:tasks.workunit.client.0.smithi029.stdout:4/34: dread - d3/d8/db/f10 zero size 2024-04-26T11:46:34.273 INFO:tasks.workunit.client.0.smithi029.stdout:1/29: dwrite f2 [4194304,4194304] 0 2024-04-26T11:46:34.273 INFO:tasks.workunit.client.0.smithi029.stdout:9/32: write f1 [870284,8460] 0 2024-04-26T11:46:34.274 INFO:tasks.workunit.client.0.smithi029.stdout:0/31: chown f5 2 1 2024-04-26T11:46:34.275 INFO:tasks.workunit.client.0.smithi029.stdout:3/46: mkdir d0/d1/d13 0 2024-04-26T11:46:34.275 INFO:tasks.workunit.client.0.smithi029.stdout:8/29: dwrite f0 [4194304,4194304] 0 2024-04-26T11:46:34.276 INFO:tasks.workunit.client.0.smithi029.stdout:0/32: mkdir d9 0 2024-04-26T11:46:34.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:34.278 INFO:tasks.workunit.client.0.smithi029.stdout:3/47: rename d0/f12 to d0/d1/d13/f14 0 2024-04-26T11:46:34.280 INFO:tasks.workunit.client.0.smithi029.stdout:0/33: write f3 [3656450,116032] 0 2024-04-26T11:46:34.281 INFO:tasks.workunit.client.0.smithi029.stdout:7/35: dwrite f6 [0,4194304] 0 2024-04-26T11:46:34.281 INFO:tasks.workunit.client.0.smithi029.stdout:6/22: fdatasync f2 0 2024-04-26T11:46:34.283 INFO:tasks.workunit.client.0.smithi029.stdout:3/48: unlink d0/d1/fa 0 2024-04-26T11:46:34.283 INFO:tasks.workunit.client.0.smithi029.stdout:7/36: symlink lb 0 2024-04-26T11:46:34.284 INFO:tasks.workunit.client.0.smithi029.stdout:0/34: creat d9/fa x:0 0 0 2024-04-26T11:46:34.285 INFO:tasks.workunit.client.0.smithi029.stdout:3/49: creat d0/f15 x:0 0 0 2024-04-26T11:46:34.285 INFO:tasks.workunit.client.0.smithi029.stdout:6/23: write f2 [539757,100078] 0 2024-04-26T11:46:34.287 INFO:tasks.workunit.client.0.smithi029.stdout:7/37: write f8 [409185,58583] 0 2024-04-26T11:46:34.290 INFO:tasks.workunit.client.0.smithi029.stdout:4/35: dwrite d3/d8/fa [0,4194304] 0 2024-04-26T11:46:34.290 INFO:tasks.workunit.client.0.smithi029.stdout:7/38: creat fc x:0 0 0 2024-04-26T11:46:34.291 INFO:tasks.workunit.client.0.smithi029.stdout:9/33: dwrite f1 [0,4194304] 0 2024-04-26T11:46:34.291 INFO:tasks.workunit.client.0.smithi029.stdout:8/30: dread f1 [0,4194304] 0 2024-04-26T11:46:34.291 INFO:tasks.workunit.client.0.smithi029.stdout:1/30: dwrite f2 [0,4194304] 0 2024-04-26T11:46:34.293 INFO:tasks.workunit.client.0.smithi029.stdout:4/36: write d3/f5 [4672681,3773] 0 2024-04-26T11:46:34.294 INFO:tasks.workunit.client.0.smithi029.stdout:8/31: chown f2 20280 1 2024-04-26T11:46:34.294 INFO:tasks.workunit.client.0.smithi029.stdout:9/34: write d4/f8 [1014640,89625] 0 2024-04-26T11:46:34.296 INFO:tasks.workunit.client.0.smithi029.stdout:4/37: mkdir d3/d8/d11 0 2024-04-26T11:46:34.297 INFO:tasks.workunit.client.0.smithi029.stdout:8/32: rename l4 to l7 0 2024-04-26T11:46:34.298 INFO:tasks.workunit.client.0.smithi029.stdout:0/35: dwrite f0 [0,4194304] 0 2024-04-26T11:46:34.299 INFO:tasks.workunit.client.0.smithi029.stdout:0/36: symlink d9/lb 0 2024-04-26T11:46:34.299 INFO:tasks.workunit.client.0.smithi029.stdout:7/39: dread f6 [0,4194304] 0 2024-04-26T11:46:34.300 INFO:tasks.workunit.client.0.smithi029.stdout:0/37: creat d9/fc x:0 0 0 2024-04-26T11:46:34.300 INFO:tasks.workunit.client.0.smithi029.stdout:7/40: creat fd x:0 0 0 2024-04-26T11:46:34.300 INFO:tasks.workunit.client.0.smithi029.stdout:7/41: write fc [385831,57682] 0 2024-04-26T11:46:34.301 INFO:tasks.workunit.client.0.smithi029.stdout:7/42: mknod ce 1 2024-04-26T11:46:34.302 INFO:tasks.workunit.client.0.smithi029.stdout:0/38: link l8 d9/ld 0 2024-04-26T11:46:34.303 INFO:tasks.workunit.client.0.smithi029.stdout:7/43: symlink lf 0 2024-04-26T11:46:34.306 INFO:tasks.workunit.client.0.smithi029.stdout:4/38: getdents d3/d8 0 2024-04-26T11:46:34.306 INFO:tasks.workunit.client.0.smithi029.stdout:0/39: rename f7 to d9/fe 0 2024-04-26T11:46:34.308 INFO:tasks.workunit.client.0.smithi029.stdout:0/40: rename f0 to d9/ff 0 2024-04-26T11:46:34.309 INFO:tasks.workunit.client.0.smithi029.stdout:1/31: dwrite f2 [8388608,4194304] 0 2024-04-26T11:46:34.311 INFO:tasks.workunit.client.0.smithi029.stdout:9/35: dwrite d4/f8 [0,4194304] 0 2024-04-26T11:46:34.312 INFO:tasks.workunit.client.0.smithi029.stdout:1/32: rmdir d3 0 2024-04-26T11:46:34.312 INFO:tasks.workunit.client.0.smithi029.stdout:8/33: dwrite f2 [0,4194304] 0 2024-04-26T11:46:34.313 INFO:tasks.workunit.client.0.smithi029.stdout:8/34: mknod c8 1 2024-04-26T11:46:34.314 INFO:tasks.workunit.client.0.smithi029.stdout:1/33: write f2 [7069585,2068] 0 2024-04-26T11:46:34.314 INFO:tasks.workunit.client.0.smithi029.stdout:7/44: getdents . 0 2024-04-26T11:46:34.315 INFO:tasks.workunit.client.0.smithi029.stdout:1/34: write f2 [12215558,32455] 0 2024-04-26T11:46:34.316 INFO:tasks.workunit.client.0.smithi029.stdout:1/35: symlink l5 0 2024-04-26T11:46:34.318 INFO:tasks.workunit.client.0.smithi029.stdout:4/39: dwrite d3/f5 [0,4194304] 0 2024-04-26T11:46:34.319 INFO:tasks.workunit.client.0.smithi029.stdout:0/41: truncate f3 539295 0 2024-04-26T11:46:34.321 INFO:tasks.workunit.client.0.smithi029.stdout:8/35: dwrite f6 [0,4194304] 0 2024-04-26T11:46:34.322 INFO:tasks.workunit.client.0.smithi029.stdout:8/36: creat f9 x:0 0 0 2024-04-26T11:46:34.323 INFO:tasks.workunit.client.0.smithi029.stdout:8/37: stat f9 0 2024-04-26T11:46:34.324 INFO:tasks.workunit.client.0.smithi029.stdout:8/38: rename l7 to la 0 2024-04-26T11:46:34.324 INFO:tasks.workunit.client.0.smithi029.stdout:8/39: unlink f6 0 2024-04-26T11:46:34.324 INFO:tasks.workunit.client.0.smithi029.stdout:8/40: symlink lb 0 2024-04-26T11:46:34.325 INFO:tasks.workunit.client.0.smithi029.stdout:8/41: mkdir dc 0 2024-04-26T11:46:34.326 INFO:tasks.workunit.client.0.smithi029.stdout:8/42: write f9 [476087,86903] 0 2024-04-26T11:46:34.328 INFO:tasks.workunit.client.0.smithi029.stdout:9/36: truncate d4/f8 2106518 0 2024-04-26T11:46:34.328 INFO:tasks.workunit.client.0.smithi029.stdout:8/43: symlink dc/ld 0 2024-04-26T11:46:34.328 INFO:tasks.workunit.client.0.smithi029.stdout:9/37: creat d4/d5/fa x:0 0 0 2024-04-26T11:46:34.329 INFO:tasks.workunit.client.0.smithi029.stdout:8/44: write f2 [3345357,101185] 0 2024-04-26T11:46:34.333 INFO:tasks.workunit.client.0.smithi029.stdout:9/38: dread f1 [0,4194304] 0 2024-04-26T11:46:34.335 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:34.333+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:34.335 INFO:tasks.workunit.client.0.smithi029.stdout:9/39: rename d4/f8 to d4/d5/fb 0 2024-04-26T11:46:34.338 INFO:tasks.workunit.client.0.smithi029.stdout:8/45: dwrite f5 [0,4194304] 0 2024-04-26T11:46:34.339 INFO:tasks.workunit.client.0.smithi029.stdout:8/46: write f5 [2803594,116571] 0 2024-04-26T11:46:34.347 INFO:tasks.workunit.client.0.smithi029.stdout:9/40: dwrite d4/d5/fa [0,4194304] 0 2024-04-26T11:46:34.348 INFO:tasks.workunit.client.0.smithi029.stdout:9/41: rename f1 to d4/d5/d7/fc 0 2024-04-26T11:46:34.350 INFO:tasks.workunit.client.0.smithi029.stdout:9/42: chown d4/d5/fb 0 1 2024-04-26T11:46:34.352 INFO:tasks.workunit.client.0.smithi029.stdout:8/47: dwrite f2 [0,4194304] 0 2024-04-26T11:46:34.353 INFO:tasks.workunit.client.0.smithi029.stdout:8/48: chown f9 3370 1 2024-04-26T11:46:34.363 INFO:tasks.workunit.client.0.smithi029.stdout:9/43: dwrite d4/d5/d7/fc [0,4194304] 0 2024-04-26T11:46:34.364 INFO:tasks.workunit.client.0.smithi029.stdout:9/44: read d4/d5/f6 [899421,285] 0 2024-04-26T11:46:34.364 INFO:tasks.workunit.client.0.smithi029.stdout:9/45: readlink - no filename 2024-04-26T11:46:34.365 INFO:tasks.workunit.client.0.smithi029.stdout:8/49: truncate f5 3228471 0 2024-04-26T11:46:34.366 INFO:tasks.workunit.client.0.smithi029.stdout:9/46: rename d4/d5/fa to d4/d5/fd 0 2024-04-26T11:46:34.367 INFO:tasks.workunit.client.0.smithi029.stdout:9/47: mknod d4/d5/ce 1 2024-04-26T11:46:34.368 INFO:tasks.workunit.client.0.smithi029.stdout:8/50: mkdir dc/de 0 2024-04-26T11:46:34.368 INFO:tasks.workunit.client.0.smithi029.stdout:8/51: mknod dc/de/cf 1 2024-04-26T11:46:34.368 INFO:tasks.workunit.client.0.smithi029.stdout:9/48: chown d4/d5/f6 28098959 1 2024-04-26T11:46:34.368 INFO:tasks.workunit.client.0.smithi029.stdout:8/52: write f9 [643995,113026] 0 2024-04-26T11:46:34.370 INFO:tasks.workunit.client.0.smithi029.stdout:9/49: getdents d4/d5/d7 0 2024-04-26T11:46:34.371 INFO:tasks.workunit.client.0.smithi029.stdout:9/50: chown d4/d5/fb 111 1 2024-04-26T11:46:34.372 INFO:tasks.workunit.client.0.smithi029.stdout:9/51: creat d4/d5/d7/ff x:0 0 0 2024-04-26T11:46:34.372 INFO:tasks.workunit.client.0.smithi029.stdout:7/45: dread fc [0,4194304] 0 2024-04-26T11:46:34.380 INFO:tasks.workunit.client.0.smithi029.stdout:7/46: dread f9 [0,4194304] 0 2024-04-26T11:46:34.381 INFO:tasks.workunit.client.0.smithi029.stdout:8/53: dwrite f1 [0,4194304] 0 2024-04-26T11:46:34.386 INFO:tasks.workunit.client.0.smithi029.stdout:8/54: getdents dc 0 2024-04-26T11:46:34.386 INFO:tasks.workunit.client.0.smithi029.stdout:9/52: dwrite d4/d5/d7/ff [0,4194304] 0 2024-04-26T11:46:34.387 INFO:tasks.workunit.client.0.smithi029.stdout:8/55: rename lb to dc/de/l10 0 2024-04-26T11:46:34.389 INFO:tasks.workunit.client.0.smithi029.stdout:8/56: write f1 [1651218,96953] 0 2024-04-26T11:46:34.391 INFO:tasks.workunit.client.0.smithi029.stdout:8/57: rename f9 to dc/f11 0 2024-04-26T11:46:34.392 INFO:tasks.workunit.client.0.smithi029.stdout:7/47: dwrite f6 [0,4194304] 0 2024-04-26T11:46:34.392 INFO:tasks.workunit.client.0.smithi029.stdout:8/58: mkdir dc/d12 0 2024-04-26T11:46:34.393 INFO:tasks.workunit.client.0.smithi029.stdout:7/48: creat f10 x:0 0 0 2024-04-26T11:46:34.393 INFO:tasks.workunit.client.0.smithi029.stdout:8/59: rename f2 to dc/f13 0 2024-04-26T11:46:34.394 INFO:tasks.workunit.client.0.smithi029.stdout:7/49: mkdir d11 0 2024-04-26T11:46:34.395 INFO:tasks.workunit.client.0.smithi029.stdout:9/53: dread d4/d5/d7/ff [0,4194304] 0 2024-04-26T11:46:34.395 INFO:tasks.workunit.client.0.smithi029.stdout:7/50: rename lb to d11/l12 0 2024-04-26T11:46:34.396 INFO:tasks.workunit.client.0.smithi029.stdout:9/54: read d4/d5/d7/fc [2649829,79713] 0 2024-04-26T11:46:34.396 INFO:tasks.workunit.client.0.smithi029.stdout:7/51: write f8 [248131,83073] 0 2024-04-26T11:46:34.397 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:34.397 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:34.399 INFO:tasks.workunit.client.0.smithi029.stdout:8/60: dread f0 [0,4194304] 0 2024-04-26T11:46:34.400 INFO:tasks.workunit.client.0.smithi029.stdout:8/61: rename dc/ld to dc/d12/l14 0 2024-04-26T11:46:34.400 INFO:tasks.workunit.client.0.smithi029.stdout:8/62: chown f0 45 1 2024-04-26T11:46:34.401 INFO:tasks.workunit.client.0.smithi029.stdout:9/55: dread d4/d5/d7/fc [0,4194304] 0 2024-04-26T11:46:34.402 INFO:tasks.workunit.client.0.smithi029.stdout:9/56: fsync d4/d5/d7/fc 0 2024-04-26T11:46:34.403 INFO:tasks.workunit.client.0.smithi029.stdout:9/57: fdatasync d4/d5/fd 0 2024-04-26T11:46:34.404 INFO:tasks.workunit.client.0.smithi029.stdout:9/58: symlink d4/l10 0 2024-04-26T11:46:34.405 INFO:tasks.workunit.client.0.smithi029.stdout:8/63: dread f0 [4194304,4194304] 0 2024-04-26T11:46:34.405 INFO:tasks.workunit.client.0.smithi029.stdout:7/52: truncate f6 3343059 0 2024-04-26T11:46:34.406 INFO:tasks.workunit.client.0.smithi029.stdout:7/53: unlink d11/l12 0 2024-04-26T11:46:34.407 INFO:tasks.workunit.client.0.smithi029.stdout:7/54: creat d11/f13 x:0 0 0 2024-04-26T11:46:34.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:34.409 INFO:tasks.workunit.client.0.smithi029.stdout:7/55: rename l1 to d11/l14 0 2024-04-26T11:46:34.409 INFO:tasks.workunit.client.0.smithi029.stdout:7/56: mkdir d11/d15 0 2024-04-26T11:46:34.409 INFO:tasks.workunit.client.0.smithi029.stdout:9/59: dread d4/d5/fd [0,4194304] 0 2024-04-26T11:46:34.410 INFO:tasks.workunit.client.0.smithi029.stdout:9/60: truncate d4/d5/fb 2134633 0 2024-04-26T11:46:34.415 INFO:tasks.workunit.client.0.smithi029.stdout:9/61: link d4/d5/d7/ff d4/d5/d7/f11 0 2024-04-26T11:46:34.415 INFO:tasks.workunit.client.0.smithi029.stdout:9/62: symlink d4/l12 0 2024-04-26T11:46:34.415 INFO:tasks.workunit.client.0.smithi029.stdout:7/57: write f6 [3350419,3317] 0 2024-04-26T11:46:34.415 INFO:tasks.workunit.client.0.smithi029.stdout:7/58: read f9 [2514150,73441] 0 2024-04-26T11:46:34.418 INFO:tasks.workunit.client.0.smithi029.stdout:9/63: dread d4/d5/d7/f11 [0,4194304] 0 2024-04-26T11:46:34.418 INFO:tasks.workunit.client.0.smithi029.stdout:9/64: readlink d4/l12 0 2024-04-26T11:46:34.420 INFO:tasks.workunit.client.0.smithi029.stdout:9/65: link d4/l12 d4/d5/d7/l13 0 2024-04-26T11:46:34.423 INFO:tasks.workunit.client.0.smithi029.stdout:9/66: truncate d4/d5/d7/fc 3697478 0 2024-04-26T11:46:34.432 INFO:tasks.workunit.client.0.smithi029.stdout:9/67: dwrite d4/d5/fd [0,4194304] 0 2024-04-26T11:46:34.433 INFO:tasks.workunit.client.0.smithi029.stdout:9/68: write d4/d5/fd [2811893,127363] 0 2024-04-26T11:46:34.436 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:34.432+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:34.436 INFO:tasks.workunit.client.0.smithi029.stdout:9/69: unlink d4/d5/d7/l13 0 2024-04-26T11:46:34.448 INFO:tasks.workunit.client.0.smithi029.stdout:9/70: dwrite d4/d5/fd [0,4194304] 0 2024-04-26T11:46:34.450 INFO:tasks.workunit.client.0.smithi029.stdout:9/71: chown d4/d5/d7/f11 391774866 1 2024-04-26T11:46:34.451 INFO:tasks.workunit.client.0.smithi029.stdout:9/72: creat d4/f14 x:0 0 0 2024-04-26T11:46:34.469 INFO:tasks.workunit.client.0.smithi029.stdout:9/73: fsync d4/d5/fd 0 2024-04-26T11:46:34.470 INFO:tasks.workunit.client.0.smithi029.stdout:9/74: read d4/d5/d7/f11 [1721874,92616] 0 2024-04-26T11:46:34.476 INFO:tasks.workunit.client.0.smithi029.stdout:9/75: link d4/d5/d7/fc d4/d5/f15 0 2024-04-26T11:46:34.477 INFO:tasks.workunit.client.0.smithi029.stdout:9/76: stat d4/l12 0 2024-04-26T11:46:34.479 INFO:tasks.workunit.client.0.smithi029.stdout:9/77: mkdir d4/d5/d16 0 2024-04-26T11:46:34.492 INFO:tasks.workunit.client.0.smithi029.stdout:9/78: dwrite d4/d5/fd [0,4194304] 0 2024-04-26T11:46:34.516 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:34.516 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:34.517 INFO:tasks.workunit.client.0.smithi029.stdout:9/79: fdatasync d4/d5/fd 0 2024-04-26T11:46:34.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/80: symlink d4/d5/d7/l17 0 2024-04-26T11:46:34.526 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:34.532 INFO:tasks.workunit.client.0.smithi029.stdout:9/81: dwrite d4/d5/d7/ff [0,4194304] 0 2024-04-26T11:46:34.533 INFO:tasks.workunit.client.0.smithi029.stdout:9/82: mknod d4/d5/d16/c18 1 2024-04-26T11:46:34.537 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:34.532+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:34.541 INFO:tasks.workunit.client.0.smithi029.stdout:9/83: dread d4/d5/d7/fc [0,4194304] 0 2024-04-26T11:46:34.543 INFO:tasks.workunit.client.0.smithi029.stdout:9/84: creat d4/d5/d16/f19 x:0 0 0 2024-04-26T11:46:34.550 INFO:tasks.workunit.client.0.smithi029.stdout:9/85: dread d4/d5/d7/f11 [0,4194304] 0 2024-04-26T11:46:34.552 INFO:tasks.workunit.client.0.smithi029.stdout:9/86: write d4/d5/d16/f19 [120618,6405] 0 2024-04-26T11:46:34.553 INFO:tasks.workunit.client.0.smithi029.stdout:9/87: dread - d4/f14 zero size 2024-04-26T11:46:34.560 INFO:tasks.workunit.client.0.smithi029.stdout:9/88: dread d4/d5/f15 [0,4194304] 0 2024-04-26T11:46:34.562 INFO:tasks.workunit.client.0.smithi029.stdout:9/89: creat d4/d5/f1a x:0 0 0 2024-04-26T11:46:34.562 INFO:tasks.workunit.client.0.smithi029.stdout:9/90: readlink d4/l12 0 2024-04-26T11:46:34.567 INFO:tasks.workunit.client.0.smithi029.stdout:9/91: write d4/d5/f15 [2751813,49317] 0 2024-04-26T11:46:34.575 INFO:tasks.workunit.client.0.smithi029.stdout:9/92: dread d4/d5/d7/f11 [0,4194304] 0 2024-04-26T11:46:34.578 INFO:tasks.workunit.client.0.smithi029.stdout:9/93: link d4/d5/d7/l17 d4/d5/d16/l1b 0 2024-04-26T11:46:34.579 INFO:tasks.workunit.client.0.smithi029.stdout:9/94: creat d4/d5/d16/f1c x:0 0 0 2024-04-26T11:46:34.580 INFO:tasks.workunit.client.0.smithi029.stdout:9/95: creat d4/f1d x:0 0 0 2024-04-26T11:46:34.582 INFO:tasks.workunit.client.0.smithi029.stdout:9/96: mkdir d4/d5/d1e 0 2024-04-26T11:46:34.583 INFO:tasks.workunit.client.0.smithi029.stdout:9/97: rmdir d4/d5/d1e 0 2024-04-26T11:46:34.584 INFO:tasks.workunit.client.0.smithi029.stdout:9/98: mknod d4/c1f 1 2024-04-26T11:46:34.590 INFO:tasks.workunit.client.0.smithi029.stdout:9/99: truncate d4/d5/d7/fc 2405949 0 2024-04-26T11:46:34.596 INFO:tasks.workunit.client.0.smithi029.stdout:9/100: fsync d4/d5/f15 0 2024-04-26T11:46:34.597 INFO:tasks.workunit.client.0.smithi029.stdout:9/101: chown d4/d5/d16/l1b 33761 1 2024-04-26T11:46:34.598 INFO:tasks.workunit.client.0.smithi029.stdout:9/102: readlink d4/d5/d16/l1b 0 2024-04-26T11:46:34.600 INFO:tasks.workunit.client.0.smithi029.stdout:9/103: getdents d4/d5/d16 0 2024-04-26T11:46:34.601 INFO:tasks.workunit.client.0.smithi029.stdout:9/104: readlink d4/l12 0 2024-04-26T11:46:34.602 INFO:tasks.workunit.client.0.smithi029.stdout:9/105: fdatasync d4/d5/d7/f11 0 2024-04-26T11:46:34.604 INFO:tasks.workunit.client.0.smithi029.stdout:9/106: getdents d4 0 2024-04-26T11:46:34.605 INFO:tasks.workunit.client.0.smithi029.stdout:9/107: truncate d4/f1d 328311 0 2024-04-26T11:46:34.610 INFO:tasks.workunit.client.0.smithi029.stdout:9/108: dread d4/d5/fb [0,4194304] 0 2024-04-26T11:46:34.613 INFO:tasks.workunit.client.0.smithi029.stdout:9/109: unlink d4/d5/f15 0 2024-04-26T11:46:34.614 INFO:tasks.workunit.client.0.smithi029.stdout:9/110: truncate d4/d5/f1a 251944 0 2024-04-26T11:46:34.626 INFO:tasks.workunit.client.0.smithi029.stdout:9/111: dwrite d4/f1d [0,4194304] 0 2024-04-26T11:46:34.633 INFO:tasks.workunit.client.0.smithi029.stdout:9/112: dread d4/d5/f1a [0,4194304] 0 2024-04-26T11:46:34.634 INFO:tasks.workunit.client.0.smithi029.stdout:9/113: creat d4/d5/f20 x:0 0 0 2024-04-26T11:46:34.638 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:34.632+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:34.642 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:34.642 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:34.653 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:34.739 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:34.737+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:34.753 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:34.753 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:34.763 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:34.839 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:34.836+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:34.869 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:34.869 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:34.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2024-04-26T11:46:34.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:34.905 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:34.940 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:34.937+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:34.998 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:34.999 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:35.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:35.041 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:35.036+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:35.061 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:35.085 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:35.085 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:35.085 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:35.085 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:35.089 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:35.090 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:35.120 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:35.120 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:35.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:35.136 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:46:35.143 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:35.141+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:35.151 INFO:tasks.workunit.client.0.smithi029.stdout:5/0: sync 2024-04-26T11:46:35.151 INFO:tasks.workunit.client.0.smithi029.stdout:5/1: dwrite - no filename 2024-04-26T11:46:35.152 INFO:tasks.workunit.client.0.smithi029.stdout:5/2: creat f0 x:0 0 0 2024-04-26T11:46:35.153 INFO:tasks.workunit.client.0.smithi029.stdout:5/3: dread - f0 zero size 2024-04-26T11:46:35.154 INFO:tasks.workunit.client.0.smithi029.stdout:5/4: dread - f0 zero size 2024-04-26T11:46:35.155 INFO:tasks.workunit.client.0.smithi029.stdout:5/5: write f0 [791911,74497] 0 2024-04-26T11:46:35.155 INFO:tasks.workunit.client.0.smithi029.stdout:5/6: rmdir - no directory 2024-04-26T11:46:35.155 INFO:tasks.workunit.client.0.smithi029.stdout:5/7: mknod c1 1 2024-04-26T11:46:35.156 INFO:tasks.workunit.client.0.smithi029.stdout:5/8: symlink l2 0 2024-04-26T11:46:35.156 INFO:tasks.workunit.client.0.smithi029.stdout:5/9: creat f3 x:0 0 0 2024-04-26T11:46:35.169 INFO:tasks.workunit.client.0.smithi029.stdout:5/10: dwrite f0 [0,4194304] 0 2024-04-26T11:46:35.170 INFO:tasks.workunit.client.0.smithi029.stdout:5/11: creat f4 x:0 0 0 2024-04-26T11:46:35.176 INFO:tasks.workunit.client.0.smithi029.stdout:5/12: dread f0 [0,4194304] 0 2024-04-26T11:46:35.176 INFO:tasks.workunit.client.0.smithi029.stdout:5/13: stat f3 0 2024-04-26T11:46:35.176 INFO:tasks.workunit.client.0.smithi029.stdout:5/14: chown f0 112911 1 2024-04-26T11:46:35.177 INFO:tasks.workunit.client.0.smithi029.stdout:5/15: creat f5 x:0 0 0 2024-04-26T11:46:35.189 INFO:tasks.workunit.client.0.smithi029.stdout:5/16: dwrite f0 [0,4194304] 0 2024-04-26T11:46:35.189 INFO:tasks.workunit.client.0.smithi029.stdout:5/17: rename l2 to l6 0 2024-04-26T11:46:35.198 INFO:tasks.workunit.client.0.smithi029.stdout:5/18: dread f0 [0,4194304] 0 2024-04-26T11:46:35.199 INFO:tasks.workunit.client.0.smithi029.stdout:5/19: write f3 [200399,23369] 0 2024-04-26T11:46:35.206 INFO:tasks.workunit.client.0.smithi029.stdout:5/20: dwrite f0 [0,4194304] 0 2024-04-26T11:46:35.207 INFO:tasks.workunit.client.0.smithi029.stdout:5/21: creat f7 x:0 0 0 2024-04-26T11:46:35.215 INFO:tasks.workunit.client.0.smithi029.stdout:5/22: dwrite f0 [0,4194304] 0 2024-04-26T11:46:35.226 INFO:tasks.workunit.client.0.smithi029.stdout:5/23: dwrite f5 [0,4194304] 0 2024-04-26T11:46:35.226 INFO:tasks.workunit.client.0.smithi029.stdout:5/24: creat f8 x:0 0 0 2024-04-26T11:46:35.226 INFO:tasks.workunit.client.0.smithi029.stdout:5/25: write f8 [247313,96968] 0 2024-04-26T11:46:35.228 INFO:tasks.workunit.client.0.smithi029.stdout:5/26: write f7 [274423,48367] 0 2024-04-26T11:46:35.228 INFO:tasks.workunit.client.0.smithi029.stdout:5/27: dread - f4 zero size 2024-04-26T11:46:35.228 INFO:tasks.workunit.client.0.smithi029.stdout:5/28: mknod c9 1 2024-04-26T11:46:35.241 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:35.241 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:35.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:35.241 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:35.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.241 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:35.241 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:35.241 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.084337719000001, 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:35.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:35.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:35.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:35.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:35.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:35.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:35.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:35.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:35.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:35.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:35.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:35.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:35.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.248 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.248 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.248 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:35.248 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.084310991000001, 2024-04-26T11:46:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:35.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:35.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.084280039999999, 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:35.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:35.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:320 3.2 3:4272d415:::200.0000000b:head [write 1502640~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156209+0000", 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0823815250000002, 2024-04-26T11:46:35.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039115105999999997, 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156209+0000", 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156209+0000", 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156208+0000", 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156214+0000", 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4360000000000001e-06 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156228+0000", 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4673e-05 2024-04-26T11:46:35.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156235+0000", 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0570000000000004e-06 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.190353+0000", 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034117786999999997 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.190596+0000", 2024-04-26T11:46:35.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024246200000000001 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195199+0000", 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046036560000000002 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195242+0000", 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2942999999999999e-05 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195324+0000", 2024-04-26T11:46:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1724999999999994e-05 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:321 3.2 3:4272d415:::200.0000000b:head [write 1504895~2256 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156242+0000", 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.082348772, 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040671862000000003, 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156242+0000", 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156242+0000", 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156241+0000", 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156252+0000", 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0664e-05 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156260+0000", 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156267+0000", 2024-04-26T11:46:35.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6460000000000004e-06 2024-04-26T11:46:35.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.192468+0000", 2024-04-26T11:46:35.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.036201184999999997 2024-04-26T11:46:35.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.192601+0000", 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000132812 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196785+0000", 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041841500000000002 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196856+0000", 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0995999999999996e-05 2024-04-26T11:46:35.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196913+0000", 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7797000000000002e-05 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.082318023, 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:35.271 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:35.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:35.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:35.276 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0822924029999998, 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:35.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:35.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:35.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:35.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:35.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:35.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0822322089999998, 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.282 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:35.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0822054319999999, 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:35.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:35.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:35.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:35.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:35.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.082149384, 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.293 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:35.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:35.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:35.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:35.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.298 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.298 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.298 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:35.299 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0821094179999999, 2024-04-26T11:46:35.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:35.299 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.299 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.299 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:35.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:35.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:35.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:35.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.305 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.305 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.305 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.305 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:35.305 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0820788079999999, 2024-04-26T11:46:35.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:35.305 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:35.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:35.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:35.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:35.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.310 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.310 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.310 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:35.310 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0820042999999999, 2024-04-26T11:46:35.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:35.311 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.311 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.311 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:35.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:35.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:35.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0819362350000001, 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.316 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:35.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:35.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:35.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:35.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:35.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:35.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:35.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:35.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:35.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:35.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:35.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:35.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.321 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.322 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.322 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0818360880000002, 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:35.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:35.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:35.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:35.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:35.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.327 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:332 3.2 3:4272d415:::200.0000000b:head [write 1522559~21066 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0723507950000002, 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042100678000000002, 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166237+0000", 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999971 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166309+0000", 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1858000000000002e-05 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166405+0000", 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6333000000000001e-05 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166451+0000", 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6529999999999997e-05 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204736+0000", 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.038284158999999998 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204876+0000", 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014074700000000001 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208177+0000", 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003301179 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208220+0000", 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2098000000000002e-05 2024-04-26T11:46:35.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208340+0000", 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120685 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:337 3.2 3:4272d415:::200.0000000b:head [write 1555976~2447 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0620119250000002, 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041570257999999999, 2024-04-26T11:46:35.332 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176582+0000", 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8480000000000003e-06 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176587+0000", 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9570000000000001e-06 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176591+0000", 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2100000000000003e-06 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.209125+0000", 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032533714999999998 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.209208+0000", 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3633000000000004e-05 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.217980+0000", 2024-04-26T11:46:35.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0087716340000000004 2024-04-26T11:46:35.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.218039+0000", 2024-04-26T11:46:35.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9021000000000003e-05 2024-04-26T11:46:35.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.218149+0000", 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000109595 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.061986986, 2024-04-26T11:46:35.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:35.338 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.338 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.338 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:35.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:35.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:35.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:35.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.061928687, 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.347 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0598914279999998, 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:35.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:35.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:35.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:35.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.352 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.352 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.352 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:35.354 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:35.354 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:35.348+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:35.454 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:35.448+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:35.468 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:35.468 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:35.468 INFO:tasks.workunit.client.0.smithi029.stdout:2/32: sync 2024-04-26T11:46:35.469 INFO:tasks.workunit.client.0.smithi029.stdout:2/33: creat f7 x:0 0 0 2024-04-26T11:46:35.469 INFO:tasks.workunit.client.0.smithi029.stdout:2/34: stat f6 0 2024-04-26T11:46:35.469 INFO:tasks.workunit.client.0.smithi029.stdout:2/35: readlink l2 0 2024-04-26T11:46:35.469 INFO:tasks.workunit.client.0.smithi029.stdout:2/36: dread - f7 zero size 2024-04-26T11:46:35.470 INFO:tasks.workunit.client.0.smithi029.stdout:2/37: creat f8 x:0 0 0 2024-04-26T11:46:35.471 INFO:tasks.workunit.client.0.smithi029.stdout:2/38: unlink f8 0 2024-04-26T11:46:35.471 INFO:tasks.workunit.client.0.smithi029.stdout:2/39: rmdir - no directory 2024-04-26T11:46:35.472 INFO:tasks.workunit.client.0.smithi029.stdout:2/40: write f6 [2551686,109103] 0 2024-04-26T11:46:35.478 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:35.478 INFO:tasks.workunit.client.0.smithi029.stdout:2/41: read f6 [1854626,99102] 0 2024-04-26T11:46:35.480 INFO:tasks.workunit.client.0.smithi029.stdout:2/42: write f7 [90424,101718] 0 2024-04-26T11:46:35.480 INFO:tasks.workunit.client.0.smithi029.stdout:2/43: mknod c9 1 2024-04-26T11:46:35.480 INFO:tasks.workunit.client.0.smithi029.stdout:2/44: mknod ca 1 2024-04-26T11:46:35.481 INFO:tasks.workunit.client.0.smithi029.stdout:2/45: write f6 [1373471,11650] 0 2024-04-26T11:46:35.482 INFO:tasks.workunit.client.0.smithi029.stdout:2/46: write f7 [838309,9141] 0 2024-04-26T11:46:35.497 INFO:tasks.workunit.client.0.smithi029.stdout:2/47: dread f6 [0,4194304] 0 2024-04-26T11:46:35.497 INFO:tasks.workunit.client.0.smithi029.stdout:2/48: readlink l2 0 2024-04-26T11:46:35.501 INFO:tasks.workunit.client.0.smithi029.stdout:2/49: dread f6 [0,4194304] 0 2024-04-26T11:46:35.508 INFO:tasks.workunit.client.0.smithi029.stdout:2/50: truncate f7 250084 0 2024-04-26T11:46:35.509 INFO:tasks.workunit.client.0.smithi029.stdout:2/51: symlink lb 0 2024-04-26T11:46:35.510 INFO:tasks.workunit.client.0.smithi029.stdout:2/52: creat fc x:0 0 0 2024-04-26T11:46:35.523 INFO:tasks.workunit.client.0.smithi029.stdout:2/53: dwrite f6 [0,4194304] 0 2024-04-26T11:46:35.524 INFO:tasks.workunit.client.0.smithi029.stdout:2/54: creat fd x:0 0 0 2024-04-26T11:46:35.531 INFO:tasks.workunit.client.0.smithi029.stdout:4/40: sync 2024-04-26T11:46:35.531 INFO:tasks.workunit.client.0.smithi029.stdout:1/36: sync 2024-04-26T11:46:35.531 INFO:tasks.workunit.client.0.smithi029.stdout:6/24: sync 2024-04-26T11:46:35.531 INFO:tasks.workunit.client.0.smithi029.stdout:9/114: sync 2024-04-26T11:46:35.531 INFO:tasks.workunit.client.0.smithi029.stdout:8/64: sync 2024-04-26T11:46:35.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/50: sync 2024-04-26T11:46:35.531 INFO:tasks.workunit.client.0.smithi029.stdout:0/42: sync 2024-04-26T11:46:35.532 INFO:tasks.workunit.client.0.smithi029.stdout:7/59: sync 2024-04-26T11:46:35.532 INFO:tasks.workunit.client.0.smithi029.stdout:5/29: sync 2024-04-26T11:46:35.532 INFO:tasks.workunit.client.0.smithi029.stdout:1/37: fsync f2 0 2024-04-26T11:46:35.532 INFO:tasks.workunit.client.0.smithi029.stdout:3/51: dread - d0/f15 zero size 2024-04-26T11:46:35.533 INFO:tasks.workunit.client.0.smithi029.stdout:8/65: write f1 [765841,12994] 0 2024-04-26T11:46:35.534 INFO:tasks.workunit.client.0.smithi029.stdout:9/115: mknod d4/d5/d16/c21 1 2024-04-26T11:46:35.534 INFO:tasks.workunit.client.0.smithi029.stdout:7/60: rename d11 to d11/d15/d16 22 2024-04-26T11:46:35.534 INFO:tasks.workunit.client.0.smithi029.stdout:4/41: creat d3/d8/f12 x:0 0 0 2024-04-26T11:46:35.535 INFO:tasks.workunit.client.0.smithi029.stdout:1/38: chown f2 756179913 1 2024-04-26T11:46:35.535 INFO:tasks.workunit.client.0.smithi029.stdout:0/43: truncate f5 124016 0 2024-04-26T11:46:35.536 INFO:tasks.workunit.client.0.smithi029.stdout:7/61: creat d11/f17 x:0 0 0 2024-04-26T11:46:35.536 INFO:tasks.workunit.client.0.smithi029.stdout:6/25: link l6 d7/l9 0 2024-04-26T11:46:35.536 INFO:tasks.workunit.client.0.smithi029.stdout:8/66: mkdir dc/de/d15 0 2024-04-26T11:46:35.537 INFO:tasks.workunit.client.0.smithi029.stdout:3/52: rename d0/dc/ff to d0/d1/f16 0 2024-04-26T11:46:35.537 INFO:tasks.workunit.client.0.smithi029.stdout:4/42: write d3/f7 [167322,19112] 0 2024-04-26T11:46:35.537 INFO:tasks.workunit.client.0.smithi029.stdout:2/55: dread f7 [0,4194304] 0 2024-04-26T11:46:35.538 INFO:tasks.workunit.client.0.smithi029.stdout:7/62: mkdir d11/d18 0 2024-04-26T11:46:35.538 INFO:tasks.workunit.client.0.smithi029.stdout:6/26: chown d7 1594 1 2024-04-26T11:46:35.538 INFO:tasks.workunit.client.0.smithi029.stdout:5/30: dread f8 [0,4194304] 0 2024-04-26T11:46:35.540 INFO:tasks.workunit.client.0.smithi029.stdout:2/56: mkdir de 0 2024-04-26T11:46:35.540 INFO:tasks.workunit.client.0.smithi029.stdout:3/53: rename d0/l9 to d0/de/l17 0 2024-04-26T11:46:35.542 INFO:tasks.workunit.client.0.smithi029.stdout:2/57: write fc [321521,10519] 0 2024-04-26T11:46:35.542 INFO:tasks.workunit.client.0.smithi029.stdout:5/31: creat fa x:0 0 0 2024-04-26T11:46:35.546 INFO:tasks.workunit.client.0.smithi029.stdout:5/32: mkdir db 0 2024-04-26T11:46:35.546 INFO:tasks.workunit.client.0.smithi029.stdout:8/67: dread dc/f11 [0,4194304] 0 2024-04-26T11:46:35.547 INFO:tasks.workunit.client.0.smithi029.stdout:1/39: truncate f2 5234041 0 2024-04-26T11:46:35.547 INFO:tasks.workunit.client.0.smithi029.stdout:8/68: stat dc/d12 0 2024-04-26T11:46:35.548 INFO:tasks.workunit.client.0.smithi029.stdout:7/63: dread f6 [0,4194304] 0 2024-04-26T11:46:35.548 INFO:tasks.workunit.client.0.smithi029.stdout:6/27: getdents d7 0 2024-04-26T11:46:35.549 INFO:tasks.workunit.client.0.smithi029.stdout:8/69: fsync f1 0 2024-04-26T11:46:35.549 INFO:tasks.workunit.client.0.smithi029.stdout:2/58: write f7 [1148032,110203] 0 2024-04-26T11:46:35.549 INFO:tasks.workunit.client.0.smithi029.stdout:0/44: dread d9/fe [0,4194304] 0 2024-04-26T11:46:35.550 INFO:tasks.workunit.client.0.smithi029.stdout:5/33: unlink l6 0 2024-04-26T11:46:35.550 INFO:tasks.workunit.client.0.smithi029.stdout:6/28: unlink f4 0 2024-04-26T11:46:35.550 INFO:tasks.workunit.client.0.smithi029.stdout:5/34: mknod db/cc 1 2024-04-26T11:46:35.550 INFO:tasks.workunit.client.0.smithi029.stdout:9/116: dwrite d4/d5/d7/f11 [4194304,4194304] 0 2024-04-26T11:46:35.550 INFO:tasks.workunit.client.0.smithi029.stdout:8/70: read f1 [6206009,58729] 0 2024-04-26T11:46:35.551 INFO:tasks.workunit.client.0.smithi029.stdout:2/59: chown l2 344996085 1 2024-04-26T11:46:35.552 INFO:tasks.workunit.client.0.smithi029.stdout:0/45: chown l8 20 1 2024-04-26T11:46:35.553 INFO:tasks.workunit.client.0.smithi029.stdout:6/29: creat d7/fa x:0 0 0 2024-04-26T11:46:35.554 INFO:tasks.workunit.client.0.smithi029.stdout:4/43: dwrite d3/d8/db/f10 [0,4194304] 0 2024-04-26T11:46:35.555 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:35.553+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:35.555 INFO:tasks.workunit.client.0.smithi029.stdout:4/44: mkdir d3/d8/db/d13 0 2024-04-26T11:46:35.558 INFO:tasks.workunit.client.0.smithi029.stdout:7/64: dwrite d11/f17 [0,4194304] 0 2024-04-26T11:46:35.558 INFO:tasks.workunit.client.0.smithi029.stdout:5/35: dread f0 [0,4194304] 0 2024-04-26T11:46:35.559 INFO:tasks.workunit.client.0.smithi029.stdout:7/65: fdatasync fd 0 2024-04-26T11:46:35.559 INFO:tasks.workunit.client.0.smithi029.stdout:5/36: read f5 [4112924,105116] 0 2024-04-26T11:46:35.560 INFO:tasks.workunit.client.0.smithi029.stdout:7/66: unlink la 0 2024-04-26T11:46:35.562 INFO:tasks.workunit.client.0.smithi029.stdout:7/67: write f10 [58032,14028] 0 2024-04-26T11:46:35.562 INFO:tasks.workunit.client.0.smithi029.stdout:0/46: truncate f5 341868 0 2024-04-26T11:46:35.563 INFO:tasks.workunit.client.0.smithi029.stdout:2/60: dwrite fc [0,4194304] 0 2024-04-26T11:46:35.563 INFO:tasks.workunit.client.0.smithi029.stdout:2/61: stat f7 0 2024-04-26T11:46:35.563 INFO:tasks.workunit.client.0.smithi029.stdout:7/68: write d11/f17 [889692,31173] 0 2024-04-26T11:46:35.563 INFO:tasks.workunit.client.0.smithi029.stdout:7/69: dread - fd zero size 2024-04-26T11:46:35.564 INFO:tasks.workunit.client.0.smithi029.stdout:0/47: fdatasync f5 0 2024-04-26T11:46:35.565 INFO:tasks.workunit.client.0.smithi029.stdout:2/62: rmdir de 0 2024-04-26T11:46:35.566 INFO:tasks.workunit.client.0.smithi029.stdout:2/63: fsync f7 0 2024-04-26T11:46:35.566 INFO:tasks.workunit.client.0.smithi029.stdout:0/48: write d9/fa [79639,15066] 0 2024-04-26T11:46:35.566 INFO:tasks.workunit.client.0.smithi029.stdout:5/37: dread f0 [0,4194304] 0 2024-04-26T11:46:35.566 INFO:tasks.workunit.client.0.smithi029.stdout:2/64: creat ff x:0 0 0 2024-04-26T11:46:35.566 INFO:tasks.workunit.client.0.smithi029.stdout:2/65: symlink l10 0 2024-04-26T11:46:35.567 INFO:tasks.workunit.client.0.smithi029.stdout:5/38: mkdir db/dd 0 2024-04-26T11:46:35.567 INFO:tasks.workunit.client.0.smithi029.stdout:2/66: mkdir d11 0 2024-04-26T11:46:35.567 INFO:tasks.workunit.client.0.smithi029.stdout:9/117: write d4/d5/f1a [849942,15490] 0 2024-04-26T11:46:35.567 INFO:tasks.workunit.client.0.smithi029.stdout:5/39: fdatasync f0 0 2024-04-26T11:46:35.568 INFO:tasks.workunit.client.0.smithi029.stdout:5/40: mkdir db/de 0 2024-04-26T11:46:35.568 INFO:tasks.workunit.client.0.smithi029.stdout:2/67: rmdir d11 0 2024-04-26T11:46:35.569 INFO:tasks.workunit.client.0.smithi029.stdout:2/68: fdatasync ff 0 2024-04-26T11:46:35.569 INFO:tasks.workunit.client.0.smithi029.stdout:5/41: getdents db/de 0 2024-04-26T11:46:35.569 INFO:tasks.workunit.client.0.smithi029.stdout:2/69: mkdir d12 0 2024-04-26T11:46:35.570 INFO:tasks.workunit.client.0.smithi029.stdout:5/42: rename db/dd to db/dd/df 22 2024-04-26T11:46:35.570 INFO:tasks.workunit.client.0.smithi029.stdout:2/70: symlink d12/l13 0 2024-04-26T11:46:35.571 INFO:tasks.workunit.client.0.smithi029.stdout:2/71: symlink d12/l14 0 2024-04-26T11:46:35.571 INFO:tasks.workunit.client.0.smithi029.stdout:2/72: write ff [818288,100033] 0 2024-04-26T11:46:35.574 INFO:tasks.workunit.client.0.smithi029.stdout:0/49: dread d9/fa [0,4194304] 0 2024-04-26T11:46:35.576 INFO:tasks.workunit.client.0.smithi029.stdout:0/50: getdents d9 0 2024-04-26T11:46:35.576 INFO:tasks.workunit.client.0.smithi029.stdout:0/51: chown f5 6081 1 2024-04-26T11:46:35.576 INFO:tasks.workunit.client.0.smithi029.stdout:0/52: truncate d9/ff 4353493 0 2024-04-26T11:46:35.577 INFO:tasks.workunit.client.0.smithi029.stdout:0/53: dread - d9/fc zero size 2024-04-26T11:46:35.578 INFO:tasks.workunit.client.0.smithi029.stdout:6/30: write f2 [1771513,45427] 0 2024-04-26T11:46:35.578 INFO:tasks.workunit.client.0.smithi029.stdout:6/31: mknod d7/cb 1 2024-04-26T11:46:35.578 INFO:tasks.workunit.client.0.smithi029.stdout:0/54: write d9/ff [986139,111663] 0 2024-04-26T11:46:35.579 INFO:tasks.workunit.client.0.smithi029.stdout:0/55: creat d9/f10 x:0 0 0 2024-04-26T11:46:35.580 INFO:tasks.workunit.client.0.smithi029.stdout:6/32: dread f2 [0,4194304] 0 2024-04-26T11:46:35.586 INFO:tasks.workunit.client.0.smithi029.stdout:7/70: truncate f8 322999 0 2024-04-26T11:46:35.587 INFO:tasks.workunit.client.0.smithi029.stdout:9/118: truncate d4/d5/d7/f11 3990436 0 2024-04-26T11:46:35.587 INFO:tasks.workunit.client.0.smithi029.stdout:5/43: truncate f5 1038275 0 2024-04-26T11:46:35.587 INFO:tasks.workunit.client.0.smithi029.stdout:7/71: creat d11/f19 x:0 0 0 2024-04-26T11:46:35.588 INFO:tasks.workunit.client.0.smithi029.stdout:9/119: symlink d4/d5/l22 0 2024-04-26T11:46:35.589 INFO:tasks.workunit.client.0.smithi029.stdout:9/120: chown d4/d5/d16 69 1 2024-04-26T11:46:35.590 INFO:tasks.workunit.client.0.smithi029.stdout:6/33: fdatasync f2 0 2024-04-26T11:46:35.591 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:35.591 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:35.591 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:35.591 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:35.591 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:35.592 INFO:tasks.workunit.client.0.smithi029.stdout:9/121: truncate d4/d5/d16/f1c 789882 0 2024-04-26T11:46:35.592 INFO:tasks.workunit.client.0.smithi029.stdout:6/34: write d7/fa [907820,86582] 0 2024-04-26T11:46:35.594 INFO:tasks.workunit.client.0.smithi029.stdout:5/44: dread f0 [0,4194304] 0 2024-04-26T11:46:35.595 INFO:tasks.workunit.client.0.smithi029.stdout:6/35: getdents d7 0 2024-04-26T11:46:35.596 INFO:tasks.workunit.client.0.smithi029.stdout:6/36: fsync f2 0 2024-04-26T11:46:35.597 INFO:tasks.workunit.client.0.smithi029.stdout:5/45: getdents db/de 0 2024-04-26T11:46:35.597 INFO:tasks.workunit.client.0.smithi029.stdout:0/56: dwrite f5 [0,4194304] 0 2024-04-26T11:46:35.598 INFO:tasks.workunit.client.0.smithi029.stdout:6/37: symlink d7/lc 0 2024-04-26T11:46:35.599 INFO:tasks.workunit.client.0.smithi029.stdout:0/57: unlink l6 0 2024-04-26T11:46:35.599 INFO:tasks.workunit.client.0.smithi029.stdout:9/122: write d4/d5/d7/f11 [1170181,52684] 0 2024-04-26T11:46:35.599 INFO:tasks.workunit.client.0.smithi029.stdout:6/38: mknod d7/cd 1 2024-04-26T11:46:35.600 INFO:tasks.workunit.client.0.smithi029.stdout:5/46: rmdir db/dd 0 2024-04-26T11:46:35.600 INFO:tasks.workunit.client.0.smithi029.stdout:0/58: mknod d9/c11 1 2024-04-26T11:46:35.601 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:35.603 INFO:tasks.workunit.client.0.smithi029.stdout:0/59: symlink d9/l12 0 2024-04-26T11:46:35.603 INFO:tasks.workunit.client.0.smithi029.stdout:9/123: rename d4/d5/d7/l17 to d4/l23 0 2024-04-26T11:46:35.603 INFO:tasks.workunit.client.0.smithi029.stdout:0/60: dread d9/fa [0,4194304] 0 2024-04-26T11:46:35.603 INFO:tasks.workunit.client.0.smithi029.stdout:7/72: dwrite d11/f13 [0,4194304] 0 2024-04-26T11:46:35.606 INFO:tasks.workunit.client.0.smithi029.stdout:3/54: sync 2024-04-26T11:46:35.606 INFO:tasks.workunit.client.0.smithi029.stdout:4/45: sync 2024-04-26T11:46:35.606 INFO:tasks.workunit.client.0.smithi029.stdout:8/71: sync 2024-04-26T11:46:35.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/40: sync 2024-04-26T11:46:35.606 INFO:tasks.workunit.client.0.smithi029.stdout:2/73: sync 2024-04-26T11:46:35.606 INFO:tasks.workunit.client.0.smithi029.stdout:8/72: chown dc 87360920 1 2024-04-26T11:46:35.607 INFO:tasks.workunit.client.0.smithi029.stdout:2/74: mknod d12/c15 1 2024-04-26T11:46:35.608 INFO:tasks.workunit.client.0.smithi029.stdout:1/41: creat f6 x:0 0 0 2024-04-26T11:46:35.608 INFO:tasks.workunit.client.0.smithi029.stdout:7/73: mkdir d11/d18/d1a 0 2024-04-26T11:46:35.608 INFO:tasks.workunit.client.0.smithi029.stdout:3/55: write d0/f15 [391384,66433] 0 2024-04-26T11:46:35.610 INFO:tasks.workunit.client.0.smithi029.stdout:8/73: readlink dc/d12/l14 0 2024-04-26T11:46:35.610 INFO:tasks.workunit.client.0.smithi029.stdout:1/42: mkdir d7 0 2024-04-26T11:46:35.610 INFO:tasks.workunit.client.0.smithi029.stdout:4/46: dread d3/f7 [0,4194304] 0 2024-04-26T11:46:35.611 INFO:tasks.workunit.client.0.smithi029.stdout:0/61: rmdir d9 39 2024-04-26T11:46:35.613 INFO:tasks.workunit.client.0.smithi029.stdout:5/47: dread f5 [0,4194304] 0 2024-04-26T11:46:35.613 INFO:tasks.workunit.client.0.smithi029.stdout:0/62: chown f3 0 1 2024-04-26T11:46:35.613 INFO:tasks.workunit.client.0.smithi029.stdout:2/75: getdents d12 0 2024-04-26T11:46:35.613 INFO:tasks.workunit.client.0.smithi029.stdout:1/43: symlink d7/l8 0 2024-04-26T11:46:35.614 INFO:tasks.workunit.client.0.smithi029.stdout:7/74: truncate d11/f19 702137 0 2024-04-26T11:46:35.614 INFO:tasks.workunit.client.0.smithi029.stdout:8/74: rename dc/de/l10 to dc/l16 0 2024-04-26T11:46:35.615 INFO:tasks.workunit.client.0.smithi029.stdout:9/124: dwrite d4/d5/f1a [0,4194304] 0 2024-04-26T11:46:35.616 INFO:tasks.workunit.client.0.smithi029.stdout:6/39: dwrite d7/fa [0,4194304] 0 2024-04-26T11:46:35.616 INFO:tasks.workunit.client.0.smithi029.stdout:4/47: creat d3/f14 x:0 0 0 2024-04-26T11:46:35.616 INFO:tasks.workunit.client.0.smithi029.stdout:0/63: chown d9/l12 24 1 2024-04-26T11:46:35.616 INFO:tasks.workunit.client.0.smithi029.stdout:7/75: stat d11/f19 0 2024-04-26T11:46:35.617 INFO:tasks.workunit.client.0.smithi029.stdout:8/75: symlink dc/de/l17 0 2024-04-26T11:46:35.617 INFO:tasks.workunit.client.0.smithi029.stdout:2/76: creat d12/f16 x:0 0 0 2024-04-26T11:46:35.618 INFO:tasks.workunit.client.0.smithi029.stdout:5/48: creat db/de/f10 x:0 0 0 2024-04-26T11:46:35.618 INFO:tasks.workunit.client.0.smithi029.stdout:1/44: truncate f2 4026146 0 2024-04-26T11:46:35.619 INFO:tasks.workunit.client.0.smithi029.stdout:9/125: unlink d4/f14 0 2024-04-26T11:46:35.619 INFO:tasks.workunit.client.0.smithi029.stdout:0/64: chown d9/lb 1909037 1 2024-04-26T11:46:35.620 INFO:tasks.workunit.client.0.smithi029.stdout:4/48: write d3/d8/fa [3794741,118626] 0 2024-04-26T11:46:35.620 INFO:tasks.workunit.client.0.smithi029.stdout:7/76: fsync d11/f13 0 2024-04-26T11:46:35.620 INFO:tasks.workunit.client.0.smithi029.stdout:0/65: mknod d9/c13 1 2024-04-26T11:46:35.621 INFO:tasks.workunit.client.0.smithi029.stdout:1/45: creat d7/f9 x:0 0 0 2024-04-26T11:46:35.621 INFO:tasks.workunit.client.0.smithi029.stdout:2/77: rename d12/l14 to d12/l17 0 2024-04-26T11:46:35.621 INFO:tasks.workunit.client.0.smithi029.stdout:5/49: rename fa to db/de/f11 0 2024-04-26T11:46:35.622 INFO:tasks.workunit.client.0.smithi029.stdout:9/126: chown d4/d5/d16 1162 1 2024-04-26T11:46:35.622 INFO:tasks.workunit.client.0.smithi029.stdout:2/78: mknod d12/c18 1 2024-04-26T11:46:35.623 INFO:tasks.workunit.client.0.smithi029.stdout:0/66: creat d9/f14 x:0 0 0 2024-04-26T11:46:35.624 INFO:tasks.workunit.client.0.smithi029.stdout:7/77: chown fc 113850645 1 2024-04-26T11:46:35.624 INFO:tasks.workunit.client.0.smithi029.stdout:4/49: mknod d3/d8/d11/c15 1 2024-04-26T11:46:35.625 INFO:tasks.workunit.client.0.smithi029.stdout:0/67: fdatasync d9/f14 0 2024-04-26T11:46:35.626 INFO:tasks.workunit.client.0.smithi029.stdout:4/50: fsync d3/f7 0 2024-04-26T11:46:35.626 INFO:tasks.workunit.client.0.smithi029.stdout:7/78: creat d11/d15/f1b x:0 0 0 2024-04-26T11:46:35.627 INFO:tasks.workunit.client.0.smithi029.stdout:3/56: dwrite d0/f15 [0,4194304] 0 2024-04-26T11:46:35.628 INFO:tasks.workunit.client.0.smithi029.stdout:0/68: rename d9/l12 to d9/l15 0 2024-04-26T11:46:35.628 INFO:tasks.workunit.client.0.smithi029.stdout:7/79: dread - d11/d15/f1b zero size 2024-04-26T11:46:35.629 INFO:tasks.workunit.client.0.smithi029.stdout:4/51: write d3/f14 [312873,31654] 0 2024-04-26T11:46:35.629 INFO:tasks.workunit.client.0.smithi029.stdout:8/76: dread f1 [0,4194304] 0 2024-04-26T11:46:35.630 INFO:tasks.workunit.client.0.smithi029.stdout:7/80: mknod d11/c1c 1 2024-04-26T11:46:35.632 INFO:tasks.workunit.client.0.smithi029.stdout:1/46: sync 2024-04-26T11:46:35.632 INFO:tasks.workunit.client.0.smithi029.stdout:5/50: sync 2024-04-26T11:46:35.632 INFO:tasks.workunit.client.0.smithi029.stdout:3/57: read d0/d1/f8 [385999,80682] 0 2024-04-26T11:46:35.632 INFO:tasks.workunit.client.0.smithi029.stdout:4/52: write d3/d8/f12 [698104,34084] 0 2024-04-26T11:46:35.633 INFO:tasks.workunit.client.0.smithi029.stdout:3/58: stat d0 0 2024-04-26T11:46:35.633 INFO:tasks.workunit.client.0.smithi029.stdout:9/127: dread d4/d5/d7/fc [0,4194304] 0 2024-04-26T11:46:35.634 INFO:tasks.workunit.client.0.smithi029.stdout:7/81: chown f8 93156 1 2024-04-26T11:46:35.634 INFO:tasks.workunit.client.0.smithi029.stdout:8/77: dread dc/f11 [0,4194304] 0 2024-04-26T11:46:35.634 INFO:tasks.workunit.client.0.smithi029.stdout:6/40: dwrite d7/fa [0,4194304] 0 2024-04-26T11:46:35.634 INFO:tasks.workunit.client.0.smithi029.stdout:5/51: dread - db/de/f11 zero size 2024-04-26T11:46:35.634 INFO:tasks.workunit.client.0.smithi029.stdout:1/47: chown d7/f9 317566631 1 2024-04-26T11:46:35.635 INFO:tasks.workunit.client.0.smithi029.stdout:8/78: read f5 [2714497,81172] 0 2024-04-26T11:46:35.636 INFO:tasks.workunit.client.0.smithi029.stdout:1/48: chown f6 959 1 2024-04-26T11:46:35.636 INFO:tasks.workunit.client.0.smithi029.stdout:6/41: write f2 [658992,59391] 0 2024-04-26T11:46:35.637 INFO:tasks.workunit.client.0.smithi029.stdout:6/42: stat l1 0 2024-04-26T11:46:35.637 INFO:tasks.workunit.client.0.smithi029.stdout:9/128: write d4/d5/f6 [544698,10451] 0 2024-04-26T11:46:35.638 INFO:tasks.workunit.client.0.smithi029.stdout:5/52: mkdir db/d12 0 2024-04-26T11:46:35.638 INFO:tasks.workunit.client.0.smithi029.stdout:7/82: symlink d11/d18/l1d 0 2024-04-26T11:46:35.638 INFO:tasks.workunit.client.0.smithi029.stdout:2/79: dwrite d12/f16 [0,4194304] 0 2024-04-26T11:46:35.640 INFO:tasks.workunit.client.0.smithi029.stdout:8/79: fsync dc/f11 0 2024-04-26T11:46:35.640 INFO:tasks.workunit.client.0.smithi029.stdout:1/49: creat d7/fa x:0 0 0 2024-04-26T11:46:35.641 INFO:tasks.workunit.client.0.smithi029.stdout:9/129: creat d4/f24 x:0 0 0 2024-04-26T11:46:35.641 INFO:tasks.workunit.client.0.smithi029.stdout:7/83: creat d11/f1e x:0 0 0 2024-04-26T11:46:35.641 INFO:tasks.workunit.client.0.smithi029.stdout:0/69: getdents d9 0 2024-04-26T11:46:35.642 INFO:tasks.workunit.client.0.smithi029.stdout:5/53: getdents db/d12 0 2024-04-26T11:46:35.642 INFO:tasks.workunit.client.0.smithi029.stdout:4/53: read d3/f14 [287909,14200] 0 2024-04-26T11:46:35.642 INFO:tasks.workunit.client.0.smithi029.stdout:1/50: chown d7/fa 476833 1 2024-04-26T11:46:35.643 INFO:tasks.workunit.client.0.smithi029.stdout:7/84: write fd [678184,89922] 0 2024-04-26T11:46:35.643 INFO:tasks.workunit.client.0.smithi029.stdout:0/70: mkdir d9/d16 0 2024-04-26T11:46:35.644 INFO:tasks.workunit.client.0.smithi029.stdout:8/80: rename la to dc/d12/l18 0 2024-04-26T11:46:35.644 INFO:tasks.workunit.client.0.smithi029.stdout:3/59: dread d0/f15 [0,4194304] 0 2024-04-26T11:46:35.644 INFO:tasks.workunit.client.0.smithi029.stdout:2/80: creat d12/f19 x:0 0 0 2024-04-26T11:46:35.644 INFO:tasks.workunit.client.0.smithi029.stdout:1/51: mkdir d7/db 0 2024-04-26T11:46:35.645 INFO:tasks.workunit.client.0.smithi029.stdout:0/71: symlink d9/l17 0 2024-04-26T11:46:35.646 INFO:tasks.workunit.client.0.smithi029.stdout:2/81: truncate f6 4897309 0 2024-04-26T11:46:35.646 INFO:tasks.workunit.client.0.smithi029.stdout:2/82: sync 2024-04-26T11:46:35.646 INFO:tasks.workunit.client.0.smithi029.stdout:0/72: read - d9/fc zero size 2024-04-26T11:46:35.647 INFO:tasks.workunit.client.0.smithi029.stdout:2/83: dread - fd zero size 2024-04-26T11:46:35.649 INFO:tasks.workunit.client.0.smithi029.stdout:3/60: creat d0/d1/f18 x:0 0 0 2024-04-26T11:46:35.650 INFO:tasks.workunit.client.0.smithi029.stdout:2/84: chown ff 73103 1 2024-04-26T11:46:35.653 INFO:tasks.workunit.client.0.smithi029.stdout:2/85: chown f6 77 1 2024-04-26T11:46:35.654 INFO:tasks.workunit.client.0.smithi029.stdout:6/43: dwrite d7/fa [0,4194304] 0 2024-04-26T11:46:35.654 INFO:tasks.workunit.client.0.smithi029.stdout:5/54: getdents db 0 2024-04-26T11:46:35.655 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:35.653+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:35.656 INFO:tasks.workunit.client.0.smithi029.stdout:2/86: chown fc 80684094 1 2024-04-26T11:46:35.658 INFO:tasks.workunit.client.0.smithi029.stdout:2/87: chown d12 4 1 2024-04-26T11:46:35.660 INFO:tasks.workunit.client.0.smithi029.stdout:2/88: readlink lb 0 2024-04-26T11:46:35.661 INFO:tasks.workunit.client.0.smithi029.stdout:9/130: dwrite d4/d5/d7/f11 [0,4194304] 0 2024-04-26T11:46:35.662 INFO:tasks.workunit.client.0.smithi029.stdout:1/52: chown f2 50 1 2024-04-26T11:46:35.662 INFO:tasks.workunit.client.0.smithi029.stdout:3/61: rename d0/lb to d0/d1/d13/l19 0 2024-04-26T11:46:35.663 INFO:tasks.workunit.client.0.smithi029.stdout:7/85: dwrite f10 [0,4194304] 0 2024-04-26T11:46:35.663 INFO:tasks.workunit.client.0.smithi029.stdout:6/44: creat d7/fe x:0 0 0 2024-04-26T11:46:35.665 INFO:tasks.workunit.client.0.smithi029.stdout:5/55: rename f3 to db/de/f13 0 2024-04-26T11:46:35.665 INFO:tasks.workunit.client.0.smithi029.stdout:8/81: dwrite f0 [8388608,4194304] 0 2024-04-26T11:46:35.665 INFO:tasks.workunit.client.0.smithi029.stdout:3/62: mkdir d0/de/d1a 0 2024-04-26T11:46:35.666 INFO:tasks.workunit.client.0.smithi029.stdout:6/45: chown d7/l9 71828195 1 2024-04-26T11:46:35.666 INFO:tasks.workunit.client.0.smithi029.stdout:5/56: chown f7 0 1 2024-04-26T11:46:35.667 INFO:tasks.workunit.client.0.smithi029.stdout:6/46: sync 2024-04-26T11:46:35.667 INFO:tasks.workunit.client.0.smithi029.stdout:2/89: truncate f7 1117980 0 2024-04-26T11:46:35.667 INFO:tasks.workunit.client.0.smithi029.stdout:1/53: mkdir d7/db/dc 0 2024-04-26T11:46:35.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/86: truncate d11/f19 1383488 0 2024-04-26T11:46:35.667 INFO:tasks.workunit.client.0.smithi029.stdout:0/73: dwrite d9/fc [0,4194304] 0 2024-04-26T11:46:35.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/47: rename d7 to d7/df 22 2024-04-26T11:46:35.668 INFO:tasks.workunit.client.0.smithi029.stdout:7/87: mknod d11/d18/d1a/c1f 1 2024-04-26T11:46:35.668 INFO:tasks.workunit.client.0.smithi029.stdout:4/54: dread d3/d8/f12 [0,4194304] 0 2024-04-26T11:46:35.669 INFO:tasks.workunit.client.0.smithi029.stdout:5/57: truncate db/de/f13 714869 0 2024-04-26T11:46:35.669 INFO:tasks.workunit.client.0.smithi029.stdout:8/82: creat dc/de/d15/f19 x:0 0 0 2024-04-26T11:46:35.669 INFO:tasks.workunit.client.0.smithi029.stdout:7/88: stat d11/d18 0 2024-04-26T11:46:35.669 INFO:tasks.workunit.client.0.smithi029.stdout:2/90: link fc d12/f1a 0 2024-04-26T11:46:35.670 INFO:tasks.workunit.client.0.smithi029.stdout:3/63: link d0/d1/d13/f14 d0/f1b 0 2024-04-26T11:46:35.670 INFO:tasks.workunit.client.0.smithi029.stdout:0/74: truncate d9/ff 4395689 0 2024-04-26T11:46:35.670 INFO:tasks.workunit.client.0.smithi029.stdout:4/55: write d3/f5 [986020,3060] 0 2024-04-26T11:46:35.671 INFO:tasks.workunit.client.0.smithi029.stdout:1/54: symlink d7/db/dc/ld 0 2024-04-26T11:46:35.671 INFO:tasks.workunit.client.0.smithi029.stdout:8/83: mkdir dc/de/d1a 0 2024-04-26T11:46:35.671 INFO:tasks.workunit.client.0.smithi029.stdout:2/91: read d12/f1a [1361380,104776] 0 2024-04-26T11:46:35.672 INFO:tasks.workunit.client.0.smithi029.stdout:4/56: write d3/d8/db/f10 [5034984,25474] 0 2024-04-26T11:46:35.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/55: write d7/fa [422772,124804] 0 2024-04-26T11:46:35.673 INFO:tasks.workunit.client.0.smithi029.stdout:6/48: dread f2 [0,4194304] 0 2024-04-26T11:46:35.673 INFO:tasks.workunit.client.0.smithi029.stdout:3/64: link d0/de/l17 d0/l1c 0 2024-04-26T11:46:35.674 INFO:tasks.workunit.client.0.smithi029.stdout:3/65: sync 2024-04-26T11:46:35.674 INFO:tasks.workunit.client.0.smithi029.stdout:8/84: dread dc/f11 [0,4194304] 0 2024-04-26T11:46:35.675 INFO:tasks.workunit.client.0.smithi029.stdout:6/49: readlink d7/l9 0 2024-04-26T11:46:35.675 INFO:tasks.workunit.client.0.smithi029.stdout:1/56: creat d7/fe x:0 0 0 2024-04-26T11:46:35.675 INFO:tasks.workunit.client.0.smithi029.stdout:4/57: chown l0 14307724 1 2024-04-26T11:46:35.675 INFO:tasks.workunit.client.0.smithi029.stdout:2/92: link ff d12/f1b 0 2024-04-26T11:46:35.675 INFO:tasks.workunit.client.0.smithi029.stdout:3/66: chown d0/d1/f18 15369 1 2024-04-26T11:46:35.675 INFO:tasks.workunit.client.0.smithi029.stdout:6/50: symlink d7/l10 0 2024-04-26T11:46:35.676 INFO:tasks.workunit.client.0.smithi029.stdout:1/57: rmdir d7/db/dc 39 2024-04-26T11:46:35.676 INFO:tasks.workunit.client.0.smithi029.stdout:8/85: write dc/f13 [495743,32889] 0 2024-04-26T11:46:35.677 INFO:tasks.workunit.client.0.smithi029.stdout:6/51: creat d7/f11 x:0 0 0 2024-04-26T11:46:35.677 INFO:tasks.workunit.client.0.smithi029.stdout:2/93: write d12/f1b [1418123,32583] 0 2024-04-26T11:46:35.677 INFO:tasks.workunit.client.0.smithi029.stdout:6/52: fsync f2 0 2024-04-26T11:46:35.678 INFO:tasks.workunit.client.0.smithi029.stdout:2/94: rename ff to d12/f1c 0 2024-04-26T11:46:35.679 INFO:tasks.workunit.client.0.smithi029.stdout:8/86: mkdir dc/de/d1b 0 2024-04-26T11:46:35.679 INFO:tasks.workunit.client.0.smithi029.stdout:4/58: dread d3/f14 [0,4194304] 0 2024-04-26T11:46:35.679 INFO:tasks.workunit.client.0.smithi029.stdout:6/53: unlink d7/fa 0 2024-04-26T11:46:35.680 INFO:tasks.workunit.client.0.smithi029.stdout:2/95: creat d12/f1d x:0 0 0 2024-04-26T11:46:35.680 INFO:tasks.workunit.client.0.smithi029.stdout:7/89: dwrite f9 [4194304,4194304] 0 2024-04-26T11:46:35.681 INFO:tasks.workunit.client.0.smithi029.stdout:2/96: creat d12/f1e x:0 0 0 2024-04-26T11:46:35.681 INFO:tasks.workunit.client.0.smithi029.stdout:5/58: rmdir db/de 39 2024-04-26T11:46:35.682 INFO:tasks.workunit.client.0.smithi029.stdout:9/131: write d4/d5/d7/fc [2317733,104660] 0 2024-04-26T11:46:35.684 INFO:tasks.workunit.client.0.smithi029.stdout:0/75: truncate d9/fc 437751 0 2024-04-26T11:46:35.684 INFO:tasks.workunit.client.0.smithi029.stdout:7/90: unlink d11/d15/f1b 0 2024-04-26T11:46:35.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/54: link d7/f11 d7/f12 0 2024-04-26T11:46:35.684 INFO:tasks.workunit.client.0.smithi029.stdout:4/59: mkdir d3/d8/d11/d16 0 2024-04-26T11:46:35.685 INFO:tasks.workunit.client.0.smithi029.stdout:4/60: readlink d3/d8/lf 0 2024-04-26T11:46:35.685 INFO:tasks.workunit.client.0.smithi029.stdout:1/58: mkdir d7/db/dc/df 0 2024-04-26T11:46:35.686 INFO:tasks.workunit.client.0.smithi029.stdout:5/59: write f5 [1380397,15951] 0 2024-04-26T11:46:35.686 INFO:tasks.workunit.client.0.smithi029.stdout:9/132: symlink d4/d5/l25 0 2024-04-26T11:46:35.686 INFO:tasks.workunit.client.0.smithi029.stdout:6/55: symlink d7/l13 0 2024-04-26T11:46:35.686 INFO:tasks.workunit.client.0.smithi029.stdout:1/59: dread - d7/fe zero size 2024-04-26T11:46:35.687 INFO:tasks.workunit.client.0.smithi029.stdout:9/133: readlink d4/l12 0 2024-04-26T11:46:35.687 INFO:tasks.workunit.client.0.smithi029.stdout:7/91: chown f9 2 1 2024-04-26T11:46:35.688 INFO:tasks.workunit.client.0.smithi029.stdout:6/56: mkdir d7/d14 0 2024-04-26T11:46:35.690 INFO:tasks.workunit.client.0.smithi029.stdout:4/61: truncate d3/d8/f12 1425318 0 2024-04-26T11:46:35.690 INFO:tasks.workunit.client.0.smithi029.stdout:5/60: dread f8 [0,4194304] 0 2024-04-26T11:46:35.690 INFO:tasks.workunit.client.0.smithi029.stdout:6/57: mknod d7/d14/c15 1 2024-04-26T11:46:35.690 INFO:tasks.workunit.client.0.smithi029.stdout:7/92: mknod d11/d18/c20 1 2024-04-26T11:46:35.690 INFO:tasks.workunit.client.0.smithi029.stdout:3/67: dread d0/d1/f16 [0,4194304] 0 2024-04-26T11:46:35.690 INFO:tasks.workunit.client.0.smithi029.stdout:1/60: write f6 [252620,117704] 0 2024-04-26T11:46:35.691 INFO:tasks.workunit.client.0.smithi029.stdout:9/134: read d4/d5/d7/f11 [1728989,78757] 0 2024-04-26T11:46:35.692 INFO:tasks.workunit.client.0.smithi029.stdout:7/93: chown d11/f13 133758388 1 2024-04-26T11:46:35.692 INFO:tasks.workunit.client.0.smithi029.stdout:8/87: dwrite f0 [4194304,4194304] 0 2024-04-26T11:46:35.692 INFO:tasks.workunit.client.0.smithi029.stdout:2/97: dread d12/f16 [0,4194304] 0 2024-04-26T11:46:35.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/62: unlink f1 0 2024-04-26T11:46:35.694 INFO:tasks.workunit.client.0.smithi029.stdout:2/98: mknod d12/c1f 1 2024-04-26T11:46:35.694 INFO:tasks.workunit.client.0.smithi029.stdout:2/99: mknod d12/c20 1 2024-04-26T11:46:35.695 INFO:tasks.workunit.client.0.smithi029.stdout:4/63: dread d3/f7 [0,4194304] 0 2024-04-26T11:46:35.695 INFO:tasks.workunit.client.0.smithi029.stdout:0/76: dwrite d9/f10 [0,4194304] 0 2024-04-26T11:46:35.696 INFO:tasks.workunit.client.0.smithi029.stdout:4/64: dread d3/f7 [0,4194304] 0 2024-04-26T11:46:35.697 INFO:tasks.workunit.client.0.smithi029.stdout:8/88: write dc/f11 [750969,92337] 0 2024-04-26T11:46:35.697 INFO:tasks.workunit.client.0.smithi029.stdout:7/94: symlink d11/d18/l21 0 2024-04-26T11:46:35.697 INFO:tasks.workunit.client.0.smithi029.stdout:5/61: symlink db/d12/l14 0 2024-04-26T11:46:35.697 INFO:tasks.workunit.client.0.smithi029.stdout:1/61: getdents d7/db/dc/df 0 2024-04-26T11:46:35.698 INFO:tasks.workunit.client.0.smithi029.stdout:2/100: creat d12/f21 x:0 0 0 2024-04-26T11:46:35.699 INFO:tasks.workunit.client.0.smithi029.stdout:7/95: dread - d11/f1e zero size 2024-04-26T11:46:35.699 INFO:tasks.workunit.client.0.smithi029.stdout:9/135: getdents d4/d5/d16 0 2024-04-26T11:46:35.699 INFO:tasks.workunit.client.0.smithi029.stdout:0/77: creat d9/f18 x:0 0 0 2024-04-26T11:46:35.699 INFO:tasks.workunit.client.0.smithi029.stdout:3/68: link d0/d1/f16 d0/de/d1a/f1d 0 2024-04-26T11:46:35.699 INFO:tasks.workunit.client.0.smithi029.stdout:5/62: chown db/d12/l14 5580869 1 2024-04-26T11:46:35.700 INFO:tasks.workunit.client.0.smithi029.stdout:8/89: chown f1 1964283 1 2024-04-26T11:46:35.700 INFO:tasks.workunit.client.0.smithi029.stdout:2/101: read d12/f16 [2021534,68006] 0 2024-04-26T11:46:35.700 INFO:tasks.workunit.client.0.smithi029.stdout:3/69: rmdir d0/de 39 2024-04-26T11:46:35.700 INFO:tasks.workunit.client.0.smithi029.stdout:7/96: rename f10 to d11/d18/f22 0 2024-04-26T11:46:35.700 INFO:tasks.workunit.client.0.smithi029.stdout:0/78: chown d9/fe 34431 1 2024-04-26T11:46:35.700 INFO:tasks.workunit.client.0.smithi029.stdout:8/90: write f1 [4561043,100977] 0 2024-04-26T11:46:35.701 INFO:tasks.workunit.client.0.smithi029.stdout:5/63: rmdir db 39 2024-04-26T11:46:35.701 INFO:tasks.workunit.client.0.smithi029.stdout:8/91: sync 2024-04-26T11:46:35.702 INFO:tasks.workunit.client.0.smithi029.stdout:9/136: rename d4/d5/l25 to d4/d5/d16/l26 0 2024-04-26T11:46:35.702 INFO:tasks.workunit.client.0.smithi029.stdout:3/70: dread - d0/d1/d13/f14 zero size 2024-04-26T11:46:35.705 INFO:tasks.workunit.client.0.smithi029.stdout:8/92: unlink dc/de/d15/f19 0 2024-04-26T11:46:35.705 INFO:tasks.workunit.client.0.smithi029.stdout:5/64: symlink db/d12/l15 0 2024-04-26T11:46:35.707 INFO:tasks.workunit.client.0.smithi029.stdout:3/71: mkdir d0/d1e 0 2024-04-26T11:46:35.707 INFO:tasks.workunit.client.0.smithi029.stdout:7/97: dread f8 [0,4194304] 0 2024-04-26T11:46:35.710 INFO:tasks.workunit.client.0.smithi029.stdout:5/65: creat db/de/f16 x:0 0 0 2024-04-26T11:46:35.711 INFO:tasks.workunit.client.0.smithi029.stdout:3/72: mkdir d0/dc/d1f 0 2024-04-26T11:46:35.713 INFO:tasks.workunit.client.0.smithi029.stdout:7/98: write f9 [3986730,92268] 0 2024-04-26T11:46:35.713 INFO:tasks.workunit.client.0.smithi029.stdout:6/58: dwrite d7/f11 [0,4194304] 0 2024-04-26T11:46:35.713 INFO:tasks.workunit.client.0.smithi029.stdout:2/102: rmdir d12 39 2024-04-26T11:46:35.714 INFO:tasks.workunit.client.0.smithi029.stdout:2/103: sync 2024-04-26T11:46:35.714 INFO:tasks.workunit.client.0.smithi029.stdout:4/65: dwrite d3/f14 [0,4194304] 0 2024-04-26T11:46:35.715 INFO:tasks.workunit.client.0.smithi029.stdout:9/137: dread d4/f1d [0,4194304] 0 2024-04-26T11:46:35.716 INFO:tasks.workunit.client.0.smithi029.stdout:1/62: dwrite d7/fa [0,4194304] 0 2024-04-26T11:46:35.717 INFO:tasks.workunit.client.0.smithi029.stdout:3/73: write d0/f15 [618807,82858] 0 2024-04-26T11:46:35.718 INFO:tasks.workunit.client.0.smithi029.stdout:9/138: mknod d4/d5/d16/c27 1 2024-04-26T11:46:35.718 INFO:tasks.workunit.client.0.smithi029.stdout:6/59: write d7/f12 [1350814,82401] 0 2024-04-26T11:46:35.719 INFO:tasks.workunit.client.0.smithi029.stdout:4/66: symlink d3/d8/l17 0 2024-04-26T11:46:35.720 INFO:tasks.workunit.client.0.smithi029.stdout:6/60: mknod d7/c16 1 2024-04-26T11:46:35.723 INFO:tasks.workunit.client.0.smithi029.stdout:8/93: dwrite f5 [0,4194304] 0 2024-04-26T11:46:35.724 INFO:tasks.workunit.client.0.smithi029.stdout:4/67: getdents d3/d8/db/d13 0 2024-04-26T11:46:35.725 INFO:tasks.workunit.client.0.smithi029.stdout:9/139: chown d4/d5/d7/f11 10 1 2024-04-26T11:46:35.726 INFO:tasks.workunit.client.0.smithi029.stdout:7/99: dread f6 [0,4194304] 0 2024-04-26T11:46:35.726 INFO:tasks.workunit.client.0.smithi029.stdout:0/79: truncate d9/f10 1814773 0 2024-04-26T11:46:35.727 INFO:tasks.workunit.client.0.smithi029.stdout:5/66: dread f7 [0,4194304] 0 2024-04-26T11:46:35.727 INFO:tasks.workunit.client.0.smithi029.stdout:8/94: rename dc/l16 to dc/d12/l1c 0 2024-04-26T11:46:35.729 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:35.729 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:35.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:35.729 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:35.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.729 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:35.729 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:35.729 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 143.125484368, 2024-04-26T11:46:35.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022276746, 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 138 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601777+0000", 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601776+0000", 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601784+0000", 2024-04-26T11:46:35.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5229999999999998e-06 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601795+0000", 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0793e-05 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601802+0000", 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1400000000000002e-06 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618322+0000", 2024-04-26T11:46:35.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016519672999999999 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618385+0000", 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3810000000000001e-05 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.618490+0000", 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104732 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623884+0000", 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053941060000000001 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623967+0000", 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2910000000000004e-05 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624017+0000", 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9740999999999997e-05 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624054+0000", 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7041e-05 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 143.12545264900001, 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022646501999999999, 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:35.735 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601809+0000", 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601808+0000", 2024-04-26T11:46:35.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601813+0000", 2024-04-26T11:46:35.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.95e-06 2024-04-26T11:46:35.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601822+0000", 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4600000000000003e-06 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601828+0000", 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619059+0000", 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017230665999999999 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619283+0000", 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000223706 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.619608+0000", 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032546099999999998 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624182+0000", 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045742059999999999 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624204+0000", 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624356+0000", 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015231700000000001 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624455+0000", 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9211999999999998e-05 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 143.12541107999999, 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023435351, 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:35.741 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 140 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601850+0000", 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601931+0000", 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1577999999999997e-05 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601959+0000", 2024-04-26T11:46:35.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7480000000000001e-05 2024-04-26T11:46:35.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601968+0000", 2024-04-26T11:46:35.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3389999999999999e-06 2024-04-26T11:46:35.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620445+0000", 2024-04-26T11:46:35.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018476421999999999 2024-04-26T11:46:35.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620524+0000", 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9155999999999999e-05 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.620635+0000", 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111483 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.624571+0000", 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039357539999999996 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625085+0000", 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051379099999999999 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625210+0000", 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124988 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625286+0000", 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5989999999999996e-05 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4165.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 143.125283943, 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023874301000000001, 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.747 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4165", 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2641812741", 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601978+0000", 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601977+0000", 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601983+0000", 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9170000000000003e-06 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601992+0000", 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.601999+0000", 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622615+0000", 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020615894999999999 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.622840+0000", 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022581500000000001 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.623167+0000", 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032712699999999997 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625031+0000", 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018639679999999999 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625685+0000", 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065316300000000001 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625784+0000", 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8880000000000002e-05 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:12.625852+0000", 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8332999999999998e-05 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.752 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.29841367500001, 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022162980999999998, 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:35.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428848+0000", 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428847+0000", 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428854+0000", 2024-04-26T11:46:35.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428864+0000", 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0363000000000001e-05 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428875+0000", 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1327e-05 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428998+0000", 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012299000000000001 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429010+0000", 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441267+0000", 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012257272 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441584+0000", 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031660100000000001 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.441730+0000", 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014663 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445167+0000", 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343684 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450936+0000", 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057691230000000001 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.450979+0000", 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2342999999999998e-05 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451011+0000", 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2055999999999999e-05 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.758 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.29834498299999, 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022572034000000001, 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428916+0000", 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428915+0000", 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428933+0000", 2024-04-26T11:46:35.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7774e-05 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428955+0000", 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1489e-05 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.428968+0000", 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3526000000000001e-05 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429146+0000", 2024-04-26T11:46:35.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017768300000000001 2024-04-26T11:46:35.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:35.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429159+0000", 2024-04-26T11:46:35.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3553000000000001e-05 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442018+0000", 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012858899 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442328+0000", 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031006600000000001 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442466+0000", 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137983 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445172+0000", 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027053789999999999 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451049+0000", 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058777789999999996 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451253+0000", 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020392199999999999 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451489+0000", 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023512500000000001 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:35.765 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.298241365, 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022593064, 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429020+0000", 2024-04-26T11:46:35.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429019+0000", 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429029+0000", 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.859e-06 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429040+0000", 2024-04-26T11:46:35.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1185999999999999e-05 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429048+0000", 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429235+0000", 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000187116 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:35.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442797+0000", 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013555377 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.442870+0000", 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3657000000000003e-05 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443007+0000", 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013668900000000001 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446083+0000", 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030755919999999998 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451540+0000", 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054569099999999997 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451571+0000", 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1384999999999999e-05 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451613+0000", 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2256000000000003e-05 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:35.771 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.298117515, 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022597064, 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429144+0000", 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429143+0000", 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429150+0000", 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429161+0000", 2024-04-26T11:46:35.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0966e-05 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429169+0000", 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0260000000000007e-06 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429309+0000", 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140397 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429319+0000", 2024-04-26T11:46:35.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2900000000000008e-06 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.443283+0000", 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013964002999999999 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444097+0000", 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081437600000000001 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444276+0000", 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017862600000000001 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446090+0000", 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001814319 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451658+0000", 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055674679999999999 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451706+0000", 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8356000000000003e-05 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451741+0000", 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5089999999999998e-05 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.29808537599999, 2024-04-26T11:46:35.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02272977, 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429176+0000", 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429175+0000", 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429180+0000", 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.25e-06 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429188+0000", 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5229999999999995e-06 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429195+0000", 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8569999999999997e-06 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429396+0000", 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200834 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429402+0000", 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1600000000000003e-06 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444740+0000", 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015338193 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444805+0000", 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4665999999999994e-05 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.444876+0000", 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1000000000000005e-05 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446110+0000", 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233664 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451811+0000", 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005700994 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451859+0000", 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7914999999999998e-05 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451906+0000", 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7324000000000003e-05 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.298055283, 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022825967999999999, 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.783 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429206+0000", 2024-04-26T11:46:35.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429211+0000", 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429220+0000", 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6230000000000003e-06 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429230+0000", 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.025e-05 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429471+0000", 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024094399999999999 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429480+0000", 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4669999999999993e-06 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445188+0000", 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015707548000000002 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445288+0000", 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100265 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445355+0000", 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7100000000000005e-05 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.446967+0000", 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001611644 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451951+0000", 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049837639999999999 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.451997+0000", 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6508000000000003e-05 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452032+0000", 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5071999999999999e-05 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.298024884, 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022968672999999998, 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429237+0000", 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429236+0000", 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429241+0000", 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.853e-06 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429249+0000", 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429261+0000", 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:35.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429529+0000", 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000268564 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.429538+0000", 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2109999999999998e-06 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445564+0000", 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016026671999999999 2024-04-26T11:46:35.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445665+0000", 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100287 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.445833+0000", 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016824299999999999 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.447088+0000", 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012547700000000001 2024-04-26T11:46:35.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452112+0000", 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050245389999999997 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452153+0000", 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1057999999999999e-05 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:44:21.452205+0000", 2024-04-26T11:46:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2139999999999999e-05 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:185 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.575640815, 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042806678000000001, 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151613+0000", 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999928 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152126+0000", 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051282900000000002 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152158+0000", 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2268999999999999e-05 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152173+0000", 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4780000000000001e-05 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152350+0000", 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017709600000000001 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152645+0000", 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029497600000000002 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194252+0000", 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041607102999999999 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194330+0000", 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8029999999999997e-05 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194427+0000", 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6892000000000007e-05 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:7127 4.1e 4:7b6a0e51:::10000002096.00000000:head [write 0~1041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:35.799 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.572643088, 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029239364, 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 7127 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154616+0000", 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154631+0000", 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4786999999999999e-05 2024-04-26T11:46:35.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154655+0000", 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3978999999999999e-05 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154669+0000", 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4022999999999999e-05 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154746+0000", 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6947999999999996e-05 2024-04-26T11:46:35.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154945+0000", 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000198736 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183781+0000", 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028835980000000001 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183812+0000", 2024-04-26T11:46:35.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1214000000000003e-05 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183858+0000", 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5933999999999998e-05 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:291 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-set-vals in=143822b,omap-rm-keys in=25459b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.5761921450000003, 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029817972000000002, 2024-04-26T11:46:35.804 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151067+0000", 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151620+0000", 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00055239000000000004 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151648+0000", 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8396000000000001e-05 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151674+0000", 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5683000000000001e-05 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151780+0000", 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010609500000000001 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151979+0000", 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019890899999999999 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.180710+0000", 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028731406000000001 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.180777+0000", 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7104e-05 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.180887+0000", 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110179 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.809 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10763 4.30 4:0ecbb745:::1000000310c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:35.809 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.170670+0000", 2024-04-26T11:46:35.809 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.55659133900000002, 2024-04-26T11:46:35.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022403353000000001, 2024-04-26T11:46:35.809 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.809 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.809 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10763 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.170670+0000", 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.170670+0000", 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.170668+0000", 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.178851+0000", 2024-04-26T11:46:35.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0081837109999999998 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.178887+0000", 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5539e-05 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.178909+0000", 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2473e-05 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.179048+0000", 2024-04-26T11:46:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013811100000000001 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.179218+0000", 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017081900000000001 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.192628+0000", 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013409628 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.192822+0000", 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019356399999999999 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.193073+0000", 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000251938 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10801 4.1e 4:7a8af247:::100000030e7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.557399+0000", 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.16986242600000001, 2024-04-26T11:46:35.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029447019000000001, 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10801 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.557399+0000", 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.557399+0000", 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.557397+0000", 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563297+0000", 2024-04-26T11:46:35.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059000859999999997 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563333+0000", 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5762000000000001e-05 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563346+0000", 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3535e-05 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563431+0000", 2024-04-26T11:46:35.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5055999999999993e-05 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563862+0000", 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00043010599999999998 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.586670+0000", 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022808096999999999 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.586740+0000", 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0561000000000004e-05 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.586846+0000", 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105881 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10802 4.32 4:4ff1f6b2:::10000003119.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.563504+0000", 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.163757713, 2024-04-26T11:46:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025997065, 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10802 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563504+0000", 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563504+0000", 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563502+0000", 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.568348+0000", 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048459089999999998 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.568359+0000", 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.012e-05 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.568364+0000", 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9139999999999996e-06 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.568432+0000", 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7327000000000001e-05 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.568613+0000", 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000181609 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.568767+0000", 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015343900000000001 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.581125+0000", 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012358330000000001 2024-04-26T11:46:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.589431+0000", 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.008305659 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.589471+0000", 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0667000000000002e-05 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.589501+0000", 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9371000000000001e-05 2024-04-26T11:46:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10804 4.13 4:cb7758dd:::10000003116.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.568429+0000", 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.15883254799999999, 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026178489999999999, 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10804 2024-04-26T11:46:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.568429+0000", 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.568429+0000", 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.568428+0000", 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.572920+0000", 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044917280000000004 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.572947+0000", 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7239000000000001e-05 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.572956+0000", 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9299999999999992e-06 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.573163+0000", 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000206947 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.573299+0000", 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013615099999999999 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.573463+0000", 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016348 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.588892+0000", 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01542937 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.594492+0000", 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056000959999999997 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.594556+0000", 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4079999999999996e-05 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.594607+0000", 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1189000000000001e-05 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10837 4.1b 4:dab1607f:::100000030fd.00000000:head [write 0~3145728] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.660621+0000", 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.066640042999999996, 2024-04-26T11:46:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027496229000000001, 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10837 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.660621+0000", 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.660621+0000", 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.660619+0000", 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.665297+0000", 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046770229999999998 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.665314+0000", 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7198999999999999e-05 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.665323+0000", 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7289999999999995e-06 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.665396+0000", 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3033000000000004e-05 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.666053+0000", 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065636100000000005 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.687936+0000", 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021883165999999999 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.688000+0000", 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3776999999999996e-05 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.688118+0000", 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117877 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10839 4.32 4:4d40c457:::100000030c0.00000002:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.665358+0000", 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.061903406000000001, 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028077477999999999, 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:35.835 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10839 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.665358+0000", 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.665358+0000", 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:35.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.665356+0000", 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.669635+0000", 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042792300000000002 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.669655+0000", 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9541000000000001e-05 2024-04-26T11:46:35.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.669668+0000", 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3657e-05 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.669806+0000", 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137377 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.670089+0000", 2024-04-26T11:46:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000283159 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.670382+0000", 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029319799999999999 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.682362+0000", 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011979392 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.693328+0000", 2024-04-26T11:46:35.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010966642 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.693368+0000", 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9651999999999999e-05 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.693436+0000", 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7662000000000004e-05 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:35.841 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:35.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:35.848 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:35.836+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:35.864 INFO:tasks.workunit.client.0.smithi029.stdout:5/67: read f0 [2514652,2135] 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:9/140: getdents d4 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:2/104: dread f7 [0,4194304] 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/68: dread d3/f7 [0,4194304] 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:8/95: symlink dc/de/l1d 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:1/63: dwrite d7/fa [0,4194304] 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:9/141: unlink d4/d5/f20 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:2/105: creat d12/f22 x:0 0 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:8/96: write f1 [1584077,21882] 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/69: truncate d3/d8/f12 2409643 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:9/142: mkdir d4/d5/d28 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:1/64: mkdir d7/db/d10 0 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:2/106: chown d12/f22 22 1 2024-04-26T11:46:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:6/61: dwrite d7/f12 [0,4194304] 0 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:1/65: dread - d7/f9 zero size 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:6/62: chown d7/l13 2 1 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:0/80: dread d9/f10 [0,4194304] 0 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:7/100: truncate d11/f19 320531 0 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:9/143: unlink d4/l10 0 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:4/70: unlink d3/d8/fa 0 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:3/74: dwrite d0/f1b [0,4194304] 0 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:1/66: unlink d7/l8 0 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:2/107: creat d12/f23 x:0 0 0 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:3/75: sync 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:9/144: dread - d4/f24 zero size 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:6/63: creat d7/f17 x:0 0 0 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:6/64: chown d7 66037 1 2024-04-26T11:46:35.866 INFO:tasks.workunit.client.0.smithi029.stdout:7/101: creat d11/d18/d1a/f23 x:0 0 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:0/81: symlink d9/d16/l19 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:5/68: dwrite db/de/f10 [0,4194304] 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:4/71: unlink d3/d8/db/f10 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:1/67: write f6 [1171007,130939] 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:7/102: symlink d11/d18/l24 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:0/82: read d9/ff [3311785,21566] 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:7/103: stat fc 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:6/65: getdents d7/d14 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:9/145: fsync d4/d5/d16/f19 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:3/76: rename d0/l11 to d0/l20 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:4/72: chown d3/d8/db/d13 1301009145 1 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:1/68: creat d7/db/d10/f11 x:0 0 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:8/97: dwrite f1 [4194304,4194304] 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:1/69: readlink l5 0 2024-04-26T11:46:35.867 INFO:tasks.workunit.client.0.smithi029.stdout:7/104: write d11/d18/f22 [440581,103394] 0 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:6/66: write d7/f17 [832217,114026] 0 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:9/146: stat d4/d5/f1a 0 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:5/69: getdents db/d12 0 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:6/67: symlink d7/l18 0 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:1/70: chown l5 431841396 1 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:4/73: creat d3/d8/db/d13/f18 x:0 0 0 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:5/70: write f4 [39662,81973] 0 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:6/68: chown d7/l13 0 1 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:7/105: getdents d11/d15 0 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:6/69: readlink d7/l13 0 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:7/106: dread - d11/f1e zero size 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:8/98: rename dc/d12/l14 to dc/de/d1a/l1e 0 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:7/107: mknod d11/c25 1 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:0/83: dread f3 [0,4194304] 0 2024-04-26T11:46:35.868 INFO:tasks.workunit.client.0.smithi029.stdout:2/108: dwrite d12/f21 [0,4194304] 0 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:7/108: read d11/d18/f22 [460192,23162] 0 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:2/109: read - d12/f19 zero size 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:7/109: chown fc 909 1 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:4/74: truncate d3/f5 2334212 0 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:8/99: mkdir dc/de/d1f 0 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:1/71: symlink d7/db/dc/df/l12 0 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:0/84: unlink d9/ff 0 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:2/110: mkdir d12/d24 0 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:8/100: write f5 [1390040,53682] 0 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:5/71: dwrite f5 [0,4194304] 0 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:3/77: write d0/d1/f8 [685788,45132] 0 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:6/70: dread d7/f12 [0,4194304] 0 2024-04-26T11:46:35.869 INFO:tasks.workunit.client.0.smithi029.stdout:8/101: write f5 [1567441,96657] 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:6/71: readlink d7/l13 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:9/147: dwrite d4/d5/d7/fc [0,4194304] 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:9/148: sync 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:5/72: dread f4 [0,4194304] 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:0/85: mkdir d9/d16/d1a 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:1/72: creat d7/db/d10/f13 x:0 0 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:6/72: mkdir d7/d19 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:8/102: creat dc/d12/f20 x:0 0 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:2/111: write d12/f1b [504548,115362] 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:7/110: getdents d11/d18/d1a 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:0/86: chown f5 1 1 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:8/103: write f0 [7009940,5512] 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:1/73: write d7/db/d10/f13 [576494,88591] 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:3/78: dread d0/f15 [0,4194304] 0 2024-04-26T11:46:35.870 INFO:tasks.workunit.client.0.smithi029.stdout:0/87: write d9/fa [1018965,98394] 0 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:2/112: creat d12/d24/f25 x:0 0 0 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:7/111: unlink d11/l14 0 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:3/79: chown d0/d1/d13/l19 320 1 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:9/149: dwrite d4/d5/f1a [0,4194304] 0 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:1/74: creat d7/db/f14 x:0 0 0 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:0/88: chown d9/d16/l19 5237617 1 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:7/112: truncate d11/f1e 175091 0 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:1/75: symlink d7/db/l15 0 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:0/89: rename d9/lb to d9/d16/d1a/l1b 0 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:0/90: sync 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:7/113: write fd [1789418,87422] 0 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:1/76: mknod d7/db/dc/c16 1 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:6/73: dwrite d7/f12 [0,4194304] 0 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:1/77: sync 2024-04-26T11:46:35.871 INFO:tasks.workunit.client.0.smithi029.stdout:0/91: symlink d9/l1c 0 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:0/92: sync 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:8/104: dwrite dc/d12/f20 [0,4194304] 0 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:6/74: dread - d7/fe zero size 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:0/93: dread - d9/f14 zero size 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:7/114: mkdir d11/d18/d1a/d26 0 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:7/115: chown d11/f1e 5 1 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:6/75: write f2 [767356,64813] 0 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:0/94: creat d9/f1d x:0 0 0 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:8/105: creat dc/de/d1b/f21 x:0 0 0 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:3/80: dwrite d0/d1/d13/f14 [0,4194304] 0 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:6/76: write f2 [2426661,5969] 0 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:6/77: write f2 [1363415,84194] 0 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:4/75: dread d3/f5 [0,4194304] 0 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:6/78: stat f2 0 2024-04-26T11:46:35.872 INFO:tasks.workunit.client.0.smithi029.stdout:6/79: stat l1 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:7/116: write d11/d18/f22 [4062067,66986] 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:8/106: rename dc/de/l17 to dc/de/d15/l22 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:3/81: chown d0/de/d1a 5763583 1 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:0/95: write d9/fc [806222,103014] 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:1/78: link d7/db/dc/ld d7/db/l17 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:9/150: write d4/d5/d7/ff [4465406,114895] 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:9/151: sync 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:2/113: truncate d12/f1c 1017233 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:3/82: fsync d0/d1/f16 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:9/152: symlink d4/d5/l29 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:7/117: getdents d11 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:6/80: dwrite d7/fe [0,4194304] 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:1/79: getdents d7/db/d10 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:9/153: fdatasync d4/f24 0 2024-04-26T11:46:35.873 INFO:tasks.workunit.client.0.smithi029.stdout:2/114: truncate d12/f19 726031 0 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:2/115: chown d12/l13 21 1 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:4/76: dwrite d3/d8/db/d13/f18 [0,4194304] 0 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:2/116: creat d12/f26 x:0 0 0 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:8/107: rename dc/de/d1b to dc/de/d1a/d23 0 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:9/154: dread - d4/f24 zero size 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:4/77: chown d3/d8/lc 20014311 1 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:7/118: link d11/d18/f22 d11/d18/f27 0 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:9/155: fsync d4/d5/d7/f11 0 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:2/117: creat d12/d24/f27 x:0 0 0 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:7/119: unlink fd 0 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:6/81: dread f2 [0,4194304] 0 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:4/78: fdatasync d3/d8/f12 0 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:5/73: fsync f5 0 2024-04-26T11:46:35.874 INFO:tasks.workunit.client.0.smithi029.stdout:8/108: mkdir dc/de/d1f/d24 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:2/118: write d12/f26 [1031425,114131] 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:9/156: chown d4/d5/d16/l1b 1331 1 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:7/120: symlink d11/d15/l28 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:8/109: symlink dc/de/l25 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:9/157: symlink d4/d5/d16/l2a 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:1/80: dwrite d7/fa [0,4194304] 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:5/74: write db/de/f13 [786695,22976] 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:6/82: rmdir d7/d14 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:6/83: stat d7/lc 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:8/110: truncate dc/f11 1681393 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:0/96: creat d9/f1e x:0 0 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:5/75: write db/de/f11 [678000,123738] 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:4/79: dread d3/f14 [0,4194304] 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:6/84: readlink d7/l13 0 2024-04-26T11:46:35.875 INFO:tasks.workunit.client.0.smithi029.stdout:0/97: dread - d9/f1d zero size 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:6/85: chown d7 32809798 1 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:5/76: truncate f4 654606 0 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:5/77: chown db 14 1 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:3/83: dwrite d0/de/d1a/f1d [0,4194304] 0 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:5/78: mknod db/de/c17 1 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:9/158: truncate d4/f1d 1908702 0 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:8/111: mkdir dc/de/d26 0 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:6/86: rename d7/f17 to d7/f1a 0 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:3/84: write d0/d1/d13/f14 [5176432,27721] 0 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:6/87: mknod d7/c1b 1 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:7/121: dwrite d11/f1e [0,4194304] 0 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:5/79: write f7 [788675,119998] 0 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:4/80: write d3/f14 [3758665,90859] 0 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:7/122: read - d11/d18/d1a/f23 zero size 2024-04-26T11:46:35.876 INFO:tasks.workunit.client.0.smithi029.stdout:5/80: write f7 [714214,30829] 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:8/112: rename dc/de/d1f to dc/de/d1a/d23/d27 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:0/98: dread f5 [0,4194304] 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:4/81: creat d3/d8/f19 x:0 0 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:1/81: dwrite d7/f9 [0,4194304] 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:7/123: chown d11/d18/d1a/f23 27 1 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:6/88: rename f2 to d7/f1c 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:3/85: rename d0 to d0/dc/d21 22 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:2/119: dread d12/f1c [0,4194304] 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:7/124: chown d11/f19 9136385 1 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:2/120: fdatasync f6 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:4/82: mkdir d3/d8/d11/d1a 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:3/86: symlink d0/dc/l22 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:6/89: write d7/f1c [2017883,59611] 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:1/82: creat d7/db/dc/df/f18 x:0 0 0 2024-04-26T11:46:35.877 INFO:tasks.workunit.client.0.smithi029.stdout:2/121: creat d12/f28 x:0 0 0 2024-04-26T11:46:35.878 INFO:tasks.workunit.client.0.smithi029.stdout:6/90: mknod d7/d19/c1d 1 2024-04-26T11:46:35.878 INFO:tasks.workunit.client.0.smithi029.stdout:7/125: dread d11/f19 [0,4194304] 0 2024-04-26T11:46:35.878 INFO:tasks.workunit.client.0.smithi029.stdout:4/83: symlink d3/d8/d11/d1a/l1b 0 2024-04-26T11:46:35.878 INFO:tasks.workunit.client.0.smithi029.stdout:2/122: fdatasync d12/f1e 0 2024-04-26T11:46:35.878 INFO:tasks.workunit.client.0.smithi029.stdout:1/83: mknod d7/db/dc/df/c19 1 2024-04-26T11:46:35.878 INFO:tasks.workunit.client.0.smithi029.stdout:6/91: creat d7/d19/f1e x:0 0 0 2024-04-26T11:46:35.878 INFO:tasks.workunit.client.0.smithi029.stdout:4/84: unlink d3/d8/f19 0 2024-04-26T11:46:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:6/92: write d7/f1c [2526880,72470] 0 2024-04-26T11:46:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:9/159: truncate d4/d5/f1a 3568875 0 2024-04-26T11:46:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:7/126: fdatasync d11/f1e 0 2024-04-26T11:46:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:5/81: dwrite f0 [4194304,4194304] 0 2024-04-26T11:46:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:4/85: write d3/f14 [1432684,121978] 0 2024-04-26T11:46:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:0/99: dwrite d9/f18 [0,4194304] 0 2024-04-26T11:46:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:8/113: dread dc/f11 [0,4194304] 0 2024-04-26T11:46:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:3/87: truncate d0/d1/f16 892036 0 2024-04-26T11:46:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:4/86: read d3/f14 [2990384,73260] 0 2024-04-26T11:46:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:1/84: truncate d7/f9 2274599 0 2024-04-26T11:46:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:6/93: rename d7/l18 to d7/d19/l1f 0 2024-04-26T11:46:35.881 INFO:tasks.workunit.client.0.smithi029.stdout:5/82: creat db/de/f18 x:0 0 0 2024-04-26T11:46:35.881 INFO:tasks.workunit.client.0.smithi029.stdout:8/114: chown dc/de/l1d 915679 1 2024-04-26T11:46:35.881 INFO:tasks.workunit.client.0.smithi029.stdout:7/127: creat d11/d18/f29 x:0 0 0 2024-04-26T11:46:35.881 INFO:tasks.workunit.client.0.smithi029.stdout:7/128: fsync d11/f17 0 2024-04-26T11:46:35.882 INFO:tasks.workunit.client.0.smithi029.stdout:9/160: symlink d4/d5/d28/l2b 0 2024-04-26T11:46:35.882 INFO:tasks.workunit.client.0.smithi029.stdout:3/88: creat d0/dc/f23 x:0 0 0 2024-04-26T11:46:35.883 INFO:tasks.workunit.client.0.smithi029.stdout:1/85: symlink d7/db/d10/l1a 0 2024-04-26T11:46:35.883 INFO:tasks.workunit.client.0.smithi029.stdout:5/83: chown db/de/f16 6 1 2024-04-26T11:46:35.883 INFO:tasks.workunit.client.0.smithi029.stdout:9/161: stat d4/d5/d7 0 2024-04-26T11:46:35.883 INFO:tasks.workunit.client.0.smithi029.stdout:1/86: readlink d7/db/l15 0 2024-04-26T11:46:35.883 INFO:tasks.workunit.client.0.smithi029.stdout:2/123: dwrite f6 [4194304,4194304] 0 2024-04-26T11:46:35.883 INFO:tasks.workunit.client.0.smithi029.stdout:0/100: rename d9/l1c to d9/l1f 0 2024-04-26T11:46:35.883 INFO:tasks.workunit.client.0.smithi029.stdout:7/129: link d11/f17 d11/d15/f2a 0 2024-04-26T11:46:35.883 INFO:tasks.workunit.client.0.smithi029.stdout:1/87: unlink d7/f9 0 2024-04-26T11:46:35.883 INFO:tasks.workunit.client.0.smithi029.stdout:3/89: symlink d0/l24 0 2024-04-26T11:46:35.884 INFO:tasks.workunit.client.0.smithi029.stdout:2/124: mkdir d12/d24/d29 0 2024-04-26T11:46:35.884 INFO:tasks.workunit.client.0.smithi029.stdout:2/125: sync 2024-04-26T11:46:35.885 INFO:tasks.workunit.client.0.smithi029.stdout:0/101: fsync d9/fe 0 2024-04-26T11:46:35.886 INFO:tasks.workunit.client.0.smithi029.stdout:7/130: sync 2024-04-26T11:46:35.886 INFO:tasks.workunit.client.0.smithi029.stdout:9/162: mknod d4/d5/d28/c2c 1 2024-04-26T11:46:35.890 INFO:tasks.workunit.client.0.smithi029.stdout:3/90: mkdir d0/dc/d1f/d25 0 2024-04-26T11:46:35.892 INFO:tasks.workunit.client.0.smithi029.stdout:4/87: dread d3/d8/db/d13/f18 [0,4194304] 0 2024-04-26T11:46:35.893 INFO:tasks.workunit.client.0.smithi029.stdout:0/102: creat d9/f20 x:0 0 0 2024-04-26T11:46:35.895 INFO:tasks.workunit.client.0.smithi029.stdout:8/115: dwrite f0 [8388608,4194304] 0 2024-04-26T11:46:35.896 INFO:tasks.workunit.client.0.smithi029.stdout:6/94: dwrite d7/d19/f1e [0,4194304] 0 2024-04-26T11:46:35.899 INFO:tasks.workunit.client.0.smithi029.stdout:1/88: dread d7/fa [0,4194304] 0 2024-04-26T11:46:35.902 INFO:tasks.workunit.client.0.smithi029.stdout:5/84: dwrite f8 [0,4194304] 0 2024-04-26T11:46:35.902 INFO:tasks.workunit.client.0.smithi029.stdout:7/131: dread f9 [4194304,4194304] 0 2024-04-26T11:46:35.903 INFO:tasks.workunit.client.0.smithi029.stdout:3/91: link d0/l24 d0/de/l26 0 2024-04-26T11:46:35.904 INFO:tasks.workunit.client.0.smithi029.stdout:8/116: creat dc/f28 x:0 0 0 2024-04-26T11:46:35.904 INFO:tasks.workunit.client.0.smithi029.stdout:5/85: readlink db/d12/l15 0 2024-04-26T11:46:35.905 INFO:tasks.workunit.client.0.smithi029.stdout:9/163: dwrite d4/d5/d7/ff [0,4194304] 0 2024-04-26T11:46:35.905 INFO:tasks.workunit.client.0.smithi029.stdout:2/126: dwrite d12/f1d [0,4194304] 0 2024-04-26T11:46:35.905 INFO:tasks.workunit.client.0.smithi029.stdout:7/132: mknod d11/d18/d1a/d26/c2b 1 2024-04-26T11:46:35.905 INFO:tasks.workunit.client.0.smithi029.stdout:1/89: write d7/db/f14 [918780,16676] 0 2024-04-26T11:46:35.905 INFO:tasks.workunit.client.0.smithi029.stdout:8/117: chown dc/de/d26 2 1 2024-04-26T11:46:35.908 INFO:tasks.workunit.client.0.smithi029.stdout:1/90: chown d7/db/dc/df 102 1 2024-04-26T11:46:35.908 INFO:tasks.workunit.client.0.smithi029.stdout:1/91: sync 2024-04-26T11:46:35.908 INFO:tasks.workunit.client.0.smithi029.stdout:2/127: write d12/f21 [4813851,82285] 0 2024-04-26T11:46:35.908 INFO:tasks.workunit.client.0.smithi029.stdout:6/95: dread d7/f1c [0,4194304] 0 2024-04-26T11:46:35.908 INFO:tasks.workunit.client.0.smithi029.stdout:7/133: write f9 [6013739,18819] 0 2024-04-26T11:46:35.909 INFO:tasks.workunit.client.0.smithi029.stdout:9/164: truncate d4/d5/d16/f19 1155607 0 2024-04-26T11:46:35.909 INFO:tasks.workunit.client.0.smithi029.stdout:0/103: dread d9/f10 [0,4194304] 0 2024-04-26T11:46:35.909 INFO:tasks.workunit.client.0.smithi029.stdout:1/92: symlink d7/db/dc/l1b 0 2024-04-26T11:46:35.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/134: fdatasync d11/f13 0 2024-04-26T11:46:35.911 INFO:tasks.workunit.client.0.smithi029.stdout:6/96: mkdir d7/d20 0 2024-04-26T11:46:35.912 INFO:tasks.workunit.client.0.smithi029.stdout:9/165: mkdir d4/d5/d28/d2d 0 2024-04-26T11:46:35.913 INFO:tasks.workunit.client.0.smithi029.stdout:7/135: stat d11/d15/f2a 0 2024-04-26T11:46:35.914 INFO:tasks.workunit.client.0.smithi029.stdout:9/166: rmdir d4/d5/d16 39 2024-04-26T11:46:35.915 INFO:tasks.workunit.client.0.smithi029.stdout:5/86: dread f0 [0,4194304] 0 2024-04-26T11:46:35.915 INFO:tasks.workunit.client.0.smithi029.stdout:4/88: write d3/f5 [2223904,13096] 0 2024-04-26T11:46:35.915 INFO:tasks.workunit.client.0.smithi029.stdout:0/104: unlink d9/d16/d1a/l1b 0 2024-04-26T11:46:35.915 INFO:tasks.workunit.client.0.smithi029.stdout:4/89: stat d3/d8/d11 0 2024-04-26T11:46:35.916 INFO:tasks.workunit.client.0.smithi029.stdout:7/136: creat d11/d18/d1a/d26/f2c x:0 0 0 2024-04-26T11:46:35.917 INFO:tasks.workunit.client.0.smithi029.stdout:9/167: read d4/f1d [428099,85618] 0 2024-04-26T11:46:35.917 INFO:tasks.workunit.client.0.smithi029.stdout:0/105: creat d9/d16/f21 x:0 0 0 2024-04-26T11:46:35.918 INFO:tasks.workunit.client.0.smithi029.stdout:0/106: creat d9/d16/f22 x:0 0 0 2024-04-26T11:46:35.919 INFO:tasks.workunit.client.0.smithi029.stdout:4/90: write d3/d8/db/d13/f18 [1746236,66472] 0 2024-04-26T11:46:35.919 INFO:tasks.workunit.client.0.smithi029.stdout:6/97: dread d7/f1c [0,4194304] 0 2024-04-26T11:46:35.919 INFO:tasks.workunit.client.0.smithi029.stdout:9/168: creat d4/d5/f2e x:0 0 0 2024-04-26T11:46:35.920 INFO:tasks.workunit.client.0.smithi029.stdout:8/118: dwrite dc/f28 [0,4194304] 0 2024-04-26T11:46:35.920 INFO:tasks.workunit.client.0.smithi029.stdout:9/169: readlink d4/d5/l22 0 2024-04-26T11:46:35.923 INFO:tasks.workunit.client.0.smithi029.stdout:8/119: write f0 [10380732,96348] 0 2024-04-26T11:46:35.923 INFO:tasks.workunit.client.0.smithi029.stdout:6/98: symlink d7/d20/l21 0 2024-04-26T11:46:35.924 INFO:tasks.workunit.client.0.smithi029.stdout:4/91: symlink d3/d9/l1c 0 2024-04-26T11:46:35.924 INFO:tasks.workunit.client.0.smithi029.stdout:9/170: stat d4/d5/d16/l2a 0 2024-04-26T11:46:35.924 INFO:tasks.workunit.client.0.smithi029.stdout:8/120: stat dc/d12/f20 0 2024-04-26T11:46:35.925 INFO:tasks.workunit.client.0.smithi029.stdout:4/92: chown d3/d9/l1c 621 1 2024-04-26T11:46:35.925 INFO:tasks.workunit.client.0.smithi029.stdout:8/121: fdatasync f5 0 2024-04-26T11:46:35.925 INFO:tasks.workunit.client.0.smithi029.stdout:6/99: creat d7/f22 x:0 0 0 2024-04-26T11:46:35.925 INFO:tasks.workunit.client.0.smithi029.stdout:6/100: chown d7 127172664 1 2024-04-26T11:46:35.925 INFO:tasks.workunit.client.0.smithi029.stdout:9/171: symlink d4/d5/d7/l2f 0 2024-04-26T11:46:35.926 INFO:tasks.workunit.client.0.smithi029.stdout:5/87: dread db/de/f11 [0,4194304] 0 2024-04-26T11:46:35.926 INFO:tasks.workunit.client.0.smithi029.stdout:9/172: dread - d4/d5/f2e zero size 2024-04-26T11:46:35.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/173: mknod d4/c30 1 2024-04-26T11:46:35.927 INFO:tasks.workunit.client.0.smithi029.stdout:5/88: creat db/de/f19 x:0 0 0 2024-04-26T11:46:35.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/174: readlink d4/d5/d7/l2f 0 2024-04-26T11:46:35.929 INFO:tasks.workunit.client.0.smithi029.stdout:2/128: truncate d12/f19 291340 0 2024-04-26T11:46:35.932 INFO:tasks.workunit.client.0.smithi029.stdout:8/122: dread f1 [0,4194304] 0 2024-04-26T11:46:35.932 INFO:tasks.workunit.client.0.smithi029.stdout:6/101: dread d7/f12 [0,4194304] 0 2024-04-26T11:46:35.934 INFO:tasks.workunit.client.0.smithi029.stdout:4/93: dread d3/d8/db/d13/f18 [0,4194304] 0 2024-04-26T11:46:35.936 INFO:tasks.workunit.client.0.smithi029.stdout:1/93: truncate d7/db/d10/f13 157898 0 2024-04-26T11:46:35.938 INFO:tasks.workunit.client.0.smithi029.stdout:9/175: dread d4/d5/f6 [0,4194304] 0 2024-04-26T11:46:35.940 INFO:tasks.workunit.client.0.smithi029.stdout:3/92: dwrite d0/de/d1a/f1d [0,4194304] 0 2024-04-26T11:46:35.941 INFO:tasks.workunit.client.0.smithi029.stdout:5/89: rename db/de to db/d12/d1a 0 2024-04-26T11:46:35.942 INFO:tasks.workunit.client.0.smithi029.stdout:9/176: read - d4/f24 zero size 2024-04-26T11:46:35.942 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:35.941+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:35.943 INFO:tasks.workunit.client.0.smithi029.stdout:1/94: truncate d7/db/d10/f11 240555 0 2024-04-26T11:46:35.946 INFO:tasks.workunit.client.0.smithi029.stdout:6/102: truncate d7/d19/f1e 3863060 0 2024-04-26T11:46:35.949 INFO:tasks.workunit.client.0.smithi029.stdout:5/90: creat db/d12/f1b x:0 0 0 2024-04-26T11:46:35.949 INFO:tasks.workunit.client.0.smithi029.stdout:9/177: symlink d4/d5/d7/l31 0 2024-04-26T11:46:35.950 INFO:tasks.workunit.client.0.smithi029.stdout:4/94: getdents d3/d8/db 0 2024-04-26T11:46:35.950 INFO:tasks.workunit.client.0.smithi029.stdout:1/95: write d7/db/dc/df/f18 [471349,26385] 0 2024-04-26T11:46:35.951 INFO:tasks.workunit.client.0.smithi029.stdout:4/95: sync 2024-04-26T11:46:35.952 INFO:tasks.workunit.client.0.smithi029.stdout:6/103: creat d7/f23 x:0 0 0 2024-04-26T11:46:35.953 INFO:tasks.workunit.client.0.smithi029.stdout:0/107: dwrite d9/fe [0,4194304] 0 2024-04-26T11:46:35.953 INFO:tasks.workunit.client.0.smithi029.stdout:3/93: getdents d0/de 0 2024-04-26T11:46:35.953 INFO:tasks.workunit.client.0.smithi029.stdout:7/137: dwrite d11/d15/f2a [0,4194304] 0 2024-04-26T11:46:35.954 INFO:tasks.workunit.client.0.smithi029.stdout:9/178: fdatasync d4/d5/d16/f19 0 2024-04-26T11:46:35.954 INFO:tasks.workunit.client.0.smithi029.stdout:1/96: write f6 [982190,72397] 0 2024-04-26T11:46:35.955 INFO:tasks.workunit.client.0.smithi029.stdout:7/138: mkdir d11/d18/d2d 0 2024-04-26T11:46:35.956 INFO:tasks.workunit.client.0.smithi029.stdout:6/104: read d7/f12 [2488018,34868] 0 2024-04-26T11:46:35.956 INFO:tasks.workunit.client.0.smithi029.stdout:2/129: dwrite d12/f19 [0,4194304] 0 2024-04-26T11:46:35.958 INFO:tasks.workunit.client.0.smithi029.stdout:8/123: dwrite f5 [0,4194304] 0 2024-04-26T11:46:35.958 INFO:tasks.workunit.client.0.smithi029.stdout:9/179: mknod d4/d5/c32 1 2024-04-26T11:46:35.959 INFO:tasks.workunit.client.0.smithi029.stdout:0/108: creat d9/f23 x:0 0 0 2024-04-26T11:46:35.959 INFO:tasks.workunit.client.0.smithi029.stdout:1/97: creat d7/f1c x:0 0 0 2024-04-26T11:46:35.959 INFO:tasks.workunit.client.0.smithi029.stdout:5/91: rename db/d12/d1a/f11 to db/f1c 0 2024-04-26T11:46:35.959 INFO:tasks.workunit.client.0.smithi029.stdout:4/96: rename d3/d8 to d3/d1d 0 2024-04-26T11:46:35.959 INFO:tasks.workunit.client.0.smithi029.stdout:9/180: write d4/d5/d16/f1c [163592,32930] 0 2024-04-26T11:46:35.960 INFO:tasks.workunit.client.0.smithi029.stdout:7/139: rmdir d11/d18/d1a/d26 39 2024-04-26T11:46:35.960 INFO:tasks.workunit.client.0.smithi029.stdout:2/130: creat d12/f2a x:0 0 0 2024-04-26T11:46:35.961 INFO:tasks.workunit.client.0.smithi029.stdout:5/92: fsync f0 0 2024-04-26T11:46:35.962 INFO:tasks.workunit.client.0.smithi029.stdout:0/109: readlink d9/l15 0 2024-04-26T11:46:35.962 INFO:tasks.workunit.client.0.smithi029.stdout:7/140: write d11/d18/d1a/f23 [584933,62834] 0 2024-04-26T11:46:35.963 INFO:tasks.workunit.client.0.smithi029.stdout:8/124: rename dc/f28 to dc/de/f29 0 2024-04-26T11:46:35.964 INFO:tasks.workunit.client.0.smithi029.stdout:2/131: symlink d12/l2b 0 2024-04-26T11:46:35.965 INFO:tasks.workunit.client.0.smithi029.stdout:5/93: symlink db/d12/l1d 0 2024-04-26T11:46:35.965 INFO:tasks.workunit.client.0.smithi029.stdout:2/132: dread - d12/f28 zero size 2024-04-26T11:46:35.966 INFO:tasks.workunit.client.0.smithi029.stdout:9/181: rename d4/d5/f2e to d4/d5/f33 0 2024-04-26T11:46:35.967 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:35.967 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:35.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.967 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4541.0:10969 4.32 e58/17 4:4ff1f6b2:::10000003119.00000000:head v 58'185, mlcod=58'183)", 2024-04-26T11:46:35.967 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.953774+0000", 2024-04-26T11:46:35.967 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013783393999999999, 2024-04-26T11:46:35.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013819813, 2024-04-26T11:46:35.967 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.967 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.953774+0000", 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.953774+0000", 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.953773+0000", 2024-04-26T11:46:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.957046+0000", 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00327319 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.957065+0000", 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8546000000000002e-05 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.957076+0000", 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1411e-05 2024-04-26T11:46:35.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.957145+0000", 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8582000000000002e-05 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.957169+0000", 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4377999999999999e-05 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10975 4.3f 4:fc0d2b13:::10000003140.00000000:head [write 0~4194304 [2@291340] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.959608+0000", 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0079493440000000005, 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0081009210000000005, 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10975 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.959608+0000", 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.959608+0000", 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.959607+0000", 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965040+0000", 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054322479999999998 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965054+0000", 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4025e-05 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965063+0000", 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9549999999999998e-06 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965159+0000", 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6522999999999997e-05 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965279+0000", 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012024200000000001 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:617 3.0 3:07a02702:::200.0000000c:head [write 2678399~5872 [fadvise_dontneed] in=5872b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-26T11:46:35.974 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.965239+0000", 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0023188919999999999, 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025915080000000002, 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965239+0000", 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965239+0000", 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965238+0000", 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965247+0000", 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3470000000000005e-06 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965255+0000", 2024-04-26T11:46:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5100000000000001e-06 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965259+0000", 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5090000000000004e-06 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965307+0000", 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7474e-05 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965399+0000", 2024-04-26T11:46:35.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1872000000000004e-05 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965527+0000", 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012861700000000001 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4541.0:10973 4.32 e58/17 4:4ff1f6b2:::10000003119.00000000:head v 58'186, mlcod=58'183)", 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.963087+0000", 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.004470244, 2024-04-26T11:46:35.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048484089999999997, 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.963087+0000", 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.963087+0000", 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.963087+0000", 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965907+0000", 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002819841 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965918+0000", 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.165e-05 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965926+0000", 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4089999999999997e-06 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.965994+0000", 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7817000000000005e-05 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.966034+0000", 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0404999999999997e-05 2024-04-26T11:46:35.981 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.982 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:35.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:35.982 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:46:35.982 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 4 2024-04-26T11:46:35.982 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:35.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:35.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/133: write d12/f2a [317340,83388] 0 2024-04-26T11:46:35.987 INFO:tasks.workunit.client.0.smithi029.stdout:4/97: dread d3/f14 [0,4194304] 0 2024-04-26T11:46:35.987 INFO:tasks.workunit.client.0.smithi029.stdout:9/182: creat d4/d5/d16/f34 x:0 0 0 2024-04-26T11:46:35.987 INFO:tasks.workunit.client.0.smithi029.stdout:4/98: sync 2024-04-26T11:46:35.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/134: mknod d12/d24/d29/c2c 1 2024-04-26T11:46:35.987 INFO:tasks.workunit.client.0.smithi029.stdout:1/98: dread d7/db/d10/f11 [0,4194304] 0 2024-04-26T11:46:35.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/135: mknod d12/d24/c2d 1 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:2/136: sync 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:2/137: sync 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:2/138: sync 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:7/141: dread f9 [4194304,4194304] 0 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:4/99: creat d3/f1e x:0 0 0 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:2/139: fdatasync d12/f26 0 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:6/105: dwrite d7/f1c [0,4194304] 0 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:3/94: truncate d0/d1/d13/f14 44699 0 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:8/125: getdents dc/de 0 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:1/99: creat d7/db/f1d x:0 0 0 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:5/94: dread f8 [0,4194304] 0 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:6/106: write d7/fe [4646134,3545] 0 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:7/142: symlink d11/d18/d1a/d26/l2e 0 2024-04-26T11:46:35.988 INFO:tasks.workunit.client.0.smithi029.stdout:4/100: chown d3/d1d/d11/d1a/l1b 4087 1 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:2/140: truncate d12/f23 811384 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:7/143: readlink d11/d18/l1d 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:8/126: rename dc/f13 to dc/de/d1a/f2a 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:0/110: dwrite d9/fc [0,4194304] 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:2/141: mknod d12/d24/c2e 1 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:3/95: creat d0/f27 x:0 0 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:1/100: truncate d7/f1c 13342 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:7/144: stat d11/d18 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:4/101: rename d3/d9 to d3/d1d/d11/d16/d1f 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:8/127: read dc/de/f29 [1175239,129364] 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:0/111: creat d9/d16/f24 x:0 0 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:6/107: getdents d7 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:9/183: dwrite d4/d5/fd [4194304,4194304] 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:3/96: write d0/d1/f8 [727058,69787] 0 2024-04-26T11:46:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:0/112: chown d9/f10 1158732064 1 2024-04-26T11:46:35.990 INFO:tasks.workunit.client.0.smithi029.stdout:8/128: creat dc/de/f2b x:0 0 0 2024-04-26T11:46:35.990 INFO:tasks.workunit.client.0.smithi029.stdout:7/145: mkdir d11/d18/d1a/d2f 0 2024-04-26T11:46:35.990 INFO:tasks.workunit.client.0.smithi029.stdout:6/108: creat d7/d19/f24 x:0 0 0 2024-04-26T11:46:35.990 INFO:tasks.workunit.client.0.smithi029.stdout:6/109: fdatasync d7/f23 0 2024-04-26T11:46:35.991 INFO:tasks.workunit.client.0.smithi029.stdout:1/101: getdents d7/db/d10 0 2024-04-26T11:46:35.991 INFO:tasks.workunit.client.0.smithi029.stdout:8/129: write dc/d12/f20 [469508,29703] 0 2024-04-26T11:46:35.991 INFO:tasks.workunit.client.0.smithi029.stdout:3/97: symlink d0/de/d1a/l28 0 2024-04-26T11:46:35.991 INFO:tasks.workunit.client.0.smithi029.stdout:5/95: dread f8 [0,4194304] 0 2024-04-26T11:46:35.991 INFO:tasks.workunit.client.0.smithi029.stdout:6/110: mkdir d7/d25 0 2024-04-26T11:46:35.998 INFO:tasks.workunit.client.0.smithi029.stdout:4/102: dread d3/f14 [0,4194304] 0 2024-04-26T11:46:35.999 INFO:tasks.workunit.client.0.smithi029.stdout:9/184: rename d4/d5/f1a to d4/d5/d7/f35 0 2024-04-26T11:46:36.001 INFO:tasks.workunit.client.0.smithi029.stdout:2/142: dwrite d12/f1d [4194304,4194304] 0 2024-04-26T11:46:36.002 INFO:tasks.workunit.client.0.smithi029.stdout:3/98: unlink d0/d1/f8 0 2024-04-26T11:46:36.003 INFO:tasks.workunit.client.0.smithi029.stdout:0/113: dwrite d9/f10 [0,4194304] 0 2024-04-26T11:46:36.006 INFO:tasks.workunit.client.0.smithi029.stdout:2/143: rmdir d12 39 2024-04-26T11:46:36.007 INFO:tasks.workunit.client.0.smithi029.stdout:1/102: dwrite d7/f1c [0,4194304] 0 2024-04-26T11:46:36.008 INFO:tasks.workunit.client.0.smithi029.stdout:8/130: dread f0 [0,4194304] 0 2024-04-26T11:46:36.009 INFO:tasks.workunit.client.0.smithi029.stdout:7/146: dwrite d11/d15/f2a [4194304,4194304] 0 2024-04-26T11:46:36.009 INFO:tasks.workunit.client.0.smithi029.stdout:3/99: rmdir d0/de 39 2024-04-26T11:46:36.009 INFO:tasks.workunit.client.0.smithi029.stdout:6/111: link d7/lc d7/d25/l26 0 2024-04-26T11:46:36.009 INFO:tasks.workunit.client.0.smithi029.stdout:0/114: mkdir d9/d16/d25 0 2024-04-26T11:46:36.010 INFO:tasks.workunit.client.0.smithi029.stdout:5/96: dread f0 [4194304,4194304] 0 2024-04-26T11:46:36.010 INFO:tasks.workunit.client.0.smithi029.stdout:8/131: symlink dc/de/d15/l2c 0 2024-04-26T11:46:36.011 INFO:tasks.workunit.client.0.smithi029.stdout:0/115: chown d9/d16/f24 36 1 2024-04-26T11:46:36.013 INFO:tasks.workunit.client.0.smithi029.stdout:4/103: dread d3/f5 [0,4194304] 0 2024-04-26T11:46:36.014 INFO:tasks.workunit.client.0.smithi029.stdout:1/103: mkdir d7/db/d10/d1e 0 2024-04-26T11:46:36.014 INFO:tasks.workunit.client.0.smithi029.stdout:7/147: write d11/d18/f29 [658692,99411] 0 2024-04-26T11:46:36.014 INFO:tasks.workunit.client.0.smithi029.stdout:4/104: fdatasync d3/f5 0 2024-04-26T11:46:36.014 INFO:tasks.workunit.client.0.smithi029.stdout:1/104: creat d7/db/dc/f1f x:0 0 0 2024-04-26T11:46:36.014 INFO:tasks.workunit.client.0.smithi029.stdout:7/148: write d11/f13 [2552511,119099] 0 2024-04-26T11:46:36.016 INFO:tasks.workunit.client.0.smithi029.stdout:8/132: creat dc/de/d1a/d23/d27/d24/f2d x:0 0 0 2024-04-26T11:46:36.018 INFO:tasks.workunit.client.0.smithi029.stdout:4/105: truncate d3/f1e 804609 0 2024-04-26T11:46:36.018 INFO:tasks.workunit.client.0.smithi029.stdout:9/185: getdents d4/d5 0 2024-04-26T11:46:36.019 INFO:tasks.workunit.client.0.smithi029.stdout:2/144: dread f6 [0,4194304] 0 2024-04-26T11:46:36.020 INFO:tasks.workunit.client.0.smithi029.stdout:9/186: creat d4/d5/d7/f36 x:0 0 0 2024-04-26T11:46:36.020 INFO:tasks.workunit.client.0.smithi029.stdout:5/97: creat db/f1e x:0 0 0 2024-04-26T11:46:36.021 INFO:tasks.workunit.client.0.smithi029.stdout:4/106: link d3/d1d/lc d3/d1d/l20 0 2024-04-26T11:46:36.022 INFO:tasks.workunit.client.0.smithi029.stdout:2/145: write d12/f22 [957507,19414] 0 2024-04-26T11:46:36.022 INFO:tasks.workunit.client.0.smithi029.stdout:5/98: mkdir db/d12/d1f 0 2024-04-26T11:46:36.023 INFO:tasks.workunit.client.0.smithi029.stdout:3/100: dwrite d0/f27 [0,4194304] 0 2024-04-26T11:46:36.023 INFO:tasks.workunit.client.0.smithi029.stdout:4/107: readlink d3/d1d/d11/d1a/l1b 0 2024-04-26T11:46:36.024 INFO:tasks.workunit.client.0.smithi029.stdout:2/146: write d12/d24/f27 [657816,93493] 0 2024-04-26T11:46:36.024 INFO:tasks.workunit.client.0.smithi029.stdout:3/101: chown d0/d1/f16 113780 1 2024-04-26T11:46:36.025 INFO:tasks.workunit.client.0.smithi029.stdout:5/99: truncate db/d12/f1b 66324 0 2024-04-26T11:46:36.026 INFO:tasks.workunit.client.0.smithi029.stdout:4/108: dread d3/f1e [0,4194304] 0 2024-04-26T11:46:36.028 INFO:tasks.workunit.client.0.smithi029.stdout:7/149: dwrite f9 [0,4194304] 0 2024-04-26T11:46:36.028 INFO:tasks.workunit.client.0.smithi029.stdout:5/100: chown db/d12/l15 17628843 1 2024-04-26T11:46:36.029 INFO:tasks.workunit.client.0.smithi029.stdout:8/133: rename dc/de/d1a to dc/de/d2e 0 2024-04-26T11:46:36.029 INFO:tasks.workunit.client.0.smithi029.stdout:6/112: sync 2024-04-26T11:46:36.030 INFO:tasks.workunit.client.0.smithi029.stdout:1/105: dread d7/db/dc/df/f18 [0,4194304] 0 2024-04-26T11:46:36.030 INFO:tasks.workunit.client.0.smithi029.stdout:5/101: readlink db/d12/l1d 0 2024-04-26T11:46:36.031 INFO:tasks.workunit.client.0.smithi029.stdout:3/102: link d0/de/d1a/l28 d0/d1/d13/l29 0 2024-04-26T11:46:36.031 INFO:tasks.workunit.client.0.smithi029.stdout:8/134: readlink dc/de/d15/l22 0 2024-04-26T11:46:36.033 INFO:tasks.workunit.client.0.smithi029.stdout:5/102: write f0 [3237611,40335] 0 2024-04-26T11:46:36.033 INFO:tasks.workunit.client.0.smithi029.stdout:3/103: chown d0/d1e 284 1 2024-04-26T11:46:36.033 INFO:tasks.workunit.client.0.smithi029.stdout:6/113: mkdir d7/d20/d27 0 2024-04-26T11:46:36.035 INFO:tasks.workunit.client.0.smithi029.stdout:4/109: dread d3/f5 [0,4194304] 0 2024-04-26T11:46:36.035 INFO:tasks.workunit.client.0.smithi029.stdout:9/187: dwrite d4/d5/d7/f36 [0,4194304] 0 2024-04-26T11:46:36.035 INFO:tasks.workunit.client.0.smithi029.stdout:3/104: rmdir d0/dc/d1f 39 2024-04-26T11:46:36.035 INFO:tasks.workunit.client.0.smithi029.stdout:6/114: fsync d7/f11 0 2024-04-26T11:46:36.035 INFO:tasks.workunit.client.0.smithi029.stdout:5/103: creat db/f20 x:0 0 0 2024-04-26T11:46:36.035 INFO:tasks.workunit.client.0.smithi029.stdout:9/188: mknod d4/d5/d28/c37 1 2024-04-26T11:46:36.036 INFO:tasks.workunit.client.0.smithi029.stdout:3/105: read d0/d1/f16 [2539315,10638] 0 2024-04-26T11:46:36.036 INFO:tasks.workunit.client.0.smithi029.stdout:4/110: unlink d3/d1d/d11/d1a/l1b 0 2024-04-26T11:46:36.038 INFO:tasks.workunit.client.0.smithi029.stdout:6/115: creat d7/d25/f28 x:0 0 0 2024-04-26T11:46:36.038 INFO:tasks.workunit.client.0.smithi029.stdout:5/104: creat db/d12/d1f/f21 x:0 0 0 2024-04-26T11:46:36.039 INFO:tasks.workunit.client.0.smithi029.stdout:9/189: truncate d4/d5/f33 390029 0 2024-04-26T11:46:36.041 INFO:tasks.workunit.client.0.smithi029.stdout:6/116: read d7/f1a [556317,121842] 0 2024-04-26T11:46:36.043 INFO:tasks.workunit.client.0.smithi029.stdout:4/111: getdents d3 0 2024-04-26T11:46:36.043 INFO:tasks.workunit.client.0.smithi029.stdout:9/190: rmdir d4/d5/d28/d2d 0 2024-04-26T11:46:36.043 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:36.040+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:36.044 INFO:tasks.workunit.client.0.smithi029.stdout:6/117: symlink d7/d20/l29 0 2024-04-26T11:46:36.045 INFO:tasks.workunit.client.0.smithi029.stdout:7/150: dwrite d11/f19 [0,4194304] 0 2024-04-26T11:46:36.046 INFO:tasks.workunit.client.0.smithi029.stdout:5/105: dread f4 [0,4194304] 0 2024-04-26T11:46:36.046 INFO:tasks.workunit.client.0.smithi029.stdout:8/135: dwrite f1 [8388608,4194304] 0 2024-04-26T11:46:36.047 INFO:tasks.workunit.client.0.smithi029.stdout:6/118: truncate d7/d19/f24 346862 0 2024-04-26T11:46:36.047 INFO:tasks.workunit.client.0.smithi029.stdout:7/151: mknod d11/d18/d1a/d2f/c30 1 2024-04-26T11:46:36.048 INFO:tasks.workunit.client.0.smithi029.stdout:8/136: write f5 [4934972,63879] 0 2024-04-26T11:46:36.048 INFO:tasks.workunit.client.0.smithi029.stdout:5/106: mkdir db/d22 0 2024-04-26T11:46:36.049 INFO:tasks.workunit.client.0.smithi029.stdout:9/191: dread d4/d5/f6 [0,4194304] 0 2024-04-26T11:46:36.049 INFO:tasks.workunit.client.0.smithi029.stdout:8/137: chown f0 8310394 1 2024-04-26T11:46:36.049 INFO:tasks.workunit.client.0.smithi029.stdout:9/192: stat d4/d5/d16/f34 0 2024-04-26T11:46:36.050 INFO:tasks.workunit.client.0.smithi029.stdout:5/107: write db/d12/d1a/f13 [55077,17227] 0 2024-04-26T11:46:36.050 INFO:tasks.workunit.client.0.smithi029.stdout:0/116: sync 2024-04-26T11:46:36.052 INFO:tasks.workunit.client.0.smithi029.stdout:7/152: link d11/d18/f22 d11/d18/d1a/f31 0 2024-04-26T11:46:36.052 INFO:tasks.workunit.client.0.smithi029.stdout:8/138: rename dc/de/d15/l22 to dc/de/d2e/d23/l2f 0 2024-04-26T11:46:36.052 INFO:tasks.workunit.client.0.smithi029.stdout:3/106: dread d0/d1/f16 [0,4194304] 0 2024-04-26T11:46:36.053 INFO:tasks.workunit.client.0.smithi029.stdout:5/108: chown db/d22 17592453 1 2024-04-26T11:46:36.054 INFO:tasks.workunit.client.0.smithi029.stdout:0/117: write d9/f14 [857462,43352] 0 2024-04-26T11:46:36.054 INFO:tasks.workunit.client.0.smithi029.stdout:7/153: rename d11 to d11/d18/d1a/d2f/d32 22 2024-04-26T11:46:36.055 INFO:tasks.workunit.client.0.smithi029.stdout:8/139: write dc/f11 [776434,12241] 0 2024-04-26T11:46:36.056 INFO:tasks.workunit.client.0.smithi029.stdout:3/107: dread d0/f1b [0,4194304] 0 2024-04-26T11:46:36.057 INFO:tasks.workunit.client.0.smithi029.stdout:8/140: symlink dc/d12/l30 0 2024-04-26T11:46:36.058 INFO:tasks.workunit.client.0.smithi029.stdout:3/108: fsync d0/de/d1a/f1d 0 2024-04-26T11:46:36.058 INFO:tasks.workunit.client.0.smithi029.stdout:4/112: dwrite d3/d1d/db/d13/f18 [0,4194304] 0 2024-04-26T11:46:36.059 INFO:tasks.workunit.client.0.smithi029.stdout:8/141: write dc/de/f2b [482374,40570] 0 2024-04-26T11:46:36.059 INFO:tasks.workunit.client.0.smithi029.stdout:3/109: rmdir d0 39 2024-04-26T11:46:36.060 INFO:tasks.workunit.client.0.smithi029.stdout:4/113: creat d3/d1d/f21 x:0 0 0 2024-04-26T11:46:36.062 INFO:tasks.workunit.client.0.smithi029.stdout:5/109: dread f0 [0,4194304] 0 2024-04-26T11:46:36.063 INFO:tasks.workunit.client.0.smithi029.stdout:9/193: dwrite d4/d5/d16/f19 [0,4194304] 0 2024-04-26T11:46:36.065 INFO:tasks.workunit.client.0.smithi029.stdout:5/110: rename f5 to db/d12/d1f/f23 0 2024-04-26T11:46:36.066 INFO:tasks.workunit.client.0.smithi029.stdout:7/154: dwrite d11/d18/d1a/f23 [0,4194304] 0 2024-04-26T11:46:36.069 INFO:tasks.workunit.client.0.smithi029.stdout:8/142: write dc/de/d2e/d23/d27/d24/f2d [527964,60893] 0 2024-04-26T11:46:36.069 INFO:tasks.workunit.client.0.smithi029.stdout:9/194: fsync d4/d5/d16/f1c 0 2024-04-26T11:46:36.072 INFO:tasks.workunit.client.0.smithi029.stdout:7/155: fdatasync d11/d18/f27 0 2024-04-26T11:46:36.072 INFO:tasks.workunit.client.0.smithi029.stdout:1/106: dread f2 [0,4194304] 0 2024-04-26T11:46:36.073 INFO:tasks.workunit.client.0.smithi029.stdout:3/110: dwrite d0/dc/f23 [0,4194304] 0 2024-04-26T11:46:36.074 INFO:tasks.workunit.client.0.smithi029.stdout:8/143: link dc/d12/f20 dc/de/d2e/d23/f31 0 2024-04-26T11:46:36.076 INFO:tasks.workunit.client.0.smithi029.stdout:4/114: dwrite d3/d1d/f12 [0,4194304] 0 2024-04-26T11:46:36.077 INFO:tasks.workunit.client.0.smithi029.stdout:1/107: fsync f2 0 2024-04-26T11:46:36.079 INFO:tasks.workunit.client.0.smithi029.stdout:4/115: rmdir d3/d1d/db/d13 39 2024-04-26T11:46:36.079 INFO:tasks.workunit.client.0.smithi029.stdout:1/108: mkdir d7/db/d10/d20 0 2024-04-26T11:46:36.080 INFO:tasks.workunit.client.0.smithi029.stdout:1/109: fdatasync d7/f1c 0 2024-04-26T11:46:36.083 INFO:tasks.workunit.client.0.smithi029.stdout:4/116: chown d3/d1d/l20 334904 1 2024-04-26T11:46:36.083 INFO:tasks.workunit.client.0.smithi029.stdout:8/144: dread dc/de/d2e/d23/d27/d24/f2d [0,4194304] 0 2024-04-26T11:46:36.084 INFO:tasks.workunit.client.0.smithi029.stdout:1/110: creat d7/db/d10/d20/f21 x:0 0 0 2024-04-26T11:46:36.085 INFO:tasks.workunit.client.0.smithi029.stdout:5/111: dwrite db/d12/f1b [0,4194304] 0 2024-04-26T11:46:36.085 INFO:tasks.workunit.client.0.smithi029.stdout:9/195: dwrite d4/d5/d7/ff [0,4194304] 0 2024-04-26T11:46:36.086 INFO:tasks.workunit.client.0.smithi029.stdout:4/117: link d3/d1d/f21 d3/d1d/f22 0 2024-04-26T11:46:36.087 INFO:tasks.workunit.client.0.smithi029.stdout:5/112: fsync f8 0 2024-04-26T11:46:36.087 INFO:tasks.workunit.client.0.smithi029.stdout:9/196: symlink d4/d5/l38 0 2024-04-26T11:46:36.087 INFO:tasks.workunit.client.0.smithi029.stdout:1/111: chown d7/db/dc/df/l12 1323439941 1 2024-04-26T11:46:36.088 INFO:tasks.workunit.client.0.smithi029.stdout:7/156: dread d11/d15/f2a [4194304,4194304] 0 2024-04-26T11:46:36.088 INFO:tasks.workunit.client.0.smithi029.stdout:3/111: dwrite d0/d1/f18 [0,4194304] 0 2024-04-26T11:46:36.088 INFO:tasks.workunit.client.0.smithi029.stdout:5/113: stat db/d12/d1f 0 2024-04-26T11:46:36.089 INFO:tasks.workunit.client.0.smithi029.stdout:8/145: rename dc/de/d2e/d23/d27/d24/f2d to dc/de/d26/f32 0 2024-04-26T11:46:36.089 INFO:tasks.workunit.client.0.smithi029.stdout:1/112: write d7/db/f14 [31163,126770] 0 2024-04-26T11:46:36.090 INFO:tasks.workunit.client.0.smithi029.stdout:3/112: rmdir d0/de/d1a 39 2024-04-26T11:46:36.090 INFO:tasks.workunit.client.0.smithi029.stdout:4/118: mkdir d3/d1d/db/d13/d23 0 2024-04-26T11:46:36.090 INFO:tasks.workunit.client.0.smithi029.stdout:5/114: creat db/d12/d1a/f24 x:0 0 0 2024-04-26T11:46:36.090 INFO:tasks.workunit.client.0.smithi029.stdout:1/113: mknod d7/db/d10/d20/c22 1 2024-04-26T11:46:36.092 INFO:tasks.workunit.client.0.smithi029.stdout:2/147: sync 2024-04-26T11:46:36.092 INFO:tasks.workunit.client.0.smithi029.stdout:1/114: dread d7/db/d10/f11 [0,4194304] 0 2024-04-26T11:46:36.093 INFO:tasks.workunit.client.0.smithi029.stdout:5/115: creat db/f25 x:0 0 0 2024-04-26T11:46:36.094 INFO:tasks.workunit.client.0.smithi029.stdout:5/116: rmdir db/d22 0 2024-04-26T11:46:36.095 INFO:tasks.workunit.client.0.smithi029.stdout:1/115: dread d7/db/d10/f13 [0,4194304] 0 2024-04-26T11:46:36.096 INFO:tasks.workunit.client.0.smithi029.stdout:5/117: rmdir db/d12/d1f 39 2024-04-26T11:46:36.096 INFO:tasks.workunit.client.0.smithi029.stdout:4/119: dread d3/d1d/f12 [0,4194304] 0 2024-04-26T11:46:36.096 INFO:tasks.workunit.client.0.smithi029.stdout:5/118: chown f8 4084 1 2024-04-26T11:46:36.096 INFO:tasks.workunit.client.0.smithi029.stdout:1/116: dread - d7/db/d10/d20/f21 zero size 2024-04-26T11:46:36.096 INFO:tasks.workunit.client.0.smithi029.stdout:4/120: truncate d3/f14 4817587 0 2024-04-26T11:46:36.097 INFO:tasks.workunit.client.0.smithi029.stdout:4/121: stat l0 0 2024-04-26T11:46:36.097 INFO:tasks.workunit.client.0.smithi029.stdout:1/117: chown d7/db/dc/df 5960 1 2024-04-26T11:46:36.098 INFO:tasks.workunit.client.0.smithi029.stdout:5/119: fsync db/d12/d1f/f23 0 2024-04-26T11:46:36.099 INFO:tasks.workunit.client.0.smithi029.stdout:4/122: mknod d3/d1d/d11/d16/c24 1 2024-04-26T11:46:36.099 INFO:tasks.workunit.client.0.smithi029.stdout:2/148: dread d12/d24/f27 [0,4194304] 0 2024-04-26T11:46:36.099 INFO:tasks.workunit.client.0.smithi029.stdout:5/120: mknod db/d12/c26 1 2024-04-26T11:46:36.099 INFO:tasks.workunit.client.0.smithi029.stdout:1/118: mknod d7/db/d10/d20/c23 1 2024-04-26T11:46:36.099 INFO:tasks.workunit.client.0.smithi029.stdout:2/149: chown d12 406 1 2024-04-26T11:46:36.099 INFO:tasks.workunit.client.0.smithi029.stdout:4/123: symlink d3/l25 0 2024-04-26T11:46:36.099 INFO:tasks.workunit.client.0.smithi029.stdout:1/119: stat f6 0 2024-04-26T11:46:36.099 INFO:tasks.workunit.client.0.smithi029.stdout:2/150: mkdir d12/d24/d2f 0 2024-04-26T11:46:36.100 INFO:tasks.workunit.client.0.smithi029.stdout:2/151: dread - fd zero size 2024-04-26T11:46:36.100 INFO:tasks.workunit.client.0.smithi029.stdout:5/121: rename db/f25 to db/d12/d1a/f27 0 2024-04-26T11:46:36.100 INFO:tasks.workunit.client.0.smithi029.stdout:5/122: chown db/d12/d1a/f24 6425114 1 2024-04-26T11:46:36.100 INFO:tasks.workunit.client.0.smithi029.stdout:5/123: truncate db/f1e 790078 0 2024-04-26T11:46:36.101 INFO:tasks.workunit.client.0.smithi029.stdout:5/124: fsync db/d12/d1a/f10 0 2024-04-26T11:46:36.101 INFO:tasks.workunit.client.0.smithi029.stdout:5/125: creat db/d12/d1a/f28 x:0 0 0 2024-04-26T11:46:36.102 INFO:tasks.workunit.client.0.smithi029.stdout:5/126: mknod db/d12/c29 1 2024-04-26T11:46:36.104 INFO:tasks.workunit.client.0.smithi029.stdout:5/127: symlink db/l2a 0 2024-04-26T11:46:36.105 INFO:tasks.workunit.client.0.smithi029.stdout:3/113: truncate d0/f15 2028369 0 2024-04-26T11:46:36.106 INFO:tasks.workunit.client.0.smithi029.stdout:5/128: mknod db/d12/d1a/c2b 1 2024-04-26T11:46:36.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/120: dwrite d7/fa [0,4194304] 0 2024-04-26T11:46:36.109 INFO:tasks.workunit.client.0.smithi029.stdout:5/129: read db/d12/f1b [460197,129212] 0 2024-04-26T11:46:36.110 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:36.110 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:36.110 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:36.110 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:36.110 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:36.111 INFO:tasks.workunit.client.0.smithi029.stdout:2/152: dwrite d12/f28 [0,4194304] 0 2024-04-26T11:46:36.113 INFO:tasks.workunit.client.0.smithi029.stdout:1/121: dread d7/db/d10/f13 [0,4194304] 0 2024-04-26T11:46:36.113 INFO:tasks.workunit.client.0.smithi029.stdout:8/146: dwrite dc/d12/f20 [4194304,4194304] 0 2024-04-26T11:46:36.113 INFO:tasks.workunit.client.0.smithi029.stdout:2/153: write d12/f26 [1615449,37113] 0 2024-04-26T11:46:36.114 INFO:tasks.workunit.client.0.smithi029.stdout:9/197: dwrite d4/d5/d7/f35 [0,4194304] 0 2024-04-26T11:46:36.115 INFO:tasks.workunit.client.0.smithi029.stdout:1/122: creat d7/db/d10/f24 x:0 0 0 2024-04-26T11:46:36.115 INFO:tasks.workunit.client.0.smithi029.stdout:2/154: truncate f7 1095975 0 2024-04-26T11:46:36.116 INFO:tasks.workunit.client.0.smithi029.stdout:2/155: stat d12/f1a 0 2024-04-26T11:46:36.116 INFO:tasks.workunit.client.0.smithi029.stdout:4/124: fdatasync d3/f1e 0 2024-04-26T11:46:36.117 INFO:tasks.workunit.client.0.smithi029.stdout:2/156: unlink d12/d24/f25 0 2024-04-26T11:46:36.118 INFO:tasks.workunit.client.0.smithi029.stdout:2/157: creat d12/d24/d2f/f30 x:0 0 0 2024-04-26T11:46:36.119 INFO:tasks.workunit.client.0.smithi029.stdout:9/198: write d4/d5/d7/f35 [3921128,112693] 0 2024-04-26T11:46:36.122 INFO:tasks.workunit.client.0.smithi029.stdout:9/199: mkdir d4/d5/d16/d39 0 2024-04-26T11:46:36.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:36.127 INFO:tasks.workunit.client.0.smithi029.stdout:9/200: mkdir d4/d5/d7/d3a 0 2024-04-26T11:46:36.127 INFO:tasks.workunit.client.0.smithi029.stdout:5/130: dwrite db/d12/d1a/f24 [0,4194304] 0 2024-04-26T11:46:36.129 INFO:tasks.workunit.client.0.smithi029.stdout:1/123: dwrite f6 [0,4194304] 0 2024-04-26T11:46:36.129 INFO:tasks.workunit.client.0.smithi029.stdout:8/147: truncate dc/f11 752249 0 2024-04-26T11:46:36.129 INFO:tasks.workunit.client.0.smithi029.stdout:7/157: dread d11/d18/f29 [0,4194304] 0 2024-04-26T11:46:36.131 INFO:tasks.workunit.client.0.smithi029.stdout:0/118: sync 2024-04-26T11:46:36.131 INFO:tasks.workunit.client.0.smithi029.stdout:6/119: sync 2024-04-26T11:46:36.133 INFO:tasks.workunit.client.0.smithi029.stdout:0/119: readlink d9/l1f 0 2024-04-26T11:46:36.133 INFO:tasks.workunit.client.0.smithi029.stdout:8/148: mknod dc/de/d2e/d23/d27/d24/c33 1 2024-04-26T11:46:36.133 INFO:tasks.workunit.client.0.smithi029.stdout:9/201: rmdir d4/d5/d7/d3a 0 2024-04-26T11:46:36.134 INFO:tasks.workunit.client.0.smithi029.stdout:2/158: dwrite d12/f1d [8388608,4194304] 0 2024-04-26T11:46:36.135 INFO:tasks.workunit.client.0.smithi029.stdout:7/158: mkdir d11/d18/d1a/d33 0 2024-04-26T11:46:36.135 INFO:tasks.workunit.client.0.smithi029.stdout:3/114: dwrite d0/d1/f16 [0,4194304] 0 2024-04-26T11:46:36.135 INFO:tasks.workunit.client.0.smithi029.stdout:6/120: write d7/f1a [1035634,120577] 0 2024-04-26T11:46:36.136 INFO:tasks.workunit.client.0.smithi029.stdout:6/121: mknod d7/d20/c2a 1 2024-04-26T11:46:36.138 INFO:tasks.workunit.client.0.smithi029.stdout:0/120: symlink d9/d16/d25/l26 0 2024-04-26T11:46:36.139 INFO:tasks.workunit.client.0.smithi029.stdout:2/159: rmdir d12 39 2024-04-26T11:46:36.139 INFO:tasks.workunit.client.0.smithi029.stdout:8/149: write dc/de/f2b [437289,33841] 0 2024-04-26T11:46:36.139 INFO:tasks.workunit.client.0.smithi029.stdout:7/159: symlink d11/l34 0 2024-04-26T11:46:36.139 INFO:tasks.workunit.client.0.smithi029.stdout:1/124: mkdir d7/d25 0 2024-04-26T11:46:36.141 INFO:tasks.workunit.client.0.smithi029.stdout:6/122: unlink d7/d25/l26 0 2024-04-26T11:46:36.142 INFO:tasks.workunit.client.0.smithi029.stdout:3/115: rename d0/de to d0/dc/d2a 0 2024-04-26T11:46:36.142 INFO:tasks.workunit.client.0.smithi029.stdout:7/160: mkdir d11/d18/d35 0 2024-04-26T11:46:36.142 INFO:tasks.workunit.client.0.smithi029.stdout:0/121: unlink d9/f14 0 2024-04-26T11:46:36.144 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:36.141+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:36.144 INFO:tasks.workunit.client.0.smithi029.stdout:2/160: rename d12/d24/d2f/f30 to d12/d24/d29/f31 0 2024-04-26T11:46:36.144 INFO:tasks.workunit.client.0.smithi029.stdout:9/202: getdents d4/d5 0 2024-04-26T11:46:36.144 INFO:tasks.workunit.client.0.smithi029.stdout:7/161: creat d11/d15/f36 x:0 0 0 2024-04-26T11:46:36.146 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:46:36.146 INFO:tasks.workunit.client.0.smithi029.stdout:4/125: dwrite d3/d1d/f22 [0,4194304] 0 2024-04-26T11:46:36.147 INFO:tasks.workunit.client.0.smithi029.stdout:1/125: truncate d7/db/d10/f13 627215 0 2024-04-26T11:46:36.148 INFO:tasks.workunit.client.0.smithi029.stdout:9/203: rmdir d4/d5 39 2024-04-26T11:46:36.149 INFO:tasks.workunit.client.0.smithi029.stdout:0/122: getdents d9/d16/d1a 0 2024-04-26T11:46:36.151 INFO:tasks.workunit.client.0.smithi029.stdout:4/126: rmdir d3/d1d/d11/d1a 0 2024-04-26T11:46:36.152 INFO:tasks.workunit.client.0.smithi029.stdout:0/123: unlink d9/l1f 0 2024-04-26T11:46:36.152 INFO:tasks.workunit.client.0.smithi029.stdout:3/116: dread d0/dc/f23 [0,4194304] 0 2024-04-26T11:46:36.153 INFO:tasks.workunit.client.0.smithi029.stdout:9/204: creat d4/d5/d16/f3b x:0 0 0 2024-04-26T11:46:36.154 INFO:tasks.workunit.client.0.smithi029.stdout:4/127: mkdir d3/d1d/d11/d26 0 2024-04-26T11:46:36.155 INFO:tasks.workunit.client.0.smithi029.stdout:8/150: dwrite dc/de/d26/f32 [0,4194304] 0 2024-04-26T11:46:36.156 INFO:tasks.workunit.client.0.smithi029.stdout:7/162: dread d11/f19 [0,4194304] 0 2024-04-26T11:46:36.157 INFO:tasks.workunit.client.0.smithi029.stdout:4/128: creat d3/d1d/d11/d16/d1f/f27 x:0 0 0 2024-04-26T11:46:36.158 INFO:tasks.workunit.client.0.smithi029.stdout:9/205: rename d4/f24 to d4/d5/d16/d39/f3c 0 2024-04-26T11:46:36.159 INFO:tasks.workunit.client.0.smithi029.stdout:6/123: dread d7/f12 [0,4194304] 0 2024-04-26T11:46:36.159 INFO:tasks.workunit.client.0.smithi029.stdout:2/161: dwrite d12/f23 [0,4194304] 0 2024-04-26T11:46:36.160 INFO:tasks.workunit.client.0.smithi029.stdout:7/163: fdatasync f8 0 2024-04-26T11:46:36.160 INFO:tasks.workunit.client.0.smithi029.stdout:4/129: fdatasync d3/d1d/d11/d16/d1f/f27 0 2024-04-26T11:46:36.161 INFO:tasks.workunit.client.0.smithi029.stdout:2/162: chown d12 946097985 1 2024-04-26T11:46:36.163 INFO:tasks.workunit.client.0.smithi029.stdout:6/124: fsync d7/fe 0 2024-04-26T11:46:36.163 INFO:tasks.workunit.client.0.smithi029.stdout:2/163: chown d12/f16 1981940 1 2024-04-26T11:46:36.165 INFO:tasks.workunit.client.0.smithi029.stdout:6/125: creat d7/d20/d27/f2b x:0 0 0 2024-04-26T11:46:36.166 INFO:tasks.workunit.client.0.smithi029.stdout:2/164: truncate d12/f23 4195516 0 2024-04-26T11:46:36.166 INFO:tasks.workunit.client.0.smithi029.stdout:0/124: dwrite d9/f18 [0,4194304] 0 2024-04-26T11:46:36.167 INFO:tasks.workunit.client.0.smithi029.stdout:6/126: mknod d7/d19/c2c 1 2024-04-26T11:46:36.169 INFO:tasks.workunit.client.0.smithi029.stdout:8/151: dwrite dc/de/f2b [0,4194304] 0 2024-04-26T11:46:36.169 INFO:tasks.workunit.client.0.smithi029.stdout:2/165: fdatasync d12/f16 0 2024-04-26T11:46:36.169 INFO:tasks.workunit.client.0.smithi029.stdout:6/127: mknod d7/c2d 1 2024-04-26T11:46:36.171 INFO:tasks.workunit.client.0.smithi029.stdout:1/126: write d7/db/d10/f13 [95166,40638] 0 2024-04-26T11:46:36.172 INFO:tasks.workunit.client.0.smithi029.stdout:8/152: mknod dc/de/d2e/d23/d27/d24/c34 1 2024-04-26T11:46:36.172 INFO:tasks.workunit.client.0.smithi029.stdout:6/128: link l5 d7/d20/d27/l2e 0 2024-04-26T11:46:36.173 INFO:tasks.workunit.client.0.smithi029.stdout:7/164: dread f9 [4194304,4194304] 0 2024-04-26T11:46:36.173 INFO:tasks.workunit.client.0.smithi029.stdout:9/206: dwrite d4/d5/fd [0,4194304] 0 2024-04-26T11:46:36.173 INFO:tasks.workunit.client.0.smithi029.stdout:2/166: truncate d12/f1b 1412147 0 2024-04-26T11:46:36.175 INFO:tasks.workunit.client.0.smithi029.stdout:8/153: dread - dc/de/d2e/d23/f21 zero size 2024-04-26T11:46:36.176 INFO:tasks.workunit.client.0.smithi029.stdout:2/167: symlink d12/d24/l32 0 2024-04-26T11:46:36.176 INFO:tasks.workunit.client.0.smithi029.stdout:9/207: chown d4/d5/d7/f11 2957 1 2024-04-26T11:46:36.176 INFO:tasks.workunit.client.0.smithi029.stdout:8/154: fsync f1 0 2024-04-26T11:46:36.176 INFO:tasks.workunit.client.0.smithi029.stdout:6/129: chown d7/d20/d27/l2e 997929 1 2024-04-26T11:46:36.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/127: creat d7/db/d10/d1e/f26 x:0 0 0 2024-04-26T11:46:36.177 INFO:tasks.workunit.client.0.smithi029.stdout:4/130: dwrite d3/d1d/d11/d16/d1f/f27 [0,4194304] 0 2024-04-26T11:46:36.180 INFO:tasks.workunit.client.0.smithi029.stdout:9/208: creat d4/d5/d16/d39/f3d x:0 0 0 2024-04-26T11:46:36.180 INFO:tasks.workunit.client.0.smithi029.stdout:4/131: readlink d3/d1d/l20 0 2024-04-26T11:46:36.180 INFO:tasks.workunit.client.0.smithi029.stdout:8/155: fsync dc/de/d2e/d23/f31 0 2024-04-26T11:46:36.180 INFO:tasks.workunit.client.0.smithi029.stdout:7/165: write d11/d15/f2a [250412,33150] 0 2024-04-26T11:46:36.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/130: write d7/f12 [1505892,15153] 0 2024-04-26T11:46:36.180 INFO:tasks.workunit.client.0.smithi029.stdout:9/209: rmdir d4/d5/d28 39 2024-04-26T11:46:36.180 INFO:tasks.workunit.client.0.smithi029.stdout:4/132: read d3/d1d/f21 [3374347,74392] 0 2024-04-26T11:46:36.182 INFO:tasks.workunit.client.0.smithi029.stdout:0/125: dwrite f3 [0,4194304] 0 2024-04-26T11:46:36.182 INFO:tasks.workunit.client.0.smithi029.stdout:7/166: chown d11/f13 15039 1 2024-04-26T11:46:36.182 INFO:tasks.workunit.client.0.smithi029.stdout:4/133: write d3/d1d/f21 [3664012,72883] 0 2024-04-26T11:46:36.182 INFO:tasks.workunit.client.0.smithi029.stdout:7/167: readlink d11/d18/l24 0 2024-04-26T11:46:36.182 INFO:tasks.workunit.client.0.smithi029.stdout:7/168: read - d11/d15/f36 zero size 2024-04-26T11:46:36.183 INFO:tasks.workunit.client.0.smithi029.stdout:6/131: mkdir d7/d20/d2f 0 2024-04-26T11:46:36.184 INFO:tasks.workunit.client.0.smithi029.stdout:0/126: mkdir d9/d16/d25/d27 0 2024-04-26T11:46:36.185 INFO:tasks.workunit.client.0.smithi029.stdout:2/168: link d12/f1e d12/d24/d2f/f33 0 2024-04-26T11:46:36.185 INFO:tasks.workunit.client.0.smithi029.stdout:0/127: chown d9/d16/d1a 335809 1 2024-04-26T11:46:36.188 INFO:tasks.workunit.client.0.smithi029.stdout:0/128: creat d9/d16/f28 x:0 0 0 2024-04-26T11:46:36.188 INFO:tasks.workunit.client.0.smithi029.stdout:8/156: link dc/d12/l1c dc/de/d2e/d23/l35 0 2024-04-26T11:46:36.189 INFO:tasks.workunit.client.0.smithi029.stdout:5/131: sync 2024-04-26T11:46:36.190 INFO:tasks.workunit.client.0.smithi029.stdout:1/128: dwrite d7/db/d10/d1e/f26 [0,4194304] 0 2024-04-26T11:46:36.191 INFO:tasks.workunit.client.0.smithi029.stdout:0/129: write d9/f20 [194615,20525] 0 2024-04-26T11:46:36.193 INFO:tasks.workunit.client.0.smithi029.stdout:1/129: write d7/db/d10/f13 [422153,27647] 0 2024-04-26T11:46:36.193 INFO:tasks.workunit.client.0.smithi029.stdout:5/132: link db/d12/d1a/f16 db/d12/d1f/f2c 0 2024-04-26T11:46:36.194 INFO:tasks.workunit.client.0.smithi029.stdout:0/130: rename d9/f23 to d9/d16/d1a/f29 0 2024-04-26T11:46:36.194 INFO:tasks.workunit.client.0.smithi029.stdout:5/133: unlink db/d12/l15 0 2024-04-26T11:46:36.194 INFO:tasks.workunit.client.0.smithi029.stdout:1/130: mknod d7/db/d10/d20/c27 1 2024-04-26T11:46:36.195 INFO:tasks.workunit.client.0.smithi029.stdout:3/117: dread d0/f15 [0,4194304] 0 2024-04-26T11:46:36.195 INFO:tasks.workunit.client.0.smithi029.stdout:9/210: dwrite d4/d5/d16/d39/f3c [0,4194304] 0 2024-04-26T11:46:36.195 INFO:tasks.workunit.client.0.smithi029.stdout:1/131: read f2 [1057656,111747] 0 2024-04-26T11:46:36.197 INFO:tasks.workunit.client.0.smithi029.stdout:1/132: write d7/fa [3504245,113389] 0 2024-04-26T11:46:36.197 INFO:tasks.workunit.client.0.smithi029.stdout:3/118: mkdir d0/d1/d2b 0 2024-04-26T11:46:36.198 INFO:tasks.workunit.client.0.smithi029.stdout:8/157: dread f1 [8388608,4194304] 0 2024-04-26T11:46:36.198 INFO:tasks.workunit.client.0.smithi029.stdout:3/119: mknod d0/d1/d13/c2c 1 2024-04-26T11:46:36.198 INFO:tasks.workunit.client.0.smithi029.stdout:9/211: truncate d4/d5/f33 522544 0 2024-04-26T11:46:36.198 INFO:tasks.workunit.client.0.smithi029.stdout:1/133: chown d7/db/dc/df/l12 2 1 2024-04-26T11:46:36.199 INFO:tasks.workunit.client.0.smithi029.stdout:3/120: unlink d0/l1c 0 2024-04-26T11:46:36.199 INFO:tasks.workunit.client.0.smithi029.stdout:1/134: unlink d7/fa 0 2024-04-26T11:46:36.200 INFO:tasks.workunit.client.0.smithi029.stdout:8/158: creat dc/de/d2e/d23/d27/d24/f36 x:0 0 0 2024-04-26T11:46:36.202 INFO:tasks.workunit.client.0.smithi029.stdout:9/212: getdents d4/d5/d7 0 2024-04-26T11:46:36.202 INFO:tasks.workunit.client.0.smithi029.stdout:3/121: chown d0/dc/d2a/d1a/l28 38432907 1 2024-04-26T11:46:36.205 INFO:tasks.workunit.client.0.smithi029.stdout:6/132: dread d7/f1a [0,4194304] 0 2024-04-26T11:46:36.205 INFO:tasks.workunit.client.0.smithi029.stdout:9/213: write d4/d5/fd [6532517,66073] 0 2024-04-26T11:46:36.205 INFO:tasks.workunit.client.0.smithi029.stdout:3/122: creat d0/dc/d1f/f2d x:0 0 0 2024-04-26T11:46:36.205 INFO:tasks.workunit.client.0.smithi029.stdout:5/134: dwrite f7 [0,4194304] 0 2024-04-26T11:46:36.206 INFO:tasks.workunit.client.0.smithi029.stdout:1/135: dread f2 [0,4194304] 0 2024-04-26T11:46:36.206 INFO:tasks.workunit.client.0.smithi029.stdout:6/133: link d7/f22 d7/d20/d2f/f30 0 2024-04-26T11:46:36.208 INFO:tasks.workunit.client.0.smithi029.stdout:1/136: chown d7/db/f14 1032449 1 2024-04-26T11:46:36.208 INFO:tasks.workunit.client.0.smithi029.stdout:3/123: rename d0/dc/l22 to d0/l2e 0 2024-04-26T11:46:36.209 INFO:tasks.workunit.client.0.smithi029.stdout:0/131: rmdir d9/d16 39 2024-04-26T11:46:36.209 INFO:tasks.workunit.client.0.smithi029.stdout:8/159: dread dc/de/f2b [0,4194304] 0 2024-04-26T11:46:36.209 INFO:tasks.workunit.client.0.smithi029.stdout:5/135: truncate db/d12/d1a/f16 816347 0 2024-04-26T11:46:36.210 INFO:tasks.workunit.client.0.smithi029.stdout:3/124: mkdir d0/d1/d2f 0 2024-04-26T11:46:36.213 INFO:tasks.workunit.client.0.smithi029.stdout:1/137: symlink d7/db/d10/d20/l28 0 2024-04-26T11:46:36.214 INFO:tasks.workunit.client.0.smithi029.stdout:5/136: symlink db/d12/d1f/l2d 0 2024-04-26T11:46:36.214 INFO:tasks.workunit.client.0.smithi029.stdout:9/214: rename d4/d5/d28/l2b to d4/l3e 0 2024-04-26T11:46:36.214 INFO:tasks.workunit.client.0.smithi029.stdout:8/160: fdatasync dc/de/f2b 0 2024-04-26T11:46:36.214 INFO:tasks.workunit.client.0.smithi029.stdout:4/134: dwrite d3/f1e [0,4194304] 0 2024-04-26T11:46:36.214 INFO:tasks.workunit.client.0.smithi029.stdout:5/137: chown f7 7011181 1 2024-04-26T11:46:36.214 INFO:tasks.workunit.client.0.smithi029.stdout:3/125: rename d0/d1e to d0/dc/d2a/d1a/d30 0 2024-04-26T11:46:36.217 INFO:tasks.workunit.client.0.smithi029.stdout:8/161: dread - dc/de/d2e/d23/f21 zero size 2024-04-26T11:46:36.218 INFO:tasks.workunit.client.0.smithi029.stdout:2/169: dread d12/f1c [0,4194304] 0 2024-04-26T11:46:36.218 INFO:tasks.workunit.client.0.smithi029.stdout:1/138: write d7/db/d10/f13 [1320550,116467] 0 2024-04-26T11:46:36.218 INFO:tasks.workunit.client.0.smithi029.stdout:3/126: fsync d0/d1/d13/f14 0 2024-04-26T11:46:36.218 INFO:tasks.workunit.client.0.smithi029.stdout:9/215: truncate d4/d5/d16/f34 1033281 0 2024-04-26T11:46:36.219 INFO:tasks.workunit.client.0.smithi029.stdout:5/138: creat db/d12/d1a/f2e x:0 0 0 2024-04-26T11:46:36.219 INFO:tasks.workunit.client.0.smithi029.stdout:0/132: dwrite d9/f10 [0,4194304] 0 2024-04-26T11:46:36.219 INFO:tasks.workunit.client.0.smithi029.stdout:1/139: dread - d7/db/d10/d20/f21 zero size 2024-04-26T11:46:36.220 INFO:tasks.workunit.client.0.smithi029.stdout:4/135: link d3/d1d/d11/d16/d1f/f27 d3/d1d/db/f28 0 2024-04-26T11:46:36.220 INFO:tasks.workunit.client.0.smithi029.stdout:2/170: link l10 d12/d24/d2f/l34 0 2024-04-26T11:46:36.221 INFO:tasks.workunit.client.0.smithi029.stdout:1/140: symlink d7/l29 0 2024-04-26T11:46:36.221 INFO:tasks.workunit.client.0.smithi029.stdout:2/171: fsync d12/f2a 0 2024-04-26T11:46:36.221 INFO:tasks.workunit.client.0.smithi029.stdout:6/134: truncate d7/f1a 1091922 0 2024-04-26T11:46:36.223 INFO:tasks.workunit.client.0.smithi029.stdout:0/133: getdents d9 0 2024-04-26T11:46:36.225 INFO:tasks.workunit.client.0.smithi029.stdout:4/136: rename d3/d1d/db/d13/f18 to d3/d1d/f29 0 2024-04-26T11:46:36.227 INFO:tasks.workunit.client.0.smithi029.stdout:4/137: mknod d3/d1d/c2a 1 2024-04-26T11:46:36.227 INFO:tasks.workunit.client.0.smithi029.stdout:1/141: rename d7/db/d10/f11 to d7/d25/f2a 0 2024-04-26T11:46:36.230 INFO:tasks.workunit.client.0.smithi029.stdout:4/138: mkdir d3/d1d/db/d13/d23/d2b 0 2024-04-26T11:46:36.230 INFO:tasks.workunit.client.0.smithi029.stdout:3/127: dwrite d0/d1/f18 [4194304,4194304] 0 2024-04-26T11:46:36.230 INFO:tasks.workunit.client.0.smithi029.stdout:4/139: stat d3 0 2024-04-26T11:46:36.232 INFO:tasks.workunit.client.0.smithi029.stdout:9/216: dwrite d4/d5/d16/d39/f3c [0,4194304] 0 2024-04-26T11:46:36.232 INFO:tasks.workunit.client.0.smithi029.stdout:1/142: rename d7/db/d10/f13 to d7/db/dc/f2b 0 2024-04-26T11:46:36.233 INFO:tasks.workunit.client.0.smithi029.stdout:4/140: rename d3/d1d/l20 to d3/d1d/d11/l2c 0 2024-04-26T11:46:36.234 INFO:tasks.workunit.client.0.smithi029.stdout:9/217: chown d4/d5/d16/f1c 106426636 1 2024-04-26T11:46:36.234 INFO:tasks.workunit.client.0.smithi029.stdout:6/135: dwrite d7/f23 [0,4194304] 0 2024-04-26T11:46:36.235 INFO:tasks.workunit.client.0.smithi029.stdout:4/141: stat d3/d1d/db/d13 0 2024-04-26T11:46:36.235 INFO:tasks.workunit.client.0.smithi029.stdout:1/143: unlink d7/db/d10/d20/f21 0 2024-04-26T11:46:36.236 INFO:tasks.workunit.client.0.smithi029.stdout:3/128: creat d0/dc/f31 x:0 0 0 2024-04-26T11:46:36.237 INFO:tasks.workunit.client.0.smithi029.stdout:1/144: write d7/db/d10/d1e/f26 [1424294,51536] 0 2024-04-26T11:46:36.237 INFO:tasks.workunit.client.0.smithi029.stdout:4/142: unlink l0 0 2024-04-26T11:46:36.237 INFO:tasks.workunit.client.0.smithi029.stdout:3/129: dread d0/d1/d13/f14 [0,4194304] 0 2024-04-26T11:46:36.237 INFO:tasks.workunit.client.0.smithi029.stdout:9/218: rename d4/d5/d7/l31 to d4/d5/d28/l3f 0 2024-04-26T11:46:36.239 INFO:tasks.workunit.client.0.smithi029.stdout:7/169: dread d11/f1e [0,4194304] 0 2024-04-26T11:46:36.239 INFO:tasks.workunit.client.0.smithi029.stdout:4/143: truncate d3/f7 756591 0 2024-04-26T11:46:36.240 INFO:tasks.workunit.client.0.smithi029.stdout:7/170: mkdir d11/d37 0 2024-04-26T11:46:36.240 INFO:tasks.workunit.client.0.smithi029.stdout:4/144: mkdir d3/d1d/db/d13/d2d 0 2024-04-26T11:46:36.240 INFO:tasks.workunit.client.0.smithi029.stdout:3/130: link d0/l2e d0/d1/d2b/l32 0 2024-04-26T11:46:36.242 INFO:tasks.workunit.client.0.smithi029.stdout:4/145: symlink d3/d1d/l2e 0 2024-04-26T11:46:36.242 INFO:tasks.workunit.client.0.smithi029.stdout:3/131: mkdir d0/d1/d2b/d33 0 2024-04-26T11:46:36.243 INFO:tasks.workunit.client.0.smithi029.stdout:4/146: fsync d3/d1d/f12 0 2024-04-26T11:46:36.243 INFO:tasks.workunit.client.0.smithi029.stdout:6/136: read d7/fe [3060869,30771] 0 2024-04-26T11:46:36.243 INFO:tasks.workunit.client.0.smithi029.stdout:3/132: mknod d0/dc/d1f/d25/c34 1 2024-04-26T11:46:36.244 INFO:tasks.workunit.client.0.smithi029.stdout:1/145: dread d7/db/d10/d1e/f26 [0,4194304] 0 2024-04-26T11:46:36.244 INFO:tasks.workunit.client.0.smithi029.stdout:6/137: unlink d7/fe 0 2024-04-26T11:46:36.244 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:36.241+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:36.245 INFO:tasks.workunit.client.0.smithi029.stdout:7/171: dread d11/d18/d1a/f23 [0,4194304] 0 2024-04-26T11:46:36.245 INFO:tasks.workunit.client.0.smithi029.stdout:1/146: rename d7/fe to d7/db/d10/f2c 0 2024-04-26T11:46:36.246 INFO:tasks.workunit.client.0.smithi029.stdout:7/172: write f6 [4225047,102892] 0 2024-04-26T11:46:36.248 INFO:tasks.workunit.client.0.smithi029.stdout:6/138: dread d7/f23 [0,4194304] 0 2024-04-26T11:46:36.249 INFO:tasks.workunit.client.0.smithi029.stdout:6/139: chown d7/l13 1319 1 2024-04-26T11:46:36.250 INFO:tasks.workunit.client.0.smithi029.stdout:9/219: link d4/d5/d28/l3f d4/d5/l40 0 2024-04-26T11:46:36.251 INFO:tasks.workunit.client.0.smithi029.stdout:9/220: stat d4/d5/d16/d39/f3d 0 2024-04-26T11:46:36.252 INFO:tasks.workunit.client.0.smithi029.stdout:9/221: fdatasync d4/d5/d7/ff 0 2024-04-26T11:46:36.253 INFO:tasks.workunit.client.0.smithi029.stdout:1/147: dwrite d7/db/d10/d1e/f26 [0,4194304] 0 2024-04-26T11:46:36.254 INFO:tasks.workunit.client.0.smithi029.stdout:6/140: dread d7/f12 [0,4194304] 0 2024-04-26T11:46:36.257 INFO:tasks.workunit.client.0.smithi029.stdout:1/148: unlink d7/l29 0 2024-04-26T11:46:36.258 INFO:tasks.workunit.client.0.smithi029.stdout:6/141: creat d7/d20/d27/f31 x:0 0 0 2024-04-26T11:46:36.258 INFO:tasks.workunit.client.0.smithi029.stdout:6/142: fdatasync d7/f22 0 2024-04-26T11:46:36.258 INFO:tasks.workunit.client.0.smithi029.stdout:1/149: write f6 [2329280,110775] 0 2024-04-26T11:46:36.258 INFO:tasks.workunit.client.0.smithi029.stdout:1/150: creat d7/db/f2d x:0 0 0 2024-04-26T11:46:36.260 INFO:tasks.workunit.client.0.smithi029.stdout:1/151: read d7/db/d10/d1e/f26 [1188022,43811] 0 2024-04-26T11:46:36.261 INFO:tasks.workunit.client.0.smithi029.stdout:9/222: dwrite d4/d5/fb [0,4194304] 0 2024-04-26T11:46:36.261 INFO:tasks.workunit.client.0.smithi029.stdout:1/152: fsync d7/db/d10/f24 0 2024-04-26T11:46:36.282 INFO:tasks.workunit.client.0.smithi029.stdout:1/153: creat d7/d25/f2e x:0 0 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:9/223: symlink d4/d5/l41 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:3/133: write d0/d1/d13/f14 [657935,107280] 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:1/154: rename d7/db/f14 to d7/db/dc/f2f 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:3/134: write d0/dc/d1f/f2d [148815,86798] 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:6/143: dwrite d7/d20/d27/f31 [0,4194304] 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:3/135: rmdir d0/dc/d2a/d1a/d30 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:6/144: write d7/f1c [1425904,91431] 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:6/145: fdatasync d7/f12 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:3/136: creat d0/dc/d2a/f35 x:0 0 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:6/146: creat d7/f32 x:0 0 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:3/137: stat d0/dc/f23 0 2024-04-26T11:46:36.283 INFO:tasks.workunit.client.0.smithi029.stdout:3/138: mknod d0/d1/d2b/c36 1 2024-04-26T11:46:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:5/139: dread db/d12/d1f/f23 [0,4194304] 0 2024-04-26T11:46:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:3/139: mkdir d0/d37 0 2024-04-26T11:46:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:9/224: dwrite d4/d5/f33 [0,4194304] 0 2024-04-26T11:46:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:8/162: dread f0 [8388608,4194304] 0 2024-04-26T11:46:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:6/147: dread d7/f1a [0,4194304] 0 2024-04-26T11:46:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:5/140: truncate db/d12/d1a/f18 987704 0 2024-04-26T11:46:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:1/155: write d7/d25/f2a [460400,28167] 0 2024-04-26T11:46:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:3/140: write d0/d1/d13/f14 [1397215,99706] 0 2024-04-26T11:46:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:6/148: truncate d7/d19/f24 385441 0 2024-04-26T11:46:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:9/225: creat d4/d5/d16/d39/f42 x:0 0 0 2024-04-26T11:46:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:6/149: fdatasync d7/f12 0 2024-04-26T11:46:36.285 INFO:tasks.workunit.client.0.smithi029.stdout:6/150: dread - d7/f22 zero size 2024-04-26T11:46:36.285 INFO:tasks.workunit.client.0.smithi029.stdout:1/156: unlink d7/db/d10/f24 0 2024-04-26T11:46:36.285 INFO:tasks.workunit.client.0.smithi029.stdout:3/141: creat d0/dc/d2a/d1a/f38 x:0 0 0 2024-04-26T11:46:36.285 INFO:tasks.workunit.client.0.smithi029.stdout:8/163: getdents dc/de/d26 0 2024-04-26T11:46:36.285 INFO:tasks.workunit.client.0.smithi029.stdout:9/226: symlink d4/l43 0 2024-04-26T11:46:36.285 INFO:tasks.workunit.client.0.smithi029.stdout:5/141: getdents db 0 2024-04-26T11:46:36.285 INFO:tasks.workunit.client.0.smithi029.stdout:5/142: read f4 [69756,40933] 0 2024-04-26T11:46:36.285 INFO:tasks.workunit.client.0.smithi029.stdout:3/142: read d0/f1b [934834,96520] 0 2024-04-26T11:46:36.285 INFO:tasks.workunit.client.0.smithi029.stdout:9/227: write d4/d5/d7/f36 [3138044,84438] 0 2024-04-26T11:46:36.285 INFO:tasks.workunit.client.0.smithi029.stdout:5/143: write db/d12/d1f/f21 [377841,37919] 0 2024-04-26T11:46:36.285 INFO:tasks.workunit.client.0.smithi029.stdout:1/157: getdents d7/db/dc 0 2024-04-26T11:46:36.287 INFO:tasks.workunit.client.0.smithi029.stdout:5/144: mknod db/d12/d1a/c2f 1 2024-04-26T11:46:36.287 INFO:tasks.workunit.client.0.smithi029.stdout:3/143: getdents d0/d1 0 2024-04-26T11:46:36.288 INFO:tasks.workunit.client.0.smithi029.stdout:7/173: dread f6 [0,4194304] 0 2024-04-26T11:46:36.288 INFO:tasks.workunit.client.0.smithi029.stdout:3/144: fdatasync d0/d1/f16 0 2024-04-26T11:46:36.288 INFO:tasks.workunit.client.0.smithi029.stdout:1/158: write d7/db/f2d [223713,39532] 0 2024-04-26T11:46:36.288 INFO:tasks.workunit.client.0.smithi029.stdout:9/228: dread d4/d5/d16/f34 [0,4194304] 0 2024-04-26T11:46:36.288 INFO:tasks.workunit.client.0.smithi029.stdout:7/174: creat d11/d18/d1a/f38 x:0 0 0 2024-04-26T11:46:36.288 INFO:tasks.workunit.client.0.smithi029.stdout:3/145: creat d0/d1/d2f/f39 x:0 0 0 2024-04-26T11:46:36.289 INFO:tasks.workunit.client.0.smithi029.stdout:3/146: chown d0/dc/f23 53376 1 2024-04-26T11:46:36.289 INFO:tasks.workunit.client.0.smithi029.stdout:8/164: dwrite f1 [12582912,4194304] 0 2024-04-26T11:46:36.289 INFO:tasks.workunit.client.0.smithi029.stdout:8/165: fdatasync f0 0 2024-04-26T11:46:36.291 INFO:tasks.workunit.client.0.smithi029.stdout:8/166: write f5 [4946052,27447] 0 2024-04-26T11:46:36.293 INFO:tasks.workunit.client.0.smithi029.stdout:6/151: write d7/f22 [457697,58749] 0 2024-04-26T11:46:36.293 INFO:tasks.workunit.client.0.smithi029.stdout:5/145: truncate db/d12/d1a/f24 3043919 0 2024-04-26T11:46:36.294 INFO:tasks.workunit.client.0.smithi029.stdout:3/147: dread d0/d1/d13/f14 [0,4194304] 0 2024-04-26T11:46:36.296 INFO:tasks.workunit.client.0.smithi029.stdout:9/229: dwrite d4/d5/fd [0,4194304] 0 2024-04-26T11:46:36.296 INFO:tasks.workunit.client.0.smithi029.stdout:3/148: creat d0/d1/d2f/f3a x:0 0 0 2024-04-26T11:46:36.296 INFO:tasks.workunit.client.0.smithi029.stdout:5/146: creat db/d12/f30 x:0 0 0 2024-04-26T11:46:36.297 INFO:tasks.workunit.client.0.smithi029.stdout:1/159: dwrite d7/db/d10/d1e/f26 [0,4194304] 0 2024-04-26T11:46:36.298 INFO:tasks.workunit.client.0.smithi029.stdout:5/147: dread - db/d12/f30 zero size 2024-04-26T11:46:36.300 INFO:tasks.workunit.client.0.smithi029.stdout:1/160: symlink d7/db/d10/d20/l30 0 2024-04-26T11:46:36.300 INFO:tasks.workunit.client.0.smithi029.stdout:5/148: chown db/d12/l14 0 1 2024-04-26T11:46:36.301 INFO:tasks.workunit.client.0.smithi029.stdout:3/149: write d0/d1/d13/f14 [1557662,13457] 0 2024-04-26T11:46:36.301 INFO:tasks.workunit.client.0.smithi029.stdout:5/149: read f0 [7383601,93156] 0 2024-04-26T11:46:36.302 INFO:tasks.workunit.client.0.smithi029.stdout:5/150: readlink db/l2a 0 2024-04-26T11:46:36.302 INFO:tasks.workunit.client.0.smithi029.stdout:5/151: mknod db/c31 1 2024-04-26T11:46:36.302 INFO:tasks.workunit.client.0.smithi029.stdout:1/161: truncate d7/d25/f2e 770130 0 2024-04-26T11:46:36.303 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:36.303 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:36.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:36.303 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:36.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.304 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:36.304 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:36.304 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.147478016000001, 2024-04-26T11:46:36.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:36.304 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.304 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.304 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:36.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:36.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:36.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:36.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:36.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.147451287999999, 2024-04-26T11:46:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:36.311 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.311 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.311 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:36.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:36.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:36.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:36.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:36.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:36.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.317 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.317 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:36.317 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:36.317 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.147420337, 2024-04-26T11:46:36.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:36.317 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.317 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.318 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:36.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:36.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:36.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:36.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:36.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:36.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:36.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:36.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:36.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:36.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.324 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.324 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:36.324 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1454583200000004, 2024-04-26T11:46:36.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:36.324 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.324 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.324 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:36.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:36.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:36.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:36.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:36.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:36.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:36.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:36.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:36.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:36.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.330 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.330 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:36.330 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1454326999999997, 2024-04-26T11:46:36.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:36.330 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.330 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.330 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:36.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:36.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:36.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:36.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:36.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:36.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:36.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:36.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:36.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:36.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:36.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:36.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:36.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:36.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:36.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:36.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:36.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:36.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:36.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.335 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1453725060000002, 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:36.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:36.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:36.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:36.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:36.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:36.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:36.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:36.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:36.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:36.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:36.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:36.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:36.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:36.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:36.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.344 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.344 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1453457289999998, 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:36.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.349 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1452896810000004, 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:36.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1452497150000003, 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:36.355 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:36.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:36.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:36.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:36.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:36.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:36.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:36.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.360 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1452191049999998, 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:36.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:36.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:36.366 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1451445969999998, 2024-04-26T11:46:36.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:36.367 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.367 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.367 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:36.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:36.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:36.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.372 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.145076532, 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:36.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:36.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:36.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:36.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:36.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:36.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:36.378 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.378 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.378 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.378 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.378 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:36.378 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1449763849999997, 2024-04-26T11:46:36.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:36.378 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:36.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:36.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:36.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:36.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:36.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:36.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:36.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:36.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:36.383 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.383 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:332 3.2 3:4272d415:::200.0000000b:head [write 1522559~21066 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1354910919999996, 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042100678000000002, 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166237+0000", 2024-04-26T11:46:36.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999971 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166309+0000", 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1858000000000002e-05 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166405+0000", 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6333000000000001e-05 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166451+0000", 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6529999999999997e-05 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204736+0000", 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.038284158999999998 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204876+0000", 2024-04-26T11:46:36.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014074700000000001 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208177+0000", 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003301179 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208220+0000", 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2098000000000002e-05 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208340+0000", 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120685 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:337 3.2 3:4272d415:::200.0000000b:head [write 1555976~2447 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1251522219999996, 2024-04-26T11:46:36.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041570257999999999, 2024-04-26T11:46:36.390 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.390 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.390 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:36.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176582+0000", 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8480000000000003e-06 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176587+0000", 2024-04-26T11:46:36.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9570000000000001e-06 2024-04-26T11:46:36.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176591+0000", 2024-04-26T11:46:36.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2100000000000003e-06 2024-04-26T11:46:36.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.209125+0000", 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032533714999999998 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.209208+0000", 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3633000000000004e-05 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.217980+0000", 2024-04-26T11:46:36.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0087716340000000004 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.218039+0000", 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9021000000000003e-05 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.218149+0000", 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000109595 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.394 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.395 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.395 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.395 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:36.395 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1251272830000003, 2024-04-26T11:46:36.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:36.395 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.395 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.395 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:36.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:36.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1250689840000003, 2024-04-26T11:46:36.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:36.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:36.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:36.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:36.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:36.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:36.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:36.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:36.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:36.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:36.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:36.405 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.405 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.406 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.406 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.406 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:36.406 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1230317249999997, 2024-04-26T11:46:36.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:36.406 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.406 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.406 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:36.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:36.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.52767362500000004, 2024-04-26T11:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:36.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:11028 4.24 4:27626b90:::10000003118.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:36.081844+0000", 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21988659299999999, 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040862177999999999, 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:36.418 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 11028 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.081844+0000", 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.081844+0000", 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.081843+0000", 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:36.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.088651+0000", 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068083639999999999 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.088669+0000", 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7360999999999999e-05 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.088678+0000", 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1099999999999992e-06 2024-04-26T11:46:36.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.088726+0000", 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8056000000000002e-05 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.088833+0000", 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107087 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.088954+0000", 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121606 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.102727+0000", 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013772085999999999 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.122641+0000", 2024-04-26T11:46:36.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019914171000000001 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.122673+0000", 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2818000000000003e-05 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.122706+0000", 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2749000000000001e-05 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.424 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.425 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:36.425 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:36.425 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:36.425 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:36.433 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:36.425+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:36.440 INFO:tasks.workunit.client.0.smithi029.stdout:3/150: fsync d0/d1/d2f/f39 0 2024-04-26T11:46:36.440 INFO:tasks.workunit.client.0.smithi029.stdout:5/152: fsync db/d12/d1a/f2e 0 2024-04-26T11:46:36.440 INFO:tasks.workunit.client.0.smithi029.stdout:6/152: dwrite d7/f12 [4194304,4194304] 0 2024-04-26T11:46:36.440 INFO:tasks.workunit.client.0.smithi029.stdout:5/153: readlink db/l2a 0 2024-04-26T11:46:36.440 INFO:tasks.workunit.client.0.smithi029.stdout:9/230: dread d4/d5/d7/ff [0,4194304] 0 2024-04-26T11:46:36.440 INFO:tasks.workunit.client.0.smithi029.stdout:5/154: fsync db/d12/d1a/f28 0 2024-04-26T11:46:36.440 INFO:tasks.workunit.client.0.smithi029.stdout:6/153: truncate d7/d25/f28 24857 0 2024-04-26T11:46:36.440 INFO:tasks.workunit.client.0.smithi029.stdout:9/231: write d4/d5/d16/f1c [1218806,114932] 0 2024-04-26T11:46:36.441 INFO:tasks.workunit.client.0.smithi029.stdout:5/155: symlink db/l32 0 2024-04-26T11:46:36.441 INFO:tasks.workunit.client.0.smithi029.stdout:3/151: dread d0/dc/d1f/f2d [0,4194304] 0 2024-04-26T11:46:36.441 INFO:tasks.workunit.client.0.smithi029.stdout:5/156: write f0 [7468743,65842] 0 2024-04-26T11:46:36.441 INFO:tasks.workunit.client.0.smithi029.stdout:6/154: rename d7/f23 to d7/d20/d2f/f33 0 2024-04-26T11:46:36.441 INFO:tasks.workunit.client.0.smithi029.stdout:9/232: rename d4/d5 to d4/d5/d28/d44 22 2024-04-26T11:46:36.441 INFO:tasks.workunit.client.0.smithi029.stdout:3/152: dread - d0/dc/d2a/f35 zero size 2024-04-26T11:46:36.441 INFO:tasks.workunit.client.0.smithi029.stdout:6/155: chown d7/f1a 82078 1 2024-04-26T11:46:36.441 INFO:tasks.workunit.client.0.smithi029.stdout:6/156: mkdir d7/d19/d34 0 2024-04-26T11:46:36.441 INFO:tasks.workunit.client.0.smithi029.stdout:3/153: write d0/d1/f18 [3873499,80805] 0 2024-04-26T11:46:36.441 INFO:tasks.workunit.client.0.smithi029.stdout:1/162: dwrite d7/db/f2d [0,4194304] 0 2024-04-26T11:46:36.441 INFO:tasks.workunit.client.0.smithi029.stdout:9/233: creat d4/d5/f45 x:0 0 0 2024-04-26T11:46:36.442 INFO:tasks.workunit.client.0.smithi029.stdout:3/154: chown d0/d1/d2b/l32 241 1 2024-04-26T11:46:36.442 INFO:tasks.workunit.client.0.smithi029.stdout:1/163: mknod d7/db/dc/df/c31 1 2024-04-26T11:46:36.442 INFO:tasks.workunit.client.0.smithi029.stdout:6/157: rename d7/d20/d27/l2e to d7/d19/l35 0 2024-04-26T11:46:36.442 INFO:tasks.workunit.client.0.smithi029.stdout:6/158: creat d7/d19/f36 x:0 0 0 2024-04-26T11:46:36.442 INFO:tasks.workunit.client.0.smithi029.stdout:1/164: rmdir d7/db 39 2024-04-26T11:46:36.442 INFO:tasks.workunit.client.0.smithi029.stdout:3/155: dwrite d0/d1/f16 [0,4194304] 0 2024-04-26T11:46:36.442 INFO:tasks.workunit.client.0.smithi029.stdout:7/175: dread d11/d18/f22 [0,4194304] 0 2024-04-26T11:46:36.442 INFO:tasks.workunit.client.0.smithi029.stdout:3/156: rename d0/dc/d1f/d25 to d0/dc/d2a/d1a/d3b 0 2024-04-26T11:46:36.442 INFO:tasks.workunit.client.0.smithi029.stdout:7/176: mkdir d11/d18/d35/d39 0 2024-04-26T11:46:36.442 INFO:tasks.workunit.client.0.smithi029.stdout:3/157: mknod d0/dc/d2a/d1a/c3c 1 2024-04-26T11:46:36.442 INFO:tasks.workunit.client.0.smithi029.stdout:6/159: dwrite d7/d20/d27/f2b [0,4194304] 0 2024-04-26T11:46:36.443 INFO:tasks.workunit.client.0.smithi029.stdout:3/158: rename d0/d1/f18 to d0/dc/d2a/d1a/f3d 0 2024-04-26T11:46:36.443 INFO:tasks.workunit.client.0.smithi029.stdout:3/159: symlink d0/d1/d2f/l3e 0 2024-04-26T11:46:36.443 INFO:tasks.workunit.client.0.smithi029.stdout:5/157: write db/d12/d1a/f28 [449571,35284] 0 2024-04-26T11:46:36.443 INFO:tasks.workunit.client.0.smithi029.stdout:5/158: write f7 [1934719,35760] 0 2024-04-26T11:46:36.443 INFO:tasks.workunit.client.0.smithi029.stdout:9/234: rmdir d4/d5 39 2024-04-26T11:46:36.443 INFO:tasks.workunit.client.0.smithi029.stdout:9/235: mkdir d4/d46 0 2024-04-26T11:46:36.443 INFO:tasks.workunit.client.0.smithi029.stdout:6/160: dwrite d7/f1c [4194304,4194304] 0 2024-04-26T11:46:36.443 INFO:tasks.workunit.client.0.smithi029.stdout:5/159: rename db/d12/f30 to db/d12/d1a/f33 0 2024-04-26T11:46:36.443 INFO:tasks.workunit.client.0.smithi029.stdout:9/236: creat d4/d5/d7/f47 x:0 0 0 2024-04-26T11:46:36.443 INFO:tasks.workunit.client.0.smithi029.stdout:9/237: write d4/d5/d7/f36 [4539530,26960] 0 2024-04-26T11:46:36.443 INFO:tasks.workunit.client.0.smithi029.stdout:3/160: write d0/f15 [1289281,2920] 0 2024-04-26T11:46:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/161: mknod d0/d37/c3f 1 2024-04-26T11:46:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/162: mknod d0/c40 1 2024-04-26T11:46:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/163: mkdir d0/d1/d41 0 2024-04-26T11:46:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:5/160: dwrite db/d12/d1a/f27 [0,4194304] 0 2024-04-26T11:46:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:7/177: dwrite d11/d18/f22 [0,4194304] 0 2024-04-26T11:46:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:7/178: chown d11/d18/f29 21936134 1 2024-04-26T11:46:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:7/179: mkdir d11/d18/d1a/d3a 0 2024-04-26T11:46:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:7/180: chown d11/d18/d1a/d33 81646 1 2024-04-26T11:46:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/164: dread d0/dc/f23 [0,4194304] 0 2024-04-26T11:46:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:9/238: dwrite d4/d5/d16/f1c [0,4194304] 0 2024-04-26T11:46:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/165: rename d0/dc/f23 to d0/d1/d41/f42 0 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:5/161: dwrite f0 [4194304,4194304] 0 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:5/162: fsync db/d12/d1f/f23 0 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:5/163: rmdir db 39 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:3/166: link d0/d1/d13/f14 d0/d1/f43 0 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:3/167: rmdir d0/dc/d2a/d1a 39 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:3/168: fdatasync d0/dc/d2a/d1a/f38 0 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:3/169: readlink d0/dc/d2a/l17 0 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:9/239: dwrite d4/d5/d16/f34 [0,4194304] 0 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:3/170: truncate d0/d1/d13/f14 1918135 0 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:7/181: truncate d11/d15/f2a 1120492 0 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:5/164: dwrite db/d12/d1f/f21 [0,4194304] 0 2024-04-26T11:46:36.445 INFO:tasks.workunit.client.0.smithi029.stdout:5/165: write db/d12/d1a/f28 [1174151,11272] 0 2024-04-26T11:46:36.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/240: read d4/d5/fd [4926550,23400] 0 2024-04-26T11:46:36.446 INFO:tasks.workunit.client.0.smithi029.stdout:3/171: read d0/f27 [1658028,28494] 0 2024-04-26T11:46:36.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/241: creat d4/d5/f48 x:0 0 0 2024-04-26T11:46:36.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/242: stat d4/d5/d16/d39/f3d 0 2024-04-26T11:46:36.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/243: mkdir d4/d49 0 2024-04-26T11:46:36.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/244: creat d4/d5/f4a x:0 0 0 2024-04-26T11:46:36.446 INFO:tasks.workunit.client.0.smithi029.stdout:6/161: dread d7/d19/f1e [0,4194304] 0 2024-04-26T11:46:36.446 INFO:tasks.workunit.client.0.smithi029.stdout:6/162: chown d7/l10 237 1 2024-04-26T11:46:36.446 INFO:tasks.workunit.client.0.smithi029.stdout:5/166: dwrite db/d12/d1a/f13 [0,4194304] 0 2024-04-26T11:46:36.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/245: creat d4/d49/f4b x:0 0 0 2024-04-26T11:46:36.446 INFO:tasks.workunit.client.0.smithi029.stdout:6/163: creat d7/d19/f37 x:0 0 0 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:3/172: truncate d0/d1/d13/f14 157764 0 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:5/167: fdatasync db/d12/d1a/f24 0 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:3/173: mknod d0/c44 1 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:9/246: write d4/d5/f6 [1906206,15104] 0 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:5/168: symlink db/d12/d1f/l34 0 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:3/174: creat d0/dc/f45 x:0 0 0 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:3/175: mknod d0/d1/d2b/c46 1 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:6/164: dwrite d7/f11 [0,4194304] 0 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:3/176: link d0/d1/f43 d0/d1/d2b/d33/f47 0 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:6/165: dread d7/d20/d2f/f30 [0,4194304] 0 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:3/177: rename d0/d1/d2b/l32 to d0/l48 0 2024-04-26T11:46:36.447 INFO:tasks.workunit.client.0.smithi029.stdout:5/169: dwrite f4 [0,4194304] 0 2024-04-26T11:46:36.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/166: write d7/f22 [908652,35361] 0 2024-04-26T11:46:36.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/167: chown d7 287001489 1 2024-04-26T11:46:36.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/168: fsync d7/d20/d27/f2b 0 2024-04-26T11:46:36.448 INFO:tasks.workunit.client.0.smithi029.stdout:5/170: creat db/f35 x:0 0 0 2024-04-26T11:46:36.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/169: creat d7/d19/d34/f38 x:0 0 0 2024-04-26T11:46:36.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/170: write d7/d19/f36 [722182,99052] 0 2024-04-26T11:46:36.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/171: stat d7/d20/d2f/f33 0 2024-04-26T11:46:36.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/172: read d7/f1c [7306593,43437] 0 2024-04-26T11:46:36.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/173: creat d7/d25/f39 x:0 0 0 2024-04-26T11:46:36.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/174: creat d7/d20/d2f/f3a x:0 0 0 2024-04-26T11:46:36.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/175: creat d7/d20/d2f/f3b x:0 0 0 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:3/178: dwrite d0/f27 [0,4194304] 0 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:6/176: dread - d7/d19/f37 zero size 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:3/179: read - d0/dc/f31 zero size 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:5/171: creat db/f36 x:0 0 0 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:9/247: dread d4/d5/d7/f36 [0,4194304] 0 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:6/177: fsync d7/d20/d2f/f33 0 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:3/180: chown d0/d1/d41/f42 91541958 1 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:5/172: rename db/d12/l14 to db/d12/d1a/l37 0 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:9/248: chown d4/d5/l22 167565 1 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:9/249: symlink d4/d5/d16/l4c 0 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:5/173: dread db/d12/d1a/f24 [0,4194304] 0 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:5/174: creat db/d12/d1a/f38 x:0 0 0 2024-04-26T11:46:36.449 INFO:tasks.workunit.client.0.smithi029.stdout:5/175: mkdir db/d12/d1f/d39 0 2024-04-26T11:46:36.450 INFO:tasks.workunit.client.0.smithi029.stdout:9/250: dwrite d4/d5/d16/f19 [0,4194304] 0 2024-04-26T11:46:36.450 INFO:tasks.workunit.client.0.smithi029.stdout:9/251: fsync d4/d5/d7/f47 0 2024-04-26T11:46:36.450 INFO:tasks.workunit.client.0.smithi029.stdout:6/178: dwrite d7/f1a [0,4194304] 0 2024-04-26T11:46:36.450 INFO:tasks.workunit.client.0.smithi029.stdout:9/252: getdents d4/d5/d7 0 2024-04-26T11:46:36.450 INFO:tasks.workunit.client.0.smithi029.stdout:9/253: creat d4/d46/f4d x:0 0 0 2024-04-26T11:46:36.450 INFO:tasks.workunit.client.0.smithi029.stdout:6/179: write d7/d19/f36 [597396,127227] 0 2024-04-26T11:46:36.450 INFO:tasks.workunit.client.0.smithi029.stdout:6/180: rmdir d7/d20/d2f 39 2024-04-26T11:46:36.450 INFO:tasks.workunit.client.0.smithi029.stdout:5/176: dwrite db/f35 [0,4194304] 0 2024-04-26T11:46:36.450 INFO:tasks.workunit.client.0.smithi029.stdout:5/177: readlink db/l2a 0 2024-04-26T11:46:36.450 INFO:tasks.workunit.client.0.smithi029.stdout:5/178: truncate db/f36 15119 0 2024-04-26T11:46:36.450 INFO:tasks.workunit.client.0.smithi029.stdout:6/181: symlink d7/d20/d27/l3c 0 2024-04-26T11:46:36.451 INFO:tasks.workunit.client.0.smithi029.stdout:5/179: symlink db/d12/l3a 0 2024-04-26T11:46:36.451 INFO:tasks.workunit.client.0.smithi029.stdout:5/180: mkdir db/d12/d1f/d39/d3b 0 2024-04-26T11:46:36.451 INFO:tasks.workunit.client.0.smithi029.stdout:5/181: fsync f8 0 2024-04-26T11:46:36.451 INFO:tasks.workunit.client.0.smithi029.stdout:5/182: fsync db/f20 0 2024-04-26T11:46:36.451 INFO:tasks.workunit.client.0.smithi029.stdout:9/254: dwrite d4/d5/d7/f47 [0,4194304] 0 2024-04-26T11:46:36.453 INFO:tasks.workunit.client.0.smithi029.stdout:6/182: dwrite d7/d20/d27/f31 [0,4194304] 0 2024-04-26T11:46:36.453 INFO:tasks.workunit.client.0.smithi029.stdout:2/172: sync 2024-04-26T11:46:36.453 INFO:tasks.workunit.client.0.smithi029.stdout:0/134: sync 2024-04-26T11:46:36.453 INFO:tasks.workunit.client.0.smithi029.stdout:2/173: rmdir d12/d24 39 2024-04-26T11:46:36.453 INFO:tasks.workunit.client.0.smithi029.stdout:6/183: getdents d7/d19/d34 0 2024-04-26T11:46:36.453 INFO:tasks.workunit.client.0.smithi029.stdout:0/135: getdents d9/d16 0 2024-04-26T11:46:36.453 INFO:tasks.workunit.client.0.smithi029.stdout:6/184: truncate d7/f32 24271 0 2024-04-26T11:46:36.453 INFO:tasks.workunit.client.0.smithi029.stdout:5/183: dwrite db/f1e [0,4194304] 0 2024-04-26T11:46:36.453 INFO:tasks.workunit.client.0.smithi029.stdout:5/184: chown db/d12/d1a/f10 3768104 1 2024-04-26T11:46:36.454 INFO:tasks.workunit.client.0.smithi029.stdout:6/185: write d7/d20/d2f/f3a [542580,39028] 0 2024-04-26T11:46:36.454 INFO:tasks.workunit.client.0.smithi029.stdout:6/186: write d7/d20/d2f/f3b [931285,98521] 0 2024-04-26T11:46:36.454 INFO:tasks.workunit.client.0.smithi029.stdout:5/185: truncate db/d12/d1a/f38 954527 0 2024-04-26T11:46:36.455 INFO:tasks.workunit.client.0.smithi029.stdout:0/136: dread d9/f18 [0,4194304] 0 2024-04-26T11:46:36.456 INFO:tasks.workunit.client.0.smithi029.stdout:0/137: truncate d9/f1e 952117 0 2024-04-26T11:46:36.458 INFO:tasks.workunit.client.0.smithi029.stdout:0/138: mkdir d9/d16/d25/d2a 0 2024-04-26T11:46:36.458 INFO:tasks.workunit.client.0.smithi029.stdout:2/174: truncate d12/f1c 201932 0 2024-04-26T11:46:36.458 INFO:tasks.workunit.client.0.smithi029.stdout:5/186: write db/d12/d1a/f16 [855399,91034] 0 2024-04-26T11:46:36.458 INFO:tasks.workunit.client.0.smithi029.stdout:2/175: chown d12/f1a 34 1 2024-04-26T11:46:36.459 INFO:tasks.workunit.client.0.smithi029.stdout:5/187: mknod db/d12/d1a/c3c 1 2024-04-26T11:46:36.460 INFO:tasks.workunit.client.0.smithi029.stdout:6/187: dwrite d7/f11 [0,4194304] 0 2024-04-26T11:46:36.460 INFO:tasks.workunit.client.0.smithi029.stdout:0/139: link d9/fe d9/d16/d25/f2b 0 2024-04-26T11:46:36.461 INFO:tasks.workunit.client.0.smithi029.stdout:6/188: stat d7/l10 0 2024-04-26T11:46:36.465 INFO:tasks.workunit.client.0.smithi029.stdout:0/140: dread d9/f20 [0,4194304] 0 2024-04-26T11:46:36.466 INFO:tasks.workunit.client.0.smithi029.stdout:0/141: creat d9/d16/d25/d27/f2c x:0 0 0 2024-04-26T11:46:36.466 INFO:tasks.workunit.client.0.smithi029.stdout:5/188: dread db/d12/d1f/f21 [0,4194304] 0 2024-04-26T11:46:36.466 INFO:tasks.workunit.client.0.smithi029.stdout:2/176: truncate d12/f1b 941514 0 2024-04-26T11:46:36.466 INFO:tasks.workunit.client.0.smithi029.stdout:6/189: truncate d7/f12 5274417 0 2024-04-26T11:46:36.467 INFO:tasks.workunit.client.0.smithi029.stdout:0/142: stat d9/d16/f24 0 2024-04-26T11:46:36.467 INFO:tasks.workunit.client.0.smithi029.stdout:2/177: fsync d12/f23 0 2024-04-26T11:46:36.467 INFO:tasks.workunit.client.0.smithi029.stdout:6/190: dread - d7/d25/f39 zero size 2024-04-26T11:46:36.467 INFO:tasks.workunit.client.0.smithi029.stdout:0/143: creat d9/f2d x:0 0 0 2024-04-26T11:46:36.468 INFO:tasks.workunit.client.0.smithi029.stdout:5/189: link db/f35 db/d12/d1f/f3d 0 2024-04-26T11:46:36.468 INFO:tasks.workunit.client.0.smithi029.stdout:0/144: write d9/f1d [765484,10725] 0 2024-04-26T11:46:36.469 INFO:tasks.workunit.client.0.smithi029.stdout:0/145: chown d9/d16/d25/f2b 17 1 2024-04-26T11:46:36.470 INFO:tasks.workunit.client.0.smithi029.stdout:5/190: truncate db/d12/d1a/f10 930203 0 2024-04-26T11:46:36.470 INFO:tasks.workunit.client.0.smithi029.stdout:0/146: dread - d9/f2d zero size 2024-04-26T11:46:36.471 INFO:tasks.workunit.client.0.smithi029.stdout:0/147: mknod d9/d16/c2e 1 2024-04-26T11:46:36.471 INFO:tasks.workunit.client.0.smithi029.stdout:5/191: fsync db/d12/d1a/f16 0 2024-04-26T11:46:36.471 INFO:tasks.workunit.client.0.smithi029.stdout:0/148: mkdir d9/d16/d1a/d2f 0 2024-04-26T11:46:36.471 INFO:tasks.workunit.client.0.smithi029.stdout:5/192: readlink db/d12/d1f/l2d 0 2024-04-26T11:46:36.472 INFO:tasks.workunit.client.0.smithi029.stdout:0/149: chown d9/fc 812082821 1 2024-04-26T11:46:36.472 INFO:tasks.workunit.client.0.smithi029.stdout:6/191: dread d7/d19/f1e [0,4194304] 0 2024-04-26T11:46:36.482 INFO:tasks.workunit.client.0.smithi029.stdout:0/150: dwrite d9/d16/f24 [0,4194304] 0 2024-04-26T11:46:36.482 INFO:tasks.workunit.client.0.smithi029.stdout:6/192: dwrite d7/d19/f24 [0,4194304] 0 2024-04-26T11:46:36.483 INFO:tasks.workunit.client.0.smithi029.stdout:4/147: sync 2024-04-26T11:46:36.484 INFO:tasks.workunit.client.0.smithi029.stdout:6/193: creat d7/d20/d2f/f3d x:0 0 0 2024-04-26T11:46:36.485 INFO:tasks.workunit.client.0.smithi029.stdout:4/148: creat d3/d1d/db/d13/f2f x:0 0 0 2024-04-26T11:46:36.485 INFO:tasks.workunit.client.0.smithi029.stdout:0/151: dread d9/f1e [0,4194304] 0 2024-04-26T11:46:36.486 INFO:tasks.workunit.client.0.smithi029.stdout:0/152: chown d9/d16/d1a 10446128 1 2024-04-26T11:46:36.488 INFO:tasks.workunit.client.0.smithi029.stdout:6/194: truncate d7/d19/f1e 2312890 0 2024-04-26T11:46:36.489 INFO:tasks.workunit.client.0.smithi029.stdout:0/153: mkdir d9/d16/d30 0 2024-04-26T11:46:36.490 INFO:tasks.workunit.client.0.smithi029.stdout:6/195: link d7/f12 d7/f3e 0 2024-04-26T11:46:36.490 INFO:tasks.workunit.client.0.smithi029.stdout:6/196: mknod d7/d25/c3f 1 2024-04-26T11:46:36.491 INFO:tasks.workunit.client.0.smithi029.stdout:3/181: sync 2024-04-26T11:46:36.491 INFO:tasks.workunit.client.0.smithi029.stdout:1/165: sync 2024-04-26T11:46:36.491 INFO:tasks.workunit.client.0.smithi029.stdout:8/167: sync 2024-04-26T11:46:36.491 INFO:tasks.workunit.client.0.smithi029.stdout:9/255: sync 2024-04-26T11:46:36.491 INFO:tasks.workunit.client.0.smithi029.stdout:7/182: sync 2024-04-26T11:46:36.492 INFO:tasks.workunit.client.0.smithi029.stdout:6/197: readlink l5 0 2024-04-26T11:46:36.492 INFO:tasks.workunit.client.0.smithi029.stdout:9/256: mknod d4/d5/c4e 1 2024-04-26T11:46:36.493 INFO:tasks.workunit.client.0.smithi029.stdout:3/182: creat d0/d1/f49 x:0 0 0 2024-04-26T11:46:36.493 INFO:tasks.workunit.client.0.smithi029.stdout:7/183: mkdir d11/d37/d3b 0 2024-04-26T11:46:36.493 INFO:tasks.workunit.client.0.smithi029.stdout:1/166: symlink d7/db/dc/df/l32 0 2024-04-26T11:46:36.494 INFO:tasks.workunit.client.0.smithi029.stdout:3/183: fsync d0/d1/d2f/f3a 0 2024-04-26T11:46:36.494 INFO:tasks.workunit.client.0.smithi029.stdout:9/257: creat d4/d5/d28/f4f x:0 0 0 2024-04-26T11:46:36.494 INFO:tasks.workunit.client.0.smithi029.stdout:8/168: truncate dc/de/d2e/d23/f21 380101 0 2024-04-26T11:46:36.495 INFO:tasks.workunit.client.0.smithi029.stdout:7/184: write f9 [4960847,64969] 0 2024-04-26T11:46:36.495 INFO:tasks.workunit.client.0.smithi029.stdout:6/198: creat d7/d20/f40 x:0 0 0 2024-04-26T11:46:36.496 INFO:tasks.workunit.client.0.smithi029.stdout:1/167: rename d7/db to d7/db/d10/d1e/d33 22 2024-04-26T11:46:36.496 INFO:tasks.workunit.client.0.smithi029.stdout:6/199: dread - d7/d19/d34/f38 zero size 2024-04-26T11:46:36.497 INFO:tasks.workunit.client.0.smithi029.stdout:3/184: getdents d0/d1/d2f 0 2024-04-26T11:46:36.498 INFO:tasks.workunit.client.0.smithi029.stdout:7/185: truncate d11/d18/d1a/f38 92667 0 2024-04-26T11:46:36.498 INFO:tasks.workunit.client.0.smithi029.stdout:6/200: write d7/d19/f36 [1573708,40779] 0 2024-04-26T11:46:36.498 INFO:tasks.workunit.client.0.smithi029.stdout:1/168: creat d7/db/f34 x:0 0 0 2024-04-26T11:46:36.498 INFO:tasks.workunit.client.0.smithi029.stdout:3/185: fsync d0/d1/f16 0 2024-04-26T11:46:36.499 INFO:tasks.workunit.client.0.smithi029.stdout:1/169: fdatasync d7/f1c 0 2024-04-26T11:46:36.499 INFO:tasks.workunit.client.0.smithi029.stdout:7/186: chown d11/d18/d1a/d26/l2e 47843 1 2024-04-26T11:46:36.500 INFO:tasks.workunit.client.0.smithi029.stdout:7/187: readlink d11/d18/d1a/d26/l2e 0 2024-04-26T11:46:36.505 INFO:tasks.workunit.client.0.smithi029.stdout:1/170: link f2 d7/f35 0 2024-04-26T11:46:36.505 INFO:tasks.workunit.client.0.smithi029.stdout:0/154: write d9/d16/d25/f2b [179903,116067] 0 2024-04-26T11:46:36.505 INFO:tasks.workunit.client.0.smithi029.stdout:7/188: rmdir d11/d18/d1a/d3a 0 2024-04-26T11:46:36.505 INFO:tasks.workunit.client.0.smithi029.stdout:9/258: dwrite d4/d5/d16/d39/f42 [0,4194304] 0 2024-04-26T11:46:36.506 INFO:tasks.workunit.client.0.smithi029.stdout:8/169: dread dc/f11 [0,4194304] 0 2024-04-26T11:46:36.508 INFO:tasks.workunit.client.0.smithi029.stdout:7/189: chown d11/f17 287050 1 2024-04-26T11:46:36.508 INFO:tasks.workunit.client.0.smithi029.stdout:1/171: write d7/db/dc/f2f [255902,6288] 0 2024-04-26T11:46:36.509 INFO:tasks.workunit.client.0.smithi029.stdout:9/259: unlink d4/d5/d7/f11 0 2024-04-26T11:46:36.509 INFO:tasks.workunit.client.0.smithi029.stdout:8/170: mknod dc/de/d2e/d23/c37 1 2024-04-26T11:46:36.510 INFO:tasks.workunit.client.0.smithi029.stdout:0/155: mkdir d9/d16/d1a/d2f/d31 0 2024-04-26T11:46:36.510 INFO:tasks.workunit.client.0.smithi029.stdout:4/149: dread d3/f5 [0,4194304] 0 2024-04-26T11:46:36.512 INFO:tasks.workunit.client.0.smithi029.stdout:6/201: dwrite d7/d20/d2f/f33 [0,4194304] 0 2024-04-26T11:46:36.512 INFO:tasks.workunit.client.0.smithi029.stdout:7/190: creat d11/d18/d1a/f3c x:0 0 0 2024-04-26T11:46:36.514 INFO:tasks.workunit.client.0.smithi029.stdout:6/202: rmdir d7/d20/d2f 39 2024-04-26T11:46:36.515 INFO:tasks.workunit.client.0.smithi029.stdout:0/156: mkdir d9/d16/d1a/d2f/d32 0 2024-04-26T11:46:36.516 INFO:tasks.workunit.client.0.smithi029.stdout:3/186: dwrite d0/d1/d2b/d33/f47 [0,4194304] 0 2024-04-26T11:46:36.517 INFO:tasks.workunit.client.0.smithi029.stdout:6/203: fdatasync d7/d20/d2f/f3b 0 2024-04-26T11:46:36.518 INFO:tasks.workunit.client.0.smithi029.stdout:1/172: dread d7/db/f2d [0,4194304] 0 2024-04-26T11:46:36.518 INFO:tasks.workunit.client.0.smithi029.stdout:0/157: truncate d9/d16/d25/d27/f2c 142423 0 2024-04-26T11:46:36.521 INFO:tasks.workunit.client.0.smithi029.stdout:1/173: rename d7/db/dc/df/f18 to d7/f36 0 2024-04-26T11:46:36.521 INFO:tasks.workunit.client.0.smithi029.stdout:4/150: dread d3/d1d/f22 [0,4194304] 0 2024-04-26T11:46:36.521 INFO:tasks.workunit.client.0.smithi029.stdout:9/260: dwrite d4/d5/d7/f47 [4194304,4194304] 0 2024-04-26T11:46:36.523 INFO:tasks.workunit.client.0.smithi029.stdout:1/174: getdents d7/db/d10 0 2024-04-26T11:46:36.524 INFO:tasks.workunit.client.0.smithi029.stdout:9/261: getdents d4/d5/d28 0 2024-04-26T11:46:36.525 INFO:tasks.workunit.client.0.smithi029.stdout:1/175: chown d7/db/d10/f2c 18473 1 2024-04-26T11:46:36.525 INFO:tasks.workunit.client.0.smithi029.stdout:9/262: read d4/d5/d16/f1c [3525895,69124] 0 2024-04-26T11:46:36.527 INFO:tasks.workunit.client.0.smithi029.stdout:0/158: rename d9/d16/d1a to d9/d16/d33 0 2024-04-26T11:46:36.527 INFO:tasks.workunit.client.0.smithi029.stdout:1/176: mkdir d7/d37 0 2024-04-26T11:46:36.528 INFO:tasks.workunit.client.0.smithi029.stdout:9/263: mknod d4/d5/d7/c50 1 2024-04-26T11:46:36.528 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:36.525+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:36.528 INFO:tasks.workunit.client.0.smithi029.stdout:0/159: creat d9/d16/d25/f34 x:0 0 0 2024-04-26T11:46:36.529 INFO:tasks.workunit.client.0.smithi029.stdout:6/204: dwrite d7/d20/d2f/f33 [4194304,4194304] 0 2024-04-26T11:46:36.529 INFO:tasks.workunit.client.0.smithi029.stdout:1/177: creat d7/db/f38 x:0 0 0 2024-04-26T11:46:36.529 INFO:tasks.workunit.client.0.smithi029.stdout:4/151: dread d3/f7 [0,4194304] 0 2024-04-26T11:46:36.529 INFO:tasks.workunit.client.0.smithi029.stdout:0/160: creat d9/d16/d33/f35 x:0 0 0 2024-04-26T11:46:36.530 INFO:tasks.workunit.client.0.smithi029.stdout:6/205: creat d7/d20/d27/f41 x:0 0 0 2024-04-26T11:46:36.530 INFO:tasks.workunit.client.0.smithi029.stdout:6/206: chown d7/d19/f36 8525726 1 2024-04-26T11:46:36.532 INFO:tasks.workunit.client.0.smithi029.stdout:5/193: sync 2024-04-26T11:46:36.532 INFO:tasks.workunit.client.0.smithi029.stdout:2/178: sync 2024-04-26T11:46:36.532 INFO:tasks.workunit.client.0.smithi029.stdout:3/187: sync 2024-04-26T11:46:36.532 INFO:tasks.workunit.client.0.smithi029.stdout:7/191: sync 2024-04-26T11:46:36.534 INFO:tasks.workunit.client.0.smithi029.stdout:0/161: rename d9/d16/d33/f29 to d9/f36 0 2024-04-26T11:46:36.534 INFO:tasks.workunit.client.0.smithi029.stdout:2/179: truncate d12/f1a 4513880 0 2024-04-26T11:46:36.534 INFO:tasks.workunit.client.0.smithi029.stdout:5/194: rmdir db/d12/d1a 39 2024-04-26T11:46:36.536 INFO:tasks.workunit.client.0.smithi029.stdout:0/162: mknod d9/d16/d25/d2a/c37 1 2024-04-26T11:46:36.536 INFO:tasks.workunit.client.0.smithi029.stdout:7/192: rename d11/d18/d1a/d26/l2e to d11/d18/d35/l3d 0 2024-04-26T11:46:36.536 INFO:tasks.workunit.client.0.smithi029.stdout:2/180: creat d12/d24/f35 x:0 0 0 2024-04-26T11:46:36.537 INFO:tasks.workunit.client.0.smithi029.stdout:7/193: unlink d11/f19 0 2024-04-26T11:46:36.537 INFO:tasks.workunit.client.0.smithi029.stdout:2/181: dread - d12/d24/f35 zero size 2024-04-26T11:46:36.538 INFO:tasks.workunit.client.0.smithi029.stdout:0/163: link d9/f20 d9/d16/d33/f38 0 2024-04-26T11:46:36.539 INFO:tasks.workunit.client.0.smithi029.stdout:9/264: dwrite d4/d5/f48 [0,4194304] 0 2024-04-26T11:46:36.539 INFO:tasks.workunit.client.0.smithi029.stdout:0/164: fdatasync d9/fc 0 2024-04-26T11:46:36.539 INFO:tasks.workunit.client.0.smithi029.stdout:6/207: dread d7/d20/d27/f31 [0,4194304] 0 2024-04-26T11:46:36.541 INFO:tasks.workunit.client.0.smithi029.stdout:0/165: write d9/d16/d25/f2b [1116586,84735] 0 2024-04-26T11:46:36.542 INFO:tasks.workunit.client.0.smithi029.stdout:6/208: rmdir d7/d19/d34 39 2024-04-26T11:46:36.542 INFO:tasks.workunit.client.0.smithi029.stdout:6/209: write d7/d20/d2f/f3b [813511,93899] 0 2024-04-26T11:46:36.543 INFO:tasks.workunit.client.0.smithi029.stdout:3/188: dwrite d0/dc/d2a/d1a/f3d [4194304,4194304] 0 2024-04-26T11:46:36.544 INFO:tasks.workunit.client.0.smithi029.stdout:3/189: chown d0/d1/d2f/l3e 191 1 2024-04-26T11:46:36.545 INFO:tasks.workunit.client.0.smithi029.stdout:7/194: dread f8 [0,4194304] 0 2024-04-26T11:46:36.545 INFO:tasks.workunit.client.0.smithi029.stdout:7/195: stat f6 0 2024-04-26T11:46:36.546 INFO:tasks.workunit.client.0.smithi029.stdout:4/152: truncate d3/f1e 1206634 0 2024-04-26T11:46:36.547 INFO:tasks.workunit.client.0.smithi029.stdout:3/190: symlink d0/d1/l4a 0 2024-04-26T11:46:36.549 INFO:tasks.workunit.client.0.smithi029.stdout:5/195: sync 2024-04-26T11:46:36.549 INFO:tasks.workunit.client.0.smithi029.stdout:9/265: sync 2024-04-26T11:46:36.550 INFO:tasks.workunit.client.0.smithi029.stdout:7/196: truncate d11/f1e 2527579 0 2024-04-26T11:46:36.551 INFO:tasks.workunit.client.0.smithi029.stdout:7/197: readlink d11/d18/l24 0 2024-04-26T11:46:36.552 INFO:tasks.workunit.client.0.smithi029.stdout:5/196: symlink db/d12/l3e 0 2024-04-26T11:46:36.556 INFO:tasks.workunit.client.0.smithi029.stdout:7/198: stat d11/d18/d1a 0 2024-04-26T11:46:36.556 INFO:tasks.workunit.client.0.smithi029.stdout:0/166: dwrite d9/d16/d25/f2b [4194304,4194304] 0 2024-04-26T11:46:36.556 INFO:tasks.workunit.client.0.smithi029.stdout:6/210: dread d7/d20/d2f/f3b [0,4194304] 0 2024-04-26T11:46:36.557 INFO:tasks.workunit.client.0.smithi029.stdout:2/182: truncate d12/f28 651738 0 2024-04-26T11:46:36.558 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:36.558 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:36.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.558 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11264 4.e 4:726ffa32:::10000003142.00000001:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.558 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.545632+0000", 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.012670733, 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012697734, 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11264 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.545632+0000", 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.545632+0000", 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.545631+0000", 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.549583+0000", 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003952087 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.549598+0000", 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5017999999999999e-05 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.549605+0000", 2024-04-26T11:46:36.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.549680+0000", 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5561000000000004e-05 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.549772+0000", 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1330999999999997e-05 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.549945+0000", 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017318499999999999 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11272 4.26 4:641e23f3:::10000003132.00000000:head [read 131072~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.555900+0000", 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0024022710000000001, 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00251505, 2024-04-26T11:46:36.563 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11272 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.555900+0000", 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.555900+0000", 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.555899+0000", 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.555906+0000", 2024-04-26T11:46:36.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5859999999999999e-06 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.555920+0000", 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.555929+0000", 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2560000000000008e-06 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.555968+0000", 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8890000000000002e-05 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.556048+0000", 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9359999999999999e-05 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:792 4.a 4:50e3ddcc:::100000031a7.00000000:head [trimtrunc 2@1206634] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.556191+0000", 2024-04-26T11:46:36.567 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0021111770000000001, 2024-04-26T11:46:36.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023152479999999998, 2024-04-26T11:46:36.568 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.568 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:46:36.568 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.556191+0000", 2024-04-26T11:46:36.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.556191+0000", 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.556190+0000", 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.556195+0000", 2024-04-26T11:46:36.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1109999999999999e-06 2024-04-26T11:46:36.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.556207+0000", 2024-04-26T11:46:36.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2027e-05 2024-04-26T11:46:36.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.556214+0000", 2024-04-26T11:46:36.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3980000000000004e-06 2024-04-26T11:46:36.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.556280+0000", 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6519000000000005e-05 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.556377+0000", 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6759e-05 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.571 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11274 4.1b 4:d94fa8da:::10000003190.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.557356+0000", 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00094667000000000004, 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001230444, 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11274 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.572 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.557356+0000", 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.557356+0000", 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.557355+0000", 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.557359+0000", 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9820000000000002e-06 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.557372+0000", 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3103e-05 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.557377+0000", 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4099999999999999e-06 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.557434+0000", 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6860000000000001e-05 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.557533+0000", 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9158000000000002e-05 2024-04-26T11:46:36.575 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11259 4.25 4:a43eb3e5:::10000003206.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.540845+0000", 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.017457670000000002, 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017831171999999999, 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.576 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11259 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.540845+0000", 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.540845+0000", 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.540843+0000", 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.545519+0000", 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046757439999999999 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.545537+0000", 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8301e-05 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.545548+0000", 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0507e-05 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.545600+0000", 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2707999999999997e-05 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.545722+0000", 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012113899999999999 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.545835+0000", 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113145 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.557985+0000", 2024-04-26T11:46:36.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012150219 2024-04-26T11:46:36.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.581 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.581 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:46:36.581 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 5 2024-04-26T11:46:36.581 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:36.583 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:36.588 INFO:tasks.workunit.client.0.smithi029.stdout:1/178: dwrite f2 [0,4194304] 0 2024-04-26T11:46:36.588 INFO:tasks.workunit.client.0.smithi029.stdout:0/167: write d9/d16/d25/f34 [1025364,37559] 0 2024-04-26T11:46:36.588 INFO:tasks.workunit.client.0.smithi029.stdout:2/183: mkdir d12/d24/d29/d36 0 2024-04-26T11:46:36.588 INFO:tasks.workunit.client.0.smithi029.stdout:7/199: dread d11/d18/d1a/f38 [0,4194304] 0 2024-04-26T11:46:36.588 INFO:tasks.workunit.client.0.smithi029.stdout:1/179: write f6 [2359875,82865] 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:3/191: dwrite d0/d1/f16 [4194304,4194304] 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:6/211: truncate d7/f11 3818669 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:2/184: write d12/f1d [181476,99933] 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/197: rename db/d12/d1a/l37 to db/d12/d1f/d39/l3f 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:0/168: creat d9/d16/d25/d2a/f39 x:0 0 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/198: mkdir db/d40 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:3/192: creat d0/f4b x:0 0 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:6/212: mkdir d7/d20/d27/d42 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:0/169: symlink d9/d16/d33/d2f/d32/l3a 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:9/266: dwrite d4/d5/d7/f35 [0,4194304] 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/199: write db/d12/d1a/f38 [1208763,13298] 0 2024-04-26T11:46:36.589 INFO:tasks.workunit.client.0.smithi029.stdout:3/193: mkdir d0/d1/d41/d4c 0 2024-04-26T11:46:36.590 INFO:tasks.workunit.client.0.smithi029.stdout:9/267: fdatasync d4/d49/f4b 0 2024-04-26T11:46:36.590 INFO:tasks.workunit.client.0.smithi029.stdout:8/171: dread dc/de/f29 [0,4194304] 0 2024-04-26T11:46:36.590 INFO:tasks.workunit.client.0.smithi029.stdout:6/213: rename d7/d25/f39 to d7/d19/d34/f43 0 2024-04-26T11:46:36.590 INFO:tasks.workunit.client.0.smithi029.stdout:5/200: creat db/d12/d1f/d39/f41 x:0 0 0 2024-04-26T11:46:36.590 INFO:tasks.workunit.client.0.smithi029.stdout:3/194: mkdir d0/dc/d2a/d4d 0 2024-04-26T11:46:36.590 INFO:tasks.workunit.client.0.smithi029.stdout:5/201: dread - db/f20 zero size 2024-04-26T11:46:36.590 INFO:tasks.workunit.client.0.smithi029.stdout:3/195: link d0/d1/d41/f42 d0/dc/f4e 0 2024-04-26T11:46:36.590 INFO:tasks.workunit.client.0.smithi029.stdout:5/202: dread - db/d12/d1f/d39/f41 zero size 2024-04-26T11:46:36.590 INFO:tasks.workunit.client.0.smithi029.stdout:6/214: dread d7/d20/d2f/f30 [0,4194304] 0 2024-04-26T11:46:36.590 INFO:tasks.workunit.client.0.smithi029.stdout:3/196: write d0/d1/d2f/f39 [386585,67335] 0 2024-04-26T11:46:36.590 INFO:tasks.workunit.client.0.smithi029.stdout:6/215: write d7/f22 [466155,89550] 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:5/203: creat db/d12/d1f/d39/d3b/f42 x:0 0 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:0/170: dwrite d9/f2d [0,4194304] 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:1/180: truncate f6 1264292 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:5/204: symlink db/d40/l43 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:3/197: creat d0/dc/d2a/d1a/d3b/f4f x:0 0 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:1/181: mknod d7/d25/c39 1 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:0/171: fsync d9/d16/f22 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:9/268: dwrite d4/d5/fb [0,4194304] 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:3/198: fsync d0/d1/d13/f14 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:2/185: dread d12/f2a [0,4194304] 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:1/182: symlink d7/l3a 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:3/199: stat d0/dc/d2a/l17 0 2024-04-26T11:46:36.591 INFO:tasks.workunit.client.0.smithi029.stdout:9/269: chown d4/d5/d16/f34 221 1 2024-04-26T11:46:36.592 INFO:tasks.workunit.client.0.smithi029.stdout:5/205: fdatasync db/d12/d1a/f10 0 2024-04-26T11:46:36.592 INFO:tasks.workunit.client.0.smithi029.stdout:1/183: unlink d7/db/dc/f2b 0 2024-04-26T11:46:36.592 INFO:tasks.workunit.client.0.smithi029.stdout:1/184: dread - d7/db/f38 zero size 2024-04-26T11:46:36.592 INFO:tasks.workunit.client.0.smithi029.stdout:3/200: write d0/dc/d2a/d1a/d3b/f4f [720638,60836] 0 2024-04-26T11:46:36.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/153: dread d3/f14 [0,4194304] 0 2024-04-26T11:46:36.592 INFO:tasks.workunit.client.0.smithi029.stdout:2/186: getdents d12 0 2024-04-26T11:46:36.592 INFO:tasks.workunit.client.0.smithi029.stdout:1/185: symlink d7/db/d10/d20/l3b 0 2024-04-26T11:46:36.592 INFO:tasks.workunit.client.0.smithi029.stdout:9/270: creat d4/d5/f51 x:0 0 0 2024-04-26T11:46:36.592 INFO:tasks.workunit.client.0.smithi029.stdout:1/186: mknod d7/c3c 1 2024-04-26T11:46:36.592 INFO:tasks.workunit.client.0.smithi029.stdout:3/201: getdents d0/dc/d2a/d4d 0 2024-04-26T11:46:36.594 INFO:tasks.workunit.client.0.smithi029.stdout:9/271: readlink d4/l12 0 2024-04-26T11:46:36.594 INFO:tasks.workunit.client.0.smithi029.stdout:2/187: rename d12/d24/l32 to d12/l37 0 2024-04-26T11:46:36.594 INFO:tasks.workunit.client.0.smithi029.stdout:3/202: mknod d0/dc/d2a/d1a/d3b/c50 1 2024-04-26T11:46:36.594 INFO:tasks.workunit.client.0.smithi029.stdout:4/154: mkdir d3/d1d/d11/d26/d30 0 2024-04-26T11:46:36.595 INFO:tasks.workunit.client.0.smithi029.stdout:9/272: chown d4/d5/d16/l2a 559 1 2024-04-26T11:46:36.595 INFO:tasks.workunit.client.0.smithi029.stdout:4/155: creat d3/f31 x:0 0 0 2024-04-26T11:46:36.595 INFO:tasks.workunit.client.0.smithi029.stdout:9/273: chown d4/d5/d16/l4c 30 1 2024-04-26T11:46:36.595 INFO:tasks.workunit.client.0.smithi029.stdout:9/274: write d4/d5/f45 [394214,28669] 0 2024-04-26T11:46:36.595 INFO:tasks.workunit.client.0.smithi029.stdout:5/206: dwrite f7 [0,4194304] 0 2024-04-26T11:46:36.595 INFO:tasks.workunit.client.0.smithi029.stdout:7/200: truncate d11/d18/f22 2926106 0 2024-04-26T11:46:36.595 INFO:tasks.workunit.client.0.smithi029.stdout:4/156: chown d3/d1d/l17 40 1 2024-04-26T11:46:36.596 INFO:tasks.workunit.client.0.smithi029.stdout:1/187: truncate f6 1658138 0 2024-04-26T11:46:36.596 INFO:tasks.workunit.client.0.smithi029.stdout:9/275: write d4/d5/d7/f35 [4834387,91346] 0 2024-04-26T11:46:36.596 INFO:tasks.workunit.client.0.smithi029.stdout:7/201: symlink d11/d18/d35/d39/l3e 0 2024-04-26T11:46:36.596 INFO:tasks.workunit.client.0.smithi029.stdout:5/207: creat db/d12/f44 x:0 0 0 2024-04-26T11:46:36.597 INFO:tasks.workunit.client.0.smithi029.stdout:9/276: mknod d4/d46/c52 1 2024-04-26T11:46:36.597 INFO:tasks.workunit.client.0.smithi029.stdout:1/188: symlink d7/db/dc/l3d 0 2024-04-26T11:46:36.597 INFO:tasks.workunit.client.0.smithi029.stdout:5/208: mknod db/d12/d1a/c45 1 2024-04-26T11:46:36.598 INFO:tasks.workunit.client.0.smithi029.stdout:1/189: chown d7/db/dc 58624216 1 2024-04-26T11:46:36.598 INFO:tasks.workunit.client.0.smithi029.stdout:4/157: chown d3/d1d/l17 1 1 2024-04-26T11:46:36.599 INFO:tasks.workunit.client.0.smithi029.stdout:9/277: unlink d4/d5/l41 0 2024-04-26T11:46:36.600 INFO:tasks.workunit.client.0.smithi029.stdout:0/172: truncate f3 1584504 0 2024-04-26T11:46:36.600 INFO:tasks.workunit.client.0.smithi029.stdout:5/209: symlink db/d12/d1f/d39/l46 0 2024-04-26T11:46:36.600 INFO:tasks.workunit.client.0.smithi029.stdout:3/203: dwrite d0/f1b [4194304,4194304] 0 2024-04-26T11:46:36.600 INFO:tasks.workunit.client.0.smithi029.stdout:0/173: creat d9/f3b x:0 0 0 2024-04-26T11:46:36.601 INFO:tasks.workunit.client.0.smithi029.stdout:0/174: write d9/f3b [685402,121386] 0 2024-04-26T11:46:36.602 INFO:tasks.workunit.client.0.smithi029.stdout:3/204: creat d0/d1/d2b/d33/f51 x:0 0 0 2024-04-26T11:46:36.602 INFO:tasks.workunit.client.0.smithi029.stdout:7/202: dread fc [0,4194304] 0 2024-04-26T11:46:36.603 INFO:tasks.workunit.client.0.smithi029.stdout:0/175: write d9/fa [1252477,116217] 0 2024-04-26T11:46:36.603 INFO:tasks.workunit.client.0.smithi029.stdout:7/203: creat d11/d15/f3f x:0 0 0 2024-04-26T11:46:36.603 INFO:tasks.workunit.client.0.smithi029.stdout:0/176: creat d9/f3c x:0 0 0 2024-04-26T11:46:36.605 INFO:tasks.workunit.client.0.smithi029.stdout:6/216: chown d7/f12 6024 1 2024-04-26T11:46:36.605 INFO:tasks.workunit.client.0.smithi029.stdout:7/204: chown d11/d18/d1a/d33 11124 1 2024-04-26T11:46:36.605 INFO:tasks.workunit.client.0.smithi029.stdout:0/177: fsync d9/d16/d25/f2b 0 2024-04-26T11:46:36.605 INFO:tasks.workunit.client.0.smithi029.stdout:1/190: rename d7/db/dc to d7/d37/d3e 0 2024-04-26T11:46:36.606 INFO:tasks.workunit.client.0.smithi029.stdout:5/210: write db/d12/d1a/f18 [903708,78260] 0 2024-04-26T11:46:36.607 INFO:tasks.workunit.client.0.smithi029.stdout:7/205: fsync f8 0 2024-04-26T11:46:36.607 INFO:tasks.workunit.client.0.smithi029.stdout:6/217: truncate d7/f32 218433 0 2024-04-26T11:46:36.609 INFO:tasks.workunit.client.0.smithi029.stdout:1/191: creat d7/d37/d3e/f3f x:0 0 0 2024-04-26T11:46:36.610 INFO:tasks.workunit.client.0.smithi029.stdout:3/205: rename d0/dc/d2a/f35 to d0/f52 0 2024-04-26T11:46:36.610 INFO:tasks.workunit.client.0.smithi029.stdout:6/218: mknod d7/d20/c44 1 2024-04-26T11:46:36.610 INFO:tasks.workunit.client.0.smithi029.stdout:3/206: sync 2024-04-26T11:46:36.610 INFO:tasks.workunit.client.0.smithi029.stdout:5/211: dread - db/d12/d1f/d39/d3b/f42 zero size 2024-04-26T11:46:36.610 INFO:tasks.workunit.client.0.smithi029.stdout:7/206: creat d11/d18/f40 x:0 0 0 2024-04-26T11:46:36.612 INFO:tasks.workunit.client.0.smithi029.stdout:3/207: chown d0/f27 54014 1 2024-04-26T11:46:36.612 INFO:tasks.workunit.client.0.smithi029.stdout:8/172: dread f5 [0,4194304] 0 2024-04-26T11:46:36.613 INFO:tasks.workunit.client.0.smithi029.stdout:4/158: dwrite d3/f31 [0,4194304] 0 2024-04-26T11:46:36.614 INFO:tasks.workunit.client.0.smithi029.stdout:7/207: chown d11/d18/d1a/f3c 277 1 2024-04-26T11:46:36.614 INFO:tasks.workunit.client.0.smithi029.stdout:1/192: write d7/db/d10/d1e/f26 [3478405,87900] 0 2024-04-26T11:46:36.615 INFO:tasks.workunit.client.0.smithi029.stdout:9/278: dwrite d4/d5/f45 [0,4194304] 0 2024-04-26T11:46:36.616 INFO:tasks.workunit.client.0.smithi029.stdout:5/212: rename db/f35 to db/d12/d1f/d39/f47 0 2024-04-26T11:46:36.617 INFO:tasks.workunit.client.0.smithi029.stdout:4/159: readlink d3/d1d/d11/d16/d1f/l1c 0 2024-04-26T11:46:36.617 INFO:tasks.workunit.client.0.smithi029.stdout:5/213: mknod db/d12/d1f/c48 1 2024-04-26T11:46:36.618 INFO:tasks.workunit.client.0.smithi029.stdout:4/160: creat d3/d1d/d11/d26/f32 x:0 0 0 2024-04-26T11:46:36.619 INFO:tasks.workunit.client.0.smithi029.stdout:7/208: symlink d11/d18/d1a/d33/l41 0 2024-04-26T11:46:36.619 INFO:tasks.workunit.client.0.smithi029.stdout:1/193: creat d7/d37/d3e/f40 x:0 0 0 2024-04-26T11:46:36.619 INFO:tasks.workunit.client.0.smithi029.stdout:0/178: dread d9/fa [0,4194304] 0 2024-04-26T11:46:36.620 INFO:tasks.workunit.client.0.smithi029.stdout:9/279: truncate d4/d5/d16/f3b 320676 0 2024-04-26T11:46:36.621 INFO:tasks.workunit.client.0.smithi029.stdout:0/179: dread - d9/d16/f21 zero size 2024-04-26T11:46:36.622 INFO:tasks.workunit.client.0.smithi029.stdout:9/280: chown d4/d5/d7/fc 0 1 2024-04-26T11:46:36.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/281: sync 2024-04-26T11:46:36.623 INFO:tasks.workunit.client.0.smithi029.stdout:1/194: creat d7/db/d10/d1e/f41 x:0 0 0 2024-04-26T11:46:36.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/282: chown d4 106576 1 2024-04-26T11:46:36.623 INFO:tasks.workunit.client.0.smithi029.stdout:7/209: symlink d11/d18/d1a/d26/l42 0 2024-04-26T11:46:36.623 INFO:tasks.workunit.client.0.smithi029.stdout:7/210: chown d11/d18/d35 23 1 2024-04-26T11:46:36.624 INFO:tasks.workunit.client.0.smithi029.stdout:0/180: rename d9/f1e to d9/d16/f3d 0 2024-04-26T11:46:36.624 INFO:tasks.workunit.client.0.smithi029.stdout:4/161: getdents d3/d1d/d11/d16 0 2024-04-26T11:46:36.624 INFO:tasks.workunit.client.0.smithi029.stdout:1/195: creat d7/db/d10/d20/f42 x:0 0 0 2024-04-26T11:46:36.625 INFO:tasks.workunit.client.0.smithi029.stdout:7/211: mknod d11/d37/c43 1 2024-04-26T11:46:36.625 INFO:tasks.workunit.client.0.smithi029.stdout:6/219: dwrite d7/d19/d34/f38 [0,4194304] 0 2024-04-26T11:46:36.626 INFO:tasks.workunit.client.0.smithi029.stdout:3/208: getdents d0/dc/d2a 0 2024-04-26T11:46:36.627 INFO:tasks.workunit.client.0.smithi029.stdout:6/220: chown d7/d19 101 1 2024-04-26T11:46:36.627 INFO:tasks.workunit.client.0.smithi029.stdout:5/214: dread db/d12/d1f/f21 [0,4194304] 0 2024-04-26T11:46:36.627 INFO:tasks.workunit.client.0.smithi029.stdout:7/212: stat d11/d18/d1a/d26/f2c 0 2024-04-26T11:46:36.628 INFO:tasks.workunit.client.0.smithi029.stdout:8/173: dwrite dc/de/d2e/d23/d27/d24/f36 [0,4194304] 0 2024-04-26T11:46:36.630 INFO:tasks.workunit.client.0.smithi029.stdout:1/196: mknod d7/c43 1 2024-04-26T11:46:36.631 INFO:tasks.workunit.client.0.smithi029.stdout:4/162: creat d3/d1d/f33 x:0 0 0 2024-04-26T11:46:36.631 INFO:tasks.workunit.client.0.smithi029.stdout:0/181: rename d9/f3c to d9/d16/d25/f3e 0 2024-04-26T11:46:36.632 INFO:tasks.workunit.client.0.smithi029.stdout:8/174: symlink dc/de/d15/l38 0 2024-04-26T11:46:36.632 INFO:tasks.workunit.client.0.smithi029.stdout:5/215: rename db/d12/d1a/f38 to db/d12/d1a/f49 0 2024-04-26T11:46:36.632 INFO:tasks.workunit.client.0.smithi029.stdout:9/283: getdents d4/d46 0 2024-04-26T11:46:36.632 INFO:tasks.workunit.client.0.smithi029.stdout:6/221: rename d7/d20/d27/d42 to d7/d20/d2f/d45 0 2024-04-26T11:46:36.633 INFO:tasks.workunit.client.0.smithi029.stdout:9/284: chown d4/d5/f48 233223362 1 2024-04-26T11:46:36.633 INFO:tasks.workunit.client.0.smithi029.stdout:4/163: fsync d3/f1e 0 2024-04-26T11:46:36.633 INFO:tasks.workunit.client.0.smithi029.stdout:6/222: mkdir d7/d46 0 2024-04-26T11:46:36.635 INFO:tasks.workunit.client.0.smithi029.stdout:9/285: creat d4/d5/d28/f53 x:0 0 0 2024-04-26T11:46:36.635 INFO:tasks.workunit.client.0.smithi029.stdout:0/182: rmdir d9/d16/d25/d2a 39 2024-04-26T11:46:36.636 INFO:tasks.workunit.client.0.smithi029.stdout:9/286: mknod d4/d5/d7/c54 1 2024-04-26T11:46:36.638 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:36.637+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:36.639 INFO:tasks.workunit.client.0.smithi029.stdout:1/197: dread f2 [0,4194304] 0 2024-04-26T11:46:36.639 INFO:tasks.workunit.client.0.smithi029.stdout:9/287: mknod d4/d5/d7/c55 1 2024-04-26T11:46:36.642 INFO:tasks.workunit.client.0.smithi029.stdout:7/213: dwrite d11/d18/d1a/f3c [0,4194304] 0 2024-04-26T11:46:36.642 INFO:tasks.workunit.client.0.smithi029.stdout:5/216: dread db/d12/d1f/f2c [0,4194304] 0 2024-04-26T11:46:36.642 INFO:tasks.workunit.client.0.smithi029.stdout:1/198: mknod d7/c44 1 2024-04-26T11:46:36.642 INFO:tasks.workunit.client.0.smithi029.stdout:0/183: truncate d9/d16/f21 894480 0 2024-04-26T11:46:36.643 INFO:tasks.workunit.client.0.smithi029.stdout:9/288: creat d4/d46/f56 x:0 0 0 2024-04-26T11:46:36.645 INFO:tasks.workunit.client.0.smithi029.stdout:5/217: chown db/f36 86203 1 2024-04-26T11:46:36.645 INFO:tasks.workunit.client.0.smithi029.stdout:1/199: readlink d7/db/d10/d20/l3b 0 2024-04-26T11:46:36.645 INFO:tasks.workunit.client.0.smithi029.stdout:3/209: dwrite d0/dc/d1f/f2d [0,4194304] 0 2024-04-26T11:46:36.645 INFO:tasks.workunit.client.0.smithi029.stdout:9/289: creat d4/d46/f57 x:0 0 0 2024-04-26T11:46:36.647 INFO:tasks.workunit.client.0.smithi029.stdout:8/175: dwrite f5 [4194304,4194304] 0 2024-04-26T11:46:36.647 INFO:tasks.workunit.client.0.smithi029.stdout:7/214: mkdir d11/d18/d1a/d44 0 2024-04-26T11:46:36.648 INFO:tasks.workunit.client.0.smithi029.stdout:0/184: rmdir d9/d16/d30 0 2024-04-26T11:46:36.648 INFO:tasks.workunit.client.0.smithi029.stdout:6/223: dwrite d7/f1a [4194304,4194304] 0 2024-04-26T11:46:36.649 INFO:tasks.workunit.client.0.smithi029.stdout:1/200: creat d7/db/d10/d1e/f45 x:0 0 0 2024-04-26T11:46:36.649 INFO:tasks.workunit.client.0.smithi029.stdout:5/218: write db/d12/f44 [91107,88025] 0 2024-04-26T11:46:36.649 INFO:tasks.workunit.client.0.smithi029.stdout:7/215: chown d11/d18/d1a/f23 3642 1 2024-04-26T11:46:36.651 INFO:tasks.workunit.client.0.smithi029.stdout:0/185: readlink d9/d16/d33/d2f/d32/l3a 0 2024-04-26T11:46:36.652 INFO:tasks.workunit.client.0.smithi029.stdout:9/290: write d4/d5/d28/f53 [668861,20296] 0 2024-04-26T11:46:36.652 INFO:tasks.workunit.client.0.smithi029.stdout:1/201: chown d7/d25/f2e 6719904 1 2024-04-26T11:46:36.654 INFO:tasks.workunit.client.0.smithi029.stdout:6/224: dread d7/d20/d2f/f30 [0,4194304] 0 2024-04-26T11:46:36.655 INFO:tasks.workunit.client.0.smithi029.stdout:8/176: truncate dc/f11 284309 0 2024-04-26T11:46:36.656 INFO:tasks.workunit.client.0.smithi029.stdout:1/202: mknod d7/d37/d3e/df/c46 1 2024-04-26T11:46:36.657 INFO:tasks.workunit.client.0.smithi029.stdout:7/216: creat d11/d18/d1a/d26/f45 x:0 0 0 2024-04-26T11:46:36.657 INFO:tasks.workunit.client.0.smithi029.stdout:9/291: write d4/d5/d16/d39/f42 [2792908,111334] 0 2024-04-26T11:46:36.659 INFO:tasks.workunit.client.0.smithi029.stdout:2/188: dread d12/f21 [0,4194304] 0 2024-04-26T11:46:36.659 INFO:tasks.workunit.client.0.smithi029.stdout:1/203: symlink d7/d37/d3e/l47 0 2024-04-26T11:46:36.659 INFO:tasks.workunit.client.0.smithi029.stdout:0/186: link d9/l17 d9/d16/d33/l3f 0 2024-04-26T11:46:36.659 INFO:tasks.workunit.client.0.smithi029.stdout:7/217: dread f8 [0,4194304] 0 2024-04-26T11:46:36.661 INFO:tasks.workunit.client.0.smithi029.stdout:7/218: symlink d11/l46 0 2024-04-26T11:46:36.661 INFO:tasks.workunit.client.0.smithi029.stdout:0/187: dread - d9/f36 zero size 2024-04-26T11:46:36.662 INFO:tasks.workunit.client.0.smithi029.stdout:9/292: rename d4/d5/d28 to d4/d49/d58 0 2024-04-26T11:46:36.662 INFO:tasks.workunit.client.0.smithi029.stdout:2/189: dread - d12/f1e zero size 2024-04-26T11:46:36.664 INFO:tasks.workunit.client.0.smithi029.stdout:3/210: dwrite d0/dc/d2a/d1a/d3b/f4f [0,4194304] 0 2024-04-26T11:46:36.665 INFO:tasks.workunit.client.0.smithi029.stdout:5/219: dwrite db/d12/d1f/f23 [0,4194304] 0 2024-04-26T11:46:36.665 INFO:tasks.workunit.client.0.smithi029.stdout:0/188: write d9/d16/f28 [895763,107274] 0 2024-04-26T11:46:36.666 INFO:tasks.workunit.client.0.smithi029.stdout:2/190: write d12/f19 [325893,11695] 0 2024-04-26T11:46:36.666 INFO:tasks.workunit.client.0.smithi029.stdout:1/204: truncate d7/d37/d3e/f3f 964435 0 2024-04-26T11:46:36.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/219: creat d11/d18/d1a/f47 x:0 0 0 2024-04-26T11:46:36.669 INFO:tasks.workunit.client.0.smithi029.stdout:5/220: stat f8 0 2024-04-26T11:46:36.669 INFO:tasks.workunit.client.0.smithi029.stdout:9/293: write d4/d5/d7/f36 [5241190,73707] 0 2024-04-26T11:46:36.669 INFO:tasks.workunit.client.0.smithi029.stdout:3/211: mknod d0/d1/d2b/c53 1 2024-04-26T11:46:36.671 INFO:tasks.workunit.client.0.smithi029.stdout:1/205: rmdir d7/d25 39 2024-04-26T11:46:36.671 INFO:tasks.workunit.client.0.smithi029.stdout:7/220: mknod d11/c48 1 2024-04-26T11:46:36.671 INFO:tasks.workunit.client.0.smithi029.stdout:5/221: mknod db/c4a 1 2024-04-26T11:46:36.671 INFO:tasks.workunit.client.0.smithi029.stdout:5/222: sync 2024-04-26T11:46:36.671 INFO:tasks.workunit.client.0.smithi029.stdout:7/221: fdatasync d11/d18/d1a/f47 0 2024-04-26T11:46:36.671 INFO:tasks.workunit.client.0.smithi029.stdout:0/189: rename d9/d16/l19 to d9/d16/d33/d2f/l40 0 2024-04-26T11:46:36.671 INFO:tasks.workunit.client.0.smithi029.stdout:9/294: creat d4/d5/d7/f59 x:0 0 0 2024-04-26T11:46:36.671 INFO:tasks.workunit.client.0.smithi029.stdout:6/225: dwrite d7/f12 [0,4194304] 0 2024-04-26T11:46:36.671 INFO:tasks.workunit.client.0.smithi029.stdout:3/212: mkdir d0/dc/d2a/d54 0 2024-04-26T11:46:36.672 INFO:tasks.workunit.client.0.smithi029.stdout:2/191: write d12/d24/d29/f31 [833918,79813] 0 2024-04-26T11:46:36.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/206: creat d7/d37/f48 x:0 0 0 2024-04-26T11:46:36.672 INFO:tasks.workunit.client.0.smithi029.stdout:5/223: symlink db/d12/d1a/l4b 0 2024-04-26T11:46:36.672 INFO:tasks.workunit.client.0.smithi029.stdout:7/222: read - d11/d18/d1a/d26/f45 zero size 2024-04-26T11:46:36.673 INFO:tasks.workunit.client.0.smithi029.stdout:0/190: unlink d9/fa 0 2024-04-26T11:46:36.673 INFO:tasks.workunit.client.0.smithi029.stdout:1/207: dread - d7/db/f38 zero size 2024-04-26T11:46:36.674 INFO:tasks.workunit.client.0.smithi029.stdout:9/295: unlink d4/d5/d16/d39/f42 0 2024-04-26T11:46:36.674 INFO:tasks.workunit.client.0.smithi029.stdout:3/213: write d0/f1b [6314369,125114] 0 2024-04-26T11:46:36.674 INFO:tasks.workunit.client.0.smithi029.stdout:7/223: mknod d11/d18/d1a/d33/c49 1 2024-04-26T11:46:36.674 INFO:tasks.workunit.client.0.smithi029.stdout:5/224: fsync db/d12/d1a/f27 0 2024-04-26T11:46:36.675 INFO:tasks.workunit.client.0.smithi029.stdout:0/191: dread - d9/d16/d25/d2a/f39 zero size 2024-04-26T11:46:36.675 INFO:tasks.workunit.client.0.smithi029.stdout:9/296: dread - d4/d5/d7/f59 zero size 2024-04-26T11:46:36.675 INFO:tasks.workunit.client.0.smithi029.stdout:1/208: fdatasync d7/db/d10/d1e/f45 0 2024-04-26T11:46:36.676 INFO:tasks.workunit.client.0.smithi029.stdout:7/224: chown d11/d18/d1a/f31 755852 1 2024-04-26T11:46:36.676 INFO:tasks.workunit.client.0.smithi029.stdout:5/225: unlink db/d12/d1f/d39/f47 0 2024-04-26T11:46:36.677 INFO:tasks.workunit.client.0.smithi029.stdout:9/297: rmdir d4/d5/d16 39 2024-04-26T11:46:36.678 INFO:tasks.workunit.client.0.smithi029.stdout:2/192: write f7 [1591327,6276] 0 2024-04-26T11:46:36.678 INFO:tasks.workunit.client.0.smithi029.stdout:9/298: readlink d4/l43 0 2024-04-26T11:46:36.679 INFO:tasks.workunit.client.0.smithi029.stdout:5/226: chown db/d12/d1f/d39/l3f 99750494 1 2024-04-26T11:46:36.681 INFO:tasks.workunit.client.0.smithi029.stdout:2/193: write d12/f22 [1086194,118819] 0 2024-04-26T11:46:36.681 INFO:tasks.workunit.client.0.smithi029.stdout:4/164: dread d3/d1d/f29 [0,4194304] 0 2024-04-26T11:46:36.683 INFO:tasks.workunit.client.0.smithi029.stdout:2/194: rmdir d12/d24 39 2024-04-26T11:46:36.683 INFO:tasks.workunit.client.0.smithi029.stdout:5/227: chown db/d12/d1f/f23 5846 1 2024-04-26T11:46:36.683 INFO:tasks.workunit.client.0.smithi029.stdout:3/214: dread d0/d1/f43 [4194304,4194304] 0 2024-04-26T11:46:36.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/226: dwrite d7/d19/d34/f38 [0,4194304] 0 2024-04-26T11:46:36.684 INFO:tasks.workunit.client.0.smithi029.stdout:9/299: rename d4/d49 to d4/d49/d58/d5a 22 2024-04-26T11:46:36.686 INFO:tasks.workunit.client.0.smithi029.stdout:4/165: mkdir d3/d1d/db/d13/d34 0 2024-04-26T11:46:36.686 INFO:tasks.workunit.client.0.smithi029.stdout:3/215: truncate d0/f52 793431 0 2024-04-26T11:46:36.686 INFO:tasks.workunit.client.0.smithi029.stdout:5/228: dread - db/d12/d1a/f33 zero size 2024-04-26T11:46:36.688 INFO:tasks.workunit.client.0.smithi029.stdout:2/195: write d12/f21 [267794,38555] 0 2024-04-26T11:46:36.688 INFO:tasks.workunit.client.0.smithi029.stdout:5/229: fsync f7 0 2024-04-26T11:46:36.688 INFO:tasks.workunit.client.0.smithi029.stdout:4/166: read d3/d1d/f22 [3074692,76471] 0 2024-04-26T11:46:36.689 INFO:tasks.workunit.client.0.smithi029.stdout:3/216: creat d0/d37/f55 x:0 0 0 2024-04-26T11:46:36.689 INFO:tasks.workunit.client.0.smithi029.stdout:6/227: link d7/f1c d7/d25/f47 0 2024-04-26T11:46:36.689 INFO:tasks.workunit.client.0.smithi029.stdout:1/209: dwrite d7/db/f34 [0,4194304] 0 2024-04-26T11:46:36.689 INFO:tasks.workunit.client.0.smithi029.stdout:0/192: dwrite d9/d16/d33/f35 [0,4194304] 0 2024-04-26T11:46:36.691 INFO:tasks.workunit.client.0.smithi029.stdout:5/230: mkdir db/d12/d1a/d4c 0 2024-04-26T11:46:36.691 INFO:tasks.workunit.client.0.smithi029.stdout:0/193: creat d9/f41 x:0 0 0 2024-04-26T11:46:36.691 INFO:tasks.workunit.client.0.smithi029.stdout:2/196: mkdir d12/d24/d29/d38 0 2024-04-26T11:46:36.692 INFO:tasks.workunit.client.0.smithi029.stdout:6/228: stat d7/d20/d27/l3c 0 2024-04-26T11:46:36.692 INFO:tasks.workunit.client.0.smithi029.stdout:1/210: write d7/d37/d3e/f40 [258412,4296] 0 2024-04-26T11:46:36.693 INFO:tasks.workunit.client.0.smithi029.stdout:6/229: stat l1 0 2024-04-26T11:46:36.693 INFO:tasks.workunit.client.0.smithi029.stdout:3/217: chown d0/dc/d1f 26483754 1 2024-04-26T11:46:36.693 INFO:tasks.workunit.client.0.smithi029.stdout:5/231: write db/d12/d1a/f27 [4997119,17533] 0 2024-04-26T11:46:36.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/167: creat d3/d1d/d11/f35 x:0 0 0 2024-04-26T11:46:36.696 INFO:tasks.workunit.client.0.smithi029.stdout:5/232: mkdir db/d40/d4d 0 2024-04-26T11:46:36.697 INFO:tasks.workunit.client.0.smithi029.stdout:0/194: creat d9/d16/d33/d2f/d32/f42 x:0 0 0 2024-04-26T11:46:36.697 INFO:tasks.workunit.client.0.smithi029.stdout:3/218: rename d0/d1/d2b/d33/f47 to d0/d1/d41/f56 0 2024-04-26T11:46:36.698 INFO:tasks.workunit.client.0.smithi029.stdout:4/168: creat d3/d1d/db/f36 x:0 0 0 2024-04-26T11:46:36.699 INFO:tasks.workunit.client.0.smithi029.stdout:0/195: mkdir d9/d43 0 2024-04-26T11:46:36.700 INFO:tasks.workunit.client.0.smithi029.stdout:0/196: stat d9/ld 0 2024-04-26T11:46:36.701 INFO:tasks.workunit.client.0.smithi029.stdout:9/300: dwrite d4/d5/d7/f59 [0,4194304] 0 2024-04-26T11:46:36.701 INFO:tasks.workunit.client.0.smithi029.stdout:3/219: creat d0/dc/d2a/f57 x:0 0 0 2024-04-26T11:46:36.701 INFO:tasks.workunit.client.0.smithi029.stdout:8/177: dread f1 [8388608,4194304] 0 2024-04-26T11:46:36.702 INFO:tasks.workunit.client.0.smithi029.stdout:4/169: truncate d3/f7 1469053 0 2024-04-26T11:46:36.702 INFO:tasks.workunit.client.0.smithi029.stdout:9/301: readlink d4/d5/d16/l4c 0 2024-04-26T11:46:36.703 INFO:tasks.workunit.client.0.smithi029.stdout:8/178: rename dc/de/l1d to dc/de/d2e/l39 0 2024-04-26T11:46:36.704 INFO:tasks.workunit.client.0.smithi029.stdout:1/211: dwrite d7/f1c [0,4194304] 0 2024-04-26T11:46:36.705 INFO:tasks.workunit.client.0.smithi029.stdout:8/179: mknod dc/d12/c3a 1 2024-04-26T11:46:36.705 INFO:tasks.workunit.client.0.smithi029.stdout:9/302: creat d4/d5/d16/f5b x:0 0 0 2024-04-26T11:46:36.706 INFO:tasks.workunit.client.0.smithi029.stdout:6/230: dwrite d7/f1c [8388608,4194304] 0 2024-04-26T11:46:36.707 INFO:tasks.workunit.client.0.smithi029.stdout:1/212: write d7/f1c [415983,125653] 0 2024-04-26T11:46:36.707 INFO:tasks.workunit.client.0.smithi029.stdout:8/180: write dc/de/f2b [3784983,20169] 0 2024-04-26T11:46:36.710 INFO:tasks.workunit.client.0.smithi029.stdout:3/220: link d0/d1/d2f/f39 d0/dc/d2a/d54/f58 0 2024-04-26T11:46:36.710 INFO:tasks.workunit.client.0.smithi029.stdout:4/170: truncate d3/f5 2187722 0 2024-04-26T11:46:36.710 INFO:tasks.workunit.client.0.smithi029.stdout:6/231: unlink d7/d19/d34/f43 0 2024-04-26T11:46:36.710 INFO:tasks.workunit.client.0.smithi029.stdout:4/171: mknod d3/d1d/d11/d16/c37 1 2024-04-26T11:46:36.710 INFO:tasks.workunit.client.0.smithi029.stdout:3/221: write d0/f1b [7031770,77550] 0 2024-04-26T11:46:36.711 INFO:tasks.workunit.client.0.smithi029.stdout:9/303: creat d4/d49/f5c x:0 0 0 2024-04-26T11:46:36.714 INFO:tasks.workunit.client.0.smithi029.stdout:9/304: mknod d4/d5/d16/d39/c5d 1 2024-04-26T11:46:36.714 INFO:tasks.workunit.client.0.smithi029.stdout:4/172: creat d3/f38 x:0 0 0 2024-04-26T11:46:36.715 INFO:tasks.workunit.client.0.smithi029.stdout:1/213: dread d7/db/f34 [0,4194304] 0 2024-04-26T11:46:36.715 INFO:tasks.workunit.client.0.smithi029.stdout:4/173: unlink d3/d1d/f33 0 2024-04-26T11:46:36.715 INFO:tasks.workunit.client.0.smithi029.stdout:4/174: chown d3/d1d/db/d13 198031 1 2024-04-26T11:46:36.715 INFO:tasks.workunit.client.0.smithi029.stdout:9/305: getdents d4/d5/d16/d39 0 2024-04-26T11:46:36.715 INFO:tasks.workunit.client.0.smithi029.stdout:1/214: truncate d7/f36 1413748 0 2024-04-26T11:46:36.715 INFO:tasks.workunit.client.0.smithi029.stdout:9/306: stat d4/d5/f4a 0 2024-04-26T11:46:36.715 INFO:tasks.workunit.client.0.smithi029.stdout:4/175: fdatasync d3/d1d/f22 0 2024-04-26T11:46:36.716 INFO:tasks.workunit.client.0.smithi029.stdout:2/197: truncate d12/f1d 12349291 0 2024-04-26T11:46:36.718 INFO:tasks.workunit.client.0.smithi029.stdout:1/215: rename d7/db/d10/d20/l30 to d7/db/d10/d1e/l49 0 2024-04-26T11:46:36.718 INFO:tasks.workunit.client.0.smithi029.stdout:2/198: fdatasync d12/f1c 0 2024-04-26T11:46:36.719 INFO:tasks.workunit.client.0.smithi029.stdout:6/232: dwrite d7/d19/f37 [0,4194304] 0 2024-04-26T11:46:36.719 INFO:tasks.workunit.client.0.smithi029.stdout:3/222: dwrite d0/f52 [0,4194304] 0 2024-04-26T11:46:36.720 INFO:tasks.workunit.client.0.smithi029.stdout:5/233: chown db/d12/d1f/d39/d3b/f42 2177 1 2024-04-26T11:46:36.720 INFO:tasks.workunit.client.0.smithi029.stdout:4/176: rename d3/d1d/d11/d26 to d3/d1d/db/d13/d2d/d39 0 2024-04-26T11:46:36.720 INFO:tasks.workunit.client.0.smithi029.stdout:2/199: fdatasync d12/f1a 0 2024-04-26T11:46:36.721 INFO:tasks.workunit.client.0.smithi029.stdout:3/223: write d0/dc/d2a/d1a/f38 [47986,9184] 0 2024-04-26T11:46:36.722 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:36.722 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:36.722 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:36.722 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:36.722 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:36.723 INFO:tasks.workunit.client.0.smithi029.stdout:2/200: write d12/d24/f27 [1326114,26597] 0 2024-04-26T11:46:36.723 INFO:tasks.workunit.client.0.smithi029.stdout:3/224: write d0/dc/d2a/f57 [644516,20700] 0 2024-04-26T11:46:36.723 INFO:tasks.workunit.client.0.smithi029.stdout:2/201: fdatasync d12/f1a 0 2024-04-26T11:46:36.723 INFO:tasks.workunit.client.0.smithi029.stdout:2/202: readlink d12/l17 0 2024-04-26T11:46:36.725 INFO:tasks.workunit.client.0.smithi029.stdout:3/225: dread d0/dc/d2a/d1a/f38 [0,4194304] 0 2024-04-26T11:46:36.725 INFO:tasks.workunit.client.0.smithi029.stdout:2/203: link f6 d12/f39 0 2024-04-26T11:46:36.726 INFO:tasks.workunit.client.0.smithi029.stdout:2/204: mkdir d12/d24/d29/d3a 0 2024-04-26T11:46:36.728 INFO:tasks.workunit.client.0.smithi029.stdout:3/226: link d0/dc/f45 d0/dc/d2a/f59 0 2024-04-26T11:46:36.728 INFO:tasks.workunit.client.0.smithi029.stdout:5/234: dwrite db/d12/d1f/d39/f41 [0,4194304] 0 2024-04-26T11:46:36.729 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:36.724+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:36.729 INFO:tasks.workunit.client.0.smithi029.stdout:3/227: rename d0/d1/d41/f56 to d0/dc/d1f/f5a 0 2024-04-26T11:46:36.730 INFO:tasks.workunit.client.0.smithi029.stdout:2/205: link f7 d12/d24/d29/d36/f3b 0 2024-04-26T11:46:36.730 INFO:tasks.workunit.client.0.smithi029.stdout:3/228: mknod d0/d1/c5b 1 2024-04-26T11:46:36.730 INFO:tasks.workunit.client.0.smithi029.stdout:2/206: mknod d12/c3c 1 2024-04-26T11:46:36.730 INFO:tasks.workunit.client.0.smithi029.stdout:3/229: mkdir d0/d1/d5c 0 2024-04-26T11:46:36.731 INFO:tasks.workunit.client.0.smithi029.stdout:3/230: creat d0/d1/f5d x:0 0 0 2024-04-26T11:46:36.732 INFO:tasks.workunit.client.0.smithi029.stdout:3/231: chown d0/d1/f49 2436879 1 2024-04-26T11:46:36.732 INFO:tasks.workunit.client.0.smithi029.stdout:2/207: read d12/f19 [2701913,100673] 0 2024-04-26T11:46:36.734 INFO:tasks.workunit.client.0.smithi029.stdout:8/181: truncate f5 2958241 0 2024-04-26T11:46:36.734 INFO:tasks.workunit.client.0.smithi029.stdout:8/182: stat dc/de/d2e/d23/d27/d24 0 2024-04-26T11:46:36.734 INFO:tasks.workunit.client.0.smithi029.stdout:8/183: mkdir dc/d3b 0 2024-04-26T11:46:36.735 INFO:tasks.workunit.client.0.smithi029.stdout:1/216: rmdir d7/db/d10/d20 39 2024-04-26T11:46:36.736 INFO:tasks.workunit.client.0.smithi029.stdout:8/184: write dc/de/d2e/d23/d27/d24/f36 [946827,20710] 0 2024-04-26T11:46:36.737 INFO:tasks.workunit.client.0.smithi029.stdout:1/217: creat d7/db/f4a x:0 0 0 2024-04-26T11:46:36.738 INFO:tasks.workunit.client.0.smithi029.stdout:7/225: dread d11/d18/d1a/f31 [0,4194304] 0 2024-04-26T11:46:36.739 INFO:tasks.workunit.client.0.smithi029.stdout:1/218: truncate d7/db/f1d 52027 0 2024-04-26T11:46:36.739 INFO:tasks.workunit.client.0.smithi029.stdout:4/177: write d3/f1e [1526295,112982] 0 2024-04-26T11:46:36.740 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:36.741 INFO:tasks.workunit.client.0.smithi029.stdout:7/226: creat d11/d18/d1a/f4a x:0 0 0 2024-04-26T11:46:36.741 INFO:tasks.workunit.client.0.smithi029.stdout:4/178: symlink d3/d1d/db/l3a 0 2024-04-26T11:46:36.741 INFO:tasks.workunit.client.0.smithi029.stdout:1/219: mkdir d7/d37/d3e/df/d4b 0 2024-04-26T11:46:36.743 INFO:tasks.workunit.client.0.smithi029.stdout:3/232: dwrite d0/d1/f16 [4194304,4194304] 0 2024-04-26T11:46:36.743 INFO:tasks.workunit.client.0.smithi029.stdout:8/185: rename f5 to dc/de/d2e/d23/d27/d24/f3c 0 2024-04-26T11:46:36.743 INFO:tasks.workunit.client.0.smithi029.stdout:7/227: mknod d11/d18/d1a/d33/c4b 1 2024-04-26T11:46:36.743 INFO:tasks.workunit.client.0.smithi029.stdout:4/179: readlink d3/d1d/l17 0 2024-04-26T11:46:36.743 INFO:tasks.workunit.client.0.smithi029.stdout:3/233: stat d0/dc/d2a/f59 0 2024-04-26T11:46:36.744 INFO:tasks.workunit.client.0.smithi029.stdout:1/220: symlink d7/l4c 0 2024-04-26T11:46:36.744 INFO:tasks.workunit.client.0.smithi029.stdout:3/234: mknod d0/d1/d13/c5e 1 2024-04-26T11:46:36.744 INFO:tasks.workunit.client.0.smithi029.stdout:7/228: read - d11/d18/d1a/f4a zero size 2024-04-26T11:46:36.744 INFO:tasks.workunit.client.0.smithi029.stdout:8/186: truncate dc/f11 320908 0 2024-04-26T11:46:36.745 INFO:tasks.workunit.client.0.smithi029.stdout:4/180: write d3/d1d/f29 [3720049,125082] 0 2024-04-26T11:46:36.745 INFO:tasks.workunit.client.0.smithi029.stdout:3/235: rename d0/dc/d2a to d0/d1/d41/d5f 0 2024-04-26T11:46:36.746 INFO:tasks.workunit.client.0.smithi029.stdout:7/229: fsync d11/d18/d1a/f31 0 2024-04-26T11:46:36.747 INFO:tasks.workunit.client.0.smithi029.stdout:1/221: getdents d7/d37/d3e 0 2024-04-26T11:46:36.748 INFO:tasks.workunit.client.0.smithi029.stdout:7/230: readlink d11/d18/d35/l3d 0 2024-04-26T11:46:36.748 INFO:tasks.workunit.client.0.smithi029.stdout:3/236: symlink d0/d1/d41/d4c/l60 0 2024-04-26T11:46:36.749 INFO:tasks.workunit.client.0.smithi029.stdout:0/197: dread f5 [0,4194304] 0 2024-04-26T11:46:36.750 INFO:tasks.workunit.client.0.smithi029.stdout:7/231: symlink d11/d18/d2d/l4c 0 2024-04-26T11:46:36.751 INFO:tasks.workunit.client.0.smithi029.stdout:8/187: write dc/f11 [1113963,2628] 0 2024-04-26T11:46:36.751 INFO:tasks.workunit.client.0.smithi029.stdout:3/237: dread - d0/d1/d2b/d33/f51 zero size 2024-04-26T11:46:36.753 INFO:tasks.workunit.client.0.smithi029.stdout:3/238: readlink d0/l20 0 2024-04-26T11:46:36.753 INFO:tasks.workunit.client.0.smithi029.stdout:8/188: chown dc/de/d15/l38 796 1 2024-04-26T11:46:36.753 INFO:tasks.workunit.client.0.smithi029.stdout:0/198: dread f5 [0,4194304] 0 2024-04-26T11:46:36.754 INFO:tasks.workunit.client.0.smithi029.stdout:2/208: dwrite d12/f1b [0,4194304] 0 2024-04-26T11:46:36.755 INFO:tasks.workunit.client.0.smithi029.stdout:5/235: dread f8 [0,4194304] 0 2024-04-26T11:46:36.755 INFO:tasks.workunit.client.0.smithi029.stdout:7/232: creat d11/d18/d1a/f4d x:0 0 0 2024-04-26T11:46:36.756 INFO:tasks.workunit.client.0.smithi029.stdout:3/239: creat d0/d1/d41/d5f/d1a/f61 x:0 0 0 2024-04-26T11:46:36.756 INFO:tasks.workunit.client.0.smithi029.stdout:8/189: symlink dc/de/d2e/d23/l3d 0 2024-04-26T11:46:36.756 INFO:tasks.workunit.client.0.smithi029.stdout:0/199: creat d9/d16/d33/f44 x:0 0 0 2024-04-26T11:46:36.756 INFO:tasks.workunit.client.0.smithi029.stdout:7/233: rmdir d11/d18/d35/d39 39 2024-04-26T11:46:36.757 INFO:tasks.workunit.client.0.smithi029.stdout:7/234: mknod d11/c4e 1 2024-04-26T11:46:36.757 INFO:tasks.workunit.client.0.smithi029.stdout:4/181: dwrite d3/d1d/db/d13/f2f [0,4194304] 0 2024-04-26T11:46:36.757 INFO:tasks.workunit.client.0.smithi029.stdout:2/209: unlink fc 0 2024-04-26T11:46:36.757 INFO:tasks.workunit.client.0.smithi029.stdout:5/236: rename db/d12/d1a/l4b to db/d40/l4e 0 2024-04-26T11:46:36.758 INFO:tasks.workunit.client.0.smithi029.stdout:8/190: stat dc/de/d2e 0 2024-04-26T11:46:36.759 INFO:tasks.workunit.client.0.smithi029.stdout:0/200: creat d9/d16/d25/d27/f45 x:0 0 0 2024-04-26T11:46:36.759 INFO:tasks.workunit.client.0.smithi029.stdout:2/210: mkdir d12/d24/d2f/d3d 0 2024-04-26T11:46:36.759 INFO:tasks.workunit.client.0.smithi029.stdout:5/237: write db/d12/d1a/f16 [1464499,16212] 0 2024-04-26T11:46:36.759 INFO:tasks.workunit.client.0.smithi029.stdout:0/201: write d9/d16/f28 [28634,53821] 0 2024-04-26T11:46:36.761 INFO:tasks.workunit.client.0.smithi029.stdout:8/191: creat dc/de/d2e/d23/d27/f3e x:0 0 0 2024-04-26T11:46:36.761 INFO:tasks.workunit.client.0.smithi029.stdout:0/202: mkdir d9/d16/d25/d2a/d46 0 2024-04-26T11:46:36.761 INFO:tasks.workunit.client.0.smithi029.stdout:5/238: truncate db/f1c 967993 0 2024-04-26T11:46:36.762 INFO:tasks.workunit.client.0.smithi029.stdout:3/240: dread d0/d1/d2f/f39 [0,4194304] 0 2024-04-26T11:46:36.763 INFO:tasks.workunit.client.0.smithi029.stdout:5/239: mkdir db/d40/d4d/d4f 0 2024-04-26T11:46:36.764 INFO:tasks.workunit.client.0.smithi029.stdout:7/235: write d11/f17 [401604,19306] 0 2024-04-26T11:46:36.765 INFO:tasks.workunit.client.0.smithi029.stdout:5/240: creat db/d40/f50 x:0 0 0 2024-04-26T11:46:36.766 INFO:tasks.workunit.client.0.smithi029.stdout:9/307: sync 2024-04-26T11:46:36.766 INFO:tasks.workunit.client.0.smithi029.stdout:1/222: sync 2024-04-26T11:46:36.766 INFO:tasks.workunit.client.0.smithi029.stdout:0/203: sync 2024-04-26T11:46:36.766 INFO:tasks.workunit.client.0.smithi029.stdout:6/233: sync 2024-04-26T11:46:36.766 INFO:tasks.workunit.client.0.smithi029.stdout:7/236: creat d11/d37/f4f x:0 0 0 2024-04-26T11:46:36.766 INFO:tasks.workunit.client.0.smithi029.stdout:4/182: truncate d3/f31 1004196 0 2024-04-26T11:46:36.767 INFO:tasks.workunit.client.0.smithi029.stdout:0/204: fdatasync d9/d16/f21 0 2024-04-26T11:46:36.768 INFO:tasks.workunit.client.0.smithi029.stdout:6/234: fsync d7/f1a 0 2024-04-26T11:46:36.769 INFO:tasks.workunit.client.0.smithi029.stdout:5/241: chown db/d12/d1a/f33 1107 1 2024-04-26T11:46:36.769 INFO:tasks.workunit.client.0.smithi029.stdout:9/308: symlink d4/d46/l5e 0 2024-04-26T11:46:36.769 INFO:tasks.workunit.client.0.smithi029.stdout:7/237: mknod d11/d18/d35/c50 1 2024-04-26T11:46:36.772 INFO:tasks.workunit.client.0.smithi029.stdout:9/309: stat d4/d49/d58/f53 0 2024-04-26T11:46:36.773 INFO:tasks.workunit.client.0.smithi029.stdout:2/211: dwrite d12/f19 [4194304,4194304] 0 2024-04-26T11:46:36.777 INFO:tasks.workunit.client.0.smithi029.stdout:0/205: write f5 [1805121,49976] 0 2024-04-26T11:46:36.778 INFO:tasks.workunit.client.0.smithi029.stdout:8/192: dwrite dc/de/d2e/d23/d27/f3e [0,4194304] 0 2024-04-26T11:46:36.778 INFO:tasks.workunit.client.0.smithi029.stdout:7/238: truncate d11/d18/d1a/f4d 63657 0 2024-04-26T11:46:36.780 INFO:tasks.workunit.client.0.smithi029.stdout:3/241: dwrite d0/d1/f16 [0,4194304] 0 2024-04-26T11:46:36.782 INFO:tasks.workunit.client.0.smithi029.stdout:8/193: mknod dc/de/d2e/d23/d27/c3f 1 2024-04-26T11:46:36.783 INFO:tasks.workunit.client.0.smithi029.stdout:6/235: dread d7/f3e [0,4194304] 0 2024-04-26T11:46:36.786 INFO:tasks.workunit.client.0.smithi029.stdout:8/194: fsync dc/de/d26/f32 0 2024-04-26T11:46:36.786 INFO:tasks.workunit.client.0.smithi029.stdout:1/223: dwrite d7/d37/d3e/f2f [0,4194304] 0 2024-04-26T11:46:36.787 INFO:tasks.workunit.client.0.smithi029.stdout:7/239: write d11/d18/f29 [14234,33287] 0 2024-04-26T11:46:36.787 INFO:tasks.workunit.client.0.smithi029.stdout:0/206: chown d9/d16/d33/d2f/l40 24007866 1 2024-04-26T11:46:36.787 INFO:tasks.workunit.client.0.smithi029.stdout:5/242: getdents db/d40/d4d/d4f 0 2024-04-26T11:46:36.787 INFO:tasks.workunit.client.0.smithi029.stdout:3/242: symlink d0/d1/d5c/l62 0 2024-04-26T11:46:36.788 INFO:tasks.workunit.client.0.smithi029.stdout:8/195: creat dc/d3b/f40 x:0 0 0 2024-04-26T11:46:36.788 INFO:tasks.workunit.client.0.smithi029.stdout:6/236: unlink d7/d20/d2f/f3b 0 2024-04-26T11:46:36.789 INFO:tasks.workunit.client.0.smithi029.stdout:4/183: dwrite d3/d1d/db/d13/f2f [0,4194304] 0 2024-04-26T11:46:36.789 INFO:tasks.workunit.client.0.smithi029.stdout:0/207: mknod d9/d16/d33/d2f/d32/c47 1 2024-04-26T11:46:36.790 INFO:tasks.workunit.client.0.smithi029.stdout:3/243: readlink d0/d1/d2f/l3e 0 2024-04-26T11:46:36.790 INFO:tasks.workunit.client.0.smithi029.stdout:9/310: dwrite d4/d49/f5c [0,4194304] 0 2024-04-26T11:46:36.790 INFO:tasks.workunit.client.0.smithi029.stdout:2/212: symlink d12/d24/d29/d38/l3e 0 2024-04-26T11:46:36.790 INFO:tasks.workunit.client.0.smithi029.stdout:5/243: creat db/d12/d1a/f51 x:0 0 0 2024-04-26T11:46:36.790 INFO:tasks.workunit.client.0.smithi029.stdout:6/237: write d7/f32 [493460,18174] 0 2024-04-26T11:46:36.791 INFO:tasks.workunit.client.0.smithi029.stdout:3/244: symlink d0/d1/d13/l63 0 2024-04-26T11:46:36.792 INFO:tasks.workunit.client.0.smithi029.stdout:9/311: write d4/d5/d7/f35 [2772412,30893] 0 2024-04-26T11:46:36.793 INFO:tasks.workunit.client.0.smithi029.stdout:4/184: mknod d3/d1d/db/d13/d2d/d39/d30/c3b 1 2024-04-26T11:46:36.793 INFO:tasks.workunit.client.0.smithi029.stdout:3/245: mknod d0/d1/d13/c64 1 2024-04-26T11:46:36.794 INFO:tasks.workunit.client.0.smithi029.stdout:3/246: mknod d0/d1/d41/c65 1 2024-04-26T11:46:36.796 INFO:tasks.workunit.client.0.smithi029.stdout:4/185: write d3/d1d/f21 [160524,50684] 0 2024-04-26T11:46:36.797 INFO:tasks.workunit.client.0.smithi029.stdout:4/186: fsync d3/f1e 0 2024-04-26T11:46:36.799 INFO:tasks.workunit.client.0.smithi029.stdout:4/187: write d3/f1e [1786663,27520] 0 2024-04-26T11:46:36.801 INFO:tasks.workunit.client.0.smithi029.stdout:0/208: dwrite d9/d16/f21 [0,4194304] 0 2024-04-26T11:46:36.801 INFO:tasks.workunit.client.0.smithi029.stdout:7/240: dwrite d11/d18/d1a/f4a [0,4194304] 0 2024-04-26T11:46:36.803 INFO:tasks.workunit.client.0.smithi029.stdout:6/238: rename d7/d20/d2f/f30 to d7/d46/f48 0 2024-04-26T11:46:36.803 INFO:tasks.workunit.client.0.smithi029.stdout:1/224: getdents d7/d37/d3e/df 0 2024-04-26T11:46:36.804 INFO:tasks.workunit.client.0.smithi029.stdout:9/312: chown d4/d5/d7/ff 3 1 2024-04-26T11:46:36.806 INFO:tasks.workunit.client.0.smithi029.stdout:3/247: chown d0/l2e 26049799 1 2024-04-26T11:46:36.810 INFO:tasks.workunit.client.0.smithi029.stdout:0/209: unlink d9/d16/f21 0 2024-04-26T11:46:36.811 INFO:tasks.workunit.client.0.smithi029.stdout:2/213: symlink d12/d24/d29/d3a/l3f 0 2024-04-26T11:46:36.811 INFO:tasks.workunit.client.0.smithi029.stdout:6/239: rmdir d7/d19 39 2024-04-26T11:46:36.811 INFO:tasks.workunit.client.0.smithi029.stdout:9/313: symlink d4/d46/l5f 0 2024-04-26T11:46:36.812 INFO:tasks.workunit.client.0.smithi029.stdout:4/188: mkdir d3/d1d/db/d13/d2d/d39/d30/d3c 0 2024-04-26T11:46:36.814 INFO:tasks.workunit.client.0.smithi029.stdout:0/210: dread - d9/d16/d25/d2a/f39 zero size 2024-04-26T11:46:36.814 INFO:tasks.workunit.client.0.smithi029.stdout:6/240: write d7/f3e [2639354,60862] 0 2024-04-26T11:46:36.814 INFO:tasks.workunit.client.0.smithi029.stdout:1/225: link d7/d37/d3e/df/l12 d7/l4d 0 2024-04-26T11:46:36.814 INFO:tasks.workunit.client.0.smithi029.stdout:2/214: truncate f6 6791757 0 2024-04-26T11:46:36.814 INFO:tasks.workunit.client.0.smithi029.stdout:7/241: dread f6 [0,4194304] 0 2024-04-26T11:46:36.814 INFO:tasks.workunit.client.0.smithi029.stdout:0/211: chown d9/d16/d33/d2f/l40 1 1 2024-04-26T11:46:36.814 INFO:tasks.workunit.client.0.smithi029.stdout:7/242: readlink d11/d18/d1a/d26/l42 0 2024-04-26T11:46:36.816 INFO:tasks.workunit.client.0.smithi029.stdout:1/226: creat d7/d37/d3e/f4e x:0 0 0 2024-04-26T11:46:36.816 INFO:tasks.workunit.client.0.smithi029.stdout:2/215: mkdir d12/d24/d29/d3a/d40 0 2024-04-26T11:46:36.816 INFO:tasks.workunit.client.0.smithi029.stdout:0/212: creat d9/f48 x:0 0 0 2024-04-26T11:46:36.816 INFO:tasks.workunit.client.0.smithi029.stdout:4/189: rmdir d3/d1d/db/d13/d34 0 2024-04-26T11:46:36.816 INFO:tasks.workunit.client.0.smithi029.stdout:0/213: mknod d9/d16/c49 1 2024-04-26T11:46:36.817 INFO:tasks.workunit.client.0.smithi029.stdout:6/241: dread d7/f32 [0,4194304] 0 2024-04-26T11:46:36.818 INFO:tasks.workunit.client.0.smithi029.stdout:0/214: dread - d9/d16/d25/d27/f45 zero size 2024-04-26T11:46:36.819 INFO:tasks.workunit.client.0.smithi029.stdout:4/190: write d3/f14 [4751293,70300] 0 2024-04-26T11:46:36.819 INFO:tasks.workunit.client.0.smithi029.stdout:1/227: getdents d7/db/d10 0 2024-04-26T11:46:36.819 INFO:tasks.workunit.client.0.smithi029.stdout:2/216: link d12/d24/d2f/l34 d12/d24/d29/d36/l41 0 2024-04-26T11:46:36.820 INFO:tasks.workunit.client.0.smithi029.stdout:6/242: mkdir d7/d19/d49 0 2024-04-26T11:46:36.822 INFO:tasks.workunit.client.0.smithi029.stdout:1/228: truncate d7/d25/f2e 1034948 0 2024-04-26T11:46:36.822 INFO:tasks.workunit.client.0.smithi029.stdout:6/243: link d7/f11 d7/d19/d34/f4a 0 2024-04-26T11:46:36.823 INFO:tasks.workunit.client.0.smithi029.stdout:3/248: dwrite d0/f1b [4194304,4194304] 0 2024-04-26T11:46:36.825 INFO:tasks.workunit.client.0.smithi029.stdout:2/217: creat d12/d24/d2f/d3d/f42 x:0 0 0 2024-04-26T11:46:36.825 INFO:tasks.workunit.client.0.smithi029.stdout:6/244: write d7/d20/d2f/f3a [985264,40405] 0 2024-04-26T11:46:36.825 INFO:tasks.workunit.client.0.smithi029.stdout:1/229: write d7/db/d10/d20/f42 [133188,14546] 0 2024-04-26T11:46:36.826 INFO:tasks.workunit.client.0.smithi029.stdout:3/249: creat d0/d1/d2b/d33/f66 x:0 0 0 2024-04-26T11:46:36.827 INFO:tasks.workunit.client.0.smithi029.stdout:7/243: dwrite d11/d18/d1a/f4d [0,4194304] 0 2024-04-26T11:46:36.827 INFO:tasks.workunit.client.0.smithi029.stdout:6/245: readlink d7/l13 0 2024-04-26T11:46:36.827 INFO:tasks.workunit.client.0.smithi029.stdout:1/230: mknod d7/d25/c4f 1 2024-04-26T11:46:36.828 INFO:tasks.workunit.client.0.smithi029.stdout:3/250: stat d0/d1/d2b/d33/f66 0 2024-04-26T11:46:36.829 INFO:tasks.workunit.client.0.smithi029.stdout:8/196: truncate dc/de/d2e/d23/d27/f3e 1289137 0 2024-04-26T11:46:36.829 INFO:tasks.workunit.client.0.smithi029.stdout:4/191: rename d3/d1d/db/d13/d2d to d3/d1d/d11/d16/d1f/d3d 0 2024-04-26T11:46:36.830 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:36.824+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:36.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/246: mkdir d7/d25/d4b 0 2024-04-26T11:46:36.832 INFO:tasks.workunit.client.0.smithi029.stdout:3/251: unlink d0/dc/f31 0 2024-04-26T11:46:36.832 INFO:tasks.workunit.client.0.smithi029.stdout:0/215: dwrite d9/f2d [0,4194304] 0 2024-04-26T11:46:36.832 INFO:tasks.workunit.client.0.smithi029.stdout:0/216: mknod d9/c4a 1 2024-04-26T11:46:36.832 INFO:tasks.workunit.client.0.smithi029.stdout:8/197: creat dc/d3b/f41 x:0 0 0 2024-04-26T11:46:36.833 INFO:tasks.workunit.client.0.smithi029.stdout:7/244: link d11/d18/l24 d11/d18/d1a/d33/l51 0 2024-04-26T11:46:36.834 INFO:tasks.workunit.client.0.smithi029.stdout:0/217: chown d9/l15 2626887 1 2024-04-26T11:46:36.834 INFO:tasks.workunit.client.0.smithi029.stdout:4/192: symlink d3/d1d/d11/d16/d1f/d3d/l3e 0 2024-04-26T11:46:36.834 INFO:tasks.workunit.client.0.smithi029.stdout:0/218: unlink d9/fe 0 2024-04-26T11:46:36.834 INFO:tasks.workunit.client.0.smithi029.stdout:7/245: chown d11/d37/f4f 755 1 2024-04-26T11:46:36.835 INFO:tasks.workunit.client.0.smithi029.stdout:8/198: dread dc/de/d2e/d23/f21 [0,4194304] 0 2024-04-26T11:46:36.836 INFO:tasks.workunit.client.0.smithi029.stdout:7/246: write d11/d18/d1a/f47 [626084,66948] 0 2024-04-26T11:46:36.836 INFO:tasks.workunit.client.0.smithi029.stdout:4/193: truncate d3/f5 1635594 0 2024-04-26T11:46:36.836 INFO:tasks.workunit.client.0.smithi029.stdout:7/247: stat d11/d18/d1a/f4d 0 2024-04-26T11:46:36.836 INFO:tasks.workunit.client.0.smithi029.stdout:8/199: stat dc/de/d2e/d23/d27/d24 0 2024-04-26T11:46:36.838 INFO:tasks.workunit.client.0.smithi029.stdout:4/194: write d3/d1d/d11/f35 [980719,32714] 0 2024-04-26T11:46:36.838 INFO:tasks.workunit.client.0.smithi029.stdout:7/248: unlink d11/d18/l1d 0 2024-04-26T11:46:36.838 INFO:tasks.workunit.client.0.smithi029.stdout:3/252: dread d0/d1/d41/d5f/d1a/f3d [4194304,4194304] 0 2024-04-26T11:46:36.838 INFO:tasks.workunit.client.0.smithi029.stdout:4/195: creat d3/d1d/f3f x:0 0 0 2024-04-26T11:46:36.838 INFO:tasks.workunit.client.0.smithi029.stdout:7/249: truncate d11/d15/f36 571688 0 2024-04-26T11:46:36.839 INFO:tasks.workunit.client.0.smithi029.stdout:2/218: write d12/f1a [2850306,26213] 0 2024-04-26T11:46:36.839 INFO:tasks.workunit.client.0.smithi029.stdout:4/196: write d3/f38 [492638,122469] 0 2024-04-26T11:46:36.840 INFO:tasks.workunit.client.0.smithi029.stdout:3/253: write d0/dc/d1f/f5a [2677307,65134] 0 2024-04-26T11:46:36.841 INFO:tasks.workunit.client.0.smithi029.stdout:2/219: rmdir d12/d24/d29/d3a 39 2024-04-26T11:46:36.841 INFO:tasks.workunit.client.0.smithi029.stdout:4/197: write d3/d1d/db/f36 [569940,69361] 0 2024-04-26T11:46:36.841 INFO:tasks.workunit.client.0.smithi029.stdout:3/254: chown d0/d1/d41/d5f/f59 28227 1 2024-04-26T11:46:36.841 INFO:tasks.workunit.client.0.smithi029.stdout:7/250: rename d11/d18/d2d/l4c to d11/d18/d1a/d33/l52 0 2024-04-26T11:46:36.843 INFO:tasks.workunit.client.0.smithi029.stdout:3/255: mknod d0/d1/d2b/c67 1 2024-04-26T11:46:36.843 INFO:tasks.workunit.client.0.smithi029.stdout:6/247: truncate d7/f32 291932 0 2024-04-26T11:46:36.843 INFO:tasks.workunit.client.0.smithi029.stdout:8/200: dread dc/de/f29 [0,4194304] 0 2024-04-26T11:46:36.843 INFO:tasks.workunit.client.0.smithi029.stdout:7/251: write d11/d15/f3f [797539,97368] 0 2024-04-26T11:46:36.844 INFO:tasks.workunit.client.0.smithi029.stdout:2/220: creat d12/d24/d29/d36/f43 x:0 0 0 2024-04-26T11:46:36.844 INFO:tasks.workunit.client.0.smithi029.stdout:3/256: chown d0/d1/d13/f14 33 1 2024-04-26T11:46:36.845 INFO:tasks.workunit.client.0.smithi029.stdout:2/221: unlink d12/f21 0 2024-04-26T11:46:36.845 INFO:tasks.workunit.client.0.smithi029.stdout:3/257: mkdir d0/d1/d2f/d68 0 2024-04-26T11:46:36.845 INFO:tasks.workunit.client.0.smithi029.stdout:2/222: fdatasync d12/d24/f35 0 2024-04-26T11:46:36.845 INFO:tasks.workunit.client.0.smithi029.stdout:7/252: rmdir d11/d18/d1a/d2f 0 2024-04-26T11:46:36.846 INFO:tasks.workunit.client.0.smithi029.stdout:3/258: write d0/d1/f49 [664334,114771] 0 2024-04-26T11:46:36.847 INFO:tasks.workunit.client.0.smithi029.stdout:2/223: fsync d12/d24/d29/d36/f3b 0 2024-04-26T11:46:36.847 INFO:tasks.workunit.client.0.smithi029.stdout:3/259: stat d0/dc/d1f/f5a 0 2024-04-26T11:46:36.847 INFO:tasks.workunit.client.0.smithi029.stdout:8/201: link dc/de/d2e/d23/d27/d24/f36 dc/de/d2e/d23/d27/f42 0 2024-04-26T11:46:36.848 INFO:tasks.workunit.client.0.smithi029.stdout:0/219: rmdir d9 39 2024-04-26T11:46:36.849 INFO:tasks.workunit.client.0.smithi029.stdout:7/253: rmdir d11/d18/d1a/d44 0 2024-04-26T11:46:36.853 INFO:tasks.workunit.client.0.smithi029.stdout:6/248: dwrite d7/f11 [4194304,4194304] 0 2024-04-26T11:46:36.854 INFO:tasks.workunit.client.0.smithi029.stdout:5/244: dread f0 [0,4194304] 0 2024-04-26T11:46:36.855 INFO:tasks.workunit.client.0.smithi029.stdout:6/249: mkdir d7/d19/d34/d4c 0 2024-04-26T11:46:36.855 INFO:tasks.workunit.client.0.smithi029.stdout:6/250: readlink l5 0 2024-04-26T11:46:36.856 INFO:tasks.workunit.client.0.smithi029.stdout:5/245: stat db/f36 0 2024-04-26T11:46:36.856 INFO:tasks.workunit.client.0.smithi029.stdout:1/231: dread d7/db/f2d [0,4194304] 0 2024-04-26T11:46:36.856 INFO:tasks.workunit.client.0.smithi029.stdout:3/260: read d0/d1/d41/d5f/f57 [624017,61528] 0 2024-04-26T11:46:36.857 INFO:tasks.workunit.client.0.smithi029.stdout:5/246: unlink db/d12/f44 0 2024-04-26T11:46:36.857 INFO:tasks.workunit.client.0.smithi029.stdout:2/224: dwrite d12/d24/f35 [0,4194304] 0 2024-04-26T11:46:36.860 INFO:tasks.workunit.client.0.smithi029.stdout:4/198: truncate d3/d1d/f22 3129096 0 2024-04-26T11:46:36.860 INFO:tasks.workunit.client.0.smithi029.stdout:8/202: truncate dc/de/d2e/d23/d27/f42 2663238 0 2024-04-26T11:46:36.860 INFO:tasks.workunit.client.0.smithi029.stdout:1/232: dread d7/db/d10/d20/f42 [0,4194304] 0 2024-04-26T11:46:36.861 INFO:tasks.workunit.client.0.smithi029.stdout:9/314: dread d4/d5/f33 [0,4194304] 0 2024-04-26T11:46:36.861 INFO:tasks.workunit.client.0.smithi029.stdout:5/247: getdents db/d12/d1f 0 2024-04-26T11:46:36.863 INFO:tasks.workunit.client.0.smithi029.stdout:2/225: link d12/d24/d2f/f33 d12/d24/d2f/f44 0 2024-04-26T11:46:36.863 INFO:tasks.workunit.client.0.smithi029.stdout:8/203: mkdir dc/de/d2e/d23/d27/d24/d43 0 2024-04-26T11:46:36.864 INFO:tasks.workunit.client.0.smithi029.stdout:4/199: truncate d3/f7 443929 0 2024-04-26T11:46:36.864 INFO:tasks.workunit.client.0.smithi029.stdout:1/233: unlink d7/d37/d3e/f3f 0 2024-04-26T11:46:36.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/315: fsync d4/d5/d16/f1c 0 2024-04-26T11:46:36.864 INFO:tasks.workunit.client.0.smithi029.stdout:1/234: fdatasync d7/f1c 0 2024-04-26T11:46:36.865 INFO:tasks.workunit.client.0.smithi029.stdout:5/248: creat db/f52 x:0 0 0 2024-04-26T11:46:36.865 INFO:tasks.workunit.client.0.smithi029.stdout:8/204: dread - dc/d3b/f41 zero size 2024-04-26T11:46:36.866 INFO:tasks.workunit.client.0.smithi029.stdout:9/316: symlink d4/d49/d58/l60 0 2024-04-26T11:46:36.867 INFO:tasks.workunit.client.0.smithi029.stdout:1/235: truncate d7/d37/f48 194718 0 2024-04-26T11:46:36.867 INFO:tasks.workunit.client.0.smithi029.stdout:8/205: stat dc/d12/l1c 0 2024-04-26T11:46:36.868 INFO:tasks.workunit.client.0.smithi029.stdout:1/236: mknod d7/c50 1 2024-04-26T11:46:36.870 INFO:tasks.workunit.client.0.smithi029.stdout:3/261: dwrite d0/d1/d2f/f3a [0,4194304] 0 2024-04-26T11:46:36.874 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:36.874 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:36.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:36.875 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:36.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.875 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:185 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:36.875 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:36.875 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.718509191999999, 2024-04-26T11:46:36.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042806678000000001, 2024-04-26T11:46:36.875 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.875 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.875 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:36.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151621+0000", 2024-04-26T11:46:36.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.151613+0000", 2024-04-26T11:46:36.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999928 2024-04-26T11:46:36.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152126+0000", 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051282900000000002 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152158+0000", 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2268999999999999e-05 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152173+0000", 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4780000000000001e-05 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152350+0000", 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017709600000000001 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.152645+0000", 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029497600000000002 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194252+0000", 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041607102999999999 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194330+0000", 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8029999999999997e-05 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.194427+0000", 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6892000000000007e-05 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.881 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:7127 4.1e 4:7b6a0e51:::10000002096.00000000:head [write 0~1041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.715511465000001, 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029239364, 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 7127 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154618+0000", 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154616+0000", 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154631+0000", 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4786999999999999e-05 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154655+0000", 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3978999999999999e-05 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154669+0000", 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4022999999999999e-05 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154746+0000", 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6947999999999996e-05 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.154945+0000", 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000198736 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183781+0000", 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028835980000000001 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183812+0000", 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1214000000000003e-05 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:22.183858+0000", 2024-04-26T11:46:36.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5933999999999998e-05 2024-04-26T11:46:36.887 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.887 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.887 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.887 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:291 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-set-vals in=143822b,omap-rm-keys in=25459b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7190605220000004, 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029817972000000002, 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151069+0000", 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151067+0000", 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151620+0000", 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00055239000000000004 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151648+0000", 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8396000000000001e-05 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151674+0000", 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5683000000000001e-05 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151780+0000", 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010609500000000001 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.151979+0000", 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019890899999999999 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.180710+0000", 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028731406000000001 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.180777+0000", 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7104e-05 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:32.180887+0000", 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110179 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10801 4.1e 4:7a8af247:::100000030e7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.557399+0000", 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.312730803, 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029447019000000001, 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.892 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10801 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.557399+0000", 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.557399+0000", 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.557397+0000", 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563297+0000", 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059000859999999997 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563333+0000", 2024-04-26T11:46:36.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5762000000000001e-05 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563346+0000", 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3535e-05 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563431+0000", 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5055999999999993e-05 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.563862+0000", 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00043010599999999998 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.586670+0000", 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022808096999999999 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.586740+0000", 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0561000000000004e-05 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.586846+0000", 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105881 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.1481754829999999, 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.897 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.902 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10887 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.739870+0000", 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.1302595820000001, 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031835012000000003, 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10887 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.903 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.739870+0000", 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.739870+0000", 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.739869+0000", 2024-04-26T11:46:36.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.747481+0000", 2024-04-26T11:46:36.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076118000000000002 2024-04-26T11:46:36.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.747495+0000", 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3533000000000001e-05 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.747505+0000", 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0054000000000001e-05 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.750437+0000", 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029325760000000001 2024-04-26T11:46:36.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.750553+0000", 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116243 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.750711+0000", 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000157035 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.768684+0000", 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017973468999999999 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.771641+0000", 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002957197 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.771683+0000", 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1918000000000001e-05 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.771705+0000", 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2181e-05 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10908 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.795097+0000", 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.075033006, 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034190396999999997, 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.909 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10908 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.795097+0000", 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.795097+0000", 2024-04-26T11:46:36.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.795095+0000", 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.802645+0000", 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0075497029999999996 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.802658+0000", 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3667e-05 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.802667+0000", 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3939999999999996e-06 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.802737+0000", 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0135000000000005e-05 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.802851+0000", 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011377100000000001 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.803051+0000", 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020020899999999999 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.824013+0000", 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020961943 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.829223+0000", 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052102930000000004 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.829261+0000", 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8254999999999999e-05 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.829287+0000", 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5887000000000001e-05 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.914 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10945 4.32 4:4d40c457:::100000030c0.00000002:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.897227+0000", 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.972903136, 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036367628999999999, 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10945 2024-04-26T11:46:36.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.897227+0000", 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.897227+0000", 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.897226+0000", 2024-04-26T11:46:36.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.901298+0000", 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040725659999999997 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.901316+0000", 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7399999999999999e-05 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.901325+0000", 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0990000000000005e-06 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.901403+0000", 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8559000000000005e-05 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.901549+0000", 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014524899999999999 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.901759+0000", 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021048700000000001 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.915788+0000", 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014029168 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.933441+0000", 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017653021000000001 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.933531+0000", 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0271000000000004e-05 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.933594+0000", 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2898000000000007e-05 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10981 4.5 4:a214167c:::100000030bc.00000000:head [write 0~4194304 [2@2537785]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:36.920 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.975405+0000", 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.89472513200000003, 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.028579784, 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10981 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.975405+0000", 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.975405+0000", 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.975403+0000", 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.979991+0000", 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045873390000000002 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.980011+0000", 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0894e-05 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.980020+0000", 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8780000000000004e-06 2024-04-26T11:46:36.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.980101+0000", 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0302000000000005e-05 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.980227+0000", 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126709 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.980403+0000", 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017542799999999999 2024-04-26T11:46:36.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.992335+0000", 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011931997 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.003873+0000", 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011538366 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.003939+0000", 2024-04-26T11:46:36.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5566000000000002e-05 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.003985+0000", 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5773999999999999e-05 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10991 4.3d 4:bc8e5709:::100000031a2.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.009587+0000", 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.86054299899999998, 2024-04-26T11:46:36.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030830162000000001, 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10991 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.009587+0000", 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.009587+0000", 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.009584+0000", 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.018540+0000", 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089557939999999996 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.018556+0000", 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5985e-05 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.018566+0000", 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7629999999999995e-06 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.018650+0000", 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3898000000000002e-05 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.018810+0000", 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016068000000000001 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.018919+0000", 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010893899999999999 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.033007+0000", 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014087644 2024-04-26T11:46:36.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.040293+0000", 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0072856680000000004 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.040368+0000", 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5279999999999998e-05 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.040417+0000", 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9082000000000002e-05 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.931 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4541.0:11051 4.1f e58/17 4:fad756a7:::10000003107.00000000:head v 58'162, mlcod=58'160)", 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.123326+0000", 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.74680433400000001, 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844996000000001, 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.123326+0000", 2024-04-26T11:46:36.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.123326+0000", 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.123325+0000", 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.129824+0000", 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064997500000000003 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.129837+0000", 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.208e-05 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.129844+0000", 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6639999999999998e-06 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.129903+0000", 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9196e-05 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.129932+0000", 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8206000000000001e-05 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.156103+0000", 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026171057000000001 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.156171+0000", 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7848000000000005e-05 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11060 4.d 4:b34af0a1:::1000000314d.00000002:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.137245+0000", 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.73288483199999999, 2024-04-26T11:46:36.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034061186, 2024-04-26T11:46:36.937 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.937 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.937 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.937 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.937 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.937 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11060 2024-04-26T11:46:36.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.937 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.137245+0000", 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.137245+0000", 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.137244+0000", 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.144345+0000", 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0071012740000000003 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.144358+0000", 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2794e-05 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.144370+0000", 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1999e-05 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.144452+0000", 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1846000000000002e-05 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.144648+0000", 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019606499999999999 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.144800+0000", 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015260800000000001 2024-04-26T11:46:36.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.156797+0000", 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01199709 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.171228+0000", 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014430511 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.171273+0000", 2024-04-26T11:46:36.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5525999999999997e-05 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.171306+0000", 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2830999999999998e-05 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11074 4.5 4:a2c63b3e:::100000031d7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.178860+0000", 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.69126964099999999, 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039609816999999999, 2024-04-26T11:46:36.942 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11074 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.178860+0000", 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.178860+0000", 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.178859+0000", 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.186439+0000", 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0075805480000000003 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.186469+0000", 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9649e-05 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.186479+0000", 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0448000000000001e-05 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.186542+0000", 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2812999999999996e-05 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.186765+0000", 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022289900000000001 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.186907+0000", 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014178500000000001 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.203450+0000", 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016543335999999999 2024-04-26T11:46:36.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.218315+0000", 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014864575999999999 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.218399+0000", 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4472e-05 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.218470+0000", 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0994999999999994e-05 2024-04-26T11:46:36.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11078 4.3d 4:be756e30:::100000030b5.00000000:head [write 0~4194304 [3@124016]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.186703+0000", 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.68342729300000005, 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033884626000000001, 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.948 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11078 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.186703+0000", 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.186703+0000", 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.186702+0000", 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.193610+0000", 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006908249 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.193626+0000", 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5345e-05 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.193633+0000", 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2609999999999996e-06 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.193699+0000", 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5919000000000004e-05 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.193808+0000", 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010894400000000001 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.193907+0000", 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9298999999999999e-05 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.207248+0000", 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013341245 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.220491+0000", 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013242326 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.220540+0000", 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9515999999999998e-05 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.220587+0000", 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7005999999999997e-05 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11109 4.e 4:726ffa32:::10000003142.00000001:head [write 0~3670016] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.231103+0000", 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.63902696599999997, 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032284207000000002, 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11109 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.231103+0000", 2024-04-26T11:46:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.231103+0000", 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.231101+0000", 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.236366+0000", 2024-04-26T11:46:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052649710000000002 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.236389+0000", 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3292999999999999e-05 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.236403+0000", 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.344e-05 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.236481+0000", 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8008000000000003e-05 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.236922+0000", 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00044087100000000001 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.237418+0000", 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00049604800000000002 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.249344+0000", 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011926681999999999 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.263297+0000", 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013952384 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.263336+0000", 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8705999999999998e-05 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.263387+0000", 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1536000000000003e-05 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11214 4.1a 4:59c2b69f:::10000003106.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.424392+0000", 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.44573775100000002, 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029624869000000002, 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11214 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.424392+0000", 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.424392+0000", 2024-04-26T11:46:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.424390+0000", 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.430949+0000", 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065583600000000001 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.430978+0000", 2024-04-26T11:46:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8991000000000001e-05 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.430990+0000", 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2342e-05 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.431064+0000", 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3653999999999996e-05 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.431199+0000", 2024-04-26T11:46:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013538999999999999 2024-04-26T11:46:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.453858+0000", 2024-04-26T11:46:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022659287 2024-04-26T11:46:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.453910+0000", 2024-04-26T11:46:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2091e-05 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.454017+0000", 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106594 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11246 4.5 4:a04eb487:::1000000319f.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.513780+0000", 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.356350202, 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029103223000000001, 2024-04-26T11:46:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11246 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.513780+0000", 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.513780+0000", 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.513778+0000", 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.518133+0000", 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043547029999999997 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.518149+0000", 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6393999999999999e-05 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.518160+0000", 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0502999999999999e-05 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.518230+0000", 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9757000000000003e-05 2024-04-26T11:46:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.518408+0000", 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000177954 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.518583+0000", 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000175465 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.533777+0000", 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015193629 2024-04-26T11:46:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.542815+0000", 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0090382239999999992 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.542853+0000", 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8228000000000001e-05 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.542883+0000", 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9785999999999999e-05 2024-04-26T11:46:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11296 4.2b 4:d7f6ff2e:::1000000321c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.580941+0000", 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.28918932899999999, 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031368136999999997, 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11296 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.580941+0000", 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.580941+0000", 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.580939+0000", 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.587994+0000", 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070549640000000004 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.588019+0000", 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4210999999999999e-05 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.588031+0000", 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.289e-05 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.588094+0000", 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2731000000000006e-05 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.588261+0000", 2024-04-26T11:46:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016643100000000001 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.612127+0000", 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023866166000000001 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.612223+0000", 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6681000000000005e-05 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.612309+0000", 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5195e-05 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11322 4.31 4:8dba0bb8:::10000003242.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.615589+0000", 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.25454119800000002, 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030832333, 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11322 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.615589+0000", 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.615589+0000", 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.615587+0000", 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.619913+0000", 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00432599 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.619930+0000", 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6982000000000001e-05 2024-04-26T11:46:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.619943+0000", 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2057e-05 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.619996+0000", 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3689e-05 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.620160+0000", 2024-04-26T11:46:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016375100000000001 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.620311+0000", 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015128900000000001 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.633077+0000", 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012765927999999999 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.646304+0000", 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013227075 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.646372+0000", 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7650000000000005e-05 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.646421+0000", 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9082000000000002e-05 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11324 4.31 4:8f63c3a3:::100000031fe.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:36.619964+0000", 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.25016612999999999, 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029270846999999999, 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11324 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.619964+0000", 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.619964+0000", 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.619962+0000", 2024-04-26T11:46:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.624085+0000", 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041225699999999999 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.624109+0000", 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4003999999999999e-05 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.624120+0000", 2024-04-26T11:46:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0487e-05 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.626690+0000", 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002570223 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.626767+0000", 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7176999999999996e-05 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.626903+0000", 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013572700000000001 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.635337+0000", 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084345240000000005 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.649113+0000", 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013775948999999999 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.649183+0000", 2024-04-26T11:46:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0000999999999996e-05 2024-04-26T11:46:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:36.649235+0000", 2024-04-26T11:46:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1436e-05 2024-04-26T11:46:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:36.986 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:36.988 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:36.985+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:36.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:37.010 INFO:tasks.workunit.client.0.smithi029.stdout:7/254: dread d11/f1e [0,4194304] 0 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:9/317: creat d4/f61 x:0 0 0 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:5/249: truncate f4 2455057 0 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:1/237: symlink d7/l51 0 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:7/255: fsync d11/d15/f2a 0 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:0/220: dread d9/d16/d25/f34 [0,4194304] 0 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:3/262: creat d0/d1/d41/d5f/f69 x:0 0 0 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:7/256: chown d11/d18/d35/d39 0 1 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:9/318: chown d4/d5/d7/f36 7 1 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:0/221: mkdir d9/d16/d25/d2a/d4b 0 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:2/226: dwrite f7 [0,4194304] 0 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:7/257: chown d11/d18/d2d 65 1 2024-04-26T11:46:37.011 INFO:tasks.workunit.client.0.smithi029.stdout:9/319: fsync d4/d5/d16/f3b 0 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:4/200: dread d3/f5 [0,4194304] 0 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:9/320: rename d4 to d4/d62 22 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:8/206: dwrite dc/de/f29 [0,4194304] 0 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:9/321: readlink d4/l23 0 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:2/227: fsync d12/f1e 0 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:3/263: dread d0/d1/d41/d5f/f57 [0,4194304] 0 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:4/201: rename d3/d1d/d11/d16/d1f to d3/d1d/d11/d16/d1f/d3d/d40 22 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:8/207: chown dc/de/d2e/d23 119395113 1 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:5/250: dwrite db/f36 [0,4194304] 0 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:6/251: dread d7/d25/f47 [4194304,4194304] 0 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:8/208: sync 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:1/238: dwrite d7/d25/f2e [0,4194304] 0 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:7/258: creat d11/d18/d1a/f53 x:0 0 0 2024-04-26T11:46:37.012 INFO:tasks.workunit.client.0.smithi029.stdout:4/202: fsync d3/f1e 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:2/228: write d12/d24/d2f/d3d/f42 [303600,57626] 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:8/209: write dc/de/f2b [4779661,128485] 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:5/251: unlink db/d12/d1f/f23 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:0/222: getdents d9/d16/d33/d2f/d32 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:7/259: rename d11/d18/d35/l3d to d11/d15/l54 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:6/252: mkdir d7/d25/d4b/d4d 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:0/223: fdatasync d9/d16/d33/d2f/d32/f42 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:8/210: link dc/f11 dc/de/d15/f44 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:5/252: link db/d12/l3a db/d12/l53 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:0/224: creat d9/d43/f4c x:0 0 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:5/253: readlink db/l32 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:5/254: mknod db/c54 1 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:2/229: dread d12/d24/f35 [0,4194304] 0 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:2/230: mknod d12/d24/d29/d36/c45 1 2024-04-26T11:46:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:5/255: getdents db/d12/d1a 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:5/256: stat db/f20 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:5/257: fsync f8 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:2/231: mknod d12/d24/d29/d3a/c46 1 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:5/258: stat db/d12/d1a/f28 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:5/259: readlink db/d12/l3a 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:5/260: sync 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:2/232: getdents d12 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:2/233: unlink d12/d24/d2f/d3d/f42 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:5/261: rename f0 to db/d12/d1a/d4c/f55 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:7/260: dread fc [0,4194304] 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:9/322: truncate d4/d5/d16/d39/f3c 259111 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:4/203: write d3/d1d/d11/d16/d1f/f27 [720765,37610] 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:1/239: truncate f2 1072362 0 2024-04-26T11:46:37.014 INFO:tasks.workunit.client.0.smithi029.stdout:6/253: getdents d7/d25/d4b 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:0/225: write d9/f20 [292411,23502] 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:5/262: write db/d12/d1a/f10 [582492,91344] 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:2/234: truncate d12/d24/d29/d36/f3b 348959 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:3/264: dwrite d0/d1/d41/d5f/f59 [0,4194304] 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:6/254: fsync d7/d46/f48 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:7/261: write d11/d18/d1a/f31 [1911657,62310] 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:0/226: creat d9/d16/f4d x:0 0 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:6/255: readlink l3 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:7/262: mknod d11/d15/c55 1 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:9/323: link d4/d5/d7/f36 d4/d5/d16/d39/f63 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:1/240: creat d7/f52 x:0 0 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:6/256: stat d7/d20/d27/l3c 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:4/204: getdents d3/d1d/d11/d16/d1f 0 2024-04-26T11:46:37.015 INFO:tasks.workunit.client.0.smithi029.stdout:1/241: truncate d7/db/f4a 164784 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:2/235: getdents d12/d24/d29/d3a/d40 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:6/257: unlink d7/d20/d2f/f3a 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:7/263: symlink d11/d15/l56 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:5/263: read db/f1e [390198,7062] 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:1/242: mkdir d7/db/d10/d1e/d53 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:7/264: creat d11/d15/f57 x:0 0 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:2/236: rename d12/d24/d2f/d3d to d12/d47 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:4/205: creat d3/d1d/db/f41 x:0 0 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:0/227: dwrite d9/f2d [0,4194304] 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:9/324: getdents d4/d49 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:1/243: write d7/f52 [206286,128956] 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:4/206: stat d3/l25 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:7/265: mkdir d11/d18/d58 0 2024-04-26T11:46:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:8/211: dread dc/de/d2e/f2a [0,4194304] 0 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:1/244: creat d7/d37/d3e/df/f54 x:0 0 0 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:0/228: creat d9/d16/d33/d2f/d31/f4e x:0 0 0 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:7/266: write f6 [3753075,75984] 0 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:1/245: readlink d7/l3a 0 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:8/212: creat dc/de/d2e/d23/d27/d24/f45 x:0 0 0 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:0/229: mknod d9/d16/d25/d2a/d46/c4f 1 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:1/246: chown d7/f52 28190170 1 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:4/207: dread - d3/d1d/db/f41 zero size 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:7/267: read d11/d18/f27 [202150,107043] 0 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:4/208: sync 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:3/265: truncate d0/d1/d41/d5f/d1a/f3d 6078693 0 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:5/264: truncate db/d12/f1b 3746719 0 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:6/258: dwrite d7/d25/f47 [4194304,4194304] 0 2024-04-26T11:46:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:3/266: chown d0/l2e 295223 1 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:6/259: sync 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:0/230: creat d9/d16/d33/d2f/f50 x:0 0 0 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:5/265: mknod db/d12/d1a/c56 1 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:6/260: chown d7/d20 239850 1 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:0/231: dread - d9/f36 zero size 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:4/209: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/f42 x:0 0 0 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:2/237: write d12/f19 [8529110,126088] 0 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:7/268: getdents d11/d37 0 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:3/267: fdatasync d0/dc/f4e 0 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:9/325: dwrite d4/d49/d58/f4f [0,4194304] 0 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:7/269: chown d11/d37/d3b 8 1 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:4/210: dread - d3/d1d/d11/d16/d1f/d3d/d39/f32 zero size 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:0/232: creat d9/d16/d33/f51 x:0 0 0 2024-04-26T11:46:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:6/261: creat d7/d25/d4b/f4e x:0 0 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:3/268: rmdir d0/d1/d41/d5f/d54 39 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:8/213: truncate dc/de/d2e/d23/f31 7706864 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:2/238: rename d12/f23 to d12/d24/d29/f48 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:4/211: rename d3/d1d/f22 to d3/d1d/db/d13/d23/f43 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:3/269: getdents d0/d1/d41/d5f 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:3/270: unlink d0/dc/d1f/f2d 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:0/233: rename d9/d16/d25/d27 to d9/d16/d52 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:3/271: symlink d0/d1/d2f/l6a 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:6/262: dread d7/f12 [4194304,4194304] 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:9/326: read d4/f1d [1302772,2175] 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:6/263: rename d7/d20/l21 to d7/d19/d34/d4c/l4f 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:6/264: creat d7/d20/d27/f50 x:0 0 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:9/327: truncate d4/d5/d7/ff 5442027 0 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:6/265: chown d7/f22 1190 1 2024-04-26T11:46:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:6/266: sync 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:6/267: chown d7/l10 99740 1 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:4/212: dwrite d3/d1d/db/f36 [0,4194304] 0 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:9/328: getdents d4/d49/d58 0 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:7/270: dwrite d11/d18/f22 [0,4194304] 0 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:6/268: dread - d7/d25/d4b/f4e zero size 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:4/213: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/c44 1 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:1/247: dread f2 [0,4194304] 0 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:9/329: unlink d4/d5/f6 0 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:8/214: unlink dc/de/d2e/d23/f31 0 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:3/272: truncate d0/d1/d41/d5f/d1a/d3b/f4f 363567 0 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:8/215: truncate dc/de/d15/f44 1163027 0 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:9/330: read d4/d5/d16/f34 [1966887,77312] 0 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:6/269: creat d7/d19/f51 x:0 0 0 2024-04-26T11:46:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:1/248: creat d7/f55 x:0 0 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:2/239: symlink d12/l49 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:8/216: creat dc/de/d2e/f46 x:0 0 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:0/234: creat d9/d16/d25/d2a/f53 x:0 0 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:7/271: dwrite d11/d15/f57 [0,4194304] 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:6/270: creat d7/d20/d2f/f52 x:0 0 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:2/240: fdatasync d12/d24/d29/d36/f43 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:1/249: creat d7/d37/d3e/f56 x:0 0 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:9/331: creat d4/f64 x:0 0 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:6/271: mknod d7/d20/d2f/c53 1 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:8/217: rename dc/d12/l30 to dc/de/l47 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:6/272: fdatasync d7/d19/f36 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:4/214: write d3/f31 [799150,12940] 0 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:4/215: sync 2024-04-26T11:46:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:2/241: readlink d12/l17 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:0/235: rename d9/d16/d25/d2a/f53 to d9/d43/f54 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:7/272: creat d11/d18/d58/f59 x:0 0 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:6/273: creat d7/d25/d4b/d4d/f54 x:0 0 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:5/266: dread db/d12/d1f/f21 [0,4194304] 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:9/332: link d4/f1d d4/d5/d16/d39/f65 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:2/242: creat d12/d24/d29/d38/f4a x:0 0 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:5/267: readlink db/l2a 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:9/333: chown d4/d5 15648281 1 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:3/273: dwrite d0/d1/f43 [4194304,4194304] 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:2/243: mkdir d12/d24/d29/d36/d4b 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:4/216: fdatasync d3/f31 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:6/274: link d7/l13 d7/d19/d34/d4c/l55 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:3/274: creat d0/dc/d1f/f6b x:0 0 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:5/268: write db/d12/d1a/f33 [118395,34176] 0 2024-04-26T11:46:37.022 INFO:tasks.workunit.client.0.smithi029.stdout:4/217: write d3/d1d/f12 [3727488,3310] 0 2024-04-26T11:46:37.023 INFO:tasks.workunit.client.0.smithi029.stdout:2/244: creat d12/d24/d29/d3a/f4c x:0 0 0 2024-04-26T11:46:37.023 INFO:tasks.workunit.client.0.smithi029.stdout:1/250: dwrite d7/d37/d3e/f56 [0,4194304] 0 2024-04-26T11:46:37.023 INFO:tasks.workunit.client.0.smithi029.stdout:6/275: mknod d7/d20/c56 1 2024-04-26T11:46:37.023 INFO:tasks.workunit.client.0.smithi029.stdout:6/276: sync 2024-04-26T11:46:37.023 INFO:tasks.workunit.client.0.smithi029.stdout:8/218: dwrite dc/de/f2b [0,4194304] 0 2024-04-26T11:46:37.023 INFO:tasks.workunit.client.0.smithi029.stdout:7/273: truncate d11/d18/f27 2626730 0 2024-04-26T11:46:37.023 INFO:tasks.workunit.client.0.smithi029.stdout:0/236: dwrite d9/f48 [0,4194304] 0 2024-04-26T11:46:37.023 INFO:tasks.workunit.client.0.smithi029.stdout:1/251: fdatasync d7/d37/d3e/f2f 0 2024-04-26T11:46:37.023 INFO:tasks.workunit.client.0.smithi029.stdout:2/245: chown d12/l13 32811274 1 2024-04-26T11:46:37.023 INFO:tasks.workunit.client.0.smithi029.stdout:7/274: chown d11/d18/d35 279113 1 2024-04-26T11:46:37.023 INFO:tasks.workunit.client.0.smithi029.stdout:3/275: creat d0/dc/f6c x:0 0 0 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:4/218: creat d3/d1d/db/d13/d23/f45 x:0 0 0 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:8/219: mkdir dc/de/d2e/d23/d27/d24/d43/d48 0 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:0/237: symlink d9/d16/d33/d2f/l55 0 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:7/275: truncate d11/f1e 1588635 0 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:9/334: dwrite d4/d5/d7/f47 [0,4194304] 0 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:1/252: chown d7/db/d10/d20/l28 489 1 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:2/246: write d12/d24/d29/d36/f3b [1332365,50938] 0 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:8/220: dread - dc/d3b/f41 zero size 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:2/247: chown d12/l49 242362839 1 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:6/277: truncate d7/d25/f47 1259326 0 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:5/269: dwrite db/d12/d1a/f27 [0,4194304] 0 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:0/238: creat d9/d16/d33/f56 x:0 0 0 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:4/219: truncate d3/f31 654317 0 2024-04-26T11:46:37.024 INFO:tasks.workunit.client.0.smithi029.stdout:8/221: read - dc/de/d2e/d23/d27/d24/f45 zero size 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:4/220: chown d3/d1d/l17 0 1 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:0/239: dread - d9/d16/f22 zero size 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:0/240: fsync d9/d16/f4d 0 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:9/335: read d4/d5/d7/f47 [6552898,105935] 0 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:0/241: mknod d9/d16/c57 1 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:7/276: link d11/d18/d1a/f53 d11/d37/d3b/f5a 0 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:5/270: unlink db/d12/d1a/f13 0 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:8/222: creat dc/d12/f49 x:0 0 0 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:6/278: chown d7/d19/f1e 6 1 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:5/271: fdatasync db/d12/d1a/f10 0 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:4/221: rmdir d3/d1d/d11/d16/d1f/d3d/d39 39 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:9/336: symlink d4/d5/d16/l66 0 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:8/223: symlink dc/de/l4a 0 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:2/248: getdents d12/d24/d29/d36/d4b 0 2024-04-26T11:46:37.025 INFO:tasks.workunit.client.0.smithi029.stdout:1/253: getdents d7/d37/d3e 0 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:1/254: mknod d7/d37/d3e/c57 1 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:6/279: getdents d7/d19/d49 0 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:8/224: read dc/de/d2e/f2a [2524670,111044] 0 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:2/249: stat d12/f19 0 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:6/280: read - d7/d20/d27/f50 zero size 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:3/276: write d0/d1/d41/d5f/d1a/d3b/f4f [531591,17163] 0 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:0/242: dwrite f3 [0,4194304] 0 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:1/255: creat d7/d37/f58 x:0 0 0 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:7/277: dread d11/d18/f22 [0,4194304] 0 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:5/272: creat db/d12/f57 x:0 0 0 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:7/278: read - d11/d18/d1a/f53 zero size 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:4/222: mkdir d3/d1d/d11/d16/d1f/d3d/d46 0 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:1/256: chown d7/db/d10/d1e/l49 72 1 2024-04-26T11:46:37.026 INFO:tasks.workunit.client.0.smithi029.stdout:3/277: creat d0/d1/d2b/f6d x:0 0 0 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:0/243: symlink d9/d16/d33/d2f/d31/l58 0 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:8/225: rename dc/de/l47 to dc/de/d15/l4b 0 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:6/281: dread d7/f32 [0,4194304] 0 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:7/279: creat d11/d15/f5b x:0 0 0 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/250: rename d12/d24 to d12/d24/d29/d36/d4b/d4d 22 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:5/273: rename db/f36 to db/d12/d1a/d4c/f58 0 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:6/282: mknod d7/d20/d2f/d45/c57 1 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:3/278: rename d0/d1/d41 to d0/d1/d41/d5f/d54/d6e 22 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:4/223: creat d3/f47 x:0 0 0 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/251: creat d12/d24/d2f/f4e x:0 0 0 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:5/274: fdatasync db/f52 0 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:0/244: truncate d9/d16/f3d 1760436 0 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:3/279: write d0/d1/d41/d5f/f59 [1453526,70388] 0 2024-04-26T11:46:37.027 INFO:tasks.workunit.client.0.smithi029.stdout:4/224: dread - d3/d1d/d11/d16/d1f/d3d/d39/f32 zero size 2024-04-26T11:46:37.028 INFO:tasks.workunit.client.0.smithi029.stdout:2/252: mkdir d12/d24/d29/d3a/d4f 0 2024-04-26T11:46:37.028 INFO:tasks.workunit.client.0.smithi029.stdout:2/253: dread - d12/d24/d29/d36/f43 zero size 2024-04-26T11:46:37.028 INFO:tasks.workunit.client.0.smithi029.stdout:3/280: link d0/d1/d41/d5f/f69 d0/dc/d1f/f6f 0 2024-04-26T11:46:37.028 INFO:tasks.workunit.client.0.smithi029.stdout:0/245: chown d9/d16/d25/f3e 7213161 1 2024-04-26T11:46:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:2/254: chown d12/d24/d29/d3a/d40 14 1 2024-04-26T11:46:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:8/226: dwrite dc/de/f29 [0,4194304] 0 2024-04-26T11:46:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:1/257: dwrite d7/f55 [0,4194304] 0 2024-04-26T11:46:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:5/275: dwrite db/d12/f57 [0,4194304] 0 2024-04-26T11:46:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:8/227: creat dc/de/d15/f4c x:0 0 0 2024-04-26T11:46:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:6/283: stat d7/d25/f47 0 2024-04-26T11:46:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:1/258: link d7/f1c d7/d25/f59 0 2024-04-26T11:46:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:6/284: write d7/d19/f24 [3936602,76036] 0 2024-04-26T11:46:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:8/228: truncate dc/f11 1751328 0 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:5/276: read - db/d12/d1f/d39/d3b/f42 zero size 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:0/246: read d9/f18 [354879,126298] 0 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:3/281: dwrite d0/d1/f5d [0,4194304] 0 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:0/247: mknod d9/c59 1 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:5/277: chown db/d12/l3a 0 1 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:0/248: rmdir d9 39 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:2/255: dwrite d12/f22 [0,4194304] 0 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:5/278: write db/d12/d1a/f27 [1927955,64206] 0 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:3/282: symlink d0/d1/d41/d5f/d1a/d3b/l70 0 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:2/256: rmdir d12/d24/d29 39 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:5/279: dread - db/f20 zero size 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:6/285: rename d7/d19/f24 to d7/d19/f58 0 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:3/283: write d0/d37/f55 [495277,71080] 0 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:0/249: creat d9/d16/d25/d2a/d46/f5a x:0 0 0 2024-04-26T11:46:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:3/284: chown d0/d1 470055810 1 2024-04-26T11:46:37.033 INFO:tasks.workunit.client.0.smithi029.stdout:5/280: chown db/d12/d1a/f51 32 1 2024-04-26T11:46:37.033 INFO:tasks.workunit.client.0.smithi029.stdout:1/259: dwrite d7/d25/f2e [0,4194304] 0 2024-04-26T11:46:37.033 INFO:tasks.workunit.client.0.smithi029.stdout:2/257: mkdir d12/d24/d29/d50 0 2024-04-26T11:46:37.033 INFO:tasks.workunit.client.0.smithi029.stdout:3/285: write d0/f52 [2188368,68323] 0 2024-04-26T11:46:37.033 INFO:tasks.workunit.client.0.smithi029.stdout:6/286: creat d7/d20/d2f/d45/f59 x:0 0 0 2024-04-26T11:46:37.033 INFO:tasks.workunit.client.0.smithi029.stdout:0/250: creat d9/d16/d52/f5b x:0 0 0 2024-04-26T11:46:37.033 INFO:tasks.workunit.client.0.smithi029.stdout:5/281: rename db/d12/d1f/d39/l3f to db/d12/d1f/d39/l59 0 2024-04-26T11:46:37.034 INFO:tasks.workunit.client.0.smithi029.stdout:6/287: mknod d7/d20/d27/c5a 1 2024-04-26T11:46:37.034 INFO:tasks.workunit.client.0.smithi029.stdout:0/251: creat d9/d16/d33/f5c x:0 0 0 2024-04-26T11:46:37.034 INFO:tasks.workunit.client.0.smithi029.stdout:3/286: getdents d0/dc/d1f 0 2024-04-26T11:46:37.034 INFO:tasks.workunit.client.0.smithi029.stdout:1/260: truncate d7/d37/d3e/f40 454691 0 2024-04-26T11:46:37.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/258: truncate d12/d24/d29/d3a/f4c 784654 0 2024-04-26T11:46:37.034 INFO:tasks.workunit.client.0.smithi029.stdout:5/282: symlink db/d12/d1f/l5a 0 2024-04-26T11:46:37.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/229: dwrite dc/de/d2e/d23/d27/f42 [0,4194304] 0 2024-04-26T11:46:37.035 INFO:tasks.workunit.client.0.smithi029.stdout:1/261: dread - d7/d37/f58 zero size 2024-04-26T11:46:37.035 INFO:tasks.workunit.client.0.smithi029.stdout:1/262: chown d7/d37/d3e/df/d4b 5 1 2024-04-26T11:46:37.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/230: chown dc/de/l25 166414 1 2024-04-26T11:46:37.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/231: readlink dc/d12/l1c 0 2024-04-26T11:46:37.036 INFO:tasks.workunit.client.0.smithi029.stdout:1/263: write d7/d37/d3e/f4e [760702,7913] 0 2024-04-26T11:46:37.036 INFO:tasks.workunit.client.0.smithi029.stdout:8/232: chown dc/de/l25 797609315 1 2024-04-26T11:46:37.036 INFO:tasks.workunit.client.0.smithi029.stdout:5/283: fdatasync db/d12/d1a/f27 0 2024-04-26T11:46:37.037 INFO:tasks.workunit.client.0.smithi029.stdout:8/233: mkdir dc/de/d2e/d23/d4d 0 2024-04-26T11:46:37.037 INFO:tasks.workunit.client.0.smithi029.stdout:2/259: rename d12/l2b to d12/d24/d29/d38/l51 0 2024-04-26T11:46:37.037 INFO:tasks.workunit.client.0.smithi029.stdout:1/264: dread d7/f35 [0,4194304] 0 2024-04-26T11:46:37.038 INFO:tasks.workunit.client.0.smithi029.stdout:8/234: chown f1 1 1 2024-04-26T11:46:37.038 INFO:tasks.workunit.client.0.smithi029.stdout:5/284: chown db/d12/d1a/f28 1010 1 2024-04-26T11:46:37.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/265: unlink d7/d37/d3e/df/f54 0 2024-04-26T11:46:37.039 INFO:tasks.workunit.client.0.smithi029.stdout:5/285: symlink db/d12/d1f/l5b 0 2024-04-26T11:46:37.039 INFO:tasks.workunit.client.0.smithi029.stdout:8/235: mknod dc/de/d2e/d23/d27/d24/c4e 1 2024-04-26T11:46:37.040 INFO:tasks.workunit.client.0.smithi029.stdout:5/286: chown db/d12/d1f/l5b 2 1 2024-04-26T11:46:37.041 INFO:tasks.workunit.client.0.smithi029.stdout:1/266: mkdir d7/d37/d5a 0 2024-04-26T11:46:37.042 INFO:tasks.workunit.client.0.smithi029.stdout:0/252: dread d9/f1d [0,4194304] 0 2024-04-26T11:46:37.042 INFO:tasks.workunit.client.0.smithi029.stdout:0/253: chown d9/d16/d33/f35 61027 1 2024-04-26T11:46:37.044 INFO:tasks.workunit.client.0.smithi029.stdout:2/260: dwrite d12/d24/d29/d3a/f4c [0,4194304] 0 2024-04-26T11:46:37.044 INFO:tasks.workunit.client.0.smithi029.stdout:2/261: readlink d12/d24/d29/d38/l3e 0 2024-04-26T11:46:37.046 INFO:tasks.workunit.client.0.smithi029.stdout:4/225: dread d3/f1e [0,4194304] 0 2024-04-26T11:46:37.048 INFO:tasks.workunit.client.0.smithi029.stdout:4/226: rename d3/d1d/d11 to d3/d1d/d11/d16/d1f/d3d/d48 22 2024-04-26T11:46:37.051 INFO:tasks.workunit.client.0.smithi029.stdout:0/254: dwrite d9/d16/d33/f56 [0,4194304] 0 2024-04-26T11:46:37.052 INFO:tasks.workunit.client.0.smithi029.stdout:0/255: readlink d9/d16/d33/d2f/d31/l58 0 2024-04-26T11:46:37.054 INFO:tasks.workunit.client.0.smithi029.stdout:0/256: rename d9/f48 to d9/d16/d25/d2a/d4b/f5d 0 2024-04-26T11:46:37.057 INFO:tasks.workunit.client.0.smithi029.stdout:5/287: rmdir db 39 2024-04-26T11:46:37.058 INFO:tasks.workunit.client.0.smithi029.stdout:8/236: truncate f1 14519363 0 2024-04-26T11:46:37.058 INFO:tasks.workunit.client.0.smithi029.stdout:7/280: sync 2024-04-26T11:46:37.059 INFO:tasks.workunit.client.0.smithi029.stdout:2/262: dread d12/f28 [0,4194304] 0 2024-04-26T11:46:37.060 INFO:tasks.workunit.client.0.smithi029.stdout:8/237: rmdir dc/de/d2e/d23 39 2024-04-26T11:46:37.061 INFO:tasks.workunit.client.0.smithi029.stdout:7/281: dread - d11/d18/d1a/d26/f45 zero size 2024-04-26T11:46:37.062 INFO:tasks.workunit.client.0.smithi029.stdout:2/263: write fd [100101,34998] 0 2024-04-26T11:46:37.063 INFO:tasks.workunit.client.0.smithi029.stdout:1/267: dread f6 [0,4194304] 0 2024-04-26T11:46:37.063 INFO:tasks.workunit.client.0.smithi029.stdout:9/337: dread d4/d5/fd [0,4194304] 0 2024-04-26T11:46:37.065 INFO:tasks.workunit.client.0.smithi029.stdout:2/264: mkdir d12/d24/d29/d38/d52 0 2024-04-26T11:46:37.066 INFO:tasks.workunit.client.0.smithi029.stdout:0/257: dwrite d9/d16/d52/f45 [0,4194304] 0 2024-04-26T11:46:37.066 INFO:tasks.workunit.client.0.smithi029.stdout:1/268: rmdir d7/db 39 2024-04-26T11:46:37.066 INFO:tasks.workunit.client.0.smithi029.stdout:8/238: write dc/de/d2e/d23/d27/d24/f45 [76967,34613] 0 2024-04-26T11:46:37.067 INFO:tasks.workunit.client.0.smithi029.stdout:9/338: unlink d4/d5/l29 0 2024-04-26T11:46:37.068 INFO:tasks.workunit.client.0.smithi029.stdout:0/258: fsync d9/d16/d33/f5c 0 2024-04-26T11:46:37.068 INFO:tasks.workunit.client.0.smithi029.stdout:2/265: fdatasync d12/f39 0 2024-04-26T11:46:37.068 INFO:tasks.workunit.client.0.smithi029.stdout:1/269: chown d7/d37/d3e/f4e 17945 1 2024-04-26T11:46:37.069 INFO:tasks.workunit.client.0.smithi029.stdout:4/227: dwrite d3/f7 [0,4194304] 0 2024-04-26T11:46:37.069 INFO:tasks.workunit.client.0.smithi029.stdout:5/288: read db/d12/d1a/f10 [501116,6774] 0 2024-04-26T11:46:37.070 INFO:tasks.workunit.client.0.smithi029.stdout:8/239: chown dc/de/d15/l2c 33840 1 2024-04-26T11:46:37.071 INFO:tasks.workunit.client.0.smithi029.stdout:2/266: mknod d12/d24/d29/d36/d4b/c53 1 2024-04-26T11:46:37.071 INFO:tasks.workunit.client.0.smithi029.stdout:8/240: fdatasync dc/de/d26/f32 0 2024-04-26T11:46:37.071 INFO:tasks.workunit.client.0.smithi029.stdout:0/259: chown d9/d16/d33/d2f/d32/l3a 764186679 1 2024-04-26T11:46:37.072 INFO:tasks.workunit.client.0.smithi029.stdout:1/270: mkdir d7/d5b 0 2024-04-26T11:46:37.072 INFO:tasks.workunit.client.0.smithi029.stdout:4/228: unlink d3/d1d/d11/f35 0 2024-04-26T11:46:37.074 INFO:tasks.workunit.client.0.smithi029.stdout:0/260: creat d9/d16/d33/f5e x:0 0 0 2024-04-26T11:46:37.074 INFO:tasks.workunit.client.0.smithi029.stdout:5/289: creat db/d12/f5c x:0 0 0 2024-04-26T11:46:37.074 INFO:tasks.workunit.client.0.smithi029.stdout:7/282: dwrite d11/d15/f3f [0,4194304] 0 2024-04-26T11:46:37.074 INFO:tasks.workunit.client.0.smithi029.stdout:1/271: fsync d7/d37/d3e/f56 0 2024-04-26T11:46:37.074 INFO:tasks.workunit.client.0.smithi029.stdout:2/267: write d12/d24/d29/d36/f3b [975849,102813] 0 2024-04-26T11:46:37.075 INFO:tasks.workunit.client.0.smithi029.stdout:9/339: dread d4/d49/d58/f53 [0,4194304] 0 2024-04-26T11:46:37.076 INFO:tasks.workunit.client.0.smithi029.stdout:8/241: dread dc/de/d2e/d23/f21 [0,4194304] 0 2024-04-26T11:46:37.076 INFO:tasks.workunit.client.0.smithi029.stdout:2/268: mknod d12/d24/d29/d36/c54 1 2024-04-26T11:46:37.076 INFO:tasks.workunit.client.0.smithi029.stdout:5/290: fdatasync f4 0 2024-04-26T11:46:37.076 INFO:tasks.workunit.client.0.smithi029.stdout:7/283: rmdir d11/d18/d35/d39 39 2024-04-26T11:46:37.077 INFO:tasks.workunit.client.0.smithi029.stdout:9/340: mkdir d4/d49/d58/d67 0 2024-04-26T11:46:37.077 INFO:tasks.workunit.client.0.smithi029.stdout:0/261: creat d9/d16/d25/d2a/f5f x:0 0 0 2024-04-26T11:46:37.077 INFO:tasks.workunit.client.0.smithi029.stdout:8/242: chown dc/d12/f49 443 1 2024-04-26T11:46:37.078 INFO:tasks.workunit.client.0.smithi029.stdout:1/272: creat d7/db/d10/d1e/d53/f5c x:0 0 0 2024-04-26T11:46:37.078 INFO:tasks.workunit.client.0.smithi029.stdout:9/341: rmdir d4/d49/d58 39 2024-04-26T11:46:37.081 INFO:tasks.workunit.client.0.smithi029.stdout:1/273: mknod d7/db/d10/d1e/c5d 1 2024-04-26T11:46:37.083 INFO:tasks.workunit.client.0.smithi029.stdout:2/269: mkdir d12/d24/d29/d50/d55 0 2024-04-26T11:46:37.083 INFO:tasks.workunit.client.0.smithi029.stdout:0/262: chown d9/d16/d33/d2f/d32/f42 95890564 1 2024-04-26T11:46:37.083 INFO:tasks.workunit.client.0.smithi029.stdout:4/229: truncate d3/f38 139730 0 2024-04-26T11:46:37.083 INFO:tasks.workunit.client.0.smithi029.stdout:9/342: chown d4/d5/f48 259908 1 2024-04-26T11:46:37.083 INFO:tasks.workunit.client.0.smithi029.stdout:7/284: rename d11/d18/d1a/d33/l41 to d11/d18/d1a/l5c 0 2024-04-26T11:46:37.083 INFO:tasks.workunit.client.0.smithi029.stdout:5/291: getdents db/d40/d4d 0 2024-04-26T11:46:37.083 INFO:tasks.workunit.client.0.smithi029.stdout:0/263: symlink d9/d16/l60 0 2024-04-26T11:46:37.083 INFO:tasks.workunit.client.0.smithi029.stdout:9/343: mknod d4/d49/d58/c68 1 2024-04-26T11:46:37.083 INFO:tasks.workunit.client.0.smithi029.stdout:7/285: creat d11/d18/d58/f5d x:0 0 0 2024-04-26T11:46:37.083 INFO:tasks.workunit.client.0.smithi029.stdout:5/292: symlink db/d12/l5d 0 2024-04-26T11:46:37.083 INFO:tasks.workunit.client.0.smithi029.stdout:9/344: creat d4/d49/d58/d67/f69 x:0 0 0 2024-04-26T11:46:37.084 INFO:tasks.workunit.client.0.smithi029.stdout:5/293: write db/f1c [1135445,49589] 0 2024-04-26T11:46:37.084 INFO:tasks.workunit.client.0.smithi029.stdout:4/230: read d3/d1d/f12 [3978568,8848] 0 2024-04-26T11:46:37.084 INFO:tasks.workunit.client.0.smithi029.stdout:7/286: rename d11/f1e to d11/d18/d35/f5e 0 2024-04-26T11:46:37.084 INFO:tasks.workunit.client.0.smithi029.stdout:2/270: link d12/d24/d29/d3a/f4c d12/d24/d29/d50/f56 0 2024-04-26T11:46:37.085 INFO:tasks.workunit.client.0.smithi029.stdout:5/294: truncate db/f52 447804 0 2024-04-26T11:46:37.085 INFO:tasks.workunit.client.0.smithi029.stdout:7/287: truncate f6 4538767 0 2024-04-26T11:46:37.086 INFO:tasks.workunit.client.0.smithi029.stdout:7/288: fsync f6 0 2024-04-26T11:46:37.087 INFO:tasks.workunit.client.0.smithi029.stdout:4/231: symlink d3/d1d/db/d13/d23/l49 0 2024-04-26T11:46:37.088 INFO:tasks.workunit.client.0.smithi029.stdout:1/274: dwrite d7/d37/d3e/f2f [0,4194304] 0 2024-04-26T11:46:37.088 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:37.085+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:37.089 INFO:tasks.workunit.client.0.smithi029.stdout:4/232: mknod d3/d1d/db/d13/d23/c4a 1 2024-04-26T11:46:37.089 INFO:tasks.workunit.client.0.smithi029.stdout:1/275: mkdir d7/db/d10/d1e/d5e 0 2024-04-26T11:46:37.090 INFO:tasks.workunit.client.0.smithi029.stdout:4/233: chown d3/d1d/f29 222 1 2024-04-26T11:46:37.090 INFO:tasks.workunit.client.0.smithi029.stdout:1/276: readlink d7/l51 0 2024-04-26T11:46:37.090 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:37.091 INFO:tasks.workunit.client.0.smithi029.stdout:0/264: dwrite d9/f41 [0,4194304] 0 2024-04-26T11:46:37.091 INFO:tasks.workunit.client.0.smithi029.stdout:1/277: readlink d7/d37/d3e/l47 0 2024-04-26T11:46:37.092 INFO:tasks.workunit.client.0.smithi029.stdout:3/287: sync 2024-04-26T11:46:37.092 INFO:tasks.workunit.client.0.smithi029.stdout:6/288: sync 2024-04-26T11:46:37.092 INFO:tasks.workunit.client.0.smithi029.stdout:9/345: sync 2024-04-26T11:46:37.092 INFO:tasks.workunit.client.0.smithi029.stdout:8/243: sync 2024-04-26T11:46:37.094 INFO:tasks.workunit.client.0.smithi029.stdout:4/234: getdents d3/d1d/db 0 2024-04-26T11:46:37.094 INFO:tasks.workunit.client.0.smithi029.stdout:6/289: mknod d7/d20/d2f/d45/c5b 1 2024-04-26T11:46:37.098 INFO:tasks.workunit.client.0.smithi029.stdout:2/271: dread d12/f2a [0,4194304] 0 2024-04-26T11:46:37.099 INFO:tasks.workunit.client.0.smithi029.stdout:1/278: symlink d7/d37/d3e/df/d4b/l5f 0 2024-04-26T11:46:37.099 INFO:tasks.workunit.client.0.smithi029.stdout:6/290: dread - d7/d20/d2f/f3d zero size 2024-04-26T11:46:37.099 INFO:tasks.workunit.client.0.smithi029.stdout:9/346: creat d4/d49/f6a x:0 0 0 2024-04-26T11:46:37.099 INFO:tasks.workunit.client.0.smithi029.stdout:3/288: link d0/d1/d2f/f39 d0/dc/f71 0 2024-04-26T11:46:37.100 INFO:tasks.workunit.client.0.smithi029.stdout:4/235: symlink d3/d1d/d11/d16/d1f/d3d/d39/d30/l4b 0 2024-04-26T11:46:37.100 INFO:tasks.workunit.client.0.smithi029.stdout:9/347: chown d4 780 1 2024-04-26T11:46:37.101 INFO:tasks.workunit.client.0.smithi029.stdout:5/295: truncate db/d12/d1a/d4c/f58 1051181 0 2024-04-26T11:46:37.101 INFO:tasks.workunit.client.0.smithi029.stdout:7/289: write d11/d18/d1a/f53 [596089,108565] 0 2024-04-26T11:46:37.102 INFO:tasks.workunit.client.0.smithi029.stdout:1/279: unlink d7/d37/d3e/f40 0 2024-04-26T11:46:37.102 INFO:tasks.workunit.client.0.smithi029.stdout:5/296: unlink f7 0 2024-04-26T11:46:37.103 INFO:tasks.workunit.client.0.smithi029.stdout:2/272: mkdir d12/d24/d29/d57 0 2024-04-26T11:46:37.106 INFO:tasks.workunit.client.0.smithi029.stdout:3/289: truncate d0/d1/f49 1612605 0 2024-04-26T11:46:37.106 INFO:tasks.workunit.client.0.smithi029.stdout:7/290: symlink d11/d18/d35/l5f 0 2024-04-26T11:46:37.106 INFO:tasks.workunit.client.0.smithi029.stdout:3/290: mknod d0/d1/d13/c72 1 2024-04-26T11:46:37.106 INFO:tasks.workunit.client.0.smithi029.stdout:4/236: symlink d3/d1d/d11/d16/d1f/l4c 0 2024-04-26T11:46:37.106 INFO:tasks.workunit.client.0.smithi029.stdout:0/265: dread d9/f2d [0,4194304] 0 2024-04-26T11:46:37.106 INFO:tasks.workunit.client.0.smithi029.stdout:2/273: chown d12/d24/d29/d3a/d40 697 1 2024-04-26T11:46:37.107 INFO:tasks.workunit.client.0.smithi029.stdout:7/291: write fc [1175345,96943] 0 2024-04-26T11:46:37.107 INFO:tasks.workunit.client.0.smithi029.stdout:8/244: dread dc/de/d2e/f2a [0,4194304] 0 2024-04-26T11:46:37.107 INFO:tasks.workunit.client.0.smithi029.stdout:4/237: mknod d3/d1d/db/c4d 1 2024-04-26T11:46:37.108 INFO:tasks.workunit.client.0.smithi029.stdout:0/266: mknod d9/d16/d25/c61 1 2024-04-26T11:46:37.108 INFO:tasks.workunit.client.0.smithi029.stdout:4/238: stat d3/d1d/d11/d16/d1f 0 2024-04-26T11:46:37.108 INFO:tasks.workunit.client.0.smithi029.stdout:7/292: readlink d11/d18/d1a/d26/l42 0 2024-04-26T11:46:37.108 INFO:tasks.workunit.client.0.smithi029.stdout:7/293: mknod d11/d18/d35/c60 1 2024-04-26T11:46:37.109 INFO:tasks.workunit.client.0.smithi029.stdout:1/280: dread d7/d37/d3e/f56 [0,4194304] 0 2024-04-26T11:46:37.110 INFO:tasks.workunit.client.0.smithi029.stdout:0/267: dread d9/d16/d52/f2c [0,4194304] 0 2024-04-26T11:46:37.110 INFO:tasks.workunit.client.0.smithi029.stdout:4/239: truncate d3/d1d/d11/d16/d1f/f27 5137289 0 2024-04-26T11:46:37.111 INFO:tasks.workunit.client.0.smithi029.stdout:0/268: dread - d9/d16/d33/f5e zero size 2024-04-26T11:46:37.112 INFO:tasks.workunit.client.0.smithi029.stdout:4/240: write d3/d1d/db/f36 [3883923,75436] 0 2024-04-26T11:46:37.112 INFO:tasks.workunit.client.0.smithi029.stdout:0/269: chown d9/d16/d33/d2f/l40 13532 1 2024-04-26T11:46:37.113 INFO:tasks.workunit.client.0.smithi029.stdout:0/270: symlink d9/d16/l62 0 2024-04-26T11:46:37.114 INFO:tasks.workunit.client.0.smithi029.stdout:4/241: dread - d3/d1d/d11/d16/d1f/d3d/d39/d30/f42 zero size 2024-04-26T11:46:37.115 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:37.115 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:37.116 INFO:tasks.workunit.client.0.smithi029.stdout:2/274: getdents d12/d24/d29 0 2024-04-26T11:46:37.116 INFO:tasks.workunit.client.0.smithi029.stdout:8/245: truncate dc/de/d2e/d23/d27/d24/f36 3440470 0 2024-04-26T11:46:37.118 INFO:tasks.workunit.client.0.smithi029.stdout:1/281: dread d7/d37/d3e/f56 [0,4194304] 0 2024-04-26T11:46:37.118 INFO:tasks.workunit.client.0.smithi029.stdout:0/271: creat d9/d16/d33/d2f/d31/f63 x:0 0 0 2024-04-26T11:46:37.119 INFO:tasks.workunit.client.0.smithi029.stdout:4/242: write d3/d1d/d11/d16/d1f/f27 [719846,50846] 0 2024-04-26T11:46:37.119 INFO:tasks.workunit.client.0.smithi029.stdout:8/246: chown dc/de/d2e/d23/d27 2 1 2024-04-26T11:46:37.121 INFO:tasks.workunit.client.0.smithi029.stdout:7/294: dwrite d11/d15/f3f [0,4194304] 0 2024-04-26T11:46:37.121 INFO:tasks.workunit.client.0.smithi029.stdout:8/247: readlink dc/de/d15/l4b 0 2024-04-26T11:46:37.123 INFO:tasks.workunit.client.0.smithi029.stdout:9/348: dread d4/d5/d7/f36 [0,4194304] 0 2024-04-26T11:46:37.124 INFO:tasks.workunit.client.0.smithi029.stdout:6/291: dwrite d7/f1c [0,4194304] 0 2024-04-26T11:46:37.124 INFO:tasks.workunit.client.0.smithi029.stdout:8/248: fsync dc/de/d2e/d23/d27/d24/f45 0 2024-04-26T11:46:37.125 INFO:tasks.workunit.client.0.smithi029.stdout:9/349: symlink d4/d49/l6b 0 2024-04-26T11:46:37.127 INFO:tasks.workunit.client.0.smithi029.stdout:6/292: chown d7/l13 1331 1 2024-04-26T11:46:37.127 INFO:tasks.workunit.client.0.smithi029.stdout:8/249: dread - dc/d12/f49 zero size 2024-04-26T11:46:37.127 INFO:tasks.workunit.client.0.smithi029.stdout:9/350: chown d4/d5/d7/ff 0 1 2024-04-26T11:46:37.127 INFO:tasks.workunit.client.0.smithi029.stdout:7/295: link d11/d18/d1a/l5c d11/d18/d1a/d33/l61 0 2024-04-26T11:46:37.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:37.129 INFO:tasks.workunit.client.0.smithi029.stdout:6/293: rename d7/d19 to d7/d25/d5c 0 2024-04-26T11:46:37.129 INFO:tasks.workunit.client.0.smithi029.stdout:9/351: stat d4/f64 0 2024-04-26T11:46:37.129 INFO:tasks.workunit.client.0.smithi029.stdout:8/250: dread - dc/de/d15/f4c zero size 2024-04-26T11:46:37.129 INFO:tasks.workunit.client.0.smithi029.stdout:7/296: chown lf 604254 1 2024-04-26T11:46:37.130 INFO:tasks.workunit.client.0.smithi029.stdout:9/352: dread - d4/d46/f57 zero size 2024-04-26T11:46:37.130 INFO:tasks.workunit.client.0.smithi029.stdout:1/282: dwrite d7/d37/d3e/f2f [4194304,4194304] 0 2024-04-26T11:46:37.131 INFO:tasks.workunit.client.0.smithi029.stdout:0/272: dread d9/f2d [0,4194304] 0 2024-04-26T11:46:37.131 INFO:tasks.workunit.client.0.smithi029.stdout:4/243: truncate d3/d1d/d11/d16/d1f/f27 1258009 0 2024-04-26T11:46:37.132 INFO:tasks.workunit.client.0.smithi029.stdout:7/297: write f9 [8654427,94646] 0 2024-04-26T11:46:37.132 INFO:tasks.workunit.client.0.smithi029.stdout:9/353: rename d4/d49/d58/l3f to d4/d49/d58/d67/l6c 0 2024-04-26T11:46:37.134 INFO:tasks.workunit.client.0.smithi029.stdout:8/251: rename dc/de/f2b to dc/f4f 0 2024-04-26T11:46:37.134 INFO:tasks.workunit.client.0.smithi029.stdout:7/298: dread - d11/d18/d1a/d26/f2c zero size 2024-04-26T11:46:37.136 INFO:tasks.workunit.client.0.smithi029.stdout:5/297: dread db/f1e [0,4194304] 0 2024-04-26T11:46:37.136 INFO:tasks.workunit.client.0.smithi029.stdout:0/273: rename d9/d16/d52/f5b to d9/d16/d25/d2a/d46/f64 0 2024-04-26T11:46:37.137 INFO:tasks.workunit.client.0.smithi029.stdout:8/252: creat dc/d3b/f50 x:0 0 0 2024-04-26T11:46:37.137 INFO:tasks.workunit.client.0.smithi029.stdout:6/294: dwrite d7/d20/f40 [0,4194304] 0 2024-04-26T11:46:37.142 INFO:tasks.workunit.client.0.smithi029.stdout:0/274: readlink d9/d16/d33/d2f/d31/l58 0 2024-04-26T11:46:37.144 INFO:tasks.workunit.client.0.smithi029.stdout:7/299: link d11/d15/l28 d11/l62 0 2024-04-26T11:46:37.144 INFO:tasks.workunit.client.0.smithi029.stdout:8/253: creat dc/de/d2e/f51 x:0 0 0 2024-04-26T11:46:37.145 INFO:tasks.workunit.client.0.smithi029.stdout:8/254: stat dc/d3b/f41 0 2024-04-26T11:46:37.146 INFO:tasks.workunit.client.0.smithi029.stdout:0/275: creat d9/d43/f65 x:0 0 0 2024-04-26T11:46:37.147 INFO:tasks.workunit.client.0.smithi029.stdout:1/283: dwrite d7/db/d10/d1e/f45 [0,4194304] 0 2024-04-26T11:46:37.147 INFO:tasks.workunit.client.0.smithi029.stdout:4/244: dwrite d3/d1d/d11/d16/d1f/d3d/d39/f32 [0,4194304] 0 2024-04-26T11:46:37.147 INFO:tasks.workunit.client.0.smithi029.stdout:7/300: creat d11/d18/d1a/d26/f63 x:0 0 0 2024-04-26T11:46:37.147 INFO:tasks.workunit.client.0.smithi029.stdout:8/255: creat dc/de/d2e/d23/d4d/f52 x:0 0 0 2024-04-26T11:46:37.147 INFO:tasks.workunit.client.0.smithi029.stdout:0/276: creat d9/d16/d25/d2a/f66 x:0 0 0 2024-04-26T11:46:37.148 INFO:tasks.workunit.client.0.smithi029.stdout:4/245: stat d3/d1d/d11/d16/d1f/l1c 0 2024-04-26T11:46:37.149 INFO:tasks.workunit.client.0.smithi029.stdout:1/284: creat d7/d37/d3e/df/f60 x:0 0 0 2024-04-26T11:46:37.151 INFO:tasks.workunit.client.0.smithi029.stdout:0/277: creat d9/d16/d33/d2f/d31/f67 x:0 0 0 2024-04-26T11:46:37.151 INFO:tasks.workunit.client.0.smithi029.stdout:4/246: write d3/d1d/db/d13/d23/f45 [77482,46852] 0 2024-04-26T11:46:37.151 INFO:tasks.workunit.client.0.smithi029.stdout:1/285: creat d7/d37/d5a/f61 x:0 0 0 2024-04-26T11:46:37.152 INFO:tasks.workunit.client.0.smithi029.stdout:6/295: read d7/f1a [6388361,33353] 0 2024-04-26T11:46:37.152 INFO:tasks.workunit.client.0.smithi029.stdout:0/278: mkdir d9/d16/d33/d2f/d68 0 2024-04-26T11:46:37.152 INFO:tasks.workunit.client.0.smithi029.stdout:1/286: chown d7/f35 6774595 1 2024-04-26T11:46:37.153 INFO:tasks.workunit.client.0.smithi029.stdout:6/296: rmdir d7/d25/d5c/d34/d4c 39 2024-04-26T11:46:37.154 INFO:tasks.workunit.client.0.smithi029.stdout:6/297: write d7/d20/d27/f2b [293785,11819] 0 2024-04-26T11:46:37.154 INFO:tasks.workunit.client.0.smithi029.stdout:1/287: symlink d7/db/d10/d20/l62 0 2024-04-26T11:46:37.157 INFO:tasks.workunit.client.0.smithi029.stdout:6/298: rmdir d7/d25/d5c/d49 0 2024-04-26T11:46:37.160 INFO:tasks.workunit.client.0.smithi029.stdout:6/299: link d7/d25/d5c/d34/d4c/l4f d7/l5d 0 2024-04-26T11:46:37.163 INFO:tasks.workunit.client.0.smithi029.stdout:0/279: dwrite d9/d16/d25/f34 [0,4194304] 0 2024-04-26T11:46:37.163 INFO:tasks.workunit.client.0.smithi029.stdout:6/300: creat d7/d25/d5c/f5e x:0 0 0 2024-04-26T11:46:37.163 INFO:tasks.workunit.client.0.smithi029.stdout:0/280: symlink d9/l69 0 2024-04-26T11:46:37.163 INFO:tasks.workunit.client.0.smithi029.stdout:7/301: dread d11/d18/d1a/f53 [0,4194304] 0 2024-04-26T11:46:37.163 INFO:tasks.workunit.client.0.smithi029.stdout:6/301: fdatasync d7/f22 0 2024-04-26T11:46:37.164 INFO:tasks.workunit.client.0.smithi029.stdout:0/281: mkdir d9/d16/d33/d2f/d31/d6a 0 2024-04-26T11:46:37.165 INFO:tasks.workunit.client.0.smithi029.stdout:7/302: rename f6 to d11/d18/d58/f64 0 2024-04-26T11:46:37.166 INFO:tasks.workunit.client.0.smithi029.stdout:5/298: dwrite db/d12/d1a/f24 [0,4194304] 0 2024-04-26T11:46:37.166 INFO:tasks.workunit.client.0.smithi029.stdout:6/302: read d7/d20/d27/f31 [762900,187] 0 2024-04-26T11:46:37.167 INFO:tasks.workunit.client.0.smithi029.stdout:0/282: fsync d9/d16/d25/f3e 0 2024-04-26T11:46:37.167 INFO:tasks.workunit.client.0.smithi029.stdout:6/303: mknod d7/d25/d4b/c5f 1 2024-04-26T11:46:37.167 INFO:tasks.workunit.client.0.smithi029.stdout:0/283: chown d9/d16/d33/d2f/d68 395001655 1 2024-04-26T11:46:37.168 INFO:tasks.workunit.client.0.smithi029.stdout:6/304: dread - d7/d20/d27/f41 zero size 2024-04-26T11:46:37.168 INFO:tasks.workunit.client.0.smithi029.stdout:7/303: dread fc [0,4194304] 0 2024-04-26T11:46:37.169 INFO:tasks.workunit.client.0.smithi029.stdout:6/305: mknod d7/d20/d2f/d45/c60 1 2024-04-26T11:46:37.169 INFO:tasks.workunit.client.0.smithi029.stdout:5/299: rename db/d12/d1a/f2e to db/d12/d1f/d39/d3b/f5e 0 2024-04-26T11:46:37.169 INFO:tasks.workunit.client.0.smithi029.stdout:7/304: readlink d11/d18/d35/l5f 0 2024-04-26T11:46:37.171 INFO:tasks.workunit.client.0.smithi029.stdout:9/354: dread d4/d5/d16/d39/f65 [0,4194304] 0 2024-04-26T11:46:37.171 INFO:tasks.workunit.client.0.smithi029.stdout:0/284: rename d9/f3b to d9/d16/d33/d2f/f6b 0 2024-04-26T11:46:37.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/306: write d7/d25/d5c/f5e [636339,112930] 0 2024-04-26T11:46:37.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/307: mknod d7/d20/d2f/c61 1 2024-04-26T11:46:37.172 INFO:tasks.workunit.client.0.smithi029.stdout:6/308: chown d7/l5d 295125510 1 2024-04-26T11:46:37.173 INFO:tasks.workunit.client.0.smithi029.stdout:5/300: creat db/d12/d1a/d4c/f5f x:0 0 0 2024-04-26T11:46:37.173 INFO:tasks.workunit.client.0.smithi029.stdout:6/309: stat l5 0 2024-04-26T11:46:37.174 INFO:tasks.workunit.client.0.smithi029.stdout:5/301: symlink db/d12/d1f/d39/l60 0 2024-04-26T11:46:37.175 INFO:tasks.workunit.client.0.smithi029.stdout:5/302: creat db/d40/f61 x:0 0 0 2024-04-26T11:46:37.176 INFO:tasks.workunit.client.0.smithi029.stdout:9/355: dread d4/d5/fd [0,4194304] 0 2024-04-26T11:46:37.176 INFO:tasks.workunit.client.0.smithi029.stdout:9/356: stat d4/d5/f4a 0 2024-04-26T11:46:37.178 INFO:tasks.workunit.client.0.smithi029.stdout:7/305: dwrite d11/f13 [0,4194304] 0 2024-04-26T11:46:37.178 INFO:tasks.workunit.client.0.smithi029.stdout:9/357: dread - d4/d5/d16/d39/f3d zero size 2024-04-26T11:46:37.180 INFO:tasks.workunit.client.0.smithi029.stdout:9/358: unlink d4/d46/l5e 0 2024-04-26T11:46:37.180 INFO:tasks.workunit.client.0.smithi029.stdout:7/306: chown d11/d18/d35/l5f 1981761 1 2024-04-26T11:46:37.181 INFO:tasks.workunit.client.0.smithi029.stdout:7/307: creat d11/f65 x:0 0 0 2024-04-26T11:46:37.181 INFO:tasks.workunit.client.0.smithi029.stdout:6/310: dwrite d7/f12 [0,4194304] 0 2024-04-26T11:46:37.182 INFO:tasks.workunit.client.0.smithi029.stdout:6/311: read d7/f32 [232441,88953] 0 2024-04-26T11:46:37.183 INFO:tasks.workunit.client.0.smithi029.stdout:0/285: dwrite d9/d16/d25/d2a/f5f [0,4194304] 0 2024-04-26T11:46:37.184 INFO:tasks.workunit.client.0.smithi029.stdout:6/312: symlink d7/d25/l62 0 2024-04-26T11:46:37.185 INFO:tasks.workunit.client.0.smithi029.stdout:0/286: creat d9/d16/d25/f6c x:0 0 0 2024-04-26T11:46:37.186 INFO:tasks.workunit.client.0.smithi029.stdout:0/287: creat d9/d43/f6d x:0 0 0 2024-04-26T11:46:37.187 INFO:tasks.workunit.client.0.smithi029.stdout:0/288: mknod d9/d16/d25/d2a/d4b/c6e 1 2024-04-26T11:46:37.188 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:37.185+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:37.189 INFO:tasks.workunit.client.0.smithi029.stdout:0/289: link d9/d16/d33/f5e d9/d16/d33/d2f/d31/f6f 0 2024-04-26T11:46:37.190 INFO:tasks.workunit.client.0.smithi029.stdout:0/290: creat d9/d16/d25/d2a/d46/f70 x:0 0 0 2024-04-26T11:46:37.190 INFO:tasks.workunit.client.0.smithi029.stdout:0/291: write f5 [3510070,93131] 0 2024-04-26T11:46:37.193 INFO:tasks.workunit.client.0.smithi029.stdout:0/292: truncate d9/d16/d25/f34 4353030 0 2024-04-26T11:46:37.193 INFO:tasks.workunit.client.0.smithi029.stdout:0/293: stat d9/d43/f54 0 2024-04-26T11:46:37.193 INFO:tasks.workunit.client.0.smithi029.stdout:0/294: stat d9/d43/f6d 0 2024-04-26T11:46:37.193 INFO:tasks.workunit.client.0.smithi029.stdout:0/295: chown d9/d16/d25/d2a/d4b 287758 1 2024-04-26T11:46:37.194 INFO:tasks.workunit.client.0.smithi029.stdout:0/296: creat d9/d16/d25/d2a/d46/f71 x:0 0 0 2024-04-26T11:46:37.201 INFO:tasks.workunit.client.0.smithi029.stdout:7/308: dread d11/d18/d1a/f23 [0,4194304] 0 2024-04-26T11:46:37.201 INFO:tasks.workunit.client.0.smithi029.stdout:7/309: unlink d11/d15/f5b 0 2024-04-26T11:46:37.203 INFO:tasks.workunit.client.0.smithi029.stdout:7/310: rename d11/d18/f27 to d11/d18/d1a/f66 0 2024-04-26T11:46:37.203 INFO:tasks.workunit.client.0.smithi029.stdout:1/288: rmdir d7/d37/d3e/df 39 2024-04-26T11:46:37.204 INFO:tasks.workunit.client.0.smithi029.stdout:7/311: chown d11/d18/f40 2 1 2024-04-26T11:46:37.205 INFO:tasks.workunit.client.0.smithi029.stdout:1/289: write d7/db/f4a [954634,40895] 0 2024-04-26T11:46:37.205 INFO:tasks.workunit.client.0.smithi029.stdout:7/312: unlink d11/f65 0 2024-04-26T11:46:37.206 INFO:tasks.workunit.client.0.smithi029.stdout:7/313: mkdir d11/d15/d67 0 2024-04-26T11:46:37.206 INFO:tasks.workunit.client.0.smithi029.stdout:1/290: link d7/d37/d3e/f4e d7/d37/f63 0 2024-04-26T11:46:37.208 INFO:tasks.workunit.client.0.smithi029.stdout:1/291: symlink d7/d25/l64 0 2024-04-26T11:46:37.211 INFO:tasks.workunit.client.0.smithi029.stdout:5/303: getdents db/d12/d1a/d4c 0 2024-04-26T11:46:37.213 INFO:tasks.workunit.client.0.smithi029.stdout:1/292: fdatasync d7/db/f4a 0 2024-04-26T11:46:37.214 INFO:tasks.workunit.client.0.smithi029.stdout:5/304: fsync db/d12/d1a/f10 0 2024-04-26T11:46:37.214 INFO:tasks.workunit.client.0.smithi029.stdout:8/256: dwrite dc/de/d2e/d23/f21 [0,4194304] 0 2024-04-26T11:46:37.215 INFO:tasks.workunit.client.0.smithi029.stdout:4/247: dwrite d3/d1d/f21 [0,4194304] 0 2024-04-26T11:46:37.215 INFO:tasks.workunit.client.0.smithi029.stdout:6/313: fsync d7/f3e 0 2024-04-26T11:46:37.216 INFO:tasks.workunit.client.0.smithi029.stdout:5/305: chown db/d12/d1a/f33 7840 1 2024-04-26T11:46:37.217 INFO:tasks.workunit.client.0.smithi029.stdout:1/293: truncate d7/db/d10/d1e/f41 92081 0 2024-04-26T11:46:37.218 INFO:tasks.workunit.client.0.smithi029.stdout:8/257: creat dc/de/d26/f53 x:0 0 0 2024-04-26T11:46:37.218 INFO:tasks.workunit.client.0.smithi029.stdout:5/306: mknod db/c62 1 2024-04-26T11:46:37.219 INFO:tasks.workunit.client.0.smithi029.stdout:4/248: rmdir d3/d1d/d11/d16/d1f 39 2024-04-26T11:46:37.219 INFO:tasks.workunit.client.0.smithi029.stdout:2/275: dread d12/d24/d29/f48 [0,4194304] 0 2024-04-26T11:46:37.219 INFO:tasks.workunit.client.0.smithi029.stdout:1/294: symlink d7/d37/d5a/l65 0 2024-04-26T11:46:37.223 INFO:tasks.workunit.client.0.smithi029.stdout:6/314: creat d7/d20/f63 x:0 0 0 2024-04-26T11:46:37.223 INFO:tasks.workunit.client.0.smithi029.stdout:8/258: mkdir dc/de/d2e/d23/d27/d24/d54 0 2024-04-26T11:46:37.223 INFO:tasks.workunit.client.0.smithi029.stdout:2/276: creat d12/d24/d29/d50/f58 x:0 0 0 2024-04-26T11:46:37.223 INFO:tasks.workunit.client.0.smithi029.stdout:5/307: rename db/d12/l53 to db/d12/d1a/l63 0 2024-04-26T11:46:37.223 INFO:tasks.workunit.client.0.smithi029.stdout:5/308: mknod db/d12/d1f/c64 1 2024-04-26T11:46:37.223 INFO:tasks.workunit.client.0.smithi029.stdout:2/277: creat d12/d24/d29/d50/f59 x:0 0 0 2024-04-26T11:46:37.224 INFO:tasks.workunit.client.0.smithi029.stdout:2/278: mknod d12/d24/d2f/c5a 1 2024-04-26T11:46:37.224 INFO:tasks.workunit.client.0.smithi029.stdout:9/359: dread d4/d49/f5c [0,4194304] 0 2024-04-26T11:46:37.224 INFO:tasks.workunit.client.0.smithi029.stdout:0/297: dread d9/fc [0,4194304] 0 2024-04-26T11:46:37.225 INFO:tasks.workunit.client.0.smithi029.stdout:1/295: write d7/f1c [3901183,33674] 0 2024-04-26T11:46:37.225 INFO:tasks.workunit.client.0.smithi029.stdout:2/279: readlink d12/l37 0 2024-04-26T11:46:37.225 INFO:tasks.workunit.client.0.smithi029.stdout:5/309: chown db/d40/l4e 253456 1 2024-04-26T11:46:37.225 INFO:tasks.workunit.client.0.smithi029.stdout:4/249: write d3/d1d/db/f28 [929209,108317] 0 2024-04-26T11:46:37.226 INFO:tasks.workunit.client.0.smithi029.stdout:9/360: unlink d4/d5/f33 0 2024-04-26T11:46:37.226 INFO:tasks.workunit.client.0.smithi029.stdout:8/259: unlink dc/de/d2e/d23/d4d/f52 0 2024-04-26T11:46:37.227 INFO:tasks.workunit.client.0.smithi029.stdout:1/296: write d7/d37/d3e/f2f [5894006,58006] 0 2024-04-26T11:46:37.227 INFO:tasks.workunit.client.0.smithi029.stdout:0/298: creat d9/d16/d33/f72 x:0 0 0 2024-04-26T11:46:37.228 INFO:tasks.workunit.client.0.smithi029.stdout:9/361: write d4/d5/fd [493342,72389] 0 2024-04-26T11:46:37.228 INFO:tasks.workunit.client.0.smithi029.stdout:2/280: link d12/f22 d12/d24/d29/d3a/d40/f5b 0 2024-04-26T11:46:37.230 INFO:tasks.workunit.client.0.smithi029.stdout:1/297: mkdir d7/d37/d3e/df/d4b/d66 0 2024-04-26T11:46:37.230 INFO:tasks.workunit.client.0.smithi029.stdout:4/250: symlink d3/d1d/db/d13/l4e 0 2024-04-26T11:46:37.230 INFO:tasks.workunit.client.0.smithi029.stdout:2/281: mkdir d12/d24/d29/d5c 0 2024-04-26T11:46:37.230 INFO:tasks.workunit.client.0.smithi029.stdout:8/260: write dc/de/f29 [582189,80695] 0 2024-04-26T11:46:37.232 INFO:tasks.workunit.client.0.smithi029.stdout:4/251: read d3/f5 [834792,82684] 0 2024-04-26T11:46:37.233 INFO:tasks.workunit.client.0.smithi029.stdout:6/315: dwrite d7/f11 [4194304,4194304] 0 2024-04-26T11:46:37.234 INFO:tasks.workunit.client.0.smithi029.stdout:2/282: chown d12/d24/d29/d38/l51 46429 1 2024-04-26T11:46:37.235 INFO:tasks.workunit.client.0.smithi029.stdout:8/261: write dc/de/d2e/f46 [281357,128917] 0 2024-04-26T11:46:37.237 INFO:tasks.workunit.client.0.smithi029.stdout:4/252: creat d3/d1d/db/d13/d23/f4f x:0 0 0 2024-04-26T11:46:37.237 INFO:tasks.workunit.client.0.smithi029.stdout:2/283: chown d12/f1d 1 1 2024-04-26T11:46:37.238 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:37.238 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:37.243 INFO:tasks.workunit.client.0.smithi029.stdout:5/310: dwrite db/d12/d1a/f49 [0,4194304] 0 2024-04-26T11:46:37.243 INFO:tasks.workunit.client.0.smithi029.stdout:0/299: dwrite d9/d16/d33/f5c [0,4194304] 0 2024-04-26T11:46:37.243 INFO:tasks.workunit.client.0.smithi029.stdout:2/284: write d12/f19 [7456988,2862] 0 2024-04-26T11:46:37.243 INFO:tasks.workunit.client.0.smithi029.stdout:1/298: dread d7/d25/f2e [0,4194304] 0 2024-04-26T11:46:37.243 INFO:tasks.workunit.client.0.smithi029.stdout:4/253: mkdir d3/d50 0 2024-04-26T11:46:37.243 INFO:tasks.workunit.client.0.smithi029.stdout:6/316: write d7/d25/d5c/f1e [980093,61215] 0 2024-04-26T11:46:37.244 INFO:tasks.workunit.client.0.smithi029.stdout:0/300: mknod d9/d16/d33/d2f/c73 1 2024-04-26T11:46:37.245 INFO:tasks.workunit.client.0.smithi029.stdout:1/299: write d7/d25/f59 [737861,113690] 0 2024-04-26T11:46:37.245 INFO:tasks.workunit.client.0.smithi029.stdout:4/254: read d3/d1d/f29 [410651,41250] 0 2024-04-26T11:46:37.245 INFO:tasks.workunit.client.0.smithi029.stdout:6/317: write d7/d25/d4b/f4e [348511,120658] 0 2024-04-26T11:46:37.245 INFO:tasks.workunit.client.0.smithi029.stdout:5/311: creat db/d12/d1f/d39/d3b/f65 x:0 0 0 2024-04-26T11:46:37.245 INFO:tasks.workunit.client.0.smithi029.stdout:0/301: chown d9/d16/d33/f72 697282862 1 2024-04-26T11:46:37.245 INFO:tasks.workunit.client.0.smithi029.stdout:2/285: chown d12/f2a 922 1 2024-04-26T11:46:37.246 INFO:tasks.workunit.client.0.smithi029.stdout:0/302: mkdir d9/d16/d25/d2a/d74 0 2024-04-26T11:46:37.247 INFO:tasks.workunit.client.0.smithi029.stdout:1/300: write d7/d25/f2a [350011,51356] 0 2024-04-26T11:46:37.247 INFO:tasks.workunit.client.0.smithi029.stdout:4/255: chown d3/d1d/d11/d16/d1f/d3d/d39/d30/f42 50817469 1 2024-04-26T11:46:37.247 INFO:tasks.workunit.client.0.smithi029.stdout:5/312: unlink db/d12/d1f/d39/d3b/f65 0 2024-04-26T11:46:37.248 INFO:tasks.workunit.client.0.smithi029.stdout:0/303: dread - d9/f36 zero size 2024-04-26T11:46:37.248 INFO:tasks.workunit.client.0.smithi029.stdout:8/262: dwrite dc/f4f [0,4194304] 0 2024-04-26T11:46:37.249 INFO:tasks.workunit.client.0.smithi029.stdout:2/286: creat d12/d47/f5d x:0 0 0 2024-04-26T11:46:37.249 INFO:tasks.workunit.client.0.smithi029.stdout:5/313: dread - db/d40/f61 zero size 2024-04-26T11:46:37.252 INFO:tasks.workunit.client.0.smithi029.stdout:0/304: write d9/f1d [946415,88281] 0 2024-04-26T11:46:37.253 INFO:tasks.workunit.client.0.smithi029.stdout:6/318: truncate d7/d25/d5c/f36 492444 0 2024-04-26T11:46:37.253 INFO:tasks.workunit.client.0.smithi029.stdout:1/301: write d7/db/d10/d20/f42 [1174831,6595] 0 2024-04-26T11:46:37.253 INFO:tasks.workunit.client.0.smithi029.stdout:2/287: write d12/d24/d2f/f4e [1023043,20815] 0 2024-04-26T11:46:37.253 INFO:tasks.workunit.client.0.smithi029.stdout:4/256: dread d3/d1d/db/d13/d23/f45 [0,4194304] 0 2024-04-26T11:46:37.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:37.255 INFO:tasks.workunit.client.0.smithi029.stdout:0/305: creat d9/d43/f75 x:0 0 0 2024-04-26T11:46:37.255 INFO:tasks.workunit.client.0.smithi029.stdout:1/302: write d7/db/d10/d20/f42 [1430579,68051] 0 2024-04-26T11:46:37.255 INFO:tasks.workunit.client.0.smithi029.stdout:8/263: link dc/de/d2e/d23/d27/d24/f3c dc/d12/f55 0 2024-04-26T11:46:37.256 INFO:tasks.workunit.client.0.smithi029.stdout:1/303: symlink d7/db/d10/d1e/l67 0 2024-04-26T11:46:37.259 INFO:tasks.workunit.client.0.smithi029.stdout:2/288: dread d12/d24/d29/d3a/d40/f5b [0,4194304] 0 2024-04-26T11:46:37.259 INFO:tasks.workunit.client.0.smithi029.stdout:1/304: rename d7/d37/d3e/df to d7/d25/d68 0 2024-04-26T11:46:37.261 INFO:tasks.workunit.client.0.smithi029.stdout:6/319: dwrite d7/f22 [0,4194304] 0 2024-04-26T11:46:37.261 INFO:tasks.workunit.client.0.smithi029.stdout:9/362: dread d4/d5/d7/fc [0,4194304] 0 2024-04-26T11:46:37.262 INFO:tasks.workunit.client.0.smithi029.stdout:5/314: dwrite db/d12/d1a/f27 [4194304,4194304] 0 2024-04-26T11:46:37.266 INFO:tasks.workunit.client.0.smithi029.stdout:9/363: unlink d4/d5/d16/d39/f65 0 2024-04-26T11:46:37.266 INFO:tasks.workunit.client.0.smithi029.stdout:6/320: getdents d7/d20 0 2024-04-26T11:46:37.266 INFO:tasks.workunit.client.0.smithi029.stdout:5/315: getdents db 0 2024-04-26T11:46:37.267 INFO:tasks.workunit.client.0.smithi029.stdout:9/364: creat d4/d49/d58/f6d x:0 0 0 2024-04-26T11:46:37.268 INFO:tasks.workunit.client.0.smithi029.stdout:6/321: link d7/f3e d7/d20/d27/f64 0 2024-04-26T11:46:37.269 INFO:tasks.workunit.client.0.smithi029.stdout:5/316: link db/d12/d1a/f10 db/d40/f66 0 2024-04-26T11:46:37.269 INFO:tasks.workunit.client.0.smithi029.stdout:6/322: readlink d7/l9 0 2024-04-26T11:46:37.270 INFO:tasks.workunit.client.0.smithi029.stdout:8/264: dwrite dc/de/d2e/d23/d27/d24/f3c [0,4194304] 0 2024-04-26T11:46:37.270 INFO:tasks.workunit.client.0.smithi029.stdout:0/306: dwrite d9/d16/d25/f2b [0,4194304] 0 2024-04-26T11:46:37.270 INFO:tasks.workunit.client.0.smithi029.stdout:9/365: link d4/l23 d4/d49/d58/d67/l6e 0 2024-04-26T11:46:37.271 INFO:tasks.workunit.client.0.smithi029.stdout:6/323: mkdir d7/d25/d4b/d4d/d65 0 2024-04-26T11:46:37.271 INFO:tasks.workunit.client.0.smithi029.stdout:8/265: creat dc/d3b/f56 x:0 0 0 2024-04-26T11:46:37.273 INFO:tasks.workunit.client.0.smithi029.stdout:0/307: rename d9/d16/d25/f2b to d9/d16/d33/d2f/d68/f76 0 2024-04-26T11:46:37.277 INFO:tasks.workunit.client.0.smithi029.stdout:1/305: truncate d7/d25/f2e 1329156 0 2024-04-26T11:46:37.277 INFO:tasks.workunit.client.0.smithi029.stdout:9/366: getdents d4/d5/d16 0 2024-04-26T11:46:37.278 INFO:tasks.workunit.client.0.smithi029.stdout:8/266: mkdir dc/de/d26/d57 0 2024-04-26T11:46:37.278 INFO:tasks.workunit.client.0.smithi029.stdout:1/306: truncate d7/d37/f48 802919 0 2024-04-26T11:46:37.278 INFO:tasks.workunit.client.0.smithi029.stdout:1/307: mknod d7/d25/d68/c69 1 2024-04-26T11:46:37.279 INFO:tasks.workunit.client.0.smithi029.stdout:1/308: rmdir d7/d37/d5a 39 2024-04-26T11:46:37.281 INFO:tasks.workunit.client.0.smithi029.stdout:1/309: getdents d7 0 2024-04-26T11:46:37.281 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:37.282 INFO:tasks.workunit.client.0.smithi029.stdout:8/267: mknod dc/de/d2e/d23/d27/d24/c58 1 2024-04-26T11:46:37.282 INFO:tasks.workunit.client.0.smithi029.stdout:6/324: dwrite d7/d25/f47 [0,4194304] 0 2024-04-26T11:46:37.286 INFO:tasks.workunit.client.0.smithi029.stdout:2/289: truncate d12/f26 844242 0 2024-04-26T11:46:37.286 INFO:tasks.workunit.client.0.smithi029.stdout:1/310: unlink d7/db/d10/d20/f42 0 2024-04-26T11:46:37.286 INFO:tasks.workunit.client.0.smithi029.stdout:2/290: read d12/f2a [164815,99327] 0 2024-04-26T11:46:37.286 INFO:tasks.workunit.client.0.smithi029.stdout:8/268: creat dc/de/d26/d57/f59 x:0 0 0 2024-04-26T11:46:37.286 INFO:tasks.workunit.client.0.smithi029.stdout:6/325: rename d7/f12 to d7/d20/d2f/f66 0 2024-04-26T11:46:37.287 INFO:tasks.workunit.client.0.smithi029.stdout:2/291: mknod d12/d24/d2f/c5e 1 2024-04-26T11:46:37.287 INFO:tasks.workunit.client.0.smithi029.stdout:1/311: mknod d7/d37/d3e/c6a 1 2024-04-26T11:46:37.287 INFO:tasks.workunit.client.0.smithi029.stdout:8/269: creat dc/d3b/f5a x:0 0 0 2024-04-26T11:46:37.288 INFO:tasks.workunit.client.0.smithi029.stdout:6/326: read d7/f11 [2169210,120240] 0 2024-04-26T11:46:37.288 INFO:tasks.workunit.client.0.smithi029.stdout:9/367: dwrite d4/d5/d16/d39/f3d [0,4194304] 0 2024-04-26T11:46:37.288 INFO:tasks.workunit.client.0.smithi029.stdout:1/312: rmdir d7/db 39 2024-04-26T11:46:37.288 INFO:tasks.workunit.client.0.smithi029.stdout:0/308: dwrite d9/f2d [0,4194304] 0 2024-04-26T11:46:37.289 INFO:tasks.workunit.client.0.smithi029.stdout:8/270: chown dc/de/d2e/d23/d27/d24 1660 1 2024-04-26T11:46:37.289 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:37.284+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:37.290 INFO:tasks.workunit.client.0.smithi029.stdout:8/271: mknod dc/de/d2e/c5b 1 2024-04-26T11:46:37.290 INFO:tasks.workunit.client.0.smithi029.stdout:6/327: read d7/d25/d5c/f5e [169042,11017] 0 2024-04-26T11:46:37.290 INFO:tasks.workunit.client.0.smithi029.stdout:9/368: link d4/d49/d58/f4f d4/f6f 0 2024-04-26T11:46:37.290 INFO:tasks.workunit.client.0.smithi029.stdout:2/292: mkdir d12/d24/d29/d50/d55/d5f 0 2024-04-26T11:46:37.291 INFO:tasks.workunit.client.0.smithi029.stdout:1/313: creat d7/db/f6b x:0 0 0 2024-04-26T11:46:37.291 INFO:tasks.workunit.client.0.smithi029.stdout:6/328: dread - d7/d25/d5c/f51 zero size 2024-04-26T11:46:37.291 INFO:tasks.workunit.client.0.smithi029.stdout:9/369: write d4/f61 [983196,79300] 0 2024-04-26T11:46:37.291 INFO:tasks.workunit.client.0.smithi029.stdout:8/272: rename dc/de/d15/f44 to dc/de/f5c 0 2024-04-26T11:46:37.292 INFO:tasks.workunit.client.0.smithi029.stdout:1/314: creat d7/db/d10/d1e/d53/f6c x:0 0 0 2024-04-26T11:46:37.292 INFO:tasks.workunit.client.0.smithi029.stdout:6/329: write d7/d20/d2f/d45/f59 [478613,40792] 0 2024-04-26T11:46:37.292 INFO:tasks.workunit.client.0.smithi029.stdout:9/370: symlink d4/d5/l70 0 2024-04-26T11:46:37.292 INFO:tasks.workunit.client.0.smithi029.stdout:8/273: creat dc/d12/f5d x:0 0 0 2024-04-26T11:46:37.293 INFO:tasks.workunit.client.0.smithi029.stdout:9/371: mknod d4/d49/d58/d67/c71 1 2024-04-26T11:46:37.293 INFO:tasks.workunit.client.0.smithi029.stdout:1/315: rmdir d7/d37/d3e 39 2024-04-26T11:46:37.294 INFO:tasks.workunit.client.0.smithi029.stdout:2/293: link d12/d24/d29/d38/l3e d12/d24/d29/d57/l60 0 2024-04-26T11:46:37.294 INFO:tasks.workunit.client.0.smithi029.stdout:9/372: fdatasync d4/d5/d7/f59 0 2024-04-26T11:46:37.294 INFO:tasks.workunit.client.0.smithi029.stdout:6/330: link d7/d20/d2f/d45/f59 d7/d25/d4b/f67 0 2024-04-26T11:46:37.294 INFO:tasks.workunit.client.0.smithi029.stdout:3/291: sync 2024-04-26T11:46:37.294 INFO:tasks.workunit.client.0.smithi029.stdout:1/316: mkdir d7/d25/d6d 0 2024-04-26T11:46:37.295 INFO:tasks.workunit.client.0.smithi029.stdout:6/331: stat d7/f11 0 2024-04-26T11:46:37.295 INFO:tasks.workunit.client.0.smithi029.stdout:3/292: chown d0/d1/d2b 16426969 1 2024-04-26T11:46:37.295 INFO:tasks.workunit.client.0.smithi029.stdout:1/317: dread - d7/db/d10/f2c zero size 2024-04-26T11:46:37.295 INFO:tasks.workunit.client.0.smithi029.stdout:6/332: write d7/d25/d4b/d4d/f54 [717293,61392] 0 2024-04-26T11:46:37.296 INFO:tasks.workunit.client.0.smithi029.stdout:9/373: read d4/d49/d58/f4f [904538,113419] 0 2024-04-26T11:46:37.296 INFO:tasks.workunit.client.0.smithi029.stdout:3/293: symlink d0/d1/d41/d5f/d1a/l73 0 2024-04-26T11:46:37.297 INFO:tasks.workunit.client.0.smithi029.stdout:1/318: fsync d7/db/f6b 0 2024-04-26T11:46:37.297 INFO:tasks.workunit.client.0.smithi029.stdout:8/274: rmdir dc/d12 39 2024-04-26T11:46:37.297 INFO:tasks.workunit.client.0.smithi029.stdout:9/374: mknod d4/c72 1 2024-04-26T11:46:37.297 INFO:tasks.workunit.client.0.smithi029.stdout:1/319: fsync d7/db/f1d 0 2024-04-26T11:46:37.298 INFO:tasks.workunit.client.0.smithi029.stdout:8/275: write dc/d3b/f41 [277147,84338] 0 2024-04-26T11:46:37.298 INFO:tasks.workunit.client.0.smithi029.stdout:9/375: chown d4/d5/d16/l4c 15434 1 2024-04-26T11:46:37.298 INFO:tasks.workunit.client.0.smithi029.stdout:3/294: truncate d0/d1/d41/d5f/d1a/f61 73730 0 2024-04-26T11:46:37.299 INFO:tasks.workunit.client.0.smithi029.stdout:3/295: fdatasync d0/f4b 0 2024-04-26T11:46:37.299 INFO:tasks.workunit.client.0.smithi029.stdout:9/376: fdatasync d4/d5/d16/f19 0 2024-04-26T11:46:37.303 INFO:tasks.workunit.client.0.smithi029.stdout:8/276: symlink dc/de/d2e/d23/d27/l5e 0 2024-04-26T11:46:37.303 INFO:tasks.workunit.client.0.smithi029.stdout:1/320: creat d7/d25/d68/f6e x:0 0 0 2024-04-26T11:46:37.303 INFO:tasks.workunit.client.0.smithi029.stdout:3/296: creat d0/d1/d2b/d33/f74 x:0 0 0 2024-04-26T11:46:37.303 INFO:tasks.workunit.client.0.smithi029.stdout:9/377: rename d4/f61 to d4/d5/d16/f73 0 2024-04-26T11:46:37.304 INFO:tasks.workunit.client.0.smithi029.stdout:8/277: truncate dc/f4f 5851294 0 2024-04-26T11:46:37.304 INFO:tasks.workunit.client.0.smithi029.stdout:4/257: dread d3/d1d/db/f36 [0,4194304] 0 2024-04-26T11:46:37.305 INFO:tasks.workunit.client.0.smithi029.stdout:1/321: readlink d7/db/d10/l1a 0 2024-04-26T11:46:37.306 INFO:tasks.workunit.client.0.smithi029.stdout:9/378: unlink d4/d5/l22 0 2024-04-26T11:46:37.307 INFO:tasks.workunit.client.0.smithi029.stdout:8/278: creat dc/de/d2e/d23/f5f x:0 0 0 2024-04-26T11:46:37.308 INFO:tasks.workunit.client.0.smithi029.stdout:8/279: mknod dc/de/d2e/d23/d27/d24/d43/c60 1 2024-04-26T11:46:37.308 INFO:tasks.workunit.client.0.smithi029.stdout:4/258: creat d3/d1d/db/f51 x:0 0 0 2024-04-26T11:46:37.308 INFO:tasks.workunit.client.0.smithi029.stdout:9/379: truncate d4/f6f 3917373 0 2024-04-26T11:46:37.309 INFO:tasks.workunit.client.0.smithi029.stdout:1/322: chown d7/d37/d3e/f1f 0 1 2024-04-26T11:46:37.309 INFO:tasks.workunit.client.0.smithi029.stdout:8/280: stat dc/d12 0 2024-04-26T11:46:37.310 INFO:tasks.workunit.client.0.smithi029.stdout:4/259: read d3/d1d/f21 [2947885,109881] 0 2024-04-26T11:46:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:9/380: truncate d4/d46/f56 743399 0 2024-04-26T11:46:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:8/281: truncate dc/d3b/f5a 191232 0 2024-04-26T11:46:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:1/323: creat d7/d25/d68/d4b/f6f x:0 0 0 2024-04-26T11:46:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:3/297: dwrite d0/dc/f6c [0,4194304] 0 2024-04-26T11:46:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:3/298: mknod d0/d37/c75 1 2024-04-26T11:46:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:1/324: rmdir d7/db/d10/d1e/d53 39 2024-04-26T11:46:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:3/299: mknod d0/d37/c76 1 2024-04-26T11:46:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:9/381: dread d4/d49/d58/f53 [0,4194304] 0 2024-04-26T11:46:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:8/282: creat dc/de/d2e/d23/d27/d24/d54/f61 x:0 0 0 2024-04-26T11:46:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:9/382: mkdir d4/d5/d7/d74 0 2024-04-26T11:46:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:1/325: creat d7/d25/d68/d4b/d66/f70 x:0 0 0 2024-04-26T11:46:37.317 INFO:tasks.workunit.client.0.smithi029.stdout:9/383: dread - d4/d49/f6a zero size 2024-04-26T11:46:37.317 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:37.317 INFO:tasks.workunit.client.0.smithi029.stdout:9/384: read d4/d5/d16/f3b [181676,20351] 0 2024-04-26T11:46:37.317 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:37.318 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:37.318 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:37.322 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:37.323 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:37.324 INFO:tasks.workunit.client.0.smithi029.stdout:9/385: read d4/d5/f45 [300984,93934] 0 2024-04-26T11:46:37.324 INFO:tasks.workunit.client.0.smithi029.stdout:1/326: dwrite d7/d25/d68/f60 [0,4194304] 0 2024-04-26T11:46:37.324 INFO:tasks.workunit.client.0.smithi029.stdout:1/327: mknod d7/c71 1 2024-04-26T11:46:37.324 INFO:tasks.workunit.client.0.smithi029.stdout:1/328: chown d7/f36 2427 1 2024-04-26T11:46:37.325 INFO:tasks.workunit.client.0.smithi029.stdout:1/329: stat d7/d25/d68/d4b/f6f 0 2024-04-26T11:46:37.325 INFO:tasks.workunit.client.0.smithi029.stdout:1/330: fsync d7/d25/f2e 0 2024-04-26T11:46:37.325 INFO:tasks.workunit.client.0.smithi029.stdout:1/331: mknod d7/db/d10/d1e/d53/c72 1 2024-04-26T11:46:37.325 INFO:tasks.workunit.client.0.smithi029.stdout:1/332: readlink d7/d37/d3e/ld 0 2024-04-26T11:46:37.328 INFO:tasks.workunit.client.0.smithi029.stdout:8/283: truncate dc/de/f5c 545030 0 2024-04-26T11:46:37.329 INFO:tasks.workunit.client.0.smithi029.stdout:8/284: write dc/de/d26/f53 [359631,125040] 0 2024-04-26T11:46:37.329 INFO:tasks.workunit.client.0.smithi029.stdout:9/386: dread d4/d5/d16/d39/f3c [0,4194304] 0 2024-04-26T11:46:37.330 INFO:tasks.workunit.client.0.smithi029.stdout:3/300: truncate d0/d1/d41/d5f/d1a/f1d 1875699 0 2024-04-26T11:46:37.330 INFO:tasks.workunit.client.0.smithi029.stdout:9/387: read - d4/f64 zero size 2024-04-26T11:46:37.331 INFO:tasks.workunit.client.0.smithi029.stdout:9/388: write d4/d5/d16/f19 [1970367,119756] 0 2024-04-26T11:46:37.333 INFO:tasks.workunit.client.0.smithi029.stdout:8/285: rename dc/de/d2e/d23/d4d to dc/de/d2e/d23/d27/d24/d43/d48/d62 0 2024-04-26T11:46:37.334 INFO:tasks.workunit.client.0.smithi029.stdout:8/286: getdents dc 0 2024-04-26T11:46:37.336 INFO:tasks.workunit.client.0.smithi029.stdout:8/287: creat dc/de/d26/d57/f63 x:0 0 0 2024-04-26T11:46:37.337 INFO:tasks.workunit.client.0.smithi029.stdout:1/333: dwrite f2 [0,4194304] 0 2024-04-26T11:46:37.339 INFO:tasks.workunit.client.0.smithi029.stdout:8/288: symlink dc/de/d26/d57/l64 0 2024-04-26T11:46:37.339 INFO:tasks.workunit.client.0.smithi029.stdout:8/289: write dc/de/d26/f32 [3974349,36646] 0 2024-04-26T11:46:37.339 INFO:tasks.workunit.client.0.smithi029.stdout:1/334: link d7/d37/f58 d7/db/d10/d1e/f73 0 2024-04-26T11:46:37.340 INFO:tasks.workunit.client.0.smithi029.stdout:8/290: write dc/de/d26/d57/f63 [1018747,21539] 0 2024-04-26T11:46:37.340 INFO:tasks.workunit.client.0.smithi029.stdout:1/335: creat d7/db/d10/f74 x:0 0 0 2024-04-26T11:46:37.341 INFO:tasks.workunit.client.0.smithi029.stdout:8/291: dread - dc/d3b/f50 zero size 2024-04-26T11:46:37.342 INFO:tasks.workunit.client.0.smithi029.stdout:1/336: chown d7/l4d 0 1 2024-04-26T11:46:37.342 INFO:tasks.workunit.client.0.smithi029.stdout:8/292: mknod dc/de/d26/c65 1 2024-04-26T11:46:37.344 INFO:tasks.workunit.client.0.smithi029.stdout:1/337: read d7/db/f2d [2050803,6230] 0 2024-04-26T11:46:37.345 INFO:tasks.workunit.client.0.smithi029.stdout:8/293: truncate dc/de/d2e/d23/d27/d24/d54/f61 813872 0 2024-04-26T11:46:37.352 INFO:tasks.workunit.client.0.smithi029.stdout:1/338: rename d7/db/d10/d1e/d53/f5c to d7/f75 0 2024-04-26T11:46:37.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/333: dread d7/d20/d2f/f33 [4194304,4194304] 0 2024-04-26T11:46:37.354 INFO:tasks.workunit.client.0.smithi029.stdout:9/389: dread d4/d5/d7/f59 [0,4194304] 0 2024-04-26T11:46:37.354 INFO:tasks.workunit.client.0.smithi029.stdout:8/294: dwrite dc/d3b/f5a [0,4194304] 0 2024-04-26T11:46:37.355 INFO:tasks.workunit.client.0.smithi029.stdout:6/334: dread - d7/d25/d5c/f51 zero size 2024-04-26T11:46:37.355 INFO:tasks.workunit.client.0.smithi029.stdout:9/390: mknod d4/d5/d7/c75 1 2024-04-26T11:46:37.355 INFO:tasks.workunit.client.0.smithi029.stdout:1/339: fsync d7/f75 0 2024-04-26T11:46:37.356 INFO:tasks.workunit.client.0.smithi029.stdout:8/295: creat dc/f66 x:0 0 0 2024-04-26T11:46:37.356 INFO:tasks.workunit.client.0.smithi029.stdout:3/301: dread d0/d1/d2f/f3a [0,4194304] 0 2024-04-26T11:46:37.356 INFO:tasks.workunit.client.0.smithi029.stdout:6/335: fsync d7/f11 0 2024-04-26T11:46:37.357 INFO:tasks.workunit.client.0.smithi029.stdout:6/336: chown l6 1 1 2024-04-26T11:46:37.357 INFO:tasks.workunit.client.0.smithi029.stdout:1/340: chown d7/db/d10/d1e/f26 999607 1 2024-04-26T11:46:37.357 INFO:tasks.workunit.client.0.smithi029.stdout:3/302: creat d0/d1/d13/f77 x:0 0 0 2024-04-26T11:46:37.358 INFO:tasks.workunit.client.0.smithi029.stdout:1/341: mkdir d7/d76 0 2024-04-26T11:46:37.358 INFO:tasks.workunit.client.0.smithi029.stdout:6/337: creat d7/d25/d5c/d34/d4c/f68 x:0 0 0 2024-04-26T11:46:37.359 INFO:tasks.workunit.client.0.smithi029.stdout:9/391: read d4/d5/d16/f73 [836061,96738] 0 2024-04-26T11:46:37.359 INFO:tasks.workunit.client.0.smithi029.stdout:8/296: unlink dc/d12/f55 0 2024-04-26T11:46:37.360 INFO:tasks.workunit.client.0.smithi029.stdout:1/342: readlink d7/l51 0 2024-04-26T11:46:37.360 INFO:tasks.workunit.client.0.smithi029.stdout:3/303: truncate d0/dc/d1f/f6b 635263 0 2024-04-26T11:46:37.361 INFO:tasks.workunit.client.0.smithi029.stdout:3/304: creat d0/d1/d5c/f78 x:0 0 0 2024-04-26T11:46:37.361 INFO:tasks.workunit.client.0.smithi029.stdout:1/343: creat d7/f77 x:0 0 0 2024-04-26T11:46:37.361 INFO:tasks.workunit.client.0.smithi029.stdout:8/297: read dc/f11 [411457,56960] 0 2024-04-26T11:46:37.361 INFO:tasks.workunit.client.0.smithi029.stdout:9/392: rename d4/d49/d58/f4f to d4/d5/d16/d39/f76 0 2024-04-26T11:46:37.363 INFO:tasks.workunit.client.0.smithi029.stdout:3/305: write d0/d1/d41/d5f/f59 [199268,69260] 0 2024-04-26T11:46:37.363 INFO:tasks.workunit.client.0.smithi029.stdout:8/298: read dc/de/d2e/f2a [1890786,12148] 0 2024-04-26T11:46:37.363 INFO:tasks.workunit.client.0.smithi029.stdout:1/344: link d7/db/f6b d7/f78 0 2024-04-26T11:46:37.363 INFO:tasks.workunit.client.0.smithi029.stdout:3/306: symlink d0/dc/d1f/l79 0 2024-04-26T11:46:37.365 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:37.365 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:37.367 INFO:tasks.workunit.client.0.smithi029.stdout:9/393: dread d4/d5/d16/f73 [0,4194304] 0 2024-04-26T11:46:37.368 INFO:tasks.workunit.client.0.smithi029.stdout:7/314: sync 2024-04-26T11:46:37.368 INFO:tasks.workunit.client.0.smithi029.stdout:3/307: read d0/f1b [5908712,108130] 0 2024-04-26T11:46:37.369 INFO:tasks.workunit.client.0.smithi029.stdout:8/299: dread dc/de/d2e/d23/f21 [0,4194304] 0 2024-04-26T11:46:37.369 INFO:tasks.workunit.client.0.smithi029.stdout:1/345: dread d7/d25/d68/f60 [0,4194304] 0 2024-04-26T11:46:37.370 INFO:tasks.workunit.client.0.smithi029.stdout:3/308: getdents d0/d1/d2f/d68 0 2024-04-26T11:46:37.370 INFO:tasks.workunit.client.0.smithi029.stdout:8/300: write dc/de/d2e/d23/d27/d24/f45 [637029,121648] 0 2024-04-26T11:46:37.370 INFO:tasks.workunit.client.0.smithi029.stdout:3/309: creat d0/d37/f7a x:0 0 0 2024-04-26T11:46:37.371 INFO:tasks.workunit.client.0.smithi029.stdout:3/310: fdatasync d0/d1/d41/d5f/f59 0 2024-04-26T11:46:37.380 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:37.383 INFO:tasks.workunit.client.0.smithi029.stdout:3/311: creat d0/d1/d41/d4c/f7b x:0 0 0 2024-04-26T11:46:37.383 INFO:tasks.workunit.client.0.smithi029.stdout:1/346: truncate d7/f35 371142 0 2024-04-26T11:46:37.383 INFO:tasks.workunit.client.0.smithi029.stdout:3/312: write d0/f4b [600784,90764] 0 2024-04-26T11:46:37.383 INFO:tasks.workunit.client.0.smithi029.stdout:1/347: fdatasync d7/d37/f63 0 2024-04-26T11:46:37.383 INFO:tasks.workunit.client.0.smithi029.stdout:3/313: creat d0/d1/f7c x:0 0 0 2024-04-26T11:46:37.383 INFO:tasks.workunit.client.0.smithi029.stdout:1/348: chown d7/d37 3897 1 2024-04-26T11:46:37.383 INFO:tasks.workunit.client.0.smithi029.stdout:3/314: creat d0/d1/d41/d5f/d54/f7d x:0 0 0 2024-04-26T11:46:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:1/349: creat d7/d25/d68/f79 x:0 0 0 2024-04-26T11:46:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:3/315: readlink d0/d1/d41/d4c/l60 0 2024-04-26T11:46:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:8/301: dwrite dc/d3b/f41 [0,4194304] 0 2024-04-26T11:46:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:3/316: mkdir d0/d1/d2b/d7e 0 2024-04-26T11:46:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:6/338: dread d7/d25/d5c/d34/f38 [0,4194304] 0 2024-04-26T11:46:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:1/350: rename d7/db/d10/d1e/f41 to d7/db/d10/d1e/d53/f7a 0 2024-04-26T11:46:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:8/302: creat dc/de/d2e/d23/d27/f67 x:0 0 0 2024-04-26T11:46:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:3/317: truncate d0/dc/f45 3673653 0 2024-04-26T11:46:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:1/351: fsync d7/f78 0 2024-04-26T11:46:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:6/339: chown d7/d25/d5c/f58 1909 1 2024-04-26T11:46:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:6/340: mkdir d7/d46/d69 0 2024-04-26T11:46:37.385 INFO:tasks.workunit.client.0.smithi029.stdout:8/303: fsync dc/de/d2e/d23/d27/f3e 0 2024-04-26T11:46:37.386 INFO:tasks.workunit.client.0.smithi029.stdout:6/341: stat d7/d46/f48 0 2024-04-26T11:46:37.386 INFO:tasks.workunit.client.0.smithi029.stdout:8/304: chown dc/de/l4a 0 1 2024-04-26T11:46:37.386 INFO:tasks.workunit.client.0.smithi029.stdout:6/342: symlink d7/d25/d4b/l6a 0 2024-04-26T11:46:37.387 INFO:tasks.workunit.client.0.smithi029.stdout:8/305: stat dc/de/d2e/d23/d27/d24/f36 0 2024-04-26T11:46:37.387 INFO:tasks.workunit.client.0.smithi029.stdout:7/315: dread d11/d15/f57 [0,4194304] 0 2024-04-26T11:46:37.387 INFO:tasks.workunit.client.0.smithi029.stdout:6/343: write d7/d20/d27/f31 [1755151,19377] 0 2024-04-26T11:46:37.389 INFO:tasks.workunit.client.0.smithi029.stdout:7/316: write d11/d15/f36 [418993,104793] 0 2024-04-26T11:46:37.389 INFO:tasks.workunit.client.0.smithi029.stdout:6/344: symlink d7/d20/d2f/l6b 0 2024-04-26T11:46:37.389 INFO:tasks.workunit.client.0.smithi029.stdout:8/306: getdents dc/de/d2e/d23/d27/d24 0 2024-04-26T11:46:37.390 INFO:tasks.workunit.client.0.smithi029.stdout:1/352: dwrite d7/db/f4a [0,4194304] 0 2024-04-26T11:46:37.391 INFO:tasks.workunit.client.0.smithi029.stdout:8/307: read dc/de/d2e/d23/d27/d24/f3c [726062,103642] 0 2024-04-26T11:46:37.392 INFO:tasks.workunit.client.0.smithi029.stdout:3/318: rmdir d0 39 2024-04-26T11:46:37.394 INFO:tasks.workunit.client.0.smithi029.stdout:3/319: getdents d0/d1/d2f 0 2024-04-26T11:46:37.396 INFO:tasks.workunit.client.0.smithi029.stdout:7/317: dread d11/d18/d1a/f47 [0,4194304] 0 2024-04-26T11:46:37.397 INFO:tasks.workunit.client.0.smithi029.stdout:7/318: chown d11/d15/f36 266288242 1 2024-04-26T11:46:37.397 INFO:tasks.workunit.client.0.smithi029.stdout:6/345: dwrite d7/d20/d27/f50 [0,4194304] 0 2024-04-26T11:46:37.399 INFO:tasks.workunit.client.0.smithi029.stdout:6/346: creat d7/d25/d4b/f6c x:0 0 0 2024-04-26T11:46:37.402 INFO:tasks.workunit.client.0.smithi029.stdout:7/319: dread d11/d15/f57 [0,4194304] 0 2024-04-26T11:46:37.404 INFO:tasks.workunit.client.0.smithi029.stdout:7/320: rmdir d11 39 2024-04-26T11:46:37.404 INFO:tasks.workunit.client.0.smithi029.stdout:1/353: write f2 [333458,112087] 0 2024-04-26T11:46:37.405 INFO:tasks.workunit.client.0.smithi029.stdout:7/321: symlink d11/d18/d1a/d33/l68 0 2024-04-26T11:46:37.406 INFO:tasks.workunit.client.0.smithi029.stdout:3/320: dwrite d0/d1/d41/d5f/d1a/f61 [0,4194304] 0 2024-04-26T11:46:37.407 INFO:tasks.workunit.client.0.smithi029.stdout:7/322: dread - d11/d18/d1a/d26/f45 zero size 2024-04-26T11:46:37.409 INFO:tasks.workunit.client.0.smithi029.stdout:7/323: mkdir d11/d15/d69 0 2024-04-26T11:46:37.409 INFO:tasks.workunit.client.0.smithi029.stdout:6/347: dwrite d7/d25/f28 [0,4194304] 0 2024-04-26T11:46:37.411 INFO:tasks.workunit.client.0.smithi029.stdout:7/324: write d11/d18/d1a/f4d [535030,47684] 0 2024-04-26T11:46:37.414 INFO:tasks.workunit.client.0.smithi029.stdout:7/325: creat d11/d18/d35/d39/f6a x:0 0 0 2024-04-26T11:46:37.414 INFO:tasks.workunit.client.0.smithi029.stdout:3/321: read d0/f27 [819605,29448] 0 2024-04-26T11:46:37.415 INFO:tasks.workunit.client.0.smithi029.stdout:1/354: truncate d7/db/f4a 574496 0 2024-04-26T11:46:37.416 INFO:tasks.workunit.client.0.smithi029.stdout:1/355: creat d7/db/d10/d20/f7b x:0 0 0 2024-04-26T11:46:37.416 INFO:tasks.workunit.client.0.smithi029.stdout:6/348: read d7/d20/d2f/f33 [2850864,33650] 0 2024-04-26T11:46:37.417 INFO:tasks.workunit.client.0.smithi029.stdout:1/356: mknod d7/db/c7c 1 2024-04-26T11:46:37.417 INFO:tasks.workunit.client.0.smithi029.stdout:6/349: write d7/d25/d4b/f6c [94443,47421] 0 2024-04-26T11:46:37.418 INFO:tasks.workunit.client.0.smithi029.stdout:1/357: unlink d7/db/d10/d20/l62 0 2024-04-26T11:46:37.419 INFO:tasks.workunit.client.0.smithi029.stdout:1/358: chown d7/d37 323581 1 2024-04-26T11:46:37.419 INFO:tasks.workunit.client.0.smithi029.stdout:6/350: read d7/d20/d27/f50 [3722873,89109] 0 2024-04-26T11:46:37.422 INFO:tasks.workunit.client.0.smithi029.stdout:1/359: creat d7/d76/f7d x:0 0 0 2024-04-26T11:46:37.423 INFO:tasks.workunit.client.0.smithi029.stdout:7/326: dwrite fc [0,4194304] 0 2024-04-26T11:46:37.423 INFO:tasks.workunit.client.0.smithi029.stdout:1/360: dread d7/db/d10/d1e/d53/f7a [0,4194304] 0 2024-04-26T11:46:37.423 INFO:tasks.workunit.client.0.smithi029.stdout:1/361: stat d7/db/f2d 0 2024-04-26T11:46:37.424 INFO:tasks.workunit.client.0.smithi029.stdout:7/327: write d11/d15/f2a [127159,62005] 0 2024-04-26T11:46:37.424 INFO:tasks.workunit.client.0.smithi029.stdout:7/328: stat d11/d18/d1a/d33/l68 0 2024-04-26T11:46:37.431 INFO:tasks.workunit.client.0.smithi029.stdout:7/329: dread d11/d18/d1a/f23 [0,4194304] 0 2024-04-26T11:46:37.433 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:37.433+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:37.435 INFO:tasks.workunit.client.0.smithi029.stdout:1/362: dwrite d7/d37/d3e/f4e [0,4194304] 0 2024-04-26T11:46:37.436 INFO:tasks.workunit.client.0.smithi029.stdout:3/322: dread d0/d1/d41/d5f/f59 [0,4194304] 0 2024-04-26T11:46:37.437 INFO:tasks.workunit.client.0.smithi029.stdout:3/323: write d0/d1/d2b/d33/f66 [1020992,59004] 0 2024-04-26T11:46:37.438 INFO:tasks.workunit.client.0.smithi029.stdout:3/324: chown d0/dc/f6c 1953116 1 2024-04-26T11:46:37.442 INFO:tasks.workunit.client.0.smithi029.stdout:1/363: dread d7/d37/f63 [0,4194304] 0 2024-04-26T11:46:37.449 INFO:tasks.workunit.client.0.smithi029.stdout:3/325: dwrite d0/dc/f45 [0,4194304] 0 2024-04-26T11:46:37.449 INFO:tasks.workunit.client.0.smithi029.stdout:3/326: readlink d0/l20 0 2024-04-26T11:46:37.452 INFO:tasks.workunit.client.0.smithi029.stdout:3/327: getdents d0/d1/d13 0 2024-04-26T11:46:37.452 INFO:tasks.workunit.client.0.smithi029.stdout:1/364: dwrite d7/d25/d68/d4b/f6f [0,4194304] 0 2024-04-26T11:46:37.454 INFO:tasks.workunit.client.0.smithi029.stdout:3/328: rename d0/d1/d5c/l62 to d0/d1/l7f 0 2024-04-26T11:46:37.455 INFO:tasks.workunit.client.0.smithi029.stdout:3/329: dread - d0/d37/f7a zero size 2024-04-26T11:46:37.460 INFO:tasks.workunit.client.0.smithi029.stdout:7/330: dread d11/d18/d1a/f4a [0,4194304] 0 2024-04-26T11:46:37.466 INFO:tasks.workunit.client.0.smithi029.stdout:7/331: dread d11/d18/d1a/f38 [0,4194304] 0 2024-04-26T11:46:37.466 INFO:tasks.workunit.client.0.smithi029.stdout:3/330: dwrite d0/d1/d41/d5f/d1a/f1d [0,4194304] 0 2024-04-26T11:46:37.467 INFO:tasks.workunit.client.0.smithi029.stdout:7/332: symlink d11/d18/d58/l6b 0 2024-04-26T11:46:37.468 INFO:tasks.workunit.client.0.smithi029.stdout:7/333: mknod d11/d18/d58/c6c 1 2024-04-26T11:46:37.469 INFO:tasks.workunit.client.0.smithi029.stdout:2/294: sync 2024-04-26T11:46:37.469 INFO:tasks.workunit.client.0.smithi029.stdout:0/309: sync 2024-04-26T11:46:37.469 INFO:tasks.workunit.client.0.smithi029.stdout:4/260: sync 2024-04-26T11:46:37.469 INFO:tasks.workunit.client.0.smithi029.stdout:5/317: sync 2024-04-26T11:46:37.469 INFO:tasks.workunit.client.0.smithi029.stdout:7/334: symlink d11/d18/d35/d39/l6d 0 2024-04-26T11:46:37.470 INFO:tasks.workunit.client.0.smithi029.stdout:2/295: chown d12/f28 18476076 1 2024-04-26T11:46:37.473 INFO:tasks.workunit.client.0.smithi029.stdout:5/318: write db/d12/d1a/f16 [2057428,74640] 0 2024-04-26T11:46:37.473 INFO:tasks.workunit.client.0.smithi029.stdout:5/319: chown db/d40 226 1 2024-04-26T11:46:37.473 INFO:tasks.workunit.client.0.smithi029.stdout:2/296: truncate d12/d24/d2f/f44 957627 0 2024-04-26T11:46:37.475 INFO:tasks.workunit.client.0.smithi029.stdout:0/310: symlink d9/d16/d25/l77 0 2024-04-26T11:46:37.475 INFO:tasks.workunit.client.0.smithi029.stdout:7/335: link d11/d18/d1a/d33/l68 d11/d18/d35/d39/l6e 0 2024-04-26T11:46:37.475 INFO:tasks.workunit.client.0.smithi029.stdout:5/320: readlink db/d12/d1f/d39/l59 0 2024-04-26T11:46:37.475 INFO:tasks.workunit.client.0.smithi029.stdout:0/311: mkdir d9/d78 0 2024-04-26T11:46:37.475 INFO:tasks.workunit.client.0.smithi029.stdout:2/297: creat d12/d24/d2f/f61 x:0 0 0 2024-04-26T11:46:37.476 INFO:tasks.workunit.client.0.smithi029.stdout:7/336: write f9 [6162684,89541] 0 2024-04-26T11:46:37.479 INFO:tasks.workunit.client.0.smithi029.stdout:5/321: write db/d12/d1f/d39/d3b/f42 [480769,33705] 0 2024-04-26T11:46:37.480 INFO:tasks.workunit.client.0.smithi029.stdout:3/331: dwrite d0/d1/d2b/d33/f66 [0,4194304] 0 2024-04-26T11:46:37.480 INFO:tasks.workunit.client.0.smithi029.stdout:0/312: read d9/f41 [2735214,3081] 0 2024-04-26T11:46:37.481 INFO:tasks.workunit.client.0.smithi029.stdout:4/261: dwrite d3/f47 [0,4194304] 0 2024-04-26T11:46:37.482 INFO:tasks.workunit.client.0.smithi029.stdout:5/322: chown db/d12/d1f/l2d 1 1 2024-04-26T11:46:37.482 INFO:tasks.workunit.client.0.smithi029.stdout:3/332: chown d0/d1/d41/d5f/d1a/f38 66485 1 2024-04-26T11:46:37.483 INFO:tasks.workunit.client.0.smithi029.stdout:0/313: creat d9/d16/d33/d2f/d68/f79 x:0 0 0 2024-04-26T11:46:37.485 INFO:tasks.workunit.client.0.smithi029.stdout:5/323: rmdir db/d12/d1f/d39/d3b 39 2024-04-26T11:46:37.485 INFO:tasks.workunit.client.0.smithi029.stdout:3/333: mkdir d0/dc/d80 0 2024-04-26T11:46:37.486 INFO:tasks.workunit.client.0.smithi029.stdout:5/324: readlink db/d40/l4e 0 2024-04-26T11:46:37.486 INFO:tasks.workunit.client.0.smithi029.stdout:0/314: truncate d9/d16/f28 1303295 0 2024-04-26T11:46:37.487 INFO:tasks.workunit.client.0.smithi029.stdout:7/337: truncate d11/d18/d1a/f23 1194507 0 2024-04-26T11:46:37.489 INFO:tasks.workunit.client.0.smithi029.stdout:0/315: read d9/d16/d33/d2f/d68/f76 [1747929,10582] 0 2024-04-26T11:46:37.490 INFO:tasks.workunit.client.0.smithi029.stdout:2/298: dwrite d12/d24/d29/d38/f4a [0,4194304] 0 2024-04-26T11:46:37.490 INFO:tasks.workunit.client.0.smithi029.stdout:7/338: creat d11/d18/d58/f6f x:0 0 0 2024-04-26T11:46:37.494 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:37.489+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:37.495 INFO:tasks.workunit.client.0.smithi029.stdout:0/316: symlink d9/d16/d25/d2a/d74/l7a 0 2024-04-26T11:46:37.495 INFO:tasks.workunit.client.0.smithi029.stdout:1/365: dread d7/d37/d3e/f2f [0,4194304] 0 2024-04-26T11:46:37.495 INFO:tasks.workunit.client.0.smithi029.stdout:4/262: write d3/f31 [1448539,99510] 0 2024-04-26T11:46:37.495 INFO:tasks.workunit.client.0.smithi029.stdout:2/299: symlink d12/d24/d29/d5c/l62 0 2024-04-26T11:46:37.496 INFO:tasks.workunit.client.0.smithi029.stdout:7/339: rename d11/d18/d1a/l5c to d11/d18/d1a/d33/l70 0 2024-04-26T11:46:37.497 INFO:tasks.workunit.client.0.smithi029.stdout:1/366: symlink d7/db/d10/d20/l7e 0 2024-04-26T11:46:37.498 INFO:tasks.workunit.client.0.smithi029.stdout:0/317: symlink d9/d16/d25/l7b 0 2024-04-26T11:46:37.498 INFO:tasks.workunit.client.0.smithi029.stdout:7/340: dread - d11/d37/f4f zero size 2024-04-26T11:46:37.498 INFO:tasks.workunit.client.0.smithi029.stdout:2/300: dread d12/f2a [0,4194304] 0 2024-04-26T11:46:37.498 INFO:tasks.workunit.client.0.smithi029.stdout:3/334: dwrite d0/f15 [0,4194304] 0 2024-04-26T11:46:37.499 INFO:tasks.workunit.client.0.smithi029.stdout:1/367: symlink d7/d37/d3e/l7f 0 2024-04-26T11:46:37.500 INFO:tasks.workunit.client.0.smithi029.stdout:5/325: dwrite db/d12/d1a/f19 [0,4194304] 0 2024-04-26T11:46:37.502 INFO:tasks.workunit.client.0.smithi029.stdout:7/341: getdents d11/d37/d3b 0 2024-04-26T11:46:37.503 INFO:tasks.workunit.client.0.smithi029.stdout:3/335: symlink d0/d1/d2f/l81 0 2024-04-26T11:46:37.503 INFO:tasks.workunit.client.0.smithi029.stdout:1/368: mkdir d7/d25/d68/d4b/d80 0 2024-04-26T11:46:37.503 INFO:tasks.workunit.client.0.smithi029.stdout:2/301: getdents d12/d24/d29/d36 0 2024-04-26T11:46:37.504 INFO:tasks.workunit.client.0.smithi029.stdout:7/342: symlink d11/d18/l71 0 2024-04-26T11:46:37.504 INFO:tasks.workunit.client.0.smithi029.stdout:7/343: chown lf 796558 1 2024-04-26T11:46:37.506 INFO:tasks.workunit.client.0.smithi029.stdout:5/326: creat db/d12/d1f/d39/d3b/f67 x:0 0 0 2024-04-26T11:46:37.506 INFO:tasks.workunit.client.0.smithi029.stdout:7/344: chown d11/d15/l56 695183 1 2024-04-26T11:46:37.506 INFO:tasks.workunit.client.0.smithi029.stdout:2/302: unlink d12/l37 0 2024-04-26T11:46:37.506 INFO:tasks.workunit.client.0.smithi029.stdout:7/345: fsync d11/d18/d58/f6f 0 2024-04-26T11:46:37.507 INFO:tasks.workunit.client.0.smithi029.stdout:1/369: creat d7/d5b/f81 x:0 0 0 2024-04-26T11:46:37.508 INFO:tasks.workunit.client.0.smithi029.stdout:1/370: dread - d7/f75 zero size 2024-04-26T11:46:37.508 INFO:tasks.workunit.client.0.smithi029.stdout:2/303: fsync d12/d24/d29/f48 0 2024-04-26T11:46:37.508 INFO:tasks.workunit.client.0.smithi029.stdout:4/263: truncate d3/d1d/db/f28 145690 0 2024-04-26T11:46:37.510 INFO:tasks.workunit.client.0.smithi029.stdout:7/346: getdents d11/d18/d1a/d33 0 2024-04-26T11:46:37.510 INFO:tasks.workunit.client.0.smithi029.stdout:0/318: dwrite d9/d16/d25/d2a/d4b/f5d [4194304,4194304] 0 2024-04-26T11:46:37.511 INFO:tasks.workunit.client.0.smithi029.stdout:1/371: mkdir d7/db/d10/d1e/d82 0 2024-04-26T11:46:37.511 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:37.511 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:37.511 INFO:tasks.workunit.client.0.smithi029.stdout:4/264: write d3/d1d/db/f36 [637608,43035] 0 2024-04-26T11:46:37.512 INFO:tasks.workunit.client.0.smithi029.stdout:1/372: dread - d7/d5b/f81 zero size 2024-04-26T11:46:37.513 INFO:tasks.workunit.client.0.smithi029.stdout:0/319: rmdir d9/d16 39 2024-04-26T11:46:37.513 INFO:tasks.workunit.client.0.smithi029.stdout:2/304: fsync d12/d24/d2f/f44 0 2024-04-26T11:46:37.513 INFO:tasks.workunit.client.0.smithi029.stdout:4/265: creat d3/d1d/d11/d16/d1f/f52 x:0 0 0 2024-04-26T11:46:37.513 INFO:tasks.workunit.client.0.smithi029.stdout:7/347: symlink d11/d15/d67/l72 0 2024-04-26T11:46:37.515 INFO:tasks.workunit.client.0.smithi029.stdout:2/305: stat d12/d24/d29/d3a/l3f 0 2024-04-26T11:46:37.515 INFO:tasks.workunit.client.0.smithi029.stdout:4/266: write d3/f7 [1402619,114441] 0 2024-04-26T11:46:37.515 INFO:tasks.workunit.client.0.smithi029.stdout:1/373: rename d7/d37/d3e/l3d to d7/db/l83 0 2024-04-26T11:46:37.515 INFO:tasks.workunit.client.0.smithi029.stdout:0/320: write d9/d16/d33/d2f/d31/f67 [682725,28932] 0 2024-04-26T11:46:37.516 INFO:tasks.workunit.client.0.smithi029.stdout:2/306: fdatasync d12/d24/d29/f48 0 2024-04-26T11:46:37.516 INFO:tasks.workunit.client.0.smithi029.stdout:1/374: creat d7/d5b/f84 x:0 0 0 2024-04-26T11:46:37.516 INFO:tasks.workunit.client.0.smithi029.stdout:0/321: write d9/d43/f54 [997126,69752] 0 2024-04-26T11:46:37.517 INFO:tasks.workunit.client.0.smithi029.stdout:2/307: truncate d12/f26 253843 0 2024-04-26T11:46:37.518 INFO:tasks.workunit.client.0.smithi029.stdout:0/322: link f3 d9/d16/d25/d2a/f7c 0 2024-04-26T11:46:37.519 INFO:tasks.workunit.client.0.smithi029.stdout:0/323: symlink d9/d16/d52/l7d 0 2024-04-26T11:46:37.521 INFO:tasks.workunit.client.0.smithi029.stdout:0/324: chown d9/d16/d33/d2f/d31/f6f 13 1 2024-04-26T11:46:37.522 INFO:tasks.workunit.client.0.smithi029.stdout:7/348: dwrite d11/d18/d58/f6f [0,4194304] 0 2024-04-26T11:46:37.523 INFO:tasks.workunit.client.0.smithi029.stdout:7/349: chown d11/d18/d1a/f31 1884959409 1 2024-04-26T11:46:37.524 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:37.524 INFO:tasks.workunit.client.0.smithi029.stdout:7/350: chown d11/d18/d1a/d33/l51 213180 1 2024-04-26T11:46:37.525 INFO:tasks.workunit.client.0.smithi029.stdout:5/327: dread db/d40/f66 [0,4194304] 0 2024-04-26T11:46:37.527 INFO:tasks.workunit.client.0.smithi029.stdout:7/351: write fc [3177205,89087] 0 2024-04-26T11:46:37.527 INFO:tasks.workunit.client.0.smithi029.stdout:1/375: getdents d7/d5b 0 2024-04-26T11:46:37.527 INFO:tasks.workunit.client.0.smithi029.stdout:0/325: dread d9/fc [0,4194304] 0 2024-04-26T11:46:37.527 INFO:tasks.workunit.client.0.smithi029.stdout:1/376: rmdir d7/d5b 39 2024-04-26T11:46:37.527 INFO:tasks.workunit.client.0.smithi029.stdout:7/352: creat d11/d15/f73 x:0 0 0 2024-04-26T11:46:37.527 INFO:tasks.workunit.client.0.smithi029.stdout:5/328: write db/d12/d1a/f19 [2934060,107236] 0 2024-04-26T11:46:37.528 INFO:tasks.workunit.client.0.smithi029.stdout:1/377: mkdir d7/d25/d85 0 2024-04-26T11:46:37.528 INFO:tasks.workunit.client.0.smithi029.stdout:7/353: creat d11/d18/d1a/d33/f74 x:0 0 0 2024-04-26T11:46:37.529 INFO:tasks.workunit.client.0.smithi029.stdout:0/326: rename d9/d16/d33/l3f to d9/d16/d25/d2a/l7e 0 2024-04-26T11:46:37.529 INFO:tasks.workunit.client.0.smithi029.stdout:5/329: write db/d12/d1a/f10 [668050,12553] 0 2024-04-26T11:46:37.530 INFO:tasks.workunit.client.0.smithi029.stdout:1/378: stat d7/db/d10/d20/l3b 0 2024-04-26T11:46:37.530 INFO:tasks.workunit.client.0.smithi029.stdout:5/330: stat db/d12/l5d 0 2024-04-26T11:46:37.530 INFO:tasks.workunit.client.0.smithi029.stdout:7/354: creat d11/d18/d1a/d33/f75 x:0 0 0 2024-04-26T11:46:37.530 INFO:tasks.workunit.client.0.smithi029.stdout:0/327: creat d9/d16/d52/f7f x:0 0 0 2024-04-26T11:46:37.532 INFO:tasks.workunit.client.0.smithi029.stdout:7/355: creat d11/d18/d35/f76 x:0 0 0 2024-04-26T11:46:37.532 INFO:tasks.workunit.client.0.smithi029.stdout:7/356: stat d11/d37 0 2024-04-26T11:46:37.532 INFO:tasks.workunit.client.0.smithi029.stdout:7/357: fsync d11/d18/d58/f5d 0 2024-04-26T11:46:37.535 INFO:tasks.workunit.client.0.smithi029.stdout:0/328: rename d9/d43/f4c to d9/d16/f80 0 2024-04-26T11:46:37.538 INFO:tasks.workunit.client.0.smithi029.stdout:1/379: dread d7/f36 [0,4194304] 0 2024-04-26T11:46:37.539 INFO:tasks.workunit.client.0.smithi029.stdout:3/336: dread d0/dc/f4e [0,4194304] 0 2024-04-26T11:46:37.540 INFO:tasks.workunit.client.0.smithi029.stdout:1/380: symlink d7/d25/d68/l86 0 2024-04-26T11:46:37.542 INFO:tasks.workunit.client.0.smithi029.stdout:5/331: dwrite db/d12/d1a/f18 [0,4194304] 0 2024-04-26T11:46:37.543 INFO:tasks.workunit.client.0.smithi029.stdout:1/381: dread d7/f35 [0,4194304] 0 2024-04-26T11:46:37.544 INFO:tasks.workunit.client.0.smithi029.stdout:2/308: dread f6 [0,4194304] 0 2024-04-26T11:46:37.544 INFO:tasks.workunit.client.0.smithi029.stdout:7/358: dwrite d11/d18/f29 [0,4194304] 0 2024-04-26T11:46:37.544 INFO:tasks.workunit.client.0.smithi029.stdout:5/332: rmdir db/d12/d1f/d39 39 2024-04-26T11:46:37.546 INFO:tasks.workunit.client.0.smithi029.stdout:7/359: creat d11/d18/d2d/f77 x:0 0 0 2024-04-26T11:46:37.546 INFO:tasks.workunit.client.0.smithi029.stdout:1/382: creat d7/d25/d68/d4b/d66/f87 x:0 0 0 2024-04-26T11:46:37.548 INFO:tasks.workunit.client.0.smithi029.stdout:7/360: symlink d11/d18/d35/l78 0 2024-04-26T11:46:37.548 INFO:tasks.workunit.client.0.smithi029.stdout:2/309: dread d12/d24/d2f/f33 [0,4194304] 0 2024-04-26T11:46:37.549 INFO:tasks.workunit.client.0.smithi029.stdout:5/333: truncate db/d12/d1f/d39/d3b/f67 124183 0 2024-04-26T11:46:37.549 INFO:tasks.workunit.client.0.smithi029.stdout:0/329: dwrite d9/d16/d25/d2a/f7c [0,4194304] 0 2024-04-26T11:46:37.549 INFO:tasks.workunit.client.0.smithi029.stdout:7/361: mkdir d11/d15/d79 0 2024-04-26T11:46:37.550 INFO:tasks.workunit.client.0.smithi029.stdout:0/330: rename f5 to d9/d16/d33/f81 0 2024-04-26T11:46:37.551 INFO:tasks.workunit.client.0.smithi029.stdout:7/362: dread - d11/d18/d35/d39/f6a zero size 2024-04-26T11:46:37.555 INFO:tasks.workunit.client.0.smithi029.stdout:3/337: dwrite d0/d1/d41/d5f/d1a/f3d [4194304,4194304] 0 2024-04-26T11:46:37.555 INFO:tasks.workunit.client.0.smithi029.stdout:1/383: dwrite d7/d25/f59 [0,4194304] 0 2024-04-26T11:46:37.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/338: mkdir d0/d1/d2f/d82 0 2024-04-26T11:46:37.556 INFO:tasks.workunit.client.0.smithi029.stdout:1/384: rmdir d7/d25/d68/d4b/d80 0 2024-04-26T11:46:37.557 INFO:tasks.workunit.client.0.smithi029.stdout:3/339: getdents d0/d1/d13 0 2024-04-26T11:46:37.558 INFO:tasks.workunit.client.0.smithi029.stdout:1/385: read d7/db/f4a [402354,69258] 0 2024-04-26T11:46:37.558 INFO:tasks.workunit.client.0.smithi029.stdout:3/340: readlink d0/d1/d13/l19 0 2024-04-26T11:46:37.559 INFO:tasks.workunit.client.0.smithi029.stdout:3/341: write d0/d1/d13/f14 [2149086,78499] 0 2024-04-26T11:46:37.559 INFO:tasks.workunit.client.0.smithi029.stdout:2/310: read d12/f39 [5474004,68084] 0 2024-04-26T11:46:37.559 INFO:tasks.workunit.client.0.smithi029.stdout:1/386: link d7/d5b/f81 d7/d37/d5a/f88 0 2024-04-26T11:46:37.560 INFO:tasks.workunit.client.0.smithi029.stdout:7/363: truncate d11/f13 995028 0 2024-04-26T11:46:37.560 INFO:tasks.workunit.client.0.smithi029.stdout:0/331: truncate d9/d16/d33/d2f/d68/f76 3842576 0 2024-04-26T11:46:37.561 INFO:tasks.workunit.client.0.smithi029.stdout:1/387: write d7/d76/f7d [454359,73550] 0 2024-04-26T11:46:37.561 INFO:tasks.workunit.client.0.smithi029.stdout:2/311: write d12/d24/d2f/f4e [1423347,58980] 0 2024-04-26T11:46:37.562 INFO:tasks.workunit.client.0.smithi029.stdout:7/364: unlink d11/d18/l21 0 2024-04-26T11:46:37.562 INFO:tasks.workunit.client.0.smithi029.stdout:1/388: dread - d7/db/d10/f74 zero size 2024-04-26T11:46:37.563 INFO:tasks.workunit.client.0.smithi029.stdout:2/312: getdents d12/d24/d29/d3a/d4f 0 2024-04-26T11:46:37.563 INFO:tasks.workunit.client.0.smithi029.stdout:1/389: chown d7/db/f2d 20978 1 2024-04-26T11:46:37.564 INFO:tasks.workunit.client.0.smithi029.stdout:1/390: unlink d7/d37/d3e/f1f 0 2024-04-26T11:46:37.564 INFO:tasks.workunit.client.0.smithi029.stdout:2/313: symlink d12/d24/d29/d38/d52/l63 0 2024-04-26T11:46:37.565 INFO:tasks.workunit.client.0.smithi029.stdout:1/391: dread - d7/d5b/f81 zero size 2024-04-26T11:46:37.566 INFO:tasks.workunit.client.0.smithi029.stdout:2/314: creat d12/d24/d29/d36/d4b/f64 x:0 0 0 2024-04-26T11:46:37.568 INFO:tasks.workunit.client.0.smithi029.stdout:2/315: read f7 [714698,5066] 0 2024-04-26T11:46:37.568 INFO:tasks.workunit.client.0.smithi029.stdout:0/332: dwrite d9/f20 [0,4194304] 0 2024-04-26T11:46:37.572 INFO:tasks.workunit.client.0.smithi029.stdout:1/392: rmdir d7/d25/d68/d4b 39 2024-04-26T11:46:37.574 INFO:tasks.workunit.client.0.smithi029.stdout:7/365: write d11/d18/d35/f5e [693451,115238] 0 2024-04-26T11:46:37.576 INFO:tasks.workunit.client.0.smithi029.stdout:1/393: creat d7/db/d10/f89 x:0 0 0 2024-04-26T11:46:37.578 INFO:tasks.workunit.client.0.smithi029.stdout:2/316: dwrite fd [0,4194304] 0 2024-04-26T11:46:37.580 INFO:tasks.workunit.client.0.smithi029.stdout:0/333: dwrite d9/d16/d33/f72 [0,4194304] 0 2024-04-26T11:46:37.581 INFO:tasks.workunit.client.0.smithi029.stdout:1/394: creat d7/d37/d3e/f8a x:0 0 0 2024-04-26T11:46:37.581 INFO:tasks.workunit.client.0.smithi029.stdout:3/342: dwrite d0/dc/d1f/f6f [0,4194304] 0 2024-04-26T11:46:37.581 INFO:tasks.workunit.client.0.smithi029.stdout:0/334: readlink d9/d16/d33/d2f/d32/l3a 0 2024-04-26T11:46:37.582 INFO:tasks.workunit.client.0.smithi029.stdout:0/335: chown d9/d16/f28 29357 1 2024-04-26T11:46:37.582 INFO:tasks.workunit.client.0.smithi029.stdout:2/317: mkdir d12/d24/d29/d3a/d4f/d65 0 2024-04-26T11:46:37.584 INFO:tasks.workunit.client.0.smithi029.stdout:1/395: symlink d7/db/d10/d20/l8b 0 2024-04-26T11:46:37.585 INFO:tasks.workunit.client.0.smithi029.stdout:2/318: write d12/f1c [326850,35068] 0 2024-04-26T11:46:37.585 INFO:tasks.workunit.client.0.smithi029.stdout:1/396: readlink d7/d37/d3e/ld 0 2024-04-26T11:46:37.585 INFO:tasks.workunit.client.0.smithi029.stdout:2/319: readlink d12/l49 0 2024-04-26T11:46:37.586 INFO:tasks.workunit.client.0.smithi029.stdout:1/397: dread - d7/d37/d5a/f61 zero size 2024-04-26T11:46:37.588 INFO:tasks.workunit.client.0.smithi029.stdout:7/366: dwrite d11/f17 [0,4194304] 0 2024-04-26T11:46:37.588 INFO:tasks.workunit.client.0.smithi029.stdout:2/320: symlink d12/d24/d29/d50/d55/l66 0 2024-04-26T11:46:37.589 INFO:tasks.workunit.client.0.smithi029.stdout:7/367: dread - d11/d18/d35/f76 zero size 2024-04-26T11:46:37.590 INFO:tasks.workunit.client.0.smithi029.stdout:3/343: truncate d0/d1/d13/f14 4848424 0 2024-04-26T11:46:37.591 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:37.589+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:37.592 INFO:tasks.workunit.client.0.smithi029.stdout:2/321: creat d12/d24/d29/d3a/f67 x:0 0 0 2024-04-26T11:46:37.593 INFO:tasks.workunit.client.0.smithi029.stdout:3/344: rmdir d0/d1/d2b/d33 39 2024-04-26T11:46:37.593 INFO:tasks.workunit.client.0.smithi029.stdout:2/322: mknod d12/d24/d29/d36/c68 1 2024-04-26T11:46:37.593 INFO:tasks.workunit.client.0.smithi029.stdout:0/336: dwrite d9/d16/d33/f81 [0,4194304] 0 2024-04-26T11:46:37.594 INFO:tasks.workunit.client.0.smithi029.stdout:7/368: rename d11/d18/d1a/f47 to d11/d15/d69/f7a 0 2024-04-26T11:46:37.596 INFO:tasks.workunit.client.0.smithi029.stdout:1/398: dwrite d7/db/f34 [0,4194304] 0 2024-04-26T11:46:37.596 INFO:tasks.workunit.client.0.smithi029.stdout:3/345: getdents d0/d1/d41 0 2024-04-26T11:46:37.598 INFO:tasks.workunit.client.0.smithi029.stdout:3/346: read d0/d1/f49 [397850,69965] 0 2024-04-26T11:46:37.599 INFO:tasks.workunit.client.0.smithi029.stdout:3/347: write d0/d1/d2b/d33/f66 [2391850,78024] 0 2024-04-26T11:46:37.602 INFO:tasks.workunit.client.0.smithi029.stdout:7/369: dwrite d11/d18/d1a/d26/f45 [0,4194304] 0 2024-04-26T11:46:37.604 INFO:tasks.workunit.client.0.smithi029.stdout:7/370: write d11/d18/d1a/d26/f2c [61071,61616] 0 2024-04-26T11:46:37.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/337: dwrite f3 [0,4194304] 0 2024-04-26T11:46:37.606 INFO:tasks.workunit.client.0.smithi029.stdout:0/338: mkdir d9/d16/d33/d2f/d82 0 2024-04-26T11:46:37.606 INFO:tasks.workunit.client.0.smithi029.stdout:7/371: getdents d11/d37 0 2024-04-26T11:46:37.606 INFO:tasks.workunit.client.0.smithi029.stdout:0/339: readlink d9/d16/l62 0 2024-04-26T11:46:37.606 INFO:tasks.workunit.client.0.smithi029.stdout:7/372: mkdir d11/d18/d7b 0 2024-04-26T11:46:37.607 INFO:tasks.workunit.client.0.smithi029.stdout:0/340: write d9/d16/d33/d2f/d31/f67 [1142633,45695] 0 2024-04-26T11:46:37.608 INFO:tasks.workunit.client.0.smithi029.stdout:7/373: mkdir d11/d18/d35/d7c 0 2024-04-26T11:46:37.608 INFO:tasks.workunit.client.0.smithi029.stdout:0/341: creat d9/d78/f83 x:0 0 0 2024-04-26T11:46:37.611 INFO:tasks.workunit.client.0.smithi029.stdout:0/342: link d9/f18 d9/f84 0 2024-04-26T11:46:37.612 INFO:tasks.workunit.client.0.smithi029.stdout:0/343: chown d9/d16/d33/f5c 551209 1 2024-04-26T11:46:37.612 INFO:tasks.workunit.client.0.smithi029.stdout:0/344: link d9/f2d d9/f85 0 2024-04-26T11:46:37.616 INFO:tasks.workunit.client.0.smithi029.stdout:1/399: truncate d7/db/d10/d1e/f45 550676 0 2024-04-26T11:46:37.616 INFO:tasks.workunit.client.0.smithi029.stdout:2/323: write d12/f26 [697750,110306] 0 2024-04-26T11:46:37.618 INFO:tasks.workunit.client.0.smithi029.stdout:2/324: truncate d12/d24/d29/d50/f58 51921 0 2024-04-26T11:46:37.618 INFO:tasks.workunit.client.0.smithi029.stdout:1/400: getdents d7/d25/d68/d4b/d66 0 2024-04-26T11:46:37.619 INFO:tasks.workunit.client.0.smithi029.stdout:1/401: rename d7/d37/d5a to d7/d25/d6d/d8c 0 2024-04-26T11:46:37.622 INFO:tasks.workunit.client.0.smithi029.stdout:0/345: truncate d9/d16/d33/d2f/f6b 805527 0 2024-04-26T11:46:37.623 INFO:tasks.workunit.client.0.smithi029.stdout:0/346: mknod d9/d16/d52/c86 1 2024-04-26T11:46:37.624 INFO:tasks.workunit.client.0.smithi029.stdout:7/374: dwrite f8 [0,4194304] 0 2024-04-26T11:46:37.624 INFO:tasks.workunit.client.0.smithi029.stdout:0/347: dread - d9/d16/d25/d2a/d46/f71 zero size 2024-04-26T11:46:37.626 INFO:tasks.workunit.client.0.smithi029.stdout:0/348: rmdir d9/d16/d25/d2a/d74 39 2024-04-26T11:46:37.626 INFO:tasks.workunit.client.0.smithi029.stdout:7/375: rmdir d11/d18/d7b 0 2024-04-26T11:46:37.626 INFO:tasks.workunit.client.0.smithi029.stdout:0/349: truncate d9/f10 4336945 0 2024-04-26T11:46:37.630 INFO:tasks.workunit.client.0.smithi029.stdout:3/348: truncate d0/d1/d13/f14 308127 0 2024-04-26T11:46:37.631 INFO:tasks.workunit.client.0.smithi029.stdout:1/402: dwrite f6 [0,4194304] 0 2024-04-26T11:46:37.635 INFO:tasks.workunit.client.0.smithi029.stdout:1/403: write d7/f78 [214262,115524] 0 2024-04-26T11:46:37.636 INFO:tasks.workunit.client.0.smithi029.stdout:1/404: write f6 [4625397,72059] 0 2024-04-26T11:46:37.637 INFO:tasks.workunit.client.0.smithi029.stdout:7/376: dwrite fc [0,4194304] 0 2024-04-26T11:46:37.638 INFO:tasks.workunit.client.0.smithi029.stdout:3/349: dread d0/d1/d2b/d33/f66 [0,4194304] 0 2024-04-26T11:46:37.639 INFO:tasks.workunit.client.0.smithi029.stdout:7/377: creat d11/d18/f7d x:0 0 0 2024-04-26T11:46:37.639 INFO:tasks.workunit.client.0.smithi029.stdout:1/405: truncate d7/db/f1d 19401 0 2024-04-26T11:46:37.639 INFO:tasks.workunit.client.0.smithi029.stdout:1/406: chown d7/db/d10/f89 1958 1 2024-04-26T11:46:37.640 INFO:tasks.workunit.client.0.smithi029.stdout:1/407: mkdir d7/db/d8d 0 2024-04-26T11:46:37.641 INFO:tasks.workunit.client.0.smithi029.stdout:1/408: mknod d7/db/d10/d1e/c8e 1 2024-04-26T11:46:37.647 INFO:tasks.workunit.client.0.smithi029.stdout:7/378: dwrite d11/d18/f29 [0,4194304] 0 2024-04-26T11:46:37.648 INFO:tasks.workunit.client.0.smithi029.stdout:7/379: mkdir d11/d18/d35/d39/d7e 0 2024-04-26T11:46:37.648 INFO:tasks.workunit.client.0.smithi029.stdout:7/380: chown d11/f17 2073689 1 2024-04-26T11:46:37.649 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:37.650 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:37.650 INFO:tasks.workunit.client.0.smithi029.stdout:7/381: write d11/d15/d69/f7a [826758,93904] 0 2024-04-26T11:46:37.652 INFO:tasks.workunit.client.0.smithi029.stdout:8/308: sync 2024-04-26T11:46:37.652 INFO:tasks.workunit.client.0.smithi029.stdout:6/351: sync 2024-04-26T11:46:37.652 INFO:tasks.workunit.client.0.smithi029.stdout:9/394: sync 2024-04-26T11:46:37.652 INFO:tasks.workunit.client.0.smithi029.stdout:5/334: sync 2024-04-26T11:46:37.652 INFO:tasks.workunit.client.0.smithi029.stdout:4/267: sync 2024-04-26T11:46:37.652 INFO:tasks.workunit.client.0.smithi029.stdout:2/325: sync 2024-04-26T11:46:37.653 INFO:tasks.workunit.client.0.smithi029.stdout:7/382: rename d11/d18/d1a/d33/l70 to d11/d15/d79/l7f 0 2024-04-26T11:46:37.653 INFO:tasks.workunit.client.0.smithi029.stdout:7/383: stat d11/d18/f29 0 2024-04-26T11:46:37.653 INFO:tasks.workunit.client.0.smithi029.stdout:9/395: unlink d4/d5/f48 0 2024-04-26T11:46:37.654 INFO:tasks.workunit.client.0.smithi029.stdout:6/352: mkdir d7/d25/d4b/d6d 0 2024-04-26T11:46:37.654 INFO:tasks.workunit.client.0.smithi029.stdout:5/335: write db/d12/d1a/f28 [1871822,13236] 0 2024-04-26T11:46:37.654 INFO:tasks.workunit.client.0.smithi029.stdout:7/384: fsync d11/d15/f3f 0 2024-04-26T11:46:37.654 INFO:tasks.workunit.client.0.smithi029.stdout:8/309: creat dc/de/d2e/f68 x:0 0 0 2024-04-26T11:46:37.655 INFO:tasks.workunit.client.0.smithi029.stdout:4/268: truncate d3/f38 307759 0 2024-04-26T11:46:37.656 INFO:tasks.workunit.client.0.smithi029.stdout:2/326: write d12/f39 [2815518,113370] 0 2024-04-26T11:46:37.656 INFO:tasks.workunit.client.0.smithi029.stdout:9/396: chown d4/d5/d16/l1b 1304 1 2024-04-26T11:46:37.656 INFO:tasks.workunit.client.0.smithi029.stdout:8/310: write dc/d12/f49 [1044840,107014] 0 2024-04-26T11:46:37.657 INFO:tasks.workunit.client.0.smithi029.stdout:6/353: rename d7/d20/d27/f31 to d7/d25/d4b/f6e 0 2024-04-26T11:46:37.658 INFO:tasks.workunit.client.0.smithi029.stdout:4/269: write d3/d1d/f21 [2146129,74585] 0 2024-04-26T11:46:37.658 INFO:tasks.workunit.client.0.smithi029.stdout:7/385: creat d11/d18/d1a/f80 x:0 0 0 2024-04-26T11:46:37.658 INFO:tasks.workunit.client.0.smithi029.stdout:3/350: dread d0/d1/f43 [0,4194304] 0 2024-04-26T11:46:37.660 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:37.661 INFO:tasks.workunit.client.0.smithi029.stdout:2/327: creat d12/d24/d29/d36/f69 x:0 0 0 2024-04-26T11:46:37.661 INFO:tasks.workunit.client.0.smithi029.stdout:8/311: unlink dc/de/d2e/f51 0 2024-04-26T11:46:37.661 INFO:tasks.workunit.client.0.smithi029.stdout:3/351: creat d0/d1/d41/f83 x:0 0 0 2024-04-26T11:46:37.661 INFO:tasks.workunit.client.0.smithi029.stdout:4/270: chown d3/d1d/db/d13/d23/f4f 3 1 2024-04-26T11:46:37.661 INFO:tasks.workunit.client.0.smithi029.stdout:9/397: getdents d4/d5/d7 0 2024-04-26T11:46:37.663 INFO:tasks.workunit.client.0.smithi029.stdout:2/328: stat d12/d24/d29/d3a/d40/f5b 0 2024-04-26T11:46:37.663 INFO:tasks.workunit.client.0.smithi029.stdout:6/354: rmdir d7/d25 39 2024-04-26T11:46:37.663 INFO:tasks.workunit.client.0.smithi029.stdout:8/312: write dc/de/d26/d57/f63 [369953,74380] 0 2024-04-26T11:46:37.664 INFO:tasks.workunit.client.0.smithi029.stdout:4/271: creat d3/d50/f53 x:0 0 0 2024-04-26T11:46:37.665 INFO:tasks.workunit.client.0.smithi029.stdout:3/352: write d0/dc/f71 [32007,28526] 0 2024-04-26T11:46:37.666 INFO:tasks.workunit.client.0.smithi029.stdout:2/329: rmdir d12/d24/d29/d38/d52 39 2024-04-26T11:46:37.666 INFO:tasks.workunit.client.0.smithi029.stdout:0/350: dread d9/d16/d25/d2a/d4b/f5d [0,4194304] 0 2024-04-26T11:46:37.667 INFO:tasks.workunit.client.0.smithi029.stdout:1/409: dread d7/d25/f2e [0,4194304] 0 2024-04-26T11:46:37.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/355: link d7/d20/d27/l3c d7/d25/d4b/d4d/l6f 0 2024-04-26T11:46:37.668 INFO:tasks.workunit.client.0.smithi029.stdout:4/272: write d3/d1d/f12 [3300070,87790] 0 2024-04-26T11:46:37.670 INFO:tasks.workunit.client.0.smithi029.stdout:5/336: dwrite db/d12/d1a/f16 [0,4194304] 0 2024-04-26T11:46:37.670 INFO:tasks.workunit.client.0.smithi029.stdout:2/330: unlink d12/d24/d29/d3a/l3f 0 2024-04-26T11:46:37.671 INFO:tasks.workunit.client.0.smithi029.stdout:4/273: read - d3/d1d/f3f zero size 2024-04-26T11:46:37.672 INFO:tasks.workunit.client.0.smithi029.stdout:7/386: dwrite d11/d15/f57 [0,4194304] 0 2024-04-26T11:46:37.673 INFO:tasks.workunit.client.0.smithi029.stdout:5/337: stat db/d12/d1f/d39/l46 0 2024-04-26T11:46:37.673 INFO:tasks.workunit.client.0.smithi029.stdout:6/356: fsync d7/d20/d27/f50 0 2024-04-26T11:46:37.673 INFO:tasks.workunit.client.0.smithi029.stdout:3/353: sync 2024-04-26T11:46:37.676 INFO:tasks.workunit.client.0.smithi029.stdout:6/357: readlink d7/d20/l29 0 2024-04-26T11:46:37.676 INFO:tasks.workunit.client.0.smithi029.stdout:0/351: rename d9/d16/d25/d2a/f5f to d9/d16/d25/d2a/d74/f87 0 2024-04-26T11:46:37.676 INFO:tasks.workunit.client.0.smithi029.stdout:2/331: readlink d12/d24/d29/d38/l3e 0 2024-04-26T11:46:37.676 INFO:tasks.workunit.client.0.smithi029.stdout:4/274: unlink d3/f1e 0 2024-04-26T11:46:37.677 INFO:tasks.workunit.client.0.smithi029.stdout:2/332: fsync d12/d24/d29/d38/f4a 0 2024-04-26T11:46:37.677 INFO:tasks.workunit.client.0.smithi029.stdout:0/352: creat d9/d16/d33/d2f/d68/f88 x:0 0 0 2024-04-26T11:46:37.677 INFO:tasks.workunit.client.0.smithi029.stdout:3/354: symlink d0/d1/d41/d4c/l84 0 2024-04-26T11:46:37.678 INFO:tasks.workunit.client.0.smithi029.stdout:8/313: dwrite dc/d3b/f40 [0,4194304] 0 2024-04-26T11:46:37.678 INFO:tasks.workunit.client.0.smithi029.stdout:5/338: truncate db/d12/d1a/d4c/f58 1062685 0 2024-04-26T11:46:37.679 INFO:tasks.workunit.client.0.smithi029.stdout:6/358: mknod d7/d25/d5c/d34/d4c/c70 1 2024-04-26T11:46:37.681 INFO:tasks.workunit.client.0.smithi029.stdout:2/333: fdatasync d12/f1b 0 2024-04-26T11:46:37.681 INFO:tasks.workunit.client.0.smithi029.stdout:3/355: rmdir d0/dc/d1f 39 2024-04-26T11:46:37.681 INFO:tasks.workunit.client.0.smithi029.stdout:0/353: stat d9/d16/d33/d2f/d82 0 2024-04-26T11:46:37.681 INFO:tasks.workunit.client.0.smithi029.stdout:9/398: dwrite d4/f1d [0,4194304] 0 2024-04-26T11:46:37.684 INFO:tasks.workunit.client.0.smithi029.stdout:1/410: dread d7/d37/f63 [0,4194304] 0 2024-04-26T11:46:37.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/359: creat d7/d20/d27/f71 x:0 0 0 2024-04-26T11:46:37.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/360: sync 2024-04-26T11:46:37.684 INFO:tasks.workunit.client.0.smithi029.stdout:3/356: rmdir d0/d1/d41 39 2024-04-26T11:46:37.686 INFO:tasks.workunit.client.0.smithi029.stdout:0/354: rmdir d9/d16/d33/d2f/d82 0 2024-04-26T11:46:37.686 INFO:tasks.workunit.client.0.smithi029.stdout:9/399: read d4/d49/d58/f53 [595808,64536] 0 2024-04-26T11:46:37.687 INFO:tasks.workunit.client.0.smithi029.stdout:7/387: dwrite d11/d15/f36 [0,4194304] 0 2024-04-26T11:46:37.688 INFO:tasks.workunit.client.0.smithi029.stdout:1/411: creat d7/db/d10/d1e/d82/f8f x:0 0 0 2024-04-26T11:46:37.689 INFO:tasks.workunit.client.0.smithi029.stdout:3/357: write d0/d1/d2b/d33/f74 [594319,100533] 0 2024-04-26T11:46:37.689 INFO:tasks.workunit.client.0.smithi029.stdout:9/400: readlink d4/d49/l6b 0 2024-04-26T11:46:37.689 INFO:tasks.workunit.client.0.smithi029.stdout:4/275: dwrite d3/d1d/f21 [4194304,4194304] 0 2024-04-26T11:46:37.690 INFO:tasks.workunit.client.0.smithi029.stdout:1/412: creat d7/d25/d68/d4b/d66/f90 x:0 0 0 2024-04-26T11:46:37.691 INFO:tasks.workunit.client.0.smithi029.stdout:7/388: rename d11/d18/d35/d39/l6d to d11/d15/l81 0 2024-04-26T11:46:37.693 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:37.689+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:37.695 INFO:tasks.workunit.client.0.smithi029.stdout:5/339: read db/d12/d1a/f49 [3265176,46330] 0 2024-04-26T11:46:37.695 INFO:tasks.workunit.client.0.smithi029.stdout:5/340: creat db/d12/d1a/f68 x:0 0 0 2024-04-26T11:46:37.695 INFO:tasks.workunit.client.0.smithi029.stdout:1/413: creat d7/db/f91 x:0 0 0 2024-04-26T11:46:37.700 INFO:tasks.workunit.client.0.smithi029.stdout:4/276: creat d3/d1d/d11/d16/d1f/d3d/d46/f54 x:0 0 0 2024-04-26T11:46:37.700 INFO:tasks.workunit.client.0.smithi029.stdout:1/414: getdents d7/d76 0 2024-04-26T11:46:37.700 INFO:tasks.workunit.client.0.smithi029.stdout:4/277: rmdir d3/d1d/db/d13 39 2024-04-26T11:46:37.700 INFO:tasks.workunit.client.0.smithi029.stdout:1/415: link d7/f77 d7/db/d8d/f92 0 2024-04-26T11:46:37.700 INFO:tasks.workunit.client.0.smithi029.stdout:9/401: dread d4/d5/d16/d39/f3c [0,4194304] 0 2024-04-26T11:46:37.701 INFO:tasks.workunit.client.0.smithi029.stdout:4/278: creat d3/d1d/d11/d16/d1f/f55 x:0 0 0 2024-04-26T11:46:37.701 INFO:tasks.workunit.client.0.smithi029.stdout:7/389: dwrite d11/d37/d3b/f5a [0,4194304] 0 2024-04-26T11:46:37.701 INFO:tasks.workunit.client.0.smithi029.stdout:9/402: dread - d4/d49/d58/f6d zero size 2024-04-26T11:46:37.701 INFO:tasks.workunit.client.0.smithi029.stdout:9/403: mknod d4/d5/c77 1 2024-04-26T11:46:37.701 INFO:tasks.workunit.client.0.smithi029.stdout:7/390: symlink d11/d15/d79/l82 0 2024-04-26T11:46:37.703 INFO:tasks.workunit.client.0.smithi029.stdout:9/404: truncate d4/d5/d16/f3b 913293 0 2024-04-26T11:46:37.703 INFO:tasks.workunit.client.0.smithi029.stdout:8/314: dread dc/de/d26/f53 [0,4194304] 0 2024-04-26T11:46:37.703 INFO:tasks.workunit.client.0.smithi029.stdout:0/355: dwrite d9/d16/d33/d2f/d68/f76 [0,4194304] 0 2024-04-26T11:46:37.705 INFO:tasks.workunit.client.0.smithi029.stdout:8/315: write dc/de/d2e/f68 [972820,69072] 0 2024-04-26T11:46:37.705 INFO:tasks.workunit.client.0.smithi029.stdout:0/356: read d9/d16/d25/d2a/f7c [1859243,52883] 0 2024-04-26T11:46:37.705 INFO:tasks.workunit.client.0.smithi029.stdout:8/316: sync 2024-04-26T11:46:37.707 INFO:tasks.workunit.client.0.smithi029.stdout:3/358: truncate d0/f4b 365257 0 2024-04-26T11:46:37.707 INFO:tasks.workunit.client.0.smithi029.stdout:0/357: stat d9/d16/d33/f5e 0 2024-04-26T11:46:37.707 INFO:tasks.workunit.client.0.smithi029.stdout:9/405: getdents d4/d5 0 2024-04-26T11:46:37.709 INFO:tasks.workunit.client.0.smithi029.stdout:2/334: dread d12/d24/d2f/f4e [0,4194304] 0 2024-04-26T11:46:37.709 INFO:tasks.workunit.client.0.smithi029.stdout:8/317: creat dc/de/d26/f69 x:0 0 0 2024-04-26T11:46:37.709 INFO:tasks.workunit.client.0.smithi029.stdout:0/358: rmdir d9/d16/d25/d2a/d74 39 2024-04-26T11:46:37.709 INFO:tasks.workunit.client.0.smithi029.stdout:9/406: mkdir d4/d5/d78 0 2024-04-26T11:46:37.710 INFO:tasks.workunit.client.0.smithi029.stdout:1/416: dread d7/d25/f2a [0,4194304] 0 2024-04-26T11:46:37.710 INFO:tasks.workunit.client.0.smithi029.stdout:3/359: unlink d0/d1/d41/d5f/d1a/l28 0 2024-04-26T11:46:37.710 INFO:tasks.workunit.client.0.smithi029.stdout:2/335: dread - d12/d24/d29/d50/f59 zero size 2024-04-26T11:46:37.711 INFO:tasks.workunit.client.0.smithi029.stdout:4/279: dwrite d3/d1d/d11/d16/d1f/d3d/d39/f32 [0,4194304] 0 2024-04-26T11:46:37.712 INFO:tasks.workunit.client.0.smithi029.stdout:1/417: symlink d7/l93 0 2024-04-26T11:46:37.713 INFO:tasks.workunit.client.0.smithi029.stdout:7/391: read d11/f13 [522718,114682] 0 2024-04-26T11:46:37.713 INFO:tasks.workunit.client.0.smithi029.stdout:3/360: write d0/f52 [5054252,67452] 0 2024-04-26T11:46:37.715 INFO:tasks.workunit.client.0.smithi029.stdout:0/359: write d9/d16/d25/d2a/d74/f87 [2649650,7831] 0 2024-04-26T11:46:37.716 INFO:tasks.workunit.client.0.smithi029.stdout:2/336: mkdir d12/d24/d29/d50/d6a 0 2024-04-26T11:46:37.717 INFO:tasks.workunit.client.0.smithi029.stdout:1/418: chown d7/db/l15 62 1 2024-04-26T11:46:37.717 INFO:tasks.workunit.client.0.smithi029.stdout:0/360: fdatasync d9/d16/f24 0 2024-04-26T11:46:37.718 INFO:tasks.workunit.client.0.smithi029.stdout:7/392: unlink d11/d18/d1a/f66 0 2024-04-26T11:46:37.719 INFO:tasks.workunit.client.0.smithi029.stdout:5/341: dwrite db/d12/d1f/f3d [4194304,4194304] 0 2024-04-26T11:46:37.719 INFO:tasks.workunit.client.0.smithi029.stdout:9/407: getdents d4/d49/d58/d67 0 2024-04-26T11:46:37.720 INFO:tasks.workunit.client.0.smithi029.stdout:4/280: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56 0 2024-04-26T11:46:37.721 INFO:tasks.workunit.client.0.smithi029.stdout:2/337: creat d12/d24/d29/f6b x:0 0 0 2024-04-26T11:46:37.722 INFO:tasks.workunit.client.0.smithi029.stdout:5/342: write db/d12/d1a/f28 [92550,112712] 0 2024-04-26T11:46:37.722 INFO:tasks.workunit.client.0.smithi029.stdout:4/281: chown d3/d1d/db/f36 15196438 1 2024-04-26T11:46:37.723 INFO:tasks.workunit.client.0.smithi029.stdout:1/419: readlink d7/db/d10/d20/l28 0 2024-04-26T11:46:37.723 INFO:tasks.workunit.client.0.smithi029.stdout:2/338: dread - d12/d24/d29/d36/d4b/f64 zero size 2024-04-26T11:46:37.723 INFO:tasks.workunit.client.0.smithi029.stdout:3/361: rename d0/d1/d41/d5f/f69 to d0/d1/d2b/f85 0 2024-04-26T11:46:37.724 INFO:tasks.workunit.client.0.smithi029.stdout:8/318: dwrite dc/d3b/f56 [0,4194304] 0 2024-04-26T11:46:37.724 INFO:tasks.workunit.client.0.smithi029.stdout:5/343: mknod db/d12/d1f/d39/c69 1 2024-04-26T11:46:37.725 INFO:tasks.workunit.client.0.smithi029.stdout:5/344: dread - db/d40/f50 zero size 2024-04-26T11:46:37.725 INFO:tasks.workunit.client.0.smithi029.stdout:1/420: write d7/d25/d68/f6e [252160,124937] 0 2024-04-26T11:46:37.726 INFO:tasks.workunit.client.0.smithi029.stdout:0/361: truncate f3 840268 0 2024-04-26T11:46:37.726 INFO:tasks.workunit.client.0.smithi029.stdout:3/362: truncate d0/d1/d13/f77 576988 0 2024-04-26T11:46:37.729 INFO:tasks.workunit.client.0.smithi029.stdout:1/421: dread d7/f35 [0,4194304] 0 2024-04-26T11:46:37.729 INFO:tasks.workunit.client.0.smithi029.stdout:2/339: rename d12/d24/d29/d5c to d12/d6c 0 2024-04-26T11:46:37.730 INFO:tasks.workunit.client.0.smithi029.stdout:4/282: dread d3/d1d/db/d13/d23/f45 [0,4194304] 0 2024-04-26T11:46:37.731 INFO:tasks.workunit.client.0.smithi029.stdout:7/393: dwrite fc [0,4194304] 0 2024-04-26T11:46:37.734 INFO:tasks.workunit.client.0.smithi029.stdout:6/361: dread d7/d20/d27/f64 [0,4194304] 0 2024-04-26T11:46:37.734 INFO:tasks.workunit.client.0.smithi029.stdout:4/283: dread - d3/d1d/d11/d16/d1f/d3d/d39/d30/f42 zero size 2024-04-26T11:46:37.734 INFO:tasks.workunit.client.0.smithi029.stdout:9/408: rmdir d4/d5/d16/d39 39 2024-04-26T11:46:37.735 INFO:tasks.workunit.client.0.smithi029.stdout:8/319: rename dc/de/d15 to dc/d12/d6a 0 2024-04-26T11:46:37.735 INFO:tasks.workunit.client.0.smithi029.stdout:2/340: symlink d12/d24/d29/d3a/d40/l6d 0 2024-04-26T11:46:37.736 INFO:tasks.workunit.client.0.smithi029.stdout:1/422: rename d7/db/d10/d20/f7b to d7/d76/f94 0 2024-04-26T11:46:37.737 INFO:tasks.workunit.client.0.smithi029.stdout:2/341: mkdir d12/d6c/d6e 0 2024-04-26T11:46:37.737 INFO:tasks.workunit.client.0.smithi029.stdout:0/362: write d9/d16/d25/d2a/f7c [623936,16157] 0 2024-04-26T11:46:37.738 INFO:tasks.workunit.client.0.smithi029.stdout:8/320: mkdir dc/de/d26/d6b 0 2024-04-26T11:46:37.739 INFO:tasks.workunit.client.0.smithi029.stdout:6/362: creat d7/d20/d2f/f72 x:0 0 0 2024-04-26T11:46:37.739 INFO:tasks.workunit.client.0.smithi029.stdout:1/423: rmdir d7/db/d8d 39 2024-04-26T11:46:37.739 INFO:tasks.workunit.client.0.smithi029.stdout:5/345: dwrite db/f52 [0,4194304] 0 2024-04-26T11:46:37.739 INFO:tasks.workunit.client.0.smithi029.stdout:4/284: creat d3/d1d/d11/d16/f57 x:0 0 0 2024-04-26T11:46:37.742 INFO:tasks.workunit.client.0.smithi029.stdout:3/363: dread d0/dc/f45 [0,4194304] 0 2024-04-26T11:46:37.742 INFO:tasks.workunit.client.0.smithi029.stdout:6/363: chown d7/d20/d2f/f72 1878119437 1 2024-04-26T11:46:37.742 INFO:tasks.workunit.client.0.smithi029.stdout:2/342: mkdir d12/d24/d29/d3a/d4f/d65/d6f 0 2024-04-26T11:46:37.743 INFO:tasks.workunit.client.0.smithi029.stdout:7/394: dwrite d11/d15/f57 [0,4194304] 0 2024-04-26T11:46:37.745 INFO:tasks.workunit.client.0.smithi029.stdout:1/424: symlink d7/db/d10/d1e/l95 0 2024-04-26T11:46:37.747 INFO:tasks.workunit.client.0.smithi029.stdout:2/343: mkdir d12/d6c/d70 0 2024-04-26T11:46:37.747 INFO:tasks.workunit.client.0.smithi029.stdout:5/346: rename db/l2a to db/d12/d1f/d39/l6a 0 2024-04-26T11:46:37.747 INFO:tasks.workunit.client.0.smithi029.stdout:9/409: dwrite d4/d5/f51 [0,4194304] 0 2024-04-26T11:46:37.747 INFO:tasks.workunit.client.0.smithi029.stdout:4/285: truncate d3/d1d/db/d13/d23/f45 1161876 0 2024-04-26T11:46:37.747 INFO:tasks.workunit.client.0.smithi029.stdout:7/395: write d11/d18/d1a/f4a [4279904,119074] 0 2024-04-26T11:46:37.747 INFO:tasks.workunit.client.0.smithi029.stdout:1/425: chown d7/d25/d68/f60 136 1 2024-04-26T11:46:37.748 INFO:tasks.workunit.client.0.smithi029.stdout:2/344: fsync d12/f1c 0 2024-04-26T11:46:37.748 INFO:tasks.workunit.client.0.smithi029.stdout:8/321: getdents dc/de/d2e/d23/d27/d24/d54 0 2024-04-26T11:46:37.752 INFO:tasks.workunit.client.0.smithi029.stdout:8/322: symlink dc/de/d2e/d23/d27/l6c 0 2024-04-26T11:46:37.752 INFO:tasks.workunit.client.0.smithi029.stdout:4/286: chown d3/d1d/d11/d16/d1f/d3d/d46/f54 29 1 2024-04-26T11:46:37.753 INFO:tasks.workunit.client.0.smithi029.stdout:3/364: dwrite d0/d1/f7c [0,4194304] 0 2024-04-26T11:46:37.753 INFO:tasks.workunit.client.0.smithi029.stdout:5/347: mkdir db/d12/d6b 0 2024-04-26T11:46:37.753 INFO:tasks.workunit.client.0.smithi029.stdout:1/426: write d7/d5b/f81 [924145,73923] 0 2024-04-26T11:46:37.754 INFO:tasks.workunit.client.0.smithi029.stdout:2/345: rename d12/d24/d2f/f61 to d12/d24/d29/f71 0 2024-04-26T11:46:37.754 INFO:tasks.workunit.client.0.smithi029.stdout:8/323: dread - dc/de/d26/f69 zero size 2024-04-26T11:46:37.755 INFO:tasks.workunit.client.0.smithi029.stdout:1/427: readlink d7/d25/d6d/d8c/l65 0 2024-04-26T11:46:37.756 INFO:tasks.workunit.client.0.smithi029.stdout:5/348: rename db/d12/l1d to db/d12/d1a/l6c 0 2024-04-26T11:46:37.757 INFO:tasks.workunit.client.0.smithi029.stdout:4/287: read d3/f5 [1296610,125182] 0 2024-04-26T11:46:37.757 INFO:tasks.workunit.client.0.smithi029.stdout:6/364: dwrite d7/d46/f48 [0,4194304] 0 2024-04-26T11:46:37.758 INFO:tasks.workunit.client.0.smithi029.stdout:4/288: dread - d3/d50/f53 zero size 2024-04-26T11:46:37.762 INFO:tasks.workunit.client.0.smithi029.stdout:4/289: readlink d3/d1d/d11/l2c 0 2024-04-26T11:46:37.762 INFO:tasks.workunit.client.0.smithi029.stdout:6/365: getdents d7/d25/d4b 0 2024-04-26T11:46:37.763 INFO:tasks.workunit.client.0.smithi029.stdout:7/396: dwrite d11/d37/f4f [0,4194304] 0 2024-04-26T11:46:37.764 INFO:tasks.workunit.client.0.smithi029.stdout:4/290: write d3/f7 [4499242,56045] 0 2024-04-26T11:46:37.765 INFO:tasks.workunit.client.0.smithi029.stdout:7/397: creat d11/d18/d1a/f83 x:0 0 0 2024-04-26T11:46:37.766 INFO:tasks.workunit.client.0.smithi029.stdout:4/291: read d3/f47 [3014199,11324] 0 2024-04-26T11:46:37.766 INFO:tasks.workunit.client.0.smithi029.stdout:2/346: dwrite d12/f2a [0,4194304] 0 2024-04-26T11:46:37.766 INFO:tasks.workunit.client.0.smithi029.stdout:4/292: sync 2024-04-26T11:46:37.767 INFO:tasks.workunit.client.0.smithi029.stdout:6/366: rename d7/d25/f28 to d7/d25/f73 0 2024-04-26T11:46:37.767 INFO:tasks.workunit.client.0.smithi029.stdout:7/398: unlink d11/f17 0 2024-04-26T11:46:37.770 INFO:tasks.workunit.client.0.smithi029.stdout:6/367: creat d7/d20/f74 x:0 0 0 2024-04-26T11:46:37.771 INFO:tasks.workunit.client.0.smithi029.stdout:4/293: write d3/d1d/db/d13/d23/f43 [6983594,112081] 0 2024-04-26T11:46:37.771 INFO:tasks.workunit.client.0.smithi029.stdout:2/347: rmdir d12/d24/d29/d3a/d4f/d65 39 2024-04-26T11:46:37.775 INFO:tasks.workunit.client.0.smithi029.stdout:8/324: dread dc/de/d2e/f68 [0,4194304] 0 2024-04-26T11:46:37.775 INFO:tasks.workunit.client.0.smithi029.stdout:1/428: dwrite d7/d25/d68/f6e [0,4194304] 0 2024-04-26T11:46:37.775 INFO:tasks.workunit.client.0.smithi029.stdout:3/365: dwrite d0/d1/d41/d5f/d1a/f3d [0,4194304] 0 2024-04-26T11:46:37.776 INFO:tasks.workunit.client.0.smithi029.stdout:8/325: chown dc/de 0 1 2024-04-26T11:46:37.777 INFO:tasks.workunit.client.0.smithi029.stdout:8/326: sync 2024-04-26T11:46:37.778 INFO:tasks.workunit.client.0.smithi029.stdout:8/327: sync 2024-04-26T11:46:37.778 INFO:tasks.workunit.client.0.smithi029.stdout:3/366: readlink d0/d1/d41/d5f/d1a/l73 0 2024-04-26T11:46:37.778 INFO:tasks.workunit.client.0.smithi029.stdout:1/429: chown d7/db/d10/d1e/d53/f7a 57120 1 2024-04-26T11:46:37.779 INFO:tasks.workunit.client.0.smithi029.stdout:1/430: stat d7/d76/f7d 0 2024-04-26T11:46:37.784 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:37.785 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:37.785 INFO:tasks.workunit.client.0.smithi029.stdout:1/431: read d7/d76/f7d [72293,98465] 0 2024-04-26T11:46:37.785 INFO:tasks.workunit.client.0.smithi029.stdout:7/399: dread d11/d15/d69/f7a [0,4194304] 0 2024-04-26T11:46:37.785 INFO:tasks.workunit.client.0.smithi029.stdout:1/432: sync 2024-04-26T11:46:37.786 INFO:tasks.workunit.client.0.smithi029.stdout:6/368: dread d7/d25/d5c/f36 [0,4194304] 0 2024-04-26T11:46:37.787 INFO:tasks.workunit.client.0.smithi029.stdout:1/433: fdatasync d7/d25/d68/d4b/d66/f87 0 2024-04-26T11:46:37.789 INFO:tasks.workunit.client.0.smithi029.stdout:3/367: dwrite d0/d1/f5d [0,4194304] 0 2024-04-26T11:46:37.789 INFO:tasks.workunit.client.0.smithi029.stdout:2/348: dwrite f7 [0,4194304] 0 2024-04-26T11:46:37.789 INFO:tasks.workunit.client.0.smithi029.stdout:1/434: readlink d7/db/d10/d20/l7e 0 2024-04-26T11:46:37.790 INFO:tasks.workunit.client.0.smithi029.stdout:6/369: write d7/d20/d2f/f33 [3424629,89577] 0 2024-04-26T11:46:37.790 INFO:tasks.workunit.client.0.smithi029.stdout:2/349: creat d12/d6c/f72 x:0 0 0 2024-04-26T11:46:37.791 INFO:tasks.workunit.client.0.smithi029.stdout:1/435: creat d7/db/d8d/f96 x:0 0 0 2024-04-26T11:46:37.791 INFO:tasks.workunit.client.0.smithi029.stdout:3/368: truncate d0/d1/f49 746987 0 2024-04-26T11:46:37.792 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:37.788+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:37.792 INFO:tasks.workunit.client.0.smithi029.stdout:6/370: chown d7/d20/d27/f2b 144846 1 2024-04-26T11:46:37.792 INFO:tasks.workunit.client.0.smithi029.stdout:6/371: fsync d7/d25/d4b/f4e 0 2024-04-26T11:46:37.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:37.797 INFO:tasks.workunit.client.0.smithi029.stdout:2/350: rename d12/d24/d29/d3a to d12/d6c/d73 0 2024-04-26T11:46:37.801 INFO:tasks.workunit.client.0.smithi029.stdout:8/328: write dc/d12/f20 [5906398,129204] 0 2024-04-26T11:46:37.801 INFO:tasks.workunit.client.0.smithi029.stdout:6/372: rename d7/d25/d5c/f37 to d7/d25/d4b/d4d/f75 0 2024-04-26T11:46:37.801 INFO:tasks.workunit.client.0.smithi029.stdout:3/369: fsync d0/d1/d13/f77 0 2024-04-26T11:46:37.802 INFO:tasks.workunit.client.0.smithi029.stdout:2/351: creat d12/d6c/d70/f74 x:0 0 0 2024-04-26T11:46:37.802 INFO:tasks.workunit.client.0.smithi029.stdout:8/329: readlink dc/d12/d6a/l2c 0 2024-04-26T11:46:37.802 INFO:tasks.workunit.client.0.smithi029.stdout:7/400: mkdir d11/d15/d69/d84 0 2024-04-26T11:46:37.802 INFO:tasks.workunit.client.0.smithi029.stdout:6/373: chown d7/d25/d5c/l1f 2 1 2024-04-26T11:46:37.803 INFO:tasks.workunit.client.0.smithi029.stdout:2/352: creat d12/d6c/d73/d4f/d65/f75 x:0 0 0 2024-04-26T11:46:37.803 INFO:tasks.workunit.client.0.smithi029.stdout:2/353: fsync d12/f2a 0 2024-04-26T11:46:37.805 INFO:tasks.workunit.client.0.smithi029.stdout:7/401: readlink d11/d18/d35/l78 0 2024-04-26T11:46:37.805 INFO:tasks.workunit.client.0.smithi029.stdout:2/354: fsync d12/d24/d29/d50/f56 0 2024-04-26T11:46:37.809 INFO:tasks.workunit.client.0.smithi029.stdout:7/402: symlink d11/d15/d69/l85 0 2024-04-26T11:46:37.809 INFO:tasks.workunit.client.0.smithi029.stdout:4/294: dread d3/d1d/db/d13/f2f [0,4194304] 0 2024-04-26T11:46:37.810 INFO:tasks.workunit.client.0.smithi029.stdout:2/355: write d12/d24/d29/d36/d4b/f64 [999382,75676] 0 2024-04-26T11:46:37.810 INFO:tasks.workunit.client.0.smithi029.stdout:1/436: truncate d7/db/d10/d1e/f26 3081429 0 2024-04-26T11:46:37.814 INFO:tasks.workunit.client.0.smithi029.stdout:5/349: dread db/d12/d1a/f24 [0,4194304] 0 2024-04-26T11:46:37.814 INFO:tasks.workunit.client.0.smithi029.stdout:4/295: dread - d3/d1d/d11/d16/f57 zero size 2024-04-26T11:46:37.814 INFO:tasks.workunit.client.0.smithi029.stdout:8/330: dwrite dc/de/d26/f69 [0,4194304] 0 2024-04-26T11:46:37.814 INFO:tasks.workunit.client.0.smithi029.stdout:6/374: write d7/d25/d5c/f36 [101705,43247] 0 2024-04-26T11:46:37.814 INFO:tasks.workunit.client.0.smithi029.stdout:9/410: dread d4/d5/d7/f35 [0,4194304] 0 2024-04-26T11:46:37.815 INFO:tasks.workunit.client.0.smithi029.stdout:3/370: dwrite d0/dc/f6c [0,4194304] 0 2024-04-26T11:46:37.815 INFO:tasks.workunit.client.0.smithi029.stdout:4/296: stat d3/d1d/db/d13 0 2024-04-26T11:46:37.816 INFO:tasks.workunit.client.0.smithi029.stdout:7/403: truncate d11/d18/d2d/f77 441188 0 2024-04-26T11:46:37.816 INFO:tasks.workunit.client.0.smithi029.stdout:0/363: dread d9/f10 [0,4194304] 0 2024-04-26T11:46:37.817 INFO:tasks.workunit.client.0.smithi029.stdout:2/356: fdatasync d12/d24/d2f/f4e 0 2024-04-26T11:46:37.819 INFO:tasks.workunit.client.0.smithi029.stdout:4/297: write d3/d1d/f29 [1713034,40223] 0 2024-04-26T11:46:37.819 INFO:tasks.workunit.client.0.smithi029.stdout:8/331: unlink dc/de/d2e/d23/l2f 0 2024-04-26T11:46:37.821 INFO:tasks.workunit.client.0.smithi029.stdout:8/332: fsync dc/d12/f20 0 2024-04-26T11:46:37.821 INFO:tasks.workunit.client.0.smithi029.stdout:6/375: write d7/d20/f63 [573679,32008] 0 2024-04-26T11:46:37.823 INFO:tasks.workunit.client.0.smithi029.stdout:7/404: getdents d11/d18/d58 0 2024-04-26T11:46:37.823 INFO:tasks.workunit.client.0.smithi029.stdout:0/364: truncate d9/d16/d33/d2f/d68/f88 320174 0 2024-04-26T11:46:37.823 INFO:tasks.workunit.client.0.smithi029.stdout:9/411: link d4/d49/f6a d4/d46/f79 0 2024-04-26T11:46:37.823 INFO:tasks.workunit.client.0.smithi029.stdout:2/357: fsync d12/d6c/d73/d4f/d65/f75 0 2024-04-26T11:46:37.825 INFO:tasks.workunit.client.0.smithi029.stdout:1/437: dwrite d7/d37/f48 [0,4194304] 0 2024-04-26T11:46:37.825 INFO:tasks.workunit.client.0.smithi029.stdout:6/376: mkdir d7/d20/d2f/d45/d76 0 2024-04-26T11:46:37.825 INFO:tasks.workunit.client.0.smithi029.stdout:2/358: mkdir d12/d24/d2f/d76 0 2024-04-26T11:46:37.825 INFO:tasks.workunit.client.0.smithi029.stdout:9/412: truncate d4/f64 156520 0 2024-04-26T11:46:37.825 INFO:tasks.workunit.client.0.smithi029.stdout:4/298: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f58 x:0 0 0 2024-04-26T11:46:37.826 INFO:tasks.workunit.client.0.smithi029.stdout:8/333: getdents dc/de/d2e 0 2024-04-26T11:46:37.826 INFO:tasks.workunit.client.0.smithi029.stdout:2/359: fdatasync d12/d24/d2f/f4e 0 2024-04-26T11:46:37.826 INFO:tasks.workunit.client.0.smithi029.stdout:3/371: dwrite d0/f52 [0,4194304] 0 2024-04-26T11:46:37.827 INFO:tasks.workunit.client.0.smithi029.stdout:8/334: chown dc/d12/f20 1265981 1 2024-04-26T11:46:37.828 INFO:tasks.workunit.client.0.smithi029.stdout:4/299: write d3/d50/f53 [897555,68009] 0 2024-04-26T11:46:37.831 INFO:tasks.workunit.client.0.smithi029.stdout:0/365: getdents d9/d16/d25/d2a/d46 0 2024-04-26T11:46:37.832 INFO:tasks.workunit.client.0.smithi029.stdout:4/300: unlink d3/f7 0 2024-04-26T11:46:37.832 INFO:tasks.workunit.client.0.smithi029.stdout:3/372: fdatasync d0/d1/d41/d5f/d54/f58 0 2024-04-26T11:46:37.833 INFO:tasks.workunit.client.0.smithi029.stdout:6/377: write d7/d25/d5c/d34/f4a [4727914,33963] 0 2024-04-26T11:46:37.838 INFO:tasks.workunit.client.0.smithi029.stdout:3/373: fdatasync d0/d1/f43 0 2024-04-26T11:46:37.838 INFO:tasks.workunit.client.0.smithi029.stdout:4/301: fdatasync d3/f38 0 2024-04-26T11:46:37.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/360: rename d12/f1e to d12/d6c/d73/d4f/d65/d6f/f77 0 2024-04-26T11:46:37.839 INFO:tasks.workunit.client.0.smithi029.stdout:2/361: sync 2024-04-26T11:46:37.841 INFO:tasks.workunit.client.0.smithi029.stdout:6/378: write d7/d20/d27/f41 [215413,31545] 0 2024-04-26T11:46:37.842 INFO:tasks.workunit.client.0.smithi029.stdout:6/379: sync 2024-04-26T11:46:37.842 INFO:tasks.workunit.client.0.smithi029.stdout:2/362: readlink d12/l49 0 2024-04-26T11:46:37.843 INFO:tasks.workunit.client.0.smithi029.stdout:7/405: dwrite d11/d15/f36 [0,4194304] 0 2024-04-26T11:46:37.843 INFO:tasks.workunit.client.0.smithi029.stdout:3/374: chown d0/d1/l7f 1 1 2024-04-26T11:46:37.843 INFO:tasks.workunit.client.0.smithi029.stdout:9/413: dwrite d4/d49/d58/f6d [0,4194304] 0 2024-04-26T11:46:37.847 INFO:tasks.workunit.client.0.smithi029.stdout:6/380: creat d7/d46/d69/f77 x:0 0 0 2024-04-26T11:46:37.847 INFO:tasks.workunit.client.0.smithi029.stdout:8/335: dwrite dc/d3b/f41 [0,4194304] 0 2024-04-26T11:46:37.847 INFO:tasks.workunit.client.0.smithi029.stdout:1/438: dwrite d7/d25/d68/d4b/f6f [0,4194304] 0 2024-04-26T11:46:37.847 INFO:tasks.workunit.client.0.smithi029.stdout:4/302: truncate d3/d1d/f3f 248775 0 2024-04-26T11:46:37.847 INFO:tasks.workunit.client.0.smithi029.stdout:9/414: rmdir d4/d5 39 2024-04-26T11:46:37.847 INFO:tasks.workunit.client.0.smithi029.stdout:0/366: dwrite f3 [0,4194304] 0 2024-04-26T11:46:37.849 INFO:tasks.workunit.client.0.smithi029.stdout:8/336: write dc/de/d2e/d23/f21 [1850738,61970] 0 2024-04-26T11:46:37.849 INFO:tasks.workunit.client.0.smithi029.stdout:2/363: rmdir d12/d6c/d73/d4f/d65 39 2024-04-26T11:46:37.849 INFO:tasks.workunit.client.0.smithi029.stdout:3/375: rename d0/dc/f4e to d0/d1/d2f/f86 0 2024-04-26T11:46:37.849 INFO:tasks.workunit.client.0.smithi029.stdout:4/303: write d3/d1d/d11/d16/f57 [447528,54950] 0 2024-04-26T11:46:37.849 INFO:tasks.workunit.client.0.smithi029.stdout:1/439: mkdir d7/db/d8d/d97 0 2024-04-26T11:46:37.849 INFO:tasks.workunit.client.0.smithi029.stdout:0/367: rmdir d9/d16/d33/d2f/d31 39 2024-04-26T11:46:37.850 INFO:tasks.workunit.client.0.smithi029.stdout:2/364: fdatasync d12/f39 0 2024-04-26T11:46:37.851 INFO:tasks.workunit.client.0.smithi029.stdout:5/350: dread db/d12/f1b [0,4194304] 0 2024-04-26T11:46:37.851 INFO:tasks.workunit.client.0.smithi029.stdout:8/337: dread - dc/de/d2e/d23/d27/f67 zero size 2024-04-26T11:46:37.851 INFO:tasks.workunit.client.0.smithi029.stdout:7/406: rename d11/d18/d1a/d26/f63 to d11/d18/d2d/f86 0 2024-04-26T11:46:37.851 INFO:tasks.workunit.client.0.smithi029.stdout:0/368: write d9/d16/d25/d2a/f66 [813893,16966] 0 2024-04-26T11:46:37.851 INFO:tasks.workunit.client.0.smithi029.stdout:2/365: symlink d12/d24/d29/d50/l78 0 2024-04-26T11:46:37.851 INFO:tasks.workunit.client.0.smithi029.stdout:3/376: creat d0/d1/d5c/f87 x:0 0 0 2024-04-26T11:46:37.851 INFO:tasks.workunit.client.0.smithi029.stdout:1/440: mkdir d7/d37/d98 0 2024-04-26T11:46:37.851 INFO:tasks.workunit.client.0.smithi029.stdout:8/338: chown dc/de/d26 18489 1 2024-04-26T11:46:37.852 INFO:tasks.workunit.client.0.smithi029.stdout:0/369: stat d9/d16/d52/f45 0 2024-04-26T11:46:37.852 INFO:tasks.workunit.client.0.smithi029.stdout:6/381: rename d7/d25/d4b/f6c to d7/d25/d4b/d6d/f78 0 2024-04-26T11:46:37.853 INFO:tasks.workunit.client.0.smithi029.stdout:4/304: symlink d3/d1d/db/d13/l59 0 2024-04-26T11:46:37.853 INFO:tasks.workunit.client.0.smithi029.stdout:5/351: creat db/d12/d1f/d39/d3b/f6d x:0 0 0 2024-04-26T11:46:37.854 INFO:tasks.workunit.client.0.smithi029.stdout:8/339: creat dc/de/d26/d57/f6d x:0 0 0 2024-04-26T11:46:37.854 INFO:tasks.workunit.client.0.smithi029.stdout:2/366: unlink d12/d24/d29/d36/f69 0 2024-04-26T11:46:37.854 INFO:tasks.workunit.client.0.smithi029.stdout:0/370: creat d9/d16/f89 x:0 0 0 2024-04-26T11:46:37.855 INFO:tasks.workunit.client.0.smithi029.stdout:1/441: write f2 [66545,58394] 0 2024-04-26T11:46:37.855 INFO:tasks.workunit.client.0.smithi029.stdout:4/305: creat d3/d1d/d11/d16/d1f/d3d/d39/f5a x:0 0 0 2024-04-26T11:46:37.857 INFO:tasks.workunit.client.0.smithi029.stdout:7/407: link d11/d18/d2d/f86 d11/d18/d35/d39/d7e/f87 0 2024-04-26T11:46:37.858 INFO:tasks.workunit.client.0.smithi029.stdout:1/442: mkdir d7/d25/d99 0 2024-04-26T11:46:37.858 INFO:tasks.workunit.client.0.smithi029.stdout:3/377: rename d0/l24 to d0/d1/d41/d5f/l88 0 2024-04-26T11:46:37.858 INFO:tasks.workunit.client.0.smithi029.stdout:7/408: chown d11/d15/d69/d84 404 1 2024-04-26T11:46:37.860 INFO:tasks.workunit.client.0.smithi029.stdout:5/352: rename db/d12/d1a/f28 to db/f6e 0 2024-04-26T11:46:37.861 INFO:tasks.workunit.client.0.smithi029.stdout:3/378: link d0/d1/d41/d5f/d54/f7d d0/dc/f89 0 2024-04-26T11:46:37.861 INFO:tasks.workunit.client.0.smithi029.stdout:4/306: getdents d3/d1d/d11/d16 0 2024-04-26T11:46:37.861 INFO:tasks.workunit.client.0.smithi029.stdout:0/371: rename d9/d16/d33/d2f/d31/f67 to d9/d43/f8a 0 2024-04-26T11:46:37.863 INFO:tasks.workunit.client.0.smithi029.stdout:6/382: truncate d7/d20/f40 4052304 0 2024-04-26T11:46:37.864 INFO:tasks.workunit.client.0.smithi029.stdout:5/353: creat db/d12/d1a/f6f x:0 0 0 2024-04-26T11:46:37.865 INFO:tasks.workunit.client.0.smithi029.stdout:1/443: rename d7/db/f4a to d7/d37/d98/f9a 0 2024-04-26T11:46:37.865 INFO:tasks.workunit.client.0.smithi029.stdout:2/367: dwrite fd [0,4194304] 0 2024-04-26T11:46:37.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/307: write d3/d1d/d11/d16/d1f/f52 [219549,120404] 0 2024-04-26T11:46:37.866 INFO:tasks.workunit.client.0.smithi029.stdout:0/372: rmdir d9/d16/d25 39 2024-04-26T11:46:37.866 INFO:tasks.workunit.client.0.smithi029.stdout:6/383: creat d7/d25/f79 x:0 0 0 2024-04-26T11:46:37.867 INFO:tasks.workunit.client.0.smithi029.stdout:3/379: read d0/dc/d1f/f5a [158925,41835] 0 2024-04-26T11:46:37.869 INFO:tasks.workunit.client.0.smithi029.stdout:9/415: dwrite d4/d5/d16/d39/f3c [0,4194304] 0 2024-04-26T11:46:37.869 INFO:tasks.workunit.client.0.smithi029.stdout:1/444: unlink d7/db/l83 0 2024-04-26T11:46:37.870 INFO:tasks.workunit.client.0.smithi029.stdout:7/409: dread d11/d37/d3b/f5a [0,4194304] 0 2024-04-26T11:46:37.871 INFO:tasks.workunit.client.0.smithi029.stdout:8/340: dwrite f1 [12582912,4194304] 0 2024-04-26T11:46:37.872 INFO:tasks.workunit.client.0.smithi029.stdout:2/368: truncate d12/d6c/d73/d4f/d65/f75 982353 0 2024-04-26T11:46:37.873 INFO:tasks.workunit.client.0.smithi029.stdout:2/369: readlink d12/d24/d29/d50/l78 0 2024-04-26T11:46:37.875 INFO:tasks.workunit.client.0.smithi029.stdout:3/380: symlink d0/d1/d41/d4c/l8a 0 2024-04-26T11:46:37.875 INFO:tasks.workunit.client.0.smithi029.stdout:4/308: symlink d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/l5b 0 2024-04-26T11:46:37.875 INFO:tasks.workunit.client.0.smithi029.stdout:2/370: stat d12/d24/d29/d36 0 2024-04-26T11:46:37.876 INFO:tasks.workunit.client.0.smithi029.stdout:6/384: rename d7/d20/d2f/d45/f59 to d7/d25/d5c/d34/d4c/f7a 0 2024-04-26T11:46:37.877 INFO:tasks.workunit.client.0.smithi029.stdout:9/416: mkdir d4/d5/d7a 0 2024-04-26T11:46:37.877 INFO:tasks.workunit.client.0.smithi029.stdout:7/410: symlink d11/d15/d67/l88 0 2024-04-26T11:46:37.878 INFO:tasks.workunit.client.0.smithi029.stdout:4/309: creat d3/d1d/f5c x:0 0 0 2024-04-26T11:46:37.878 INFO:tasks.workunit.client.0.smithi029.stdout:6/385: creat d7/d20/d27/f7b x:0 0 0 2024-04-26T11:46:37.878 INFO:tasks.workunit.client.0.smithi029.stdout:1/445: rmdir d7/db/d8d/d97 0 2024-04-26T11:46:37.879 INFO:tasks.workunit.client.0.smithi029.stdout:1/446: mknod d7/d25/d85/c9b 1 2024-04-26T11:46:37.880 INFO:tasks.workunit.client.0.smithi029.stdout:6/386: symlink d7/d20/d2f/l7c 0 2024-04-26T11:46:37.880 INFO:tasks.workunit.client.0.smithi029.stdout:5/354: dwrite db/d12/d1a/f27 [0,4194304] 0 2024-04-26T11:46:37.882 INFO:tasks.workunit.client.0.smithi029.stdout:1/447: write d7/f35 [550463,21834] 0 2024-04-26T11:46:37.882 INFO:tasks.workunit.client.0.smithi029.stdout:2/371: truncate d12/d6c/d73/f4c 1238837 0 2024-04-26T11:46:37.883 INFO:tasks.workunit.client.0.smithi029.stdout:7/411: getdents d11/d18/d1a/d33 0 2024-04-26T11:46:37.883 INFO:tasks.workunit.client.0.smithi029.stdout:0/373: dwrite d9/d16/d33/d2f/d68/f88 [0,4194304] 0 2024-04-26T11:46:37.884 INFO:tasks.workunit.client.0.smithi029.stdout:5/355: write db/d12/d1a/f51 [13081,65568] 0 2024-04-26T11:46:37.884 INFO:tasks.workunit.client.0.smithi029.stdout:1/448: rmdir d7/d25/d68/d4b/d66 39 2024-04-26T11:46:37.885 INFO:tasks.workunit.client.0.smithi029.stdout:7/412: read d11/d18/f29 [3858345,14592] 0 2024-04-26T11:46:37.885 INFO:tasks.workunit.client.0.smithi029.stdout:3/381: dread d0/d37/f55 [0,4194304] 0 2024-04-26T11:46:37.886 INFO:tasks.workunit.client.0.smithi029.stdout:6/387: rename d7/l5d to d7/d25/d4b/d4d/d65/l7d 0 2024-04-26T11:46:37.887 INFO:tasks.workunit.client.0.smithi029.stdout:5/356: readlink db/l32 0 2024-04-26T11:46:37.887 INFO:tasks.workunit.client.0.smithi029.stdout:6/388: mknod d7/d20/d2f/c7e 1 2024-04-26T11:46:37.888 INFO:tasks.workunit.client.0.smithi029.stdout:7/413: unlink d11/d18/d58/f5d 0 2024-04-26T11:46:37.888 INFO:tasks.workunit.client.0.smithi029.stdout:2/372: read d12/f1c [1948816,109713] 0 2024-04-26T11:46:37.888 INFO:tasks.workunit.client.0.smithi029.stdout:9/417: link d4/d46/f57 d4/d5/d78/f7b 0 2024-04-26T11:46:37.889 INFO:tasks.workunit.client.0.smithi029.stdout:8/341: dwrite dc/de/f5c [0,4194304] 0 2024-04-26T11:46:37.890 INFO:tasks.workunit.client.0.smithi029.stdout:1/449: read - d7/d25/d6d/d8c/f61 zero size 2024-04-26T11:46:37.890 INFO:tasks.workunit.client.0.smithi029.stdout:7/414: fdatasync d11/d18/d1a/f4a 0 2024-04-26T11:46:37.891 INFO:tasks.workunit.client.0.smithi029.stdout:0/374: getdents d9/d16/d25/d2a/d4b 0 2024-04-26T11:46:37.892 INFO:tasks.workunit.client.0.smithi029.stdout:1/450: write f6 [2050302,20907] 0 2024-04-26T11:46:37.892 INFO:tasks.workunit.client.0.smithi029.stdout:8/342: creat dc/de/d2e/f6e x:0 0 0 2024-04-26T11:46:37.893 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:37.889+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:37.893 INFO:tasks.workunit.client.0.smithi029.stdout:3/382: rename d0/d1/d41/d5f/f57 to d0/d1/d2b/d33/f8b 0 2024-04-26T11:46:37.893 INFO:tasks.workunit.client.0.smithi029.stdout:4/310: dread d3/d1d/d11/d16/d1f/d3d/d39/f32 [0,4194304] 0 2024-04-26T11:46:37.894 INFO:tasks.workunit.client.0.smithi029.stdout:4/311: stat d3/d1d/db/d13/d23/f4f 0 2024-04-26T11:46:37.894 INFO:tasks.workunit.client.0.smithi029.stdout:9/418: creat d4/d5/d78/f7c x:0 0 0 2024-04-26T11:46:37.894 INFO:tasks.workunit.client.0.smithi029.stdout:3/383: fsync d0/dc/f45 0 2024-04-26T11:46:37.894 INFO:tasks.workunit.client.0.smithi029.stdout:5/357: dread db/d12/d1a/f16 [0,4194304] 0 2024-04-26T11:46:37.894 INFO:tasks.workunit.client.0.smithi029.stdout:2/373: rename d12/l17 to d12/d24/d29/d36/l79 0 2024-04-26T11:46:37.894 INFO:tasks.workunit.client.0.smithi029.stdout:0/375: write d9/d16/d25/d2a/d4b/f5d [5278936,65005] 0 2024-04-26T11:46:37.895 INFO:tasks.workunit.client.0.smithi029.stdout:4/312: dread - d3/d1d/d11/d16/d1f/d3d/d46/f54 zero size 2024-04-26T11:46:37.895 INFO:tasks.workunit.client.0.smithi029.stdout:7/415: rename d11/d18/d58/f59 to d11/d18/d2d/f89 0 2024-04-26T11:46:37.896 INFO:tasks.workunit.client.0.smithi029.stdout:5/358: fsync db/d12/d1a/d4c/f55 0 2024-04-26T11:46:37.896 INFO:tasks.workunit.client.0.smithi029.stdout:1/451: rename d7/d25/d6d/d8c/l65 to d7/d25/d99/l9c 0 2024-04-26T11:46:37.897 INFO:tasks.workunit.client.0.smithi029.stdout:7/416: read d11/d18/f29 [1260396,70254] 0 2024-04-26T11:46:37.897 INFO:tasks.workunit.client.0.smithi029.stdout:4/313: fdatasync d3/d1d/d11/d16/d1f/d3d/d39/d30/f42 0 2024-04-26T11:46:37.898 INFO:tasks.workunit.client.0.smithi029.stdout:1/452: fdatasync d7/d25/d68/d4b/d66/f70 0 2024-04-26T11:46:37.901 INFO:tasks.workunit.client.0.smithi029.stdout:3/384: read d0/d1/d41/f42 [1416750,17944] 0 2024-04-26T11:46:37.904 INFO:tasks.workunit.client.0.smithi029.stdout:6/389: truncate d7/d20/d2f/f66 4339897 0 2024-04-26T11:46:37.904 INFO:tasks.workunit.client.0.smithi029.stdout:4/314: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d 0 2024-04-26T11:46:37.904 INFO:tasks.workunit.client.0.smithi029.stdout:3/385: read d0/d1/f43 [198862,41735] 0 2024-04-26T11:46:37.904 INFO:tasks.workunit.client.0.smithi029.stdout:9/419: truncate d4/d5/d16/d39/f3d 2342202 0 2024-04-26T11:46:37.904 INFO:tasks.workunit.client.0.smithi029.stdout:5/359: write db/d12/d1a/d4c/f58 [531291,16292] 0 2024-04-26T11:46:37.905 INFO:tasks.workunit.client.0.smithi029.stdout:8/343: mkdir dc/de/d2e/d23/d27/d6f 0 2024-04-26T11:46:37.905 INFO:tasks.workunit.client.0.smithi029.stdout:1/453: mkdir d7/db/d10/d1e/d53/d9d 0 2024-04-26T11:46:37.905 INFO:tasks.workunit.client.0.smithi029.stdout:6/390: creat d7/d46/f7f x:0 0 0 2024-04-26T11:46:37.905 INFO:tasks.workunit.client.0.smithi029.stdout:5/360: mkdir db/d40/d70 0 2024-04-26T11:46:37.905 INFO:tasks.workunit.client.0.smithi029.stdout:3/386: creat d0/d1/d2b/d33/f8c x:0 0 0 2024-04-26T11:46:37.905 INFO:tasks.workunit.client.0.smithi029.stdout:9/420: mkdir d4/d49/d7d 0 2024-04-26T11:46:37.908 INFO:tasks.workunit.client.0.smithi029.stdout:7/417: dread d11/d37/d3b/f5a [0,4194304] 0 2024-04-26T11:46:37.908 INFO:tasks.workunit.client.0.smithi029.stdout:6/391: chown d7/d20/d27/f7b 581 1 2024-04-26T11:46:37.908 INFO:tasks.workunit.client.0.smithi029.stdout:8/344: mknod dc/de/d2e/d23/d27/d24/d43/c70 1 2024-04-26T11:46:37.909 INFO:tasks.workunit.client.0.smithi029.stdout:4/315: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f5e x:0 0 0 2024-04-26T11:46:37.909 INFO:tasks.workunit.client.0.smithi029.stdout:8/345: sync 2024-04-26T11:46:37.909 INFO:tasks.workunit.client.0.smithi029.stdout:2/374: dread d12/d24/d29/f31 [0,4194304] 0 2024-04-26T11:46:37.909 INFO:tasks.workunit.client.0.smithi029.stdout:1/454: mkdir d7/db/d10/d1e/d5e/d9e 0 2024-04-26T11:46:37.909 INFO:tasks.workunit.client.0.smithi029.stdout:0/376: dwrite d9/d16/d25/d2a/f39 [0,4194304] 0 2024-04-26T11:46:37.909 INFO:tasks.workunit.client.0.smithi029.stdout:9/421: write d4/d5/d16/d39/f63 [4409215,85611] 0 2024-04-26T11:46:37.910 INFO:tasks.workunit.client.0.smithi029.stdout:8/346: mknod dc/de/d2e/d23/d27/d24/d43/c71 1 2024-04-26T11:46:37.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/418: chown d11/d18/d35/d39/d7e/f87 1652 1 2024-04-26T11:46:37.911 INFO:tasks.workunit.client.0.smithi029.stdout:7/419: fdatasync d11/d18/d35/f76 0 2024-04-26T11:46:37.911 INFO:tasks.workunit.client.0.smithi029.stdout:9/422: write d4/f64 [336997,114584] 0 2024-04-26T11:46:37.911 INFO:tasks.workunit.client.0.smithi029.stdout:0/377: creat d9/d16/d33/d2f/d31/d6a/f8b x:0 0 0 2024-04-26T11:46:37.912 INFO:tasks.workunit.client.0.smithi029.stdout:8/347: symlink dc/de/d2e/d23/d27/d24/l72 0 2024-04-26T11:46:37.912 INFO:tasks.workunit.client.0.smithi029.stdout:4/316: write d3/d1d/db/d13/d23/f43 [2077547,79806] 0 2024-04-26T11:46:37.914 INFO:tasks.workunit.client.0.smithi029.stdout:3/387: dread d0/d1/f7c [0,4194304] 0 2024-04-26T11:46:37.916 INFO:tasks.workunit.client.0.smithi029.stdout:0/378: symlink d9/d16/d25/d2a/d46/l8c 0 2024-04-26T11:46:37.916 INFO:tasks.workunit.client.0.smithi029.stdout:7/420: link d11/d18/d1a/d26/l42 d11/d15/d79/l8a 0 2024-04-26T11:46:37.916 INFO:tasks.workunit.client.0.smithi029.stdout:8/348: chown dc/de/d2e/d23/d27/f67 24993713 1 2024-04-26T11:46:37.917 INFO:tasks.workunit.client.0.smithi029.stdout:5/361: dwrite db/f6e [0,4194304] 0 2024-04-26T11:46:37.917 INFO:tasks.workunit.client.0.smithi029.stdout:4/317: creat d3/d1d/d11/d16/d1f/d3d/d46/f5f x:0 0 0 2024-04-26T11:46:37.918 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:37.919 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:37.920 INFO:tasks.workunit.client.0.smithi029.stdout:3/388: creat d0/dc/d1f/f8d x:0 0 0 2024-04-26T11:46:37.920 INFO:tasks.workunit.client.0.smithi029.stdout:7/421: symlink d11/d18/l8b 0 2024-04-26T11:46:37.920 INFO:tasks.workunit.client.0.smithi029.stdout:0/379: mkdir d9/d16/d8d 0 2024-04-26T11:46:37.920 INFO:tasks.workunit.client.0.smithi029.stdout:6/392: truncate d7/d20/d2f/f33 3561108 0 2024-04-26T11:46:37.921 INFO:tasks.workunit.client.0.smithi029.stdout:5/362: fsync db/d12/d1a/f24 0 2024-04-26T11:46:37.921 INFO:tasks.workunit.client.0.smithi029.stdout:1/455: dwrite d7/d25/d68/d4b/d66/f70 [0,4194304] 0 2024-04-26T11:46:37.922 INFO:tasks.workunit.client.0.smithi029.stdout:6/393: chown d7/d20/d27/f7b 305943 1 2024-04-26T11:46:37.922 INFO:tasks.workunit.client.0.smithi029.stdout:3/389: read d0/d37/f55 [517108,127126] 0 2024-04-26T11:46:37.922 INFO:tasks.workunit.client.0.smithi029.stdout:4/318: fdatasync d3/d1d/d11/d16/d1f/d3d/d46/f5f 0 2024-04-26T11:46:37.922 INFO:tasks.workunit.client.0.smithi029.stdout:8/349: rename dc/de/d2e/d23/d27/d24 to dc/de/d2e/d23/d27/d73 0 2024-04-26T11:46:37.922 INFO:tasks.workunit.client.0.smithi029.stdout:2/375: dread d12/d24/d29/d36/d4b/f64 [0,4194304] 0 2024-04-26T11:46:37.922 INFO:tasks.workunit.client.0.smithi029.stdout:0/380: mkdir d9/d16/d25/d2a/d8e 0 2024-04-26T11:46:37.922 INFO:tasks.workunit.client.0.smithi029.stdout:5/363: chown db/d12/d1a/f19 0 1 2024-04-26T11:46:37.922 INFO:tasks.workunit.client.0.smithi029.stdout:5/364: sync 2024-04-26T11:46:37.923 INFO:tasks.workunit.client.0.smithi029.stdout:2/376: readlink d12/l49 0 2024-04-26T11:46:37.923 INFO:tasks.workunit.client.0.smithi029.stdout:1/456: write d7/db/d10/d1e/d53/f7a [124789,90923] 0 2024-04-26T11:46:37.924 INFO:tasks.workunit.client.0.smithi029.stdout:0/381: write d9/d16/f24 [1979776,16364] 0 2024-04-26T11:46:37.924 INFO:tasks.workunit.client.0.smithi029.stdout:6/394: getdents d7/d25/d4b/d4d/d65 0 2024-04-26T11:46:37.924 INFO:tasks.workunit.client.0.smithi029.stdout:5/365: rmdir db/d12/d1f 39 2024-04-26T11:46:37.924 INFO:tasks.workunit.client.0.smithi029.stdout:0/382: stat d9/f84 0 2024-04-26T11:46:37.925 INFO:tasks.workunit.client.0.smithi029.stdout:3/390: dread d0/dc/d1f/f6b [0,4194304] 0 2024-04-26T11:46:37.925 INFO:tasks.workunit.client.0.smithi029.stdout:5/366: mknod db/d40/c71 1 2024-04-26T11:46:37.926 INFO:tasks.workunit.client.0.smithi029.stdout:7/422: write d11/d18/d1a/f23 [1346950,120745] 0 2024-04-26T11:46:37.926 INFO:tasks.workunit.client.0.smithi029.stdout:8/350: link dc/d3b/f5a dc/de/d2e/d23/d27/d73/d54/f74 0 2024-04-26T11:46:37.927 INFO:tasks.workunit.client.0.smithi029.stdout:3/391: symlink d0/d1/d41/l8e 0 2024-04-26T11:46:37.927 INFO:tasks.workunit.client.0.smithi029.stdout:7/423: dread - d11/d18/d2d/f89 zero size 2024-04-26T11:46:37.927 INFO:tasks.workunit.client.0.smithi029.stdout:4/319: link d3/d1d/d11/d16/d1f/f27 d3/d1d/d11/d16/d1f/d3d/f60 0 2024-04-26T11:46:37.928 INFO:tasks.workunit.client.0.smithi029.stdout:2/377: creat d12/d6c/d73/d4f/f7a x:0 0 0 2024-04-26T11:46:37.928 INFO:tasks.workunit.client.0.smithi029.stdout:1/457: symlink d7/db/d10/d1e/d53/d9d/l9f 0 2024-04-26T11:46:37.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:37.930 INFO:tasks.workunit.client.0.smithi029.stdout:2/378: dread - d12/d47/f5d zero size 2024-04-26T11:46:37.930 INFO:tasks.workunit.client.0.smithi029.stdout:2/379: mknod d12/d6c/d6e/c7b 1 2024-04-26T11:46:37.931 INFO:tasks.workunit.client.0.smithi029.stdout:7/424: creat d11/d18/d2d/f8c x:0 0 0 2024-04-26T11:46:37.931 INFO:tasks.workunit.client.0.smithi029.stdout:4/320: creat d3/d1d/d11/d16/d1f/f61 x:0 0 0 2024-04-26T11:46:37.932 INFO:tasks.workunit.client.0.smithi029.stdout:2/380: symlink d12/d24/d29/d50/l7c 0 2024-04-26T11:46:37.933 INFO:tasks.workunit.client.0.smithi029.stdout:5/367: rename db/d12/d1f to db/d12/d72 0 2024-04-26T11:46:37.933 INFO:tasks.workunit.client.0.smithi029.stdout:7/425: mkdir d11/d18/d58/d8d 0 2024-04-26T11:46:37.935 INFO:tasks.workunit.client.0.smithi029.stdout:1/458: getdents d7/d25 0 2024-04-26T11:46:37.936 INFO:tasks.workunit.client.0.smithi029.stdout:4/321: chown d3/d1d/d11/d16/d1f/d3d/l3e 691530 1 2024-04-26T11:46:37.936 INFO:tasks.workunit.client.0.smithi029.stdout:5/368: mkdir db/d40/d4d/d4f/d73 0 2024-04-26T11:46:37.937 INFO:tasks.workunit.client.0.smithi029.stdout:2/381: link d12/d6c/f72 d12/d24/d29/d50/f7d 0 2024-04-26T11:46:37.937 INFO:tasks.workunit.client.0.smithi029.stdout:7/426: getdents d11/d18/d58/d8d 0 2024-04-26T11:46:37.938 INFO:tasks.workunit.client.0.smithi029.stdout:8/351: dwrite dc/d3b/f50 [0,4194304] 0 2024-04-26T11:46:37.939 INFO:tasks.workunit.client.0.smithi029.stdout:3/392: dwrite d0/d1/d2b/d33/f8c [0,4194304] 0 2024-04-26T11:46:37.940 INFO:tasks.workunit.client.0.smithi029.stdout:4/322: creat d3/d1d/d11/d16/d1f/d3d/f62 x:0 0 0 2024-04-26T11:46:37.940 INFO:tasks.workunit.client.0.smithi029.stdout:1/459: rename d7/d25/f59 to d7/db/d10/d1e/d53/d9d/fa0 0 2024-04-26T11:46:37.941 INFO:tasks.workunit.client.0.smithi029.stdout:6/395: dread d7/d25/d5c/d34/f38 [0,4194304] 0 2024-04-26T11:46:37.941 INFO:tasks.workunit.client.0.smithi029.stdout:8/352: write dc/de/d2e/f46 [1226454,2846] 0 2024-04-26T11:46:37.942 INFO:tasks.workunit.client.0.smithi029.stdout:3/393: stat d0/dc/d1f/f8d 0 2024-04-26T11:46:37.942 INFO:tasks.workunit.client.0.smithi029.stdout:5/369: creat db/d40/d4d/d4f/d73/f74 x:0 0 0 2024-04-26T11:46:37.944 INFO:tasks.workunit.client.0.smithi029.stdout:2/382: rename d12 to d12/d6c/d73/d4f/d7e 22 2024-04-26T11:46:37.944 INFO:tasks.workunit.client.0.smithi029.stdout:4/323: chown d3/d1d/d11/d16/d1f/d3d/d46/f5f 465161112 1 2024-04-26T11:46:37.946 INFO:tasks.workunit.client.0.smithi029.stdout:6/396: truncate d7/d20/d2f/f3d 250537 0 2024-04-26T11:46:37.946 INFO:tasks.workunit.client.0.smithi029.stdout:4/324: dread - d3/d1d/d11/d16/d1f/d3d/d46/f5f zero size 2024-04-26T11:46:37.947 INFO:tasks.workunit.client.0.smithi029.stdout:0/383: truncate d9/d16/d25/d2a/d74/f87 2101532 0 2024-04-26T11:46:37.948 INFO:tasks.workunit.client.0.smithi029.stdout:3/394: creat d0/dc/d80/f8f x:0 0 0 2024-04-26T11:46:37.948 INFO:tasks.workunit.client.0.smithi029.stdout:8/353: mkdir dc/d75 0 2024-04-26T11:46:37.949 INFO:tasks.workunit.client.0.smithi029.stdout:1/460: creat d7/d37/fa1 x:0 0 0 2024-04-26T11:46:37.949 INFO:tasks.workunit.client.0.smithi029.stdout:9/423: dread d4/d5/f45 [0,4194304] 0 2024-04-26T11:46:37.950 INFO:tasks.workunit.client.0.smithi029.stdout:7/427: dwrite d11/d15/f36 [0,4194304] 0 2024-04-26T11:46:37.951 INFO:tasks.workunit.client.0.smithi029.stdout:1/461: dread - d7/db/d10/f74 zero size 2024-04-26T11:46:37.951 INFO:tasks.workunit.client.0.smithi029.stdout:7/428: readlink d11/d18/d1a/d33/l51 0 2024-04-26T11:46:37.952 INFO:tasks.workunit.client.0.smithi029.stdout:5/370: rename db/d12/d1a/f24 to db/f75 0 2024-04-26T11:46:37.952 INFO:tasks.workunit.client.0.smithi029.stdout:9/424: mknod d4/c7e 1 2024-04-26T11:46:37.953 INFO:tasks.workunit.client.0.smithi029.stdout:1/462: creat d7/db/d10/d20/fa2 x:0 0 0 2024-04-26T11:46:37.953 INFO:tasks.workunit.client.0.smithi029.stdout:8/354: stat dc/de/d2e/d23/l35 0 2024-04-26T11:46:37.954 INFO:tasks.workunit.client.0.smithi029.stdout:6/397: write d7/d20/d2f/f33 [684357,53446] 0 2024-04-26T11:46:37.956 INFO:tasks.workunit.client.0.smithi029.stdout:7/429: creat d11/d15/f8e x:0 0 0 2024-04-26T11:46:37.957 INFO:tasks.workunit.client.0.smithi029.stdout:5/371: creat db/f76 x:0 0 0 2024-04-26T11:46:37.957 INFO:tasks.workunit.client.0.smithi029.stdout:4/325: getdents d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56 0 2024-04-26T11:46:37.958 INFO:tasks.workunit.client.0.smithi029.stdout:6/398: chown d7/d20/d2f/d45 1 1 2024-04-26T11:46:37.958 INFO:tasks.workunit.client.0.smithi029.stdout:8/355: mknod dc/de/d2e/d23/d27/d73/d43/d48/d62/c76 1 2024-04-26T11:46:37.958 INFO:tasks.workunit.client.0.smithi029.stdout:5/372: mkdir db/d40/d77 0 2024-04-26T11:46:37.960 INFO:tasks.workunit.client.0.smithi029.stdout:1/463: getdents d7/db/d10/d1e/d53/d9d 0 2024-04-26T11:46:37.960 INFO:tasks.workunit.client.0.smithi029.stdout:0/384: dwrite d9/d16/d52/f45 [4194304,4194304] 0 2024-04-26T11:46:37.963 INFO:tasks.workunit.client.0.smithi029.stdout:8/356: getdents dc/d75 0 2024-04-26T11:46:37.963 INFO:tasks.workunit.client.0.smithi029.stdout:3/395: dwrite d0/d1/d2f/f3a [0,4194304] 0 2024-04-26T11:46:37.964 INFO:tasks.workunit.client.0.smithi029.stdout:4/326: truncate d3/d1d/d11/d16/d1f/f55 810664 0 2024-04-26T11:46:37.964 INFO:tasks.workunit.client.0.smithi029.stdout:1/464: creat d7/db/fa3 x:0 0 0 2024-04-26T11:46:37.964 INFO:tasks.workunit.client.0.smithi029.stdout:5/373: rename db/d40/f50 to db/d12/f78 0 2024-04-26T11:46:37.965 INFO:tasks.workunit.client.0.smithi029.stdout:5/374: sync 2024-04-26T11:46:37.965 INFO:tasks.workunit.client.0.smithi029.stdout:7/430: truncate d11/d37/f4f 2627422 0 2024-04-26T11:46:37.965 INFO:tasks.workunit.client.0.smithi029.stdout:8/357: chown dc/de/d2e/f6e 155222387 1 2024-04-26T11:46:37.966 INFO:tasks.workunit.client.0.smithi029.stdout:3/396: fdatasync d0/dc/f71 0 2024-04-26T11:46:37.968 INFO:tasks.workunit.client.0.smithi029.stdout:3/397: mknod d0/d37/c90 1 2024-04-26T11:46:37.968 INFO:tasks.workunit.client.0.smithi029.stdout:0/385: rename d9/d16/d33/d2f/d31/f63 to d9/d16/d25/d2a/d74/f8f 0 2024-04-26T11:46:37.968 INFO:tasks.workunit.client.0.smithi029.stdout:2/383: dread f6 [0,4194304] 0 2024-04-26T11:46:37.968 INFO:tasks.workunit.client.0.smithi029.stdout:9/425: dwrite d4/d5/d16/d39/f3c [4194304,4194304] 0 2024-04-26T11:46:37.968 INFO:tasks.workunit.client.0.smithi029.stdout:1/465: truncate d7/d25/f2e 1545304 0 2024-04-26T11:46:37.969 INFO:tasks.workunit.client.0.smithi029.stdout:7/431: chown d11/d18/d1a/d33/f75 1402595 1 2024-04-26T11:46:37.969 INFO:tasks.workunit.client.0.smithi029.stdout:4/327: dread - d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f5e zero size 2024-04-26T11:46:37.969 INFO:tasks.workunit.client.0.smithi029.stdout:3/398: symlink d0/d1/l91 0 2024-04-26T11:46:37.970 INFO:tasks.workunit.client.0.smithi029.stdout:8/358: creat dc/d12/d6a/f77 x:0 0 0 2024-04-26T11:46:37.970 INFO:tasks.workunit.client.0.smithi029.stdout:0/386: mkdir d9/d16/d33/d2f/d32/d90 0 2024-04-26T11:46:37.970 INFO:tasks.workunit.client.0.smithi029.stdout:2/384: fsync d12/d24/d29/f71 0 2024-04-26T11:46:37.970 INFO:tasks.workunit.client.0.smithi029.stdout:1/466: symlink d7/d25/d99/la4 0 2024-04-26T11:46:37.971 INFO:tasks.workunit.client.0.smithi029.stdout:9/426: truncate d4/d46/f57 835075 0 2024-04-26T11:46:37.971 INFO:tasks.workunit.client.0.smithi029.stdout:7/432: chown d11/d18/d1a/d26/l42 28771390 1 2024-04-26T11:46:37.972 INFO:tasks.workunit.client.0.smithi029.stdout:2/385: chown d12/d24/d29/d50/d55/l66 31510 1 2024-04-26T11:46:37.973 INFO:tasks.workunit.client.0.smithi029.stdout:3/399: write d0/d1/f7c [967910,23578] 0 2024-04-26T11:46:37.974 INFO:tasks.workunit.client.0.smithi029.stdout:5/375: dread db/d12/d1a/f33 [0,4194304] 0 2024-04-26T11:46:37.975 INFO:tasks.workunit.client.0.smithi029.stdout:5/376: chown db/d12/d1a/f19 208768 1 2024-04-26T11:46:37.976 INFO:tasks.workunit.client.0.smithi029.stdout:8/359: rename dc/de/d2e/d23/d27/d73/d43/d48 to dc/d12/d6a/d78 0 2024-04-26T11:46:37.976 INFO:tasks.workunit.client.0.smithi029.stdout:3/400: mkdir d0/dc/d1f/d92 0 2024-04-26T11:46:37.977 INFO:tasks.workunit.client.0.smithi029.stdout:5/377: write db/d12/f5c [152338,63785] 0 2024-04-26T11:46:37.978 INFO:tasks.workunit.client.0.smithi029.stdout:2/386: write d12/f1a [4123905,95789] 0 2024-04-26T11:46:37.978 INFO:tasks.workunit.client.0.smithi029.stdout:8/360: fsync dc/de/d26/d57/f6d 0 2024-04-26T11:46:37.978 INFO:tasks.workunit.client.0.smithi029.stdout:3/401: dread - d0/d1/d5c/f78 zero size 2024-04-26T11:46:37.980 INFO:tasks.workunit.client.0.smithi029.stdout:5/378: dread db/d12/d1a/f33 [0,4194304] 0 2024-04-26T11:46:37.982 INFO:tasks.workunit.client.0.smithi029.stdout:4/328: dwrite d3/d1d/f3f [0,4194304] 0 2024-04-26T11:46:37.982 INFO:tasks.workunit.client.0.smithi029.stdout:8/361: stat dc/de/d2e/f46 0 2024-04-26T11:46:37.982 INFO:tasks.workunit.client.0.smithi029.stdout:2/387: write d12/d24/d29/f48 [3045264,15346] 0 2024-04-26T11:46:37.983 INFO:tasks.workunit.client.0.smithi029.stdout:1/467: dwrite d7/f1c [0,4194304] 0 2024-04-26T11:46:37.983 INFO:tasks.workunit.client.0.smithi029.stdout:0/387: truncate d9/d16/d33/f35 1398149 0 2024-04-26T11:46:37.986 INFO:tasks.workunit.client.0.smithi029.stdout:4/329: unlink d3/d50/f53 0 2024-04-26T11:46:37.987 INFO:tasks.workunit.client.0.smithi029.stdout:5/379: write db/d12/d1a/f49 [4431431,49243] 0 2024-04-26T11:46:37.989 INFO:tasks.workunit.client.0.smithi029.stdout:9/427: dwrite d4/d5/f51 [4194304,4194304] 0 2024-04-26T11:46:37.989 INFO:tasks.workunit.client.0.smithi029.stdout:4/330: write d3/f47 [3644897,59743] 0 2024-04-26T11:46:37.989 INFO:tasks.workunit.client.0.smithi029.stdout:1/468: rename d7/d37/d3e/f2f to d7/d37/d98/fa5 0 2024-04-26T11:46:37.989 INFO:tasks.workunit.client.0.smithi029.stdout:5/380: rmdir db/d12/d1a 39 2024-04-26T11:46:37.992 INFO:tasks.workunit.client.0.smithi029.stdout:3/402: write d0/d1/f49 [536379,6394] 0 2024-04-26T11:46:37.993 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:37.989+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:37.994 INFO:tasks.workunit.client.0.smithi029.stdout:2/388: truncate d12/f1a 4287590 0 2024-04-26T11:46:37.994 INFO:tasks.workunit.client.0.smithi029.stdout:9/428: rename d4/d5/d7/ff to d4/f7f 0 2024-04-26T11:46:37.994 INFO:tasks.workunit.client.0.smithi029.stdout:5/381: truncate db/d12/d1a/f68 757506 0 2024-04-26T11:46:37.994 INFO:tasks.workunit.client.0.smithi029.stdout:4/331: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f63 x:0 0 0 2024-04-26T11:46:37.994 INFO:tasks.workunit.client.0.smithi029.stdout:1/469: link d7/d25/d68/l32 d7/d25/d99/la6 0 2024-04-26T11:46:37.995 INFO:tasks.workunit.client.0.smithi029.stdout:8/362: dwrite dc/de/d2e/d23/d27/f67 [0,4194304] 0 2024-04-26T11:46:37.996 INFO:tasks.workunit.client.0.smithi029.stdout:9/429: chown d4/d5/d16/l66 24569448 1 2024-04-26T11:46:37.998 INFO:tasks.workunit.client.0.smithi029.stdout:0/388: dwrite d9/d16/d33/d2f/f50 [0,4194304] 0 2024-04-26T11:46:38.000 INFO:tasks.workunit.client.0.smithi029.stdout:8/363: creat dc/d75/f79 x:0 0 0 2024-04-26T11:46:38.000 INFO:tasks.workunit.client.0.smithi029.stdout:1/470: creat d7/d37/d3e/fa7 x:0 0 0 2024-04-26T11:46:38.000 INFO:tasks.workunit.client.0.smithi029.stdout:9/430: mkdir d4/d5/d16/d80 0 2024-04-26T11:46:38.001 INFO:tasks.workunit.client.0.smithi029.stdout:1/471: mknod d7/ca8 1 2024-04-26T11:46:38.001 INFO:tasks.workunit.client.0.smithi029.stdout:9/431: readlink d4/l3e 0 2024-04-26T11:46:38.002 INFO:tasks.workunit.client.0.smithi029.stdout:0/389: rename d9/d16/f22 to d9/d16/d25/d2a/d74/f91 0 2024-04-26T11:46:38.005 INFO:tasks.workunit.client.0.smithi029.stdout:3/403: dwrite d0/d1/f5d [0,4194304] 0 2024-04-26T11:46:38.005 INFO:tasks.workunit.client.0.smithi029.stdout:9/432: link d4/l12 d4/d46/l81 0 2024-04-26T11:46:38.005 INFO:tasks.workunit.client.0.smithi029.stdout:0/390: chown d9/d16/d33/d2f/d31 1023 1 2024-04-26T11:46:38.007 INFO:tasks.workunit.client.0.smithi029.stdout:7/433: dwrite d11/d37/f4f [0,4194304] 0 2024-04-26T11:46:38.008 INFO:tasks.workunit.client.0.smithi029.stdout:3/404: symlink d0/dc/l93 0 2024-04-26T11:46:38.008 INFO:tasks.workunit.client.0.smithi029.stdout:0/391: write d9/d16/d25/d2a/d46/f5a [761208,118856] 0 2024-04-26T11:46:38.010 INFO:tasks.workunit.client.0.smithi029.stdout:4/332: dwrite d3/d1d/f12 [0,4194304] 0 2024-04-26T11:46:38.011 INFO:tasks.workunit.client.0.smithi029.stdout:0/392: symlink d9/d43/l92 0 2024-04-26T11:46:38.011 INFO:tasks.workunit.client.0.smithi029.stdout:9/433: getdents d4/d5/d7 0 2024-04-26T11:46:38.011 INFO:tasks.workunit.client.0.smithi029.stdout:2/389: dwrite d12/f1b [0,4194304] 0 2024-04-26T11:46:38.012 INFO:tasks.workunit.client.0.smithi029.stdout:7/434: rename d11/d18/d58/f6f to d11/d18/d35/d39/f8f 0 2024-04-26T11:46:38.013 INFO:tasks.workunit.client.0.smithi029.stdout:9/434: symlink d4/l82 0 2024-04-26T11:46:38.013 INFO:tasks.workunit.client.0.smithi029.stdout:2/390: symlink d12/d24/d2f/l7f 0 2024-04-26T11:46:38.013 INFO:tasks.workunit.client.0.smithi029.stdout:0/393: symlink d9/d16/d33/d2f/d68/l93 0 2024-04-26T11:46:38.014 INFO:tasks.workunit.client.0.smithi029.stdout:9/435: stat d4/d5/d16/d39/f63 0 2024-04-26T11:46:38.014 INFO:tasks.workunit.client.0.smithi029.stdout:6/399: dread d7/d20/d27/f2b [0,4194304] 0 2024-04-26T11:46:38.015 INFO:tasks.workunit.client.0.smithi029.stdout:1/472: dwrite d7/db/d10/d1e/d53/d9d/fa0 [0,4194304] 0 2024-04-26T11:46:38.017 INFO:tasks.workunit.client.0.smithi029.stdout:9/436: write d4/d5/d16/d39/f63 [1723790,96237] 0 2024-04-26T11:46:38.017 INFO:tasks.workunit.client.0.smithi029.stdout:2/391: creat d12/d6c/d73/d4f/f80 x:0 0 0 2024-04-26T11:46:38.019 INFO:tasks.workunit.client.0.smithi029.stdout:2/392: chown d12/f1c 10 1 2024-04-26T11:46:38.019 INFO:tasks.workunit.client.0.smithi029.stdout:2/393: write d12/d24/d29/f71 [405323,60009] 0 2024-04-26T11:46:38.019 INFO:tasks.workunit.client.0.smithi029.stdout:2/394: readlink d12/d24/d29/d38/d52/l63 0 2024-04-26T11:46:38.020 INFO:tasks.workunit.client.0.smithi029.stdout:2/395: readlink d12/d24/d29/d50/l78 0 2024-04-26T11:46:38.021 INFO:tasks.workunit.client.0.smithi029.stdout:2/396: mkdir d12/d6c/d73/d4f/d65/d81 0 2024-04-26T11:46:38.022 INFO:tasks.workunit.client.0.smithi029.stdout:2/397: rename d12/d24/d29 to d12/d24/d29/d50/d6a/d82 22 2024-04-26T11:46:38.024 INFO:tasks.workunit.client.0.smithi029.stdout:0/394: truncate d9/d16/f24 3512660 0 2024-04-26T11:46:38.024 INFO:tasks.workunit.client.0.smithi029.stdout:1/473: truncate d7/d25/d68/f60 3100829 0 2024-04-26T11:46:38.025 INFO:tasks.workunit.client.0.smithi029.stdout:2/398: mknod d12/d24/d29/d38/c83 1 2024-04-26T11:46:38.025 INFO:tasks.workunit.client.0.smithi029.stdout:0/395: chown d9/d16/d52/f2c 75 1 2024-04-26T11:46:38.026 INFO:tasks.workunit.client.0.smithi029.stdout:0/396: rmdir d9/d16/d25/d2a/d46 39 2024-04-26T11:46:38.026 INFO:tasks.workunit.client.0.smithi029.stdout:2/399: write d12/d24/d29/d36/d4b/f64 [502352,20370] 0 2024-04-26T11:46:38.031 INFO:tasks.workunit.client.0.smithi029.stdout:1/474: dwrite d7/f78 [0,4194304] 0 2024-04-26T11:46:38.032 INFO:tasks.workunit.client.0.smithi029.stdout:5/382: sync 2024-04-26T11:46:38.034 INFO:tasks.workunit.client.0.smithi029.stdout:1/475: fsync d7/db/f1d 0 2024-04-26T11:46:38.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/400: dwrite d12/d24/d29/d36/f43 [0,4194304] 0 2024-04-26T11:46:38.035 INFO:tasks.workunit.client.0.smithi029.stdout:1/476: readlink d7/db/d10/d20/l8b 0 2024-04-26T11:46:38.036 INFO:tasks.workunit.client.0.smithi029.stdout:1/477: chown d7/db/d10/d1e/f73 6495 1 2024-04-26T11:46:38.036 INFO:tasks.workunit.client.0.smithi029.stdout:2/401: creat d12/d6c/d73/d4f/d65/f84 x:0 0 0 2024-04-26T11:46:38.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/478: chown d7/db/d10/d20/l7e 57 1 2024-04-26T11:46:38.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/479: chown l5 943 1 2024-04-26T11:46:38.040 INFO:tasks.workunit.client.0.smithi029.stdout:1/480: write d7/db/d8d/f96 [366275,28371] 0 2024-04-26T11:46:38.041 INFO:tasks.workunit.client.0.smithi029.stdout:1/481: unlink d7/db/d10/d1e/f26 0 2024-04-26T11:46:38.042 INFO:tasks.workunit.client.0.smithi029.stdout:1/482: write d7/db/d10/f74 [781976,15687] 0 2024-04-26T11:46:38.044 INFO:tasks.workunit.client.0.smithi029.stdout:1/483: write d7/d5b/f81 [1782852,38255] 0 2024-04-26T11:46:38.044 INFO:tasks.workunit.client.0.smithi029.stdout:1/484: readlink d7/db/d10/d20/l8b 0 2024-04-26T11:46:38.046 INFO:tasks.workunit.client.0.smithi029.stdout:4/333: dread d3/f14 [0,4194304] 0 2024-04-26T11:46:38.048 INFO:tasks.workunit.client.0.smithi029.stdout:4/334: rmdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56 39 2024-04-26T11:46:38.051 INFO:tasks.workunit.client.0.smithi029.stdout:0/397: dread d9/d16/d25/d2a/d46/f5a [0,4194304] 0 2024-04-26T11:46:38.052 INFO:tasks.workunit.client.0.smithi029.stdout:0/398: stat d9/d16/d33/f56 0 2024-04-26T11:46:38.053 INFO:tasks.workunit.client.0.smithi029.stdout:0/399: mknod d9/d16/d33/d2f/c94 1 2024-04-26T11:46:38.054 INFO:tasks.workunit.client.0.smithi029.stdout:0/400: dread - d9/d16/d25/f6c zero size 2024-04-26T11:46:38.056 INFO:tasks.workunit.client.0.smithi029.stdout:0/401: symlink d9/d16/d25/d2a/d74/l95 0 2024-04-26T11:46:38.057 INFO:tasks.workunit.client.0.smithi029.stdout:4/335: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/f42 [0,4194304] 0 2024-04-26T11:46:38.060 INFO:tasks.workunit.client.0.smithi029.stdout:4/336: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/c64 1 2024-04-26T11:46:38.060 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:38.060 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:38.061 INFO:tasks.workunit.client.0.smithi029.stdout:4/337: mknod d3/d1d/db/d13/d23/c65 1 2024-04-26T11:46:38.061 INFO:tasks.workunit.client.0.smithi029.stdout:2/402: dwrite d12/d6c/d73/d40/f5b [4194304,4194304] 0 2024-04-26T11:46:38.062 INFO:tasks.workunit.client.0.smithi029.stdout:2/403: fsync fd 0 2024-04-26T11:46:38.062 INFO:tasks.workunit.client.0.smithi029.stdout:4/338: creat d3/f66 x:0 0 0 2024-04-26T11:46:38.063 INFO:tasks.workunit.client.0.smithi029.stdout:4/339: dread - d3/d1d/db/f41 zero size 2024-04-26T11:46:38.067 INFO:tasks.workunit.client.0.smithi029.stdout:4/340: chown d3/d1d/d11/d16/d1f/d3d/l3e 453 1 2024-04-26T11:46:38.068 INFO:tasks.workunit.client.0.smithi029.stdout:6/400: sync 2024-04-26T11:46:38.068 INFO:tasks.workunit.client.0.smithi029.stdout:5/383: sync 2024-04-26T11:46:38.068 INFO:tasks.workunit.client.0.smithi029.stdout:7/435: sync 2024-04-26T11:46:38.068 INFO:tasks.workunit.client.0.smithi029.stdout:9/437: sync 2024-04-26T11:46:38.068 INFO:tasks.workunit.client.0.smithi029.stdout:3/405: sync 2024-04-26T11:46:38.068 INFO:tasks.workunit.client.0.smithi029.stdout:1/485: sync 2024-04-26T11:46:38.069 INFO:tasks.workunit.client.0.smithi029.stdout:5/384: mkdir db/d40/d4d/d79 0 2024-04-26T11:46:38.070 INFO:tasks.workunit.client.0.smithi029.stdout:3/406: write d0/d1/d41/f83 [632428,49604] 0 2024-04-26T11:46:38.071 INFO:tasks.workunit.client.0.smithi029.stdout:9/438: getdents d4/d49/d7d 0 2024-04-26T11:46:38.071 INFO:tasks.workunit.client.0.smithi029.stdout:6/401: fdatasync d7/d25/d5c/d34/f38 0 2024-04-26T11:46:38.071 INFO:tasks.workunit.client.0.smithi029.stdout:1/486: write d7/db/d8d/f96 [154005,121865] 0 2024-04-26T11:46:38.071 INFO:tasks.workunit.client.0.smithi029.stdout:0/402: dwrite d9/d16/d33/d2f/d68/f79 [0,4194304] 0 2024-04-26T11:46:38.071 INFO:tasks.workunit.client.0.smithi029.stdout:5/385: dread - db/f76 zero size 2024-04-26T11:46:38.072 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:38.073 INFO:tasks.workunit.client.0.smithi029.stdout:9/439: dread - d4/d5/f4a zero size 2024-04-26T11:46:38.073 INFO:tasks.workunit.client.0.smithi029.stdout:3/407: creat d0/d1/d41/d4c/f94 x:0 0 0 2024-04-26T11:46:38.073 INFO:tasks.workunit.client.0.smithi029.stdout:5/386: symlink db/d12/d72/d39/d3b/l7a 0 2024-04-26T11:46:38.073 INFO:tasks.workunit.client.0.smithi029.stdout:6/402: truncate d7/d20/d2f/f52 809948 0 2024-04-26T11:46:38.074 INFO:tasks.workunit.client.0.smithi029.stdout:9/440: stat d4/d5/d7/l2f 0 2024-04-26T11:46:38.074 INFO:tasks.workunit.client.0.smithi029.stdout:6/403: readlink l1 0 2024-04-26T11:46:38.074 INFO:tasks.workunit.client.0.smithi029.stdout:2/404: truncate d12/d24/d29/d36/f3b 1932302 0 2024-04-26T11:46:38.077 INFO:tasks.workunit.client.0.smithi029.stdout:5/387: symlink db/d12/d1a/l7b 0 2024-04-26T11:46:38.077 INFO:tasks.workunit.client.0.smithi029.stdout:2/405: chown d12/d24/d29/f71 3702 1 2024-04-26T11:46:38.077 INFO:tasks.workunit.client.0.smithi029.stdout:9/441: unlink d4/d5/d16/l26 0 2024-04-26T11:46:38.079 INFO:tasks.workunit.client.0.smithi029.stdout:4/341: link d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f63 d3/d1d/d11/d16/d1f/f67 0 2024-04-26T11:46:38.079 INFO:tasks.workunit.client.0.smithi029.stdout:3/408: fdatasync d0/d1/d13/f14 0 2024-04-26T11:46:38.079 INFO:tasks.workunit.client.0.smithi029.stdout:5/388: chown db/d12/d1a 351346117 1 2024-04-26T11:46:38.080 INFO:tasks.workunit.client.0.smithi029.stdout:2/406: mknod d12/d24/d29/d50/d55/c85 1 2024-04-26T11:46:38.080 INFO:tasks.workunit.client.0.smithi029.stdout:3/409: stat d0/d1 0 2024-04-26T11:46:38.082 INFO:tasks.workunit.client.0.smithi029.stdout:8/364: dread dc/de/d2e/f2a [0,4194304] 0 2024-04-26T11:46:38.085 INFO:tasks.workunit.client.0.smithi029.stdout:3/410: symlink d0/dc/d80/l95 0 2024-04-26T11:46:38.085 INFO:tasks.workunit.client.0.smithi029.stdout:5/389: read db/d12/d1a/d4c/f55 [3144842,50285] 0 2024-04-26T11:46:38.086 INFO:tasks.workunit.client.0.smithi029.stdout:4/342: fsync d3/d1d/d11/d16/d1f/d3d/d46/f54 0 2024-04-26T11:46:38.087 INFO:tasks.workunit.client.0.smithi029.stdout:7/436: dwrite d11/d18/d2d/f8c [0,4194304] 0 2024-04-26T11:46:38.089 INFO:tasks.workunit.client.0.smithi029.stdout:0/403: dwrite d9/d16/d25/d2a/d46/f70 [0,4194304] 0 2024-04-26T11:46:38.089 INFO:tasks.workunit.client.0.smithi029.stdout:6/404: dwrite d7/d46/d69/f77 [0,4194304] 0 2024-04-26T11:46:38.089 INFO:tasks.workunit.client.0.smithi029.stdout:3/411: chown d0/dc/f45 0 1 2024-04-26T11:46:38.091 INFO:tasks.workunit.client.0.smithi029.stdout:5/390: write db/d12/d72/f3d [1987555,31857] 0 2024-04-26T11:46:38.091 INFO:tasks.workunit.client.0.smithi029.stdout:4/343: fsync d3/d1d/db/f41 0 2024-04-26T11:46:38.092 INFO:tasks.workunit.client.0.smithi029.stdout:2/407: write d12/d24/d29/d36/f43 [577693,67307] 0 2024-04-26T11:46:38.092 INFO:tasks.workunit.client.0.smithi029.stdout:0/404: sync 2024-04-26T11:46:38.092 INFO:tasks.workunit.client.0.smithi029.stdout:7/437: stat d11/d15/d79/l82 0 2024-04-26T11:46:38.093 INFO:tasks.workunit.client.0.smithi029.stdout:1/487: dwrite d7/f36 [0,4194304] 0 2024-04-26T11:46:38.093 INFO:tasks.workunit.client.0.smithi029.stdout:0/405: readlink d9/l15 0 2024-04-26T11:46:38.094 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:38.093+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:38.094 INFO:tasks.workunit.client.0.smithi029.stdout:8/365: creat dc/de/d2e/d23/d27/d6f/f7a x:0 0 0 2024-04-26T11:46:38.096 INFO:tasks.workunit.client.0.smithi029.stdout:3/412: symlink d0/d1/d2b/d33/l96 0 2024-04-26T11:46:38.096 INFO:tasks.workunit.client.0.smithi029.stdout:5/391: chown db/f20 2 1 2024-04-26T11:46:38.096 INFO:tasks.workunit.client.0.smithi029.stdout:3/413: sync 2024-04-26T11:46:38.096 INFO:tasks.workunit.client.0.smithi029.stdout:9/442: dwrite d4/d5/f51 [4194304,4194304] 0 2024-04-26T11:46:38.096 INFO:tasks.workunit.client.0.smithi029.stdout:1/488: unlink f6 0 2024-04-26T11:46:38.096 INFO:tasks.workunit.client.0.smithi029.stdout:6/405: write d7/d25/d4b/f6e [2675169,47280] 0 2024-04-26T11:46:38.097 INFO:tasks.workunit.client.0.smithi029.stdout:2/408: getdents d12/d24/d2f/d76 0 2024-04-26T11:46:38.097 INFO:tasks.workunit.client.0.smithi029.stdout:4/344: truncate d3/d1d/db/d13/d23/f4f 305505 0 2024-04-26T11:46:38.097 INFO:tasks.workunit.client.0.smithi029.stdout:2/409: mknod d12/d24/d29/d38/d52/c86 1 2024-04-26T11:46:38.097 INFO:tasks.workunit.client.0.smithi029.stdout:0/406: symlink d9/d16/d25/d2a/d46/l96 0 2024-04-26T11:46:38.098 INFO:tasks.workunit.client.0.smithi029.stdout:7/438: getdents d11/d18/d35/d7c 0 2024-04-26T11:46:38.098 INFO:tasks.workunit.client.0.smithi029.stdout:9/443: read - d4/d49/f4b zero size 2024-04-26T11:46:38.098 INFO:tasks.workunit.client.0.smithi029.stdout:2/410: unlink d12/l49 0 2024-04-26T11:46:38.099 INFO:tasks.workunit.client.0.smithi029.stdout:4/345: mknod d3/d1d/d11/d16/d1f/d3d/c68 1 2024-04-26T11:46:38.099 INFO:tasks.workunit.client.0.smithi029.stdout:5/392: creat db/d12/f7c x:0 0 0 2024-04-26T11:46:38.100 INFO:tasks.workunit.client.0.smithi029.stdout:9/444: creat d4/d5/d16/d80/f83 x:0 0 0 2024-04-26T11:46:38.100 INFO:tasks.workunit.client.0.smithi029.stdout:0/407: symlink d9/d16/d33/d2f/d32/d90/l97 0 2024-04-26T11:46:38.100 INFO:tasks.workunit.client.0.smithi029.stdout:4/346: chown d3/d1d/d11/d16/d1f/d3d 2 1 2024-04-26T11:46:38.101 INFO:tasks.workunit.client.0.smithi029.stdout:2/411: write d12/d24/d2f/f4e [148599,62801] 0 2024-04-26T11:46:38.101 INFO:tasks.workunit.client.0.smithi029.stdout:5/393: write db/d12/d1a/f19 [2305405,116831] 0 2024-04-26T11:46:38.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/408: fdatasync d9/d43/f8a 0 2024-04-26T11:46:38.102 INFO:tasks.workunit.client.0.smithi029.stdout:2/412: chown d12/d24/d2f/d76 30221921 1 2024-04-26T11:46:38.102 INFO:tasks.workunit.client.0.smithi029.stdout:4/347: creat d3/d1d/db/d13/d23/f69 x:0 0 0 2024-04-26T11:46:38.102 INFO:tasks.workunit.client.0.smithi029.stdout:0/409: fsync d9/f84 0 2024-04-26T11:46:38.106 INFO:tasks.workunit.client.0.smithi029.stdout:5/394: symlink db/d12/d72/l7d 0 2024-04-26T11:46:38.106 INFO:tasks.workunit.client.0.smithi029.stdout:2/413: symlink d12/d6c/l87 0 2024-04-26T11:46:38.106 INFO:tasks.workunit.client.0.smithi029.stdout:9/445: creat d4/d49/d58/d67/f84 x:0 0 0 2024-04-26T11:46:38.107 INFO:tasks.workunit.client.0.smithi029.stdout:0/410: mknod d9/d16/d25/d2a/d8e/c98 1 2024-04-26T11:46:38.107 INFO:tasks.workunit.client.0.smithi029.stdout:2/414: readlink d12/d24/d29/d50/l78 0 2024-04-26T11:46:38.107 INFO:tasks.workunit.client.0.smithi029.stdout:1/489: dwrite d7/d25/d68/f79 [0,4194304] 0 2024-04-26T11:46:38.107 INFO:tasks.workunit.client.0.smithi029.stdout:0/411: symlink d9/d16/d25/d2a/l99 0 2024-04-26T11:46:38.107 INFO:tasks.workunit.client.0.smithi029.stdout:9/446: creat d4/d5/d7/f85 x:0 0 0 2024-04-26T11:46:38.107 INFO:tasks.workunit.client.0.smithi029.stdout:3/414: write d0/d1/d41/f42 [487163,106003] 0 2024-04-26T11:46:38.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/490: write d7/db/d10/d1e/d53/f7a [999999,22322] 0 2024-04-26T11:46:38.108 INFO:tasks.workunit.client.0.smithi029.stdout:0/412: fdatasync d9/d16/d33/f35 0 2024-04-26T11:46:38.109 INFO:tasks.workunit.client.0.smithi029.stdout:0/413: fdatasync d9/d16/d25/d2a/d46/f71 0 2024-04-26T11:46:38.110 INFO:tasks.workunit.client.0.smithi029.stdout:1/491: unlink d7/d25/d68/l86 0 2024-04-26T11:46:38.110 INFO:tasks.workunit.client.0.smithi029.stdout:4/348: link d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f5e d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f6a 0 2024-04-26T11:46:38.111 INFO:tasks.workunit.client.0.smithi029.stdout:1/492: fdatasync d7/d37/f58 0 2024-04-26T11:46:38.112 INFO:tasks.workunit.client.0.smithi029.stdout:4/349: readlink d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/l5b 0 2024-04-26T11:46:38.112 INFO:tasks.workunit.client.0.smithi029.stdout:1/493: fsync d7/d37/f58 0 2024-04-26T11:46:38.115 INFO:tasks.workunit.client.0.smithi029.stdout:6/406: truncate d7/f1c 2898773 0 2024-04-26T11:46:38.118 INFO:tasks.workunit.client.0.smithi029.stdout:5/395: dread db/d12/d72/d39/d3b/f42 [0,4194304] 0 2024-04-26T11:46:38.118 INFO:tasks.workunit.client.0.smithi029.stdout:3/415: dwrite d0/d1/d2b/f6d [0,4194304] 0 2024-04-26T11:46:38.120 INFO:tasks.workunit.client.0.smithi029.stdout:4/350: link d3/d1d/d11/d16/d1f/d3d/l3e d3/d1d/db/d13/d23/d2b/l6b 0 2024-04-26T11:46:38.122 INFO:tasks.workunit.client.0.smithi029.stdout:0/414: dwrite d9/d43/f65 [0,4194304] 0 2024-04-26T11:46:38.123 INFO:tasks.workunit.client.0.smithi029.stdout:3/416: symlink d0/d1/d2f/l97 0 2024-04-26T11:46:38.125 INFO:tasks.workunit.client.0.smithi029.stdout:6/407: creat d7/d25/d5c/d34/f80 x:0 0 0 2024-04-26T11:46:38.126 INFO:tasks.workunit.client.0.smithi029.stdout:4/351: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c 0 2024-04-26T11:46:38.127 INFO:tasks.workunit.client.0.smithi029.stdout:1/494: dwrite d7/f55 [4194304,4194304] 0 2024-04-26T11:46:38.128 INFO:tasks.workunit.client.0.smithi029.stdout:3/417: truncate d0/dc/d1f/f6f 4222323 0 2024-04-26T11:46:38.128 INFO:tasks.workunit.client.0.smithi029.stdout:3/418: sync 2024-04-26T11:46:38.129 INFO:tasks.workunit.client.0.smithi029.stdout:9/447: dwrite d4/d5/d78/f7b [0,4194304] 0 2024-04-26T11:46:38.130 INFO:tasks.workunit.client.0.smithi029.stdout:6/408: creat d7/d20/d2f/f81 x:0 0 0 2024-04-26T11:46:38.130 INFO:tasks.workunit.client.0.smithi029.stdout:9/448: sync 2024-04-26T11:46:38.131 INFO:tasks.workunit.client.0.smithi029.stdout:3/419: read d0/d1/d2f/f3a [3346242,83851] 0 2024-04-26T11:46:38.132 INFO:tasks.workunit.client.0.smithi029.stdout:4/352: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f6d x:0 0 0 2024-04-26T11:46:38.134 INFO:tasks.workunit.client.0.smithi029.stdout:3/420: chown d0/d1/d2f/d68 5665485 1 2024-04-26T11:46:38.135 INFO:tasks.workunit.client.0.smithi029.stdout:5/396: dwrite db/f75 [0,4194304] 0 2024-04-26T11:46:38.136 INFO:tasks.workunit.client.0.smithi029.stdout:4/353: creat d3/f6e x:0 0 0 2024-04-26T11:46:38.136 INFO:tasks.workunit.client.0.smithi029.stdout:8/366: dread dc/de/d2e/d23/f21 [0,4194304] 0 2024-04-26T11:46:38.137 INFO:tasks.workunit.client.0.smithi029.stdout:6/409: getdents d7 0 2024-04-26T11:46:38.137 INFO:tasks.workunit.client.0.smithi029.stdout:3/421: stat d0/d1/d2b/f85 0 2024-04-26T11:46:38.138 INFO:tasks.workunit.client.0.smithi029.stdout:8/367: write dc/d12/f20 [4746950,5750] 0 2024-04-26T11:46:38.139 INFO:tasks.workunit.client.0.smithi029.stdout:5/397: creat db/d12/d6b/f7e x:0 0 0 2024-04-26T11:46:38.139 INFO:tasks.workunit.client.0.smithi029.stdout:6/410: rmdir d7/d46/d69 39 2024-04-26T11:46:38.140 INFO:tasks.workunit.client.0.smithi029.stdout:0/415: dwrite d9/d16/f24 [0,4194304] 0 2024-04-26T11:46:38.141 INFO:tasks.workunit.client.0.smithi029.stdout:8/368: fdatasync dc/de/d26/f69 0 2024-04-26T11:46:38.141 INFO:tasks.workunit.client.0.smithi029.stdout:1/495: dwrite d7/f75 [0,4194304] 0 2024-04-26T11:46:38.142 INFO:tasks.workunit.client.0.smithi029.stdout:9/449: truncate d4/d5/f51 6941657 0 2024-04-26T11:46:38.147 INFO:tasks.workunit.client.0.smithi029.stdout:9/450: symlink d4/d5/d78/l86 0 2024-04-26T11:46:38.147 INFO:tasks.workunit.client.0.smithi029.stdout:3/422: truncate d0/f27 1306707 0 2024-04-26T11:46:38.147 INFO:tasks.workunit.client.0.smithi029.stdout:6/411: creat d7/d25/d4b/d4d/f82 x:0 0 0 2024-04-26T11:46:38.147 INFO:tasks.workunit.client.0.smithi029.stdout:5/398: symlink db/d40/d4d/d79/l7f 0 2024-04-26T11:46:38.149 INFO:tasks.workunit.client.0.smithi029.stdout:6/412: mkdir d7/d20/d2f/d45/d83 0 2024-04-26T11:46:38.149 INFO:tasks.workunit.client.0.smithi029.stdout:0/416: getdents d9/d16/d8d 0 2024-04-26T11:46:38.149 INFO:tasks.workunit.client.0.smithi029.stdout:5/399: write db/f76 [325429,30589] 0 2024-04-26T11:46:38.151 INFO:tasks.workunit.client.0.smithi029.stdout:4/354: dread d3/d1d/db/d13/d23/f4f [0,4194304] 0 2024-04-26T11:46:38.152 INFO:tasks.workunit.client.0.smithi029.stdout:5/400: unlink db/d12/f57 0 2024-04-26T11:46:38.152 INFO:tasks.workunit.client.0.smithi029.stdout:1/496: dwrite d7/db/f38 [0,4194304] 0 2024-04-26T11:46:38.153 INFO:tasks.workunit.client.0.smithi029.stdout:3/423: write d0/d1/d5c/f87 [1019099,122418] 0 2024-04-26T11:46:38.153 INFO:tasks.workunit.client.0.smithi029.stdout:6/413: creat d7/d25/f84 x:0 0 0 2024-04-26T11:46:38.153 INFO:tasks.workunit.client.0.smithi029.stdout:9/451: link d4/d46/f79 d4/d49/f87 0 2024-04-26T11:46:38.154 INFO:tasks.workunit.client.0.smithi029.stdout:9/452: symlink d4/l88 0 2024-04-26T11:46:38.154 INFO:tasks.workunit.client.0.smithi029.stdout:4/355: dread d3/f38 [0,4194304] 0 2024-04-26T11:46:38.154 INFO:tasks.workunit.client.0.smithi029.stdout:1/497: symlink d7/db/d10/la9 0 2024-04-26T11:46:38.155 INFO:tasks.workunit.client.0.smithi029.stdout:6/414: chown d7/d25/d5c/d34/d4c/l4f 0 1 2024-04-26T11:46:38.155 INFO:tasks.workunit.client.0.smithi029.stdout:9/453: read - d4/d49/f4b zero size 2024-04-26T11:46:38.156 INFO:tasks.workunit.client.0.smithi029.stdout:4/356: dread - d3/d1d/db/d13/d23/f69 zero size 2024-04-26T11:46:38.157 INFO:tasks.workunit.client.0.smithi029.stdout:6/415: truncate d7/d25/d5c/d34/d4c/f68 506272 0 2024-04-26T11:46:38.159 INFO:tasks.workunit.client.0.smithi029.stdout:0/417: truncate d9/f20 1061364 0 2024-04-26T11:46:38.159 INFO:tasks.workunit.client.0.smithi029.stdout:9/454: rename d4/d49/d58/d67/l6e to d4/d49/l89 0 2024-04-26T11:46:38.159 INFO:tasks.workunit.client.0.smithi029.stdout:4/357: symlink d3/d1d/d11/d16/d1f/d3d/d39/l6f 0 2024-04-26T11:46:38.160 INFO:tasks.workunit.client.0.smithi029.stdout:2/415: dread d12/d24/d29/f48 [0,4194304] 0 2024-04-26T11:46:38.160 INFO:tasks.workunit.client.0.smithi029.stdout:7/439: dread d11/d18/d1a/f4d [0,4194304] 0 2024-04-26T11:46:38.160 INFO:tasks.workunit.client.0.smithi029.stdout:4/358: readlink d3/d1d/lf 0 2024-04-26T11:46:38.163 INFO:tasks.workunit.client.0.smithi029.stdout:2/416: write d12/d24/d29/d50/f59 [611054,68736] 0 2024-04-26T11:46:38.165 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:46:38.168 INFO:tasks.workunit.client.0.smithi029.stdout:9/455: link d4/d49/d58/d67/l6c d4/d49/l8a 0 2024-04-26T11:46:38.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/424: dwrite d0/d1/d41/d5f/d54/f58 [0,4194304] 0 2024-04-26T11:46:38.169 INFO:tasks.workunit.client.0.smithi029.stdout:2/417: creat d12/d24/d29/d36/f88 x:0 0 0 2024-04-26T11:46:38.172 INFO:tasks.workunit.client.0.smithi029.stdout:6/416: dwrite d7/d20/d27/f7b [0,4194304] 0 2024-04-26T11:46:38.173 INFO:tasks.workunit.client.0.smithi029.stdout:1/498: dwrite d7/db/f34 [0,4194304] 0 2024-04-26T11:46:38.175 INFO:tasks.workunit.client.0.smithi029.stdout:7/440: dwrite d11/d18/d35/d39/f6a [0,4194304] 0 2024-04-26T11:46:38.175 INFO:tasks.workunit.client.0.smithi029.stdout:3/425: write d0/d1/d41/f42 [3462516,19715] 0 2024-04-26T11:46:38.176 INFO:tasks.workunit.client.0.smithi029.stdout:2/418: creat d12/d24/d29/d57/f89 x:0 0 0 2024-04-26T11:46:38.176 INFO:tasks.workunit.client.0.smithi029.stdout:0/418: dwrite d9/d16/f24 [0,4194304] 0 2024-04-26T11:46:38.178 INFO:tasks.workunit.client.0.smithi029.stdout:7/441: mknod d11/d37/d3b/c90 1 2024-04-26T11:46:38.178 INFO:tasks.workunit.client.0.smithi029.stdout:6/417: rename d7/d25/d4b/f67 to d7/d25/f85 0 2024-04-26T11:46:38.178 INFO:tasks.workunit.client.0.smithi029.stdout:2/419: mkdir d12/d6c/d73/d4f/d65/d8a 0 2024-04-26T11:46:38.178 INFO:tasks.workunit.client.0.smithi029.stdout:0/419: mkdir d9/d16/d25/d2a/d74/d9a 0 2024-04-26T11:46:38.179 INFO:tasks.workunit.client.0.smithi029.stdout:3/426: write d0/dc/d80/f8f [297570,130254] 0 2024-04-26T11:46:38.180 INFO:tasks.workunit.client.0.smithi029.stdout:2/420: chown d12/l13 4938 1 2024-04-26T11:46:38.182 INFO:tasks.workunit.client.0.smithi029.stdout:0/420: fsync d9/f41 0 2024-04-26T11:46:38.186 INFO:tasks.workunit.client.0.smithi029.stdout:2/421: mkdir d12/d24/d29/d8b 0 2024-04-26T11:46:38.187 INFO:tasks.workunit.client.0.smithi029.stdout:7/442: write d11/d18/d1a/f53 [895931,110301] 0 2024-04-26T11:46:38.187 INFO:tasks.workunit.client.0.smithi029.stdout:6/418: link d7/d25/d5c/l1f d7/d20/d2f/d45/l86 0 2024-04-26T11:46:38.187 INFO:tasks.workunit.client.0.smithi029.stdout:4/359: dwrite d3/d1d/db/d13/d23/f45 [0,4194304] 0 2024-04-26T11:46:38.188 INFO:tasks.workunit.client.0.smithi029.stdout:1/499: truncate d7/f35 421008 0 2024-04-26T11:46:38.189 INFO:tasks.workunit.client.0.smithi029.stdout:7/443: unlink d11/d15/f36 0 2024-04-26T11:46:38.189 INFO:tasks.workunit.client.0.smithi029.stdout:1/500: mknod d7/d5b/caa 1 2024-04-26T11:46:38.189 INFO:tasks.workunit.client.0.smithi029.stdout:4/360: symlink d3/d1d/l70 0 2024-04-26T11:46:38.189 INFO:tasks.workunit.client.0.smithi029.stdout:1/501: rename d7/d76 to d7/d25/dab 0 2024-04-26T11:46:38.189 INFO:tasks.workunit.client.0.smithi029.stdout:4/361: chown d3/d1d/l70 54 1 2024-04-26T11:46:38.190 INFO:tasks.workunit.client.0.smithi029.stdout:7/444: truncate d11/d18/d35/d39/f8f 4388726 0 2024-04-26T11:46:38.193 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:38.193+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:38.196 INFO:tasks.workunit.client.0.smithi029.stdout:0/421: dwrite d9/d16/f80 [0,4194304] 0 2024-04-26T11:46:38.196 INFO:tasks.workunit.client.0.smithi029.stdout:4/362: getdents d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c 0 2024-04-26T11:46:38.197 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:38.197 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:38.198 INFO:tasks.workunit.client.0.smithi029.stdout:0/422: creat d9/d16/d52/f9b x:0 0 0 2024-04-26T11:46:38.203 INFO:tasks.workunit.client.0.smithi029.stdout:0/423: stat d9/d16/d33/f56 0 2024-04-26T11:46:38.203 INFO:tasks.workunit.client.0.smithi029.stdout:6/419: dwrite d7/d20/d2f/f3d [0,4194304] 0 2024-04-26T11:46:38.204 INFO:tasks.workunit.client.0.smithi029.stdout:1/502: dwrite d7/db/f91 [0,4194304] 0 2024-04-26T11:46:38.207 INFO:tasks.workunit.client.0.smithi029.stdout:0/424: mknod d9/d16/d25/d2a/d46/c9c 1 2024-04-26T11:46:38.207 INFO:tasks.workunit.client.0.smithi029.stdout:2/422: dwrite d12/f1a [0,4194304] 0 2024-04-26T11:46:38.209 INFO:tasks.workunit.client.0.smithi029.stdout:3/427: dwrite d0/d1/f43 [0,4194304] 0 2024-04-26T11:46:38.209 INFO:tasks.workunit.client.0.smithi029.stdout:5/401: dread db/d12/f1b [0,4194304] 0 2024-04-26T11:46:38.211 INFO:tasks.workunit.client.0.smithi029.stdout:6/420: write d7/d25/d5c/f36 [1334385,94397] 0 2024-04-26T11:46:38.211 INFO:tasks.workunit.client.0.smithi029.stdout:1/503: unlink d7/d37/f48 0 2024-04-26T11:46:38.212 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:38.213 INFO:tasks.workunit.client.0.smithi029.stdout:3/428: fdatasync d0/d1/d2b/d33/f74 0 2024-04-26T11:46:38.214 INFO:tasks.workunit.client.0.smithi029.stdout:8/369: dread dc/de/d26/f69 [0,4194304] 0 2024-04-26T11:46:38.214 INFO:tasks.workunit.client.0.smithi029.stdout:5/402: write db/f76 [327205,87825] 0 2024-04-26T11:46:38.216 INFO:tasks.workunit.client.0.smithi029.stdout:7/445: dwrite d11/f13 [0,4194304] 0 2024-04-26T11:46:38.216 INFO:tasks.workunit.client.0.smithi029.stdout:2/423: truncate d12/d24/d2f/f33 824958 0 2024-04-26T11:46:38.216 INFO:tasks.workunit.client.0.smithi029.stdout:1/504: creat d7/d25/d68/fac x:0 0 0 2024-04-26T11:46:38.216 INFO:tasks.workunit.client.0.smithi029.stdout:3/429: mkdir d0/d1/d13/d98 0 2024-04-26T11:46:38.217 INFO:tasks.workunit.client.0.smithi029.stdout:6/421: creat d7/d20/d2f/d45/d83/f87 x:0 0 0 2024-04-26T11:46:38.217 INFO:tasks.workunit.client.0.smithi029.stdout:7/446: mkdir d11/d18/d1a/d26/d91 0 2024-04-26T11:46:38.218 INFO:tasks.workunit.client.0.smithi029.stdout:5/403: chown db/f52 22408984 1 2024-04-26T11:46:38.218 INFO:tasks.workunit.client.0.smithi029.stdout:2/424: chown d12/d6c/d73/d4f/f80 11 1 2024-04-26T11:46:38.220 INFO:tasks.workunit.client.0.smithi029.stdout:1/505: rmdir d7/d25/dab 39 2024-04-26T11:46:38.220 INFO:tasks.workunit.client.0.smithi029.stdout:4/363: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f6d [0,4194304] 0 2024-04-26T11:46:38.221 INFO:tasks.workunit.client.0.smithi029.stdout:6/422: fdatasync d7/d25/d5c/f5e 0 2024-04-26T11:46:38.221 INFO:tasks.workunit.client.0.smithi029.stdout:7/447: readlink d11/d18/d1a/d33/l68 0 2024-04-26T11:46:38.223 INFO:tasks.workunit.client.0.smithi029.stdout:1/506: chown d7/db/d10/d20/l8b 61412553 1 2024-04-26T11:46:38.223 INFO:tasks.workunit.client.0.smithi029.stdout:2/425: dread - d12/d24/d29/f6b zero size 2024-04-26T11:46:38.223 INFO:tasks.workunit.client.0.smithi029.stdout:5/404: write db/d12/d1a/f33 [462699,74508] 0 2024-04-26T11:46:38.225 INFO:tasks.workunit.client.0.smithi029.stdout:4/364: mkdir d3/d1d/d11/d16/d71 0 2024-04-26T11:46:38.225 INFO:tasks.workunit.client.0.smithi029.stdout:9/456: dread d4/d5/d16/d39/f76 [0,4194304] 0 2024-04-26T11:46:38.225 INFO:tasks.workunit.client.0.smithi029.stdout:7/448: mkdir d11/d18/d1a/d92 0 2024-04-26T11:46:38.226 INFO:tasks.workunit.client.0.smithi029.stdout:2/426: stat d12/d6c/d73/d40 0 2024-04-26T11:46:38.226 INFO:tasks.workunit.client.0.smithi029.stdout:5/405: rename f8 to db/d12/d1a/f80 0 2024-04-26T11:46:38.227 INFO:tasks.workunit.client.0.smithi029.stdout:3/430: dwrite d0/d1/d2b/f6d [0,4194304] 0 2024-04-26T11:46:38.230 INFO:tasks.workunit.client.0.smithi029.stdout:9/457: write d4/d5/d16/f73 [1191147,55219] 0 2024-04-26T11:46:38.230 INFO:tasks.workunit.client.0.smithi029.stdout:2/427: mkdir d12/d24/d2f/d8c 0 2024-04-26T11:46:38.230 INFO:tasks.workunit.client.0.smithi029.stdout:5/406: creat db/d12/d72/d39/d3b/f81 x:0 0 0 2024-04-26T11:46:38.231 INFO:tasks.workunit.client.0.smithi029.stdout:3/431: unlink d0/dc/d1f/f5a 0 2024-04-26T11:46:38.231 INFO:tasks.workunit.client.0.smithi029.stdout:7/449: rename d11/d18/d2d/f89 to d11/d18/d1a/d33/f93 0 2024-04-26T11:46:38.231 INFO:tasks.workunit.client.0.smithi029.stdout:5/407: fsync db/d12/d1a/d4c/f55 0 2024-04-26T11:46:38.232 INFO:tasks.workunit.client.0.smithi029.stdout:2/428: truncate d12/d6c/d73/d4f/d65/f84 1035450 0 2024-04-26T11:46:38.233 INFO:tasks.workunit.client.0.smithi029.stdout:9/458: link d4/l23 d4/d5/d78/l8b 0 2024-04-26T11:46:38.233 INFO:tasks.workunit.client.0.smithi029.stdout:6/423: dread d7/d25/f85 [0,4194304] 0 2024-04-26T11:46:38.234 INFO:tasks.workunit.client.0.smithi029.stdout:2/429: chown d12/d6c/d73/d40 3931 1 2024-04-26T11:46:38.234 INFO:tasks.workunit.client.0.smithi029.stdout:6/424: mknod d7/d25/d5c/d34/d4c/c88 1 2024-04-26T11:46:38.234 INFO:tasks.workunit.client.0.smithi029.stdout:7/450: symlink d11/d18/d1a/d92/l94 0 2024-04-26T11:46:38.235 INFO:tasks.workunit.client.0.smithi029.stdout:2/430: write d12/d24/f27 [1367893,94447] 0 2024-04-26T11:46:38.236 INFO:tasks.workunit.client.0.smithi029.stdout:9/459: link d4/d5/d16/f1c d4/d5/d16/d39/f8c 0 2024-04-26T11:46:38.236 INFO:tasks.workunit.client.0.smithi029.stdout:0/425: dread d9/fc [0,4194304] 0 2024-04-26T11:46:38.237 INFO:tasks.workunit.client.0.smithi029.stdout:2/431: write d12/d24/d29/d57/f89 [729934,114978] 0 2024-04-26T11:46:38.238 INFO:tasks.workunit.client.0.smithi029.stdout:0/426: mkdir d9/d16/d33/d2f/d32/d9d 0 2024-04-26T11:46:38.240 INFO:tasks.workunit.client.0.smithi029.stdout:9/460: chown d4/d5/d78/l8b 105234311 1 2024-04-26T11:46:38.240 INFO:tasks.workunit.client.0.smithi029.stdout:3/432: dwrite d0/f15 [0,4194304] 0 2024-04-26T11:46:38.242 INFO:tasks.workunit.client.0.smithi029.stdout:2/432: creat d12/d6c/d73/d4f/f8d x:0 0 0 2024-04-26T11:46:38.242 INFO:tasks.workunit.client.0.smithi029.stdout:4/365: stat d3/d1d/d11/d16/d1f/d3d/d39/l6f 0 2024-04-26T11:46:38.244 INFO:tasks.workunit.client.0.smithi029.stdout:0/427: link d9/f2d d9/d16/d33/d2f/d32/d9d/f9e 0 2024-04-26T11:46:38.245 INFO:tasks.workunit.client.0.smithi029.stdout:9/461: link d4/d5/d16/l66 d4/d5/d16/d39/l8d 0 2024-04-26T11:46:38.246 INFO:tasks.workunit.client.0.smithi029.stdout:2/433: rmdir d12/d6c/d73/d4f 39 2024-04-26T11:46:38.246 INFO:tasks.workunit.client.0.smithi029.stdout:4/366: unlink d3/d1d/d11/d16/d1f/f27 0 2024-04-26T11:46:38.247 INFO:tasks.workunit.client.0.smithi029.stdout:7/451: dwrite d11/d18/d1a/d33/f75 [0,4194304] 0 2024-04-26T11:46:38.247 INFO:tasks.workunit.client.0.smithi029.stdout:0/428: chown d9/d16/d25/d2a/d74/f91 262832352 1 2024-04-26T11:46:38.247 INFO:tasks.workunit.client.0.smithi029.stdout:3/433: truncate d0/d1/d41/d5f/d54/f58 4917910 0 2024-04-26T11:46:38.248 INFO:tasks.workunit.client.0.smithi029.stdout:9/462: symlink d4/d5/d16/l8e 0 2024-04-26T11:46:38.249 INFO:tasks.workunit.client.0.smithi029.stdout:7/452: rmdir d11/d37 39 2024-04-26T11:46:38.251 INFO:tasks.workunit.client.0.smithi029.stdout:9/463: rmdir d4/d46 39 2024-04-26T11:46:38.251 INFO:tasks.workunit.client.0.smithi029.stdout:0/429: readlink d9/d16/d25/d2a/d74/l7a 0 2024-04-26T11:46:38.251 INFO:tasks.workunit.client.0.smithi029.stdout:6/425: dwrite d7/d20/d27/f64 [4194304,4194304] 0 2024-04-26T11:46:38.251 INFO:tasks.workunit.client.0.smithi029.stdout:0/430: write d9/d43/f6d [390324,106190] 0 2024-04-26T11:46:38.252 INFO:tasks.workunit.client.0.smithi029.stdout:6/426: creat d7/d25/d4b/d4d/d65/f89 x:0 0 0 2024-04-26T11:46:38.252 INFO:tasks.workunit.client.0.smithi029.stdout:9/464: symlink d4/d49/d7d/l8f 0 2024-04-26T11:46:38.253 INFO:tasks.workunit.client.0.smithi029.stdout:7/453: chown d11/d15/f3f 47951 1 2024-04-26T11:46:38.253 INFO:tasks.workunit.client.0.smithi029.stdout:0/431: mkdir d9/d16/d33/d2f/d32/d9f 0 2024-04-26T11:46:38.254 INFO:tasks.workunit.client.0.smithi029.stdout:9/465: symlink d4/d5/d7a/l90 0 2024-04-26T11:46:38.255 INFO:tasks.workunit.client.0.smithi029.stdout:6/427: creat d7/d46/d69/f8a x:0 0 0 2024-04-26T11:46:38.256 INFO:tasks.workunit.client.0.smithi029.stdout:0/432: creat d9/d43/fa0 x:0 0 0 2024-04-26T11:46:38.256 INFO:tasks.workunit.client.0.smithi029.stdout:6/428: mknod d7/d25/d5c/d34/c8b 1 2024-04-26T11:46:38.257 INFO:tasks.workunit.client.0.smithi029.stdout:6/429: readlink l5 0 2024-04-26T11:46:38.257 INFO:tasks.workunit.client.0.smithi029.stdout:9/466: chown d4/d46/l5f 7862 1 2024-04-26T11:46:38.257 INFO:tasks.workunit.client.0.smithi029.stdout:7/454: rename d11/d15/d67/l72 to d11/d15/d69/l95 0 2024-04-26T11:46:38.258 INFO:tasks.workunit.client.0.smithi029.stdout:4/367: dwrite d3/d1d/d11/d16/d1f/d3d/f62 [0,4194304] 0 2024-04-26T11:46:38.259 INFO:tasks.workunit.client.0.smithi029.stdout:7/455: stat d11/d18/d1a/d33/f74 0 2024-04-26T11:46:38.259 INFO:tasks.workunit.client.0.smithi029.stdout:2/434: dwrite d12/d6c/d73/d4f/f7a [0,4194304] 0 2024-04-26T11:46:38.261 INFO:tasks.workunit.client.0.smithi029.stdout:0/433: symlink d9/d16/d8d/la1 0 2024-04-26T11:46:38.262 INFO:tasks.workunit.client.0.smithi029.stdout:7/456: rmdir d11/d18/d1a/d92 39 2024-04-26T11:46:38.262 INFO:tasks.workunit.client.0.smithi029.stdout:6/430: creat d7/d25/d4b/d4d/d65/f8c x:0 0 0 2024-04-26T11:46:38.262 INFO:tasks.workunit.client.0.smithi029.stdout:2/435: rename d12/d47/f5d to d12/d24/d2f/d8c/f8e 0 2024-04-26T11:46:38.263 INFO:tasks.workunit.client.0.smithi029.stdout:4/368: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f72 x:0 0 0 2024-04-26T11:46:38.264 INFO:tasks.workunit.client.0.smithi029.stdout:7/457: chown d11/d15/f3f 306929974 1 2024-04-26T11:46:38.264 INFO:tasks.workunit.client.0.smithi029.stdout:6/431: mknod d7/d25/d5c/d34/c8d 1 2024-04-26T11:46:38.266 INFO:tasks.workunit.client.0.smithi029.stdout:2/436: symlink d12/d6c/d73/d4f/d65/d8a/l8f 0 2024-04-26T11:46:38.266 INFO:tasks.workunit.client.0.smithi029.stdout:6/432: creat d7/d25/d4b/d6d/f8e x:0 0 0 2024-04-26T11:46:38.267 INFO:tasks.workunit.client.0.smithi029.stdout:0/434: read d9/d16/d25/d2a/d46/f5a [374016,91169] 0 2024-04-26T11:46:38.269 INFO:tasks.workunit.client.0.smithi029.stdout:0/435: truncate d9/d16/d33/f38 1127640 0 2024-04-26T11:46:38.271 INFO:tasks.workunit.client.0.smithi029.stdout:0/436: unlink d9/d16/d25/d2a/d46/f71 0 2024-04-26T11:46:38.271 INFO:tasks.workunit.client.0.smithi029.stdout:6/433: dread d7/d25/d4b/f4e [0,4194304] 0 2024-04-26T11:46:38.271 INFO:tasks.workunit.client.0.smithi029.stdout:7/458: dwrite d11/d18/d1a/f83 [0,4194304] 0 2024-04-26T11:46:38.272 INFO:tasks.workunit.client.0.smithi029.stdout:7/459: readlink d11/d18/d35/l78 0 2024-04-26T11:46:38.275 INFO:tasks.workunit.client.0.smithi029.stdout:4/369: write d3/d1d/db/f28 [9833,120111] 0 2024-04-26T11:46:38.275 INFO:tasks.workunit.client.0.smithi029.stdout:6/434: fsync d7/d20/d27/f2b 0 2024-04-26T11:46:38.277 INFO:tasks.workunit.client.0.smithi029.stdout:2/437: dwrite d12/d6c/d73/d4f/f7a [4194304,4194304] 0 2024-04-26T11:46:38.277 INFO:tasks.workunit.client.0.smithi029.stdout:6/435: symlink d7/d25/d5c/l8f 0 2024-04-26T11:46:38.278 INFO:tasks.workunit.client.0.smithi029.stdout:4/370: mkdir d3/d1d/db/d13/d73 0 2024-04-26T11:46:38.279 INFO:tasks.workunit.client.0.smithi029.stdout:4/371: readlink d3/l25 0 2024-04-26T11:46:38.280 INFO:tasks.workunit.client.0.smithi029.stdout:6/436: chown d7/d25/d5c/f36 1818791189 1 2024-04-26T11:46:38.280 INFO:tasks.workunit.client.0.smithi029.stdout:2/438: symlink d12/d6c/d73/l90 0 2024-04-26T11:46:38.281 INFO:tasks.workunit.client.0.smithi029.stdout:6/437: unlink d7/d46/f48 0 2024-04-26T11:46:38.282 INFO:tasks.workunit.client.0.smithi029.stdout:4/372: mknod d3/d1d/d11/d16/d1f/d3d/d46/c74 1 2024-04-26T11:46:38.282 INFO:tasks.workunit.client.0.smithi029.stdout:2/439: dread - d12/d24/d29/d50/f7d zero size 2024-04-26T11:46:38.282 INFO:tasks.workunit.client.0.smithi029.stdout:0/437: dwrite d9/d16/d33/f44 [0,4194304] 0 2024-04-26T11:46:38.282 INFO:tasks.workunit.client.0.smithi029.stdout:4/373: chown d3/d1d/d11 7 1 2024-04-26T11:46:38.283 INFO:tasks.workunit.client.0.smithi029.stdout:5/408: dread db/d12/d1a/f27 [4194304,4194304] 0 2024-04-26T11:46:38.283 INFO:tasks.workunit.client.0.smithi029.stdout:2/440: fsync d12/d24/d2f/f4e 0 2024-04-26T11:46:38.283 INFO:tasks.workunit.client.0.smithi029.stdout:5/409: stat db/f75 0 2024-04-26T11:46:38.284 INFO:tasks.workunit.client.0.smithi029.stdout:0/438: creat d9/d16/d52/fa2 x:0 0 0 2024-04-26T11:46:38.285 INFO:tasks.workunit.client.0.smithi029.stdout:4/374: fdatasync d3/d1d/d11/d16/d1f/d3d/f60 0 2024-04-26T11:46:38.285 INFO:tasks.workunit.client.0.smithi029.stdout:2/441: symlink d12/d24/d29/d50/l91 0 2024-04-26T11:46:38.286 INFO:tasks.workunit.client.0.smithi029.stdout:2/442: dread - d12/d24/d29/d36/f88 zero size 2024-04-26T11:46:38.286 INFO:tasks.workunit.client.0.smithi029.stdout:0/439: dread - d9/d16/d25/d2a/d46/f64 zero size 2024-04-26T11:46:38.287 INFO:tasks.workunit.client.0.smithi029.stdout:5/410: fdatasync db/d12/d1a/f80 0 2024-04-26T11:46:38.287 INFO:tasks.workunit.client.0.smithi029.stdout:5/411: mknod db/d12/d1a/c82 1 2024-04-26T11:46:38.287 INFO:tasks.workunit.client.0.smithi029.stdout:4/375: creat d3/d1d/d11/d16/f75 x:0 0 0 2024-04-26T11:46:38.288 INFO:tasks.workunit.client.0.smithi029.stdout:0/440: write d9/d16/d52/f45 [8939966,2586] 0 2024-04-26T11:46:38.289 INFO:tasks.workunit.client.0.smithi029.stdout:9/467: dread d4/d5/f45 [0,4194304] 0 2024-04-26T11:46:38.290 INFO:tasks.workunit.client.0.smithi029.stdout:0/441: readlink d9/d16/d33/d2f/d31/l58 0 2024-04-26T11:46:38.290 INFO:tasks.workunit.client.0.smithi029.stdout:6/438: dwrite d7/d20/d2f/f33 [0,4194304] 0 2024-04-26T11:46:38.293 INFO:tasks.workunit.client.0.smithi029.stdout:2/443: write d12/f1d [6640029,56281] 0 2024-04-26T11:46:38.293 INFO:tasks.workunit.client.0.smithi029.stdout:6/439: creat d7/f90 x:0 0 0 2024-04-26T11:46:38.294 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:38.293+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:38.294 INFO:tasks.workunit.client.0.smithi029.stdout:4/376: symlink d3/d1d/d11/d16/d1f/d3d/d39/l76 0 2024-04-26T11:46:38.295 INFO:tasks.workunit.client.0.smithi029.stdout:7/460: dwrite d11/d18/f29 [4194304,4194304] 0 2024-04-26T11:46:38.297 INFO:tasks.workunit.client.0.smithi029.stdout:4/377: fdatasync d3/d1d/db/d13/d23/f4f 0 2024-04-26T11:46:38.297 INFO:tasks.workunit.client.0.smithi029.stdout:5/412: dwrite db/f20 [0,4194304] 0 2024-04-26T11:46:38.298 INFO:tasks.workunit.client.0.smithi029.stdout:9/468: read d4/d5/fd [5524603,56087] 0 2024-04-26T11:46:38.298 INFO:tasks.workunit.client.0.smithi029.stdout:7/461: creat d11/d18/d35/f96 x:0 0 0 2024-04-26T11:46:38.299 INFO:tasks.workunit.client.0.smithi029.stdout:4/378: fsync d3/d1d/d11/d16/d1f/d3d/d46/f5f 0 2024-04-26T11:46:38.299 INFO:tasks.workunit.client.0.smithi029.stdout:5/413: creat db/d12/d6b/f83 x:0 0 0 2024-04-26T11:46:38.300 INFO:tasks.workunit.client.0.smithi029.stdout:4/379: write d3/f31 [2003571,24313] 0 2024-04-26T11:46:38.301 INFO:tasks.workunit.client.0.smithi029.stdout:0/442: dwrite d9/d16/f80 [0,4194304] 0 2024-04-26T11:46:38.302 INFO:tasks.workunit.client.0.smithi029.stdout:9/469: rename d4/d5/d16/f34 to d4/d49/d58/f91 0 2024-04-26T11:46:38.303 INFO:tasks.workunit.client.0.smithi029.stdout:5/414: creat db/d40/f84 x:0 0 0 2024-04-26T11:46:38.303 INFO:tasks.workunit.client.0.smithi029.stdout:4/380: chown d3/d1d/f5c 31 1 2024-04-26T11:46:38.303 INFO:tasks.workunit.client.0.smithi029.stdout:7/462: getdents d11/d18/d1a/d33 0 2024-04-26T11:46:38.304 INFO:tasks.workunit.client.0.smithi029.stdout:6/440: mkdir d7/d20/d27/d91 0 2024-04-26T11:46:38.304 INFO:tasks.workunit.client.0.smithi029.stdout:5/415: write db/d12/d1a/f16 [4627411,85252] 0 2024-04-26T11:46:38.304 INFO:tasks.workunit.client.0.smithi029.stdout:7/463: mkdir d11/d15/d79/d97 0 2024-04-26T11:46:38.304 INFO:tasks.workunit.client.0.smithi029.stdout:9/470: creat d4/d5/d16/d80/f92 x:0 0 0 2024-04-26T11:46:38.304 INFO:tasks.workunit.client.0.smithi029.stdout:6/441: symlink d7/d46/l92 0 2024-04-26T11:46:38.304 INFO:tasks.workunit.client.0.smithi029.stdout:7/464: mknod d11/d18/d58/d8d/c98 1 2024-04-26T11:46:38.305 INFO:tasks.workunit.client.0.smithi029.stdout:6/442: mknod d7/d46/d69/c93 1 2024-04-26T11:46:38.305 INFO:tasks.workunit.client.0.smithi029.stdout:4/381: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f77 x:0 0 0 2024-04-26T11:46:38.306 INFO:tasks.workunit.client.0.smithi029.stdout:7/465: creat d11/d18/d1a/f99 x:0 0 0 2024-04-26T11:46:38.307 INFO:tasks.workunit.client.0.smithi029.stdout:4/382: creat d3/f78 x:0 0 0 2024-04-26T11:46:38.311 INFO:tasks.workunit.client.0.smithi029.stdout:7/466: fsync d11/d18/d1a/f4a 0 2024-04-26T11:46:38.311 INFO:tasks.workunit.client.0.smithi029.stdout:5/416: truncate db/d12/d1a/f27 4125735 0 2024-04-26T11:46:38.311 INFO:tasks.workunit.client.0.smithi029.stdout:6/443: link d7/d25/d4b/d4d/f54 d7/d25/d5c/d34/d4c/f94 0 2024-04-26T11:46:38.311 INFO:tasks.workunit.client.0.smithi029.stdout:5/417: fsync db/d12/d72/d39/d3b/f81 0 2024-04-26T11:46:38.311 INFO:tasks.workunit.client.0.smithi029.stdout:6/444: write d7/d25/d5c/f36 [221530,112236] 0 2024-04-26T11:46:38.312 INFO:tasks.workunit.client.0.smithi029.stdout:4/383: dread d3/d1d/d11/d16/d1f/f55 [0,4194304] 0 2024-04-26T11:46:38.312 INFO:tasks.workunit.client.0.smithi029.stdout:5/418: write db/d12/d6b/f7e [73726,58022] 0 2024-04-26T11:46:38.313 INFO:tasks.workunit.client.0.smithi029.stdout:4/384: creat d3/d1d/d11/f79 x:0 0 0 2024-04-26T11:46:38.314 INFO:tasks.workunit.client.0.smithi029.stdout:5/419: unlink db/d12/d72/d39/d3b/f67 0 2024-04-26T11:46:38.314 INFO:tasks.workunit.client.0.smithi029.stdout:9/471: dwrite d4/d5/d16/f19 [0,4194304] 0 2024-04-26T11:46:38.316 INFO:tasks.workunit.client.0.smithi029.stdout:5/420: unlink db/d12/d1a/f10 0 2024-04-26T11:46:38.318 INFO:tasks.workunit.client.0.smithi029.stdout:5/421: readlink db/d12/d72/d39/l59 0 2024-04-26T11:46:38.318 INFO:tasks.workunit.client.0.smithi029.stdout:7/467: dwrite d11/d18/d35/f5e [0,4194304] 0 2024-04-26T11:46:38.319 INFO:tasks.workunit.client.0.smithi029.stdout:9/472: creat d4/d49/f93 x:0 0 0 2024-04-26T11:46:38.319 INFO:tasks.workunit.client.0.smithi029.stdout:9/473: stat d4/d5/fd 0 2024-04-26T11:46:38.320 INFO:tasks.workunit.client.0.smithi029.stdout:5/422: write db/d12/d72/d39/d3b/f42 [512959,43657] 0 2024-04-26T11:46:38.320 INFO:tasks.workunit.client.0.smithi029.stdout:7/468: rename d11/d37/f4f to d11/d18/d1a/d92/f9a 0 2024-04-26T11:46:38.321 INFO:tasks.workunit.client.0.smithi029.stdout:5/423: creat db/d12/d6b/f85 x:0 0 0 2024-04-26T11:46:38.322 INFO:tasks.workunit.client.0.smithi029.stdout:9/474: rename d4/d5/d16/f3b to d4/d5/d7/f94 0 2024-04-26T11:46:38.322 INFO:tasks.workunit.client.0.smithi029.stdout:9/475: fsync d4/d5/d16/f5b 0 2024-04-26T11:46:38.323 INFO:tasks.workunit.client.0.smithi029.stdout:6/445: truncate d7/d25/d5c/f1e 701490 0 2024-04-26T11:46:38.325 INFO:tasks.workunit.client.0.smithi029.stdout:4/385: read d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f6d [2292630,83000] 0 2024-04-26T11:46:38.325 INFO:tasks.workunit.client.0.smithi029.stdout:9/476: write d4/d5/f45 [4991874,126678] 0 2024-04-26T11:46:38.325 INFO:tasks.workunit.client.0.smithi029.stdout:4/386: stat d3/d1d/d11/d16/d1f/d3d 0 2024-04-26T11:46:38.326 INFO:tasks.workunit.client.0.smithi029.stdout:6/446: truncate d7/d25/d5c/d34/d4c/f7a 609653 0 2024-04-26T11:46:38.326 INFO:tasks.workunit.client.0.smithi029.stdout:9/477: truncate d4/d49/f93 192224 0 2024-04-26T11:46:38.326 INFO:tasks.workunit.client.0.smithi029.stdout:4/387: mkdir d3/d50/d7a 0 2024-04-26T11:46:38.326 INFO:tasks.workunit.client.0.smithi029.stdout:6/447: creat d7/d25/d4b/d6d/f95 x:0 0 0 2024-04-26T11:46:38.326 INFO:tasks.workunit.client.0.smithi029.stdout:9/478: creat d4/d5/f95 x:0 0 0 2024-04-26T11:46:38.326 INFO:tasks.workunit.client.0.smithi029.stdout:6/448: creat d7/d25/d4b/f96 x:0 0 0 2024-04-26T11:46:38.327 INFO:tasks.workunit.client.0.smithi029.stdout:7/469: read d11/d18/d1a/f31 [825752,91046] 0 2024-04-26T11:46:38.327 INFO:tasks.workunit.client.0.smithi029.stdout:5/424: read db/d12/f5c [56121,100537] 0 2024-04-26T11:46:38.328 INFO:tasks.workunit.client.0.smithi029.stdout:9/479: write d4/d5/d78/f7b [557579,126312] 0 2024-04-26T11:46:38.328 INFO:tasks.workunit.client.0.smithi029.stdout:4/388: symlink d3/d1d/db/d13/d23/d2b/l7b 0 2024-04-26T11:46:38.328 INFO:tasks.workunit.client.0.smithi029.stdout:6/449: mkdir d7/d97 0 2024-04-26T11:46:38.328 INFO:tasks.workunit.client.0.smithi029.stdout:4/389: chown d3/d1d/d11/d16/d1f/d3d 1053920 1 2024-04-26T11:46:38.329 INFO:tasks.workunit.client.0.smithi029.stdout:7/470: mkdir d11/d15/d79/d97/d9b 0 2024-04-26T11:46:38.329 INFO:tasks.workunit.client.0.smithi029.stdout:5/425: read db/f1c [926240,32306] 0 2024-04-26T11:46:38.330 INFO:tasks.workunit.client.0.smithi029.stdout:2/444: dread d12/d24/d29/d36/f3b [0,4194304] 0 2024-04-26T11:46:38.330 INFO:tasks.workunit.client.0.smithi029.stdout:9/480: link d4/d5/d78/f7c d4/d5/d7a/f96 0 2024-04-26T11:46:38.330 INFO:tasks.workunit.client.0.smithi029.stdout:6/450: truncate d7/d25/d4b/f4e 344944 0 2024-04-26T11:46:38.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/471: write d11/d18/d1a/f4d [702506,108413] 0 2024-04-26T11:46:38.331 INFO:tasks.workunit.client.0.smithi029.stdout:9/481: mkdir d4/d5/d7a/d97 0 2024-04-26T11:46:38.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/472: stat d11/d15/d67 0 2024-04-26T11:46:38.332 INFO:tasks.workunit.client.0.smithi029.stdout:4/390: link d3/d1d/db/d13/d23/f45 d3/d1d/db/d13/d23/d2b/f7c 0 2024-04-26T11:46:38.332 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:38.332 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:38.333 INFO:tasks.workunit.client.0.smithi029.stdout:7/473: write fc [3501333,96934] 0 2024-04-26T11:46:38.334 INFO:tasks.workunit.client.0.smithi029.stdout:9/482: write d4/d5/d7/f36 [5780824,65398] 0 2024-04-26T11:46:38.334 INFO:tasks.workunit.client.0.smithi029.stdout:6/451: rename d7/d20/d2f to d7/d25/d5c/d34/d4c/d98 0 2024-04-26T11:46:38.335 INFO:tasks.workunit.client.0.smithi029.stdout:9/483: stat d4/d49/d7d 0 2024-04-26T11:46:38.336 INFO:tasks.workunit.client.0.smithi029.stdout:7/474: creat d11/d18/d1a/d26/d91/f9c x:0 0 0 2024-04-26T11:46:38.336 INFO:tasks.workunit.client.0.smithi029.stdout:4/391: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f7d x:0 0 0 2024-04-26T11:46:38.337 INFO:tasks.workunit.client.0.smithi029.stdout:9/484: dread - d4/d5/d7/f85 zero size 2024-04-26T11:46:38.339 INFO:tasks.workunit.client.0.smithi029.stdout:5/426: dwrite db/f75 [4194304,4194304] 0 2024-04-26T11:46:38.340 INFO:tasks.workunit.client.0.smithi029.stdout:4/392: write d3/d1d/d11/d16/d1f/f52 [104695,40361] 0 2024-04-26T11:46:38.340 INFO:tasks.workunit.client.0.smithi029.stdout:9/485: dread - d4/d49/d58/d67/f84 zero size 2024-04-26T11:46:38.341 INFO:tasks.workunit.client.0.smithi029.stdout:5/427: write db/f76 [53644,27193] 0 2024-04-26T11:46:38.342 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:38.343 INFO:tasks.workunit.client.0.smithi029.stdout:7/475: link d11/d15/d79/l82 d11/d18/d35/d39/d7e/l9d 0 2024-04-26T11:46:38.344 INFO:tasks.workunit.client.0.smithi029.stdout:4/393: mkdir d3/d1d/db/d13/d73/d7e 0 2024-04-26T11:46:38.344 INFO:tasks.workunit.client.0.smithi029.stdout:9/486: creat d4/d5/d7a/d97/f98 x:0 0 0 2024-04-26T11:46:38.344 INFO:tasks.workunit.client.0.smithi029.stdout:2/445: dwrite d12/d24/d29/f48 [0,4194304] 0 2024-04-26T11:46:38.345 INFO:tasks.workunit.client.0.smithi029.stdout:9/487: chown d4/d5/f51 333 1 2024-04-26T11:46:38.345 INFO:tasks.workunit.client.0.smithi029.stdout:4/394: creat d3/f7f x:0 0 0 2024-04-26T11:46:38.346 INFO:tasks.workunit.client.0.smithi029.stdout:9/488: mknod d4/d49/d7d/c99 1 2024-04-26T11:46:38.346 INFO:tasks.workunit.client.0.smithi029.stdout:2/446: rename d12/d24/f35 to d12/d24/f92 0 2024-04-26T11:46:38.347 INFO:tasks.workunit.client.0.smithi029.stdout:9/489: fdatasync d4/d5/d7/f94 0 2024-04-26T11:46:38.348 INFO:tasks.workunit.client.0.smithi029.stdout:5/428: read db/d12/d1a/f49 [1191064,128426] 0 2024-04-26T11:46:38.348 INFO:tasks.workunit.client.0.smithi029.stdout:2/447: rmdir d12/d6c/d73/d40 39 2024-04-26T11:46:38.350 INFO:tasks.workunit.client.0.smithi029.stdout:2/448: write d12/f1d [1786170,80419] 0 2024-04-26T11:46:38.350 INFO:tasks.workunit.client.0.smithi029.stdout:5/429: mkdir db/d12/d72/d39/d3b/d86 0 2024-04-26T11:46:38.350 INFO:tasks.workunit.client.0.smithi029.stdout:9/490: link d4/l23 d4/l9a 0 2024-04-26T11:46:38.351 INFO:tasks.workunit.client.0.smithi029.stdout:2/449: chown d12/d24/d29/d57/l60 1 1 2024-04-26T11:46:38.353 INFO:tasks.workunit.client.0.smithi029.stdout:7/476: dwrite d11/d18/d1a/f99 [0,4194304] 0 2024-04-26T11:46:38.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/452: dread d7/d25/d5c/d34/f38 [0,4194304] 0 2024-04-26T11:46:38.353 INFO:tasks.workunit.client.0.smithi029.stdout:4/395: dread d3/d1d/d11/d16/d1f/d3d/f62 [0,4194304] 0 2024-04-26T11:46:38.354 INFO:tasks.workunit.client.0.smithi029.stdout:5/430: creat db/d40/d4d/d4f/f87 x:0 0 0 2024-04-26T11:46:38.354 INFO:tasks.workunit.client.0.smithi029.stdout:7/477: creat d11/d15/d79/d97/f9e x:0 0 0 2024-04-26T11:46:38.355 INFO:tasks.workunit.client.0.smithi029.stdout:2/450: link d12/f16 d12/d24/d2f/f93 0 2024-04-26T11:46:38.355 INFO:tasks.workunit.client.0.smithi029.stdout:6/453: creat d7/d25/d5c/d34/d4c/d98/d45/d76/f99 x:0 0 0 2024-04-26T11:46:38.356 INFO:tasks.workunit.client.0.smithi029.stdout:6/454: dread - d7/d25/d5c/d34/d4c/d98/f72 zero size 2024-04-26T11:46:38.356 INFO:tasks.workunit.client.0.smithi029.stdout:5/431: rename db/d40/d4d/d4f/f87 to db/d12/d1a/d4c/f88 0 2024-04-26T11:46:38.356 INFO:tasks.workunit.client.0.smithi029.stdout:6/455: mknod d7/c9a 1 2024-04-26T11:46:38.357 INFO:tasks.workunit.client.0.smithi029.stdout:7/478: creat d11/d18/d1a/d26/d91/f9f x:0 0 0 2024-04-26T11:46:38.357 INFO:tasks.workunit.client.0.smithi029.stdout:2/451: creat d12/d24/d29/d50/d55/f94 x:0 0 0 2024-04-26T11:46:38.358 INFO:tasks.workunit.client.0.smithi029.stdout:2/452: fdatasync d12/f1b 0 2024-04-26T11:46:38.358 INFO:tasks.workunit.client.0.smithi029.stdout:7/479: getdents d11/d15 0 2024-04-26T11:46:38.359 INFO:tasks.workunit.client.0.smithi029.stdout:7/480: mknod d11/d18/d58/ca0 1 2024-04-26T11:46:38.359 INFO:tasks.workunit.client.0.smithi029.stdout:2/453: chown d12/d24/d29/d36/d4b 1 1 2024-04-26T11:46:38.359 INFO:tasks.workunit.client.0.smithi029.stdout:7/481: fdatasync d11/d18/d1a/f53 0 2024-04-26T11:46:38.359 INFO:tasks.workunit.client.0.smithi029.stdout:2/454: fsync d12/d6c/d70/f74 0 2024-04-26T11:46:38.361 INFO:tasks.workunit.client.0.smithi029.stdout:2/455: symlink d12/d24/d29/d50/d55/d5f/l95 0 2024-04-26T11:46:38.361 INFO:tasks.workunit.client.0.smithi029.stdout:7/482: link d11/d15/d79/l8a d11/d15/la1 0 2024-04-26T11:46:38.363 INFO:tasks.workunit.client.0.smithi029.stdout:2/456: write d12/d24/d2f/d8c/f8e [116803,69822] 0 2024-04-26T11:46:38.365 INFO:tasks.workunit.client.0.smithi029.stdout:6/456: dwrite d7/d20/d27/f41 [0,4194304] 0 2024-04-26T11:46:38.366 INFO:tasks.workunit.client.0.smithi029.stdout:5/432: dwrite db/d40/d4d/d4f/d73/f74 [0,4194304] 0 2024-04-26T11:46:38.367 INFO:tasks.workunit.client.0.smithi029.stdout:2/457: link d12/d24/d29/d50/f59 d12/d24/d29/d38/f96 0 2024-04-26T11:46:38.367 INFO:tasks.workunit.client.0.smithi029.stdout:7/483: fdatasync d11/d15/f3f 0 2024-04-26T11:46:38.369 INFO:tasks.workunit.client.0.smithi029.stdout:5/433: fdatasync db/f75 0 2024-04-26T11:46:38.371 INFO:tasks.workunit.client.0.smithi029.stdout:2/458: getdents d12/d6c/d73/d4f/d65/d81 0 2024-04-26T11:46:38.371 INFO:tasks.workunit.client.0.smithi029.stdout:7/484: mkdir d11/d18/d35/d39/d7e/da2 0 2024-04-26T11:46:38.371 INFO:tasks.workunit.client.0.smithi029.stdout:5/434: rmdir db/d12/d6b 39 2024-04-26T11:46:38.372 INFO:tasks.workunit.client.0.smithi029.stdout:7/485: readlink d11/d18/d35/d39/l6e 0 2024-04-26T11:46:38.372 INFO:tasks.workunit.client.0.smithi029.stdout:5/435: fdatasync db/d12/d1a/f68 0 2024-04-26T11:46:38.373 INFO:tasks.workunit.client.0.smithi029.stdout:7/486: readlink lf 0 2024-04-26T11:46:38.373 INFO:tasks.workunit.client.0.smithi029.stdout:7/487: rmdir d11/d37/d3b 39 2024-04-26T11:46:38.373 INFO:tasks.workunit.client.0.smithi029.stdout:5/436: mkdir db/d89 0 2024-04-26T11:46:38.374 INFO:tasks.workunit.client.0.smithi029.stdout:7/488: read d11/d18/d1a/f31 [447117,108296] 0 2024-04-26T11:46:38.376 INFO:tasks.workunit.client.0.smithi029.stdout:6/457: truncate d7/d25/d4b/f6e 41200 0 2024-04-26T11:46:38.376 INFO:tasks.workunit.client.0.smithi029.stdout:7/489: write d11/d18/d1a/d92/f9a [2841339,81464] 0 2024-04-26T11:46:38.377 INFO:tasks.workunit.client.0.smithi029.stdout:2/459: dread d12/f28 [0,4194304] 0 2024-04-26T11:46:38.378 INFO:tasks.workunit.client.0.smithi029.stdout:6/458: fsync d7/d25/d5c/d34/f4a 0 2024-04-26T11:46:38.378 INFO:tasks.workunit.client.0.smithi029.stdout:2/460: rmdir d12/d6c 39 2024-04-26T11:46:38.378 INFO:tasks.workunit.client.0.smithi029.stdout:6/459: readlink d7/lc 0 2024-04-26T11:46:38.379 INFO:tasks.workunit.client.0.smithi029.stdout:7/490: rename d11/d15/f73 to d11/d18/d1a/d33/fa3 0 2024-04-26T11:46:38.380 INFO:tasks.workunit.client.0.smithi029.stdout:5/437: dwrite db/d12/d72/f2c [0,4194304] 0 2024-04-26T11:46:38.381 INFO:tasks.workunit.client.0.smithi029.stdout:7/491: fsync d11/d18/d1a/d33/f93 0 2024-04-26T11:46:38.382 INFO:tasks.workunit.client.0.smithi029.stdout:5/438: symlink db/d12/d72/d39/d3b/l8a 0 2024-04-26T11:46:38.383 INFO:tasks.workunit.client.0.smithi029.stdout:6/460: getdents d7/d25/d5c/d34/d4c 0 2024-04-26T11:46:38.384 INFO:tasks.workunit.client.0.smithi029.stdout:7/492: link lf d11/d37/d3b/la4 0 2024-04-26T11:46:38.385 INFO:tasks.workunit.client.0.smithi029.stdout:5/439: truncate db/d12/d1a/d4c/f58 1524711 0 2024-04-26T11:46:38.385 INFO:tasks.workunit.client.0.smithi029.stdout:6/461: rename d7/d25/d4b/f96 to d7/d20/f9b 0 2024-04-26T11:46:38.386 INFO:tasks.workunit.client.0.smithi029.stdout:7/493: write d11/d18/d58/f64 [841045,51359] 0 2024-04-26T11:46:38.386 INFO:tasks.workunit.client.0.smithi029.stdout:6/462: readlink d7/d25/d4b/l6a 0 2024-04-26T11:46:38.386 INFO:tasks.workunit.client.0.smithi029.stdout:5/440: creat db/d12/d1a/d4c/f8b x:0 0 0 2024-04-26T11:46:38.388 INFO:tasks.workunit.client.0.smithi029.stdout:6/463: creat d7/d20/d27/f9c x:0 0 0 2024-04-26T11:46:38.388 INFO:tasks.workunit.client.0.smithi029.stdout:5/441: write db/d12/d72/d39/d3b/f42 [1095540,24008] 0 2024-04-26T11:46:38.388 INFO:tasks.workunit.client.0.smithi029.stdout:6/464: rmdir d7/d25/d4b/d4d 39 2024-04-26T11:46:38.389 INFO:tasks.workunit.client.0.smithi029.stdout:2/461: dwrite d12/d24/d29/f71 [0,4194304] 0 2024-04-26T11:46:38.389 INFO:tasks.workunit.client.0.smithi029.stdout:7/494: link d11/d18/d1a/d92/f9a d11/d18/d35/d7c/fa5 0 2024-04-26T11:46:38.390 INFO:tasks.workunit.client.0.smithi029.stdout:7/495: chown d11/d18/d2d 536437 1 2024-04-26T11:46:38.391 INFO:tasks.workunit.client.0.smithi029.stdout:5/442: truncate db/d12/d72/f21 4931037 0 2024-04-26T11:46:38.391 INFO:tasks.workunit.client.0.smithi029.stdout:2/462: mknod d12/d6c/d73/d4f/d65/d8a/c97 1 2024-04-26T11:46:38.393 INFO:tasks.workunit.client.0.smithi029.stdout:2/463: rename d12/d24/d29/d8b to d12/d24/d29/d50/d98 0 2024-04-26T11:46:38.393 INFO:tasks.workunit.client.0.smithi029.stdout:6/465: link d7/d25/d4b/f4e d7/d46/d69/f9d 0 2024-04-26T11:46:38.393 INFO:tasks.workunit.client.0.smithi029.stdout:5/443: creat db/d12/d72/f8c x:0 0 0 2024-04-26T11:46:38.395 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:38.388+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:38.401 INFO:tasks.workunit.client.0.smithi029.stdout:6/466: dwrite d7/d25/f79 [0,4194304] 0 2024-04-26T11:46:38.402 INFO:tasks.workunit.client.0.smithi029.stdout:6/467: getdents d7/d20/d27/d91 0 2024-04-26T11:46:38.405 INFO:tasks.workunit.client.0.smithi029.stdout:6/468: symlink d7/d25/d5c/d34/d4c/d98/d45/d76/l9e 0 2024-04-26T11:46:38.406 INFO:tasks.workunit.client.0.smithi029.stdout:5/444: write db/d40/f66 [1045971,123341] 0 2024-04-26T11:46:38.407 INFO:tasks.workunit.client.0.smithi029.stdout:6/469: creat d7/d25/d5c/f9f x:0 0 0 2024-04-26T11:46:38.408 INFO:tasks.workunit.client.0.smithi029.stdout:6/470: rmdir d7/d25/d4b/d6d 39 2024-04-26T11:46:38.410 INFO:tasks.workunit.client.0.smithi029.stdout:2/464: dwrite f7 [0,4194304] 0 2024-04-26T11:46:38.413 INFO:tasks.workunit.client.0.smithi029.stdout:2/465: truncate d12/d24/f27 162120 0 2024-04-26T11:46:38.415 INFO:tasks.workunit.client.0.smithi029.stdout:2/466: rmdir d12/d24/d29/d50/d98 0 2024-04-26T11:46:38.416 INFO:tasks.workunit.client.0.smithi029.stdout:7/496: dread d11/d18/d1a/f4a [0,4194304] 0 2024-04-26T11:46:38.418 INFO:tasks.workunit.client.0.smithi029.stdout:2/467: dread d12/d24/d2f/d8c/f8e [0,4194304] 0 2024-04-26T11:46:38.419 INFO:tasks.workunit.client.0.smithi029.stdout:8/370: sync 2024-04-26T11:46:38.420 INFO:tasks.workunit.client.0.smithi029.stdout:1/507: sync 2024-04-26T11:46:38.421 INFO:tasks.workunit.client.0.smithi029.stdout:8/371: symlink dc/de/l7b 0 2024-04-26T11:46:38.422 INFO:tasks.workunit.client.0.smithi029.stdout:5/445: dread db/d12/d72/d39/d3b/f42 [0,4194304] 0 2024-04-26T11:46:38.422 INFO:tasks.workunit.client.0.smithi029.stdout:1/508: write d7/db/d10/d1e/d53/d9d/fa0 [1777323,111924] 0 2024-04-26T11:46:38.423 INFO:tasks.workunit.client.0.smithi029.stdout:8/372: read - dc/de/d2e/d23/f5f zero size 2024-04-26T11:46:38.423 INFO:tasks.workunit.client.0.smithi029.stdout:5/446: stat db/d40/l4e 0 2024-04-26T11:46:38.424 INFO:tasks.workunit.client.0.smithi029.stdout:7/497: dwrite d11/d18/d1a/d26/d91/f9c [0,4194304] 0 2024-04-26T11:46:38.425 INFO:tasks.workunit.client.0.smithi029.stdout:8/373: mkdir dc/d12/d7c 0 2024-04-26T11:46:38.425 INFO:tasks.workunit.client.0.smithi029.stdout:5/447: chown db/d40/f84 1438695941 1 2024-04-26T11:46:38.426 INFO:tasks.workunit.client.0.smithi029.stdout:8/374: fdatasync dc/d12/d6a/f77 0 2024-04-26T11:46:38.426 INFO:tasks.workunit.client.0.smithi029.stdout:7/498: truncate d11/d18/d35/f96 1022265 0 2024-04-26T11:46:38.427 INFO:tasks.workunit.client.0.smithi029.stdout:5/448: rmdir db/d40/d4d/d79 39 2024-04-26T11:46:38.428 INFO:tasks.workunit.client.0.smithi029.stdout:7/499: rmdir d11/d18/d1a/d26 39 2024-04-26T11:46:38.429 INFO:tasks.workunit.client.0.smithi029.stdout:7/500: truncate d11/d18/f40 1017687 0 2024-04-26T11:46:38.429 INFO:tasks.workunit.client.0.smithi029.stdout:8/375: truncate dc/de/d2e/d23/d27/d73/f45 1754748 0 2024-04-26T11:46:38.430 INFO:tasks.workunit.client.0.smithi029.stdout:8/376: fdatasync dc/f4f 0 2024-04-26T11:46:38.432 INFO:tasks.workunit.client.0.smithi029.stdout:7/501: getdents d11/d18/d35/d7c 0 2024-04-26T11:46:38.433 INFO:tasks.workunit.client.0.smithi029.stdout:1/509: dwrite d7/d25/dab/f94 [0,4194304] 0 2024-04-26T11:46:38.434 INFO:tasks.workunit.client.0.smithi029.stdout:1/510: mknod d7/cad 1 2024-04-26T11:46:38.434 INFO:tasks.workunit.client.0.smithi029.stdout:7/502: mkdir d11/d15/d79/da6 0 2024-04-26T11:46:38.435 INFO:tasks.workunit.client.0.smithi029.stdout:1/511: chown d7/d25/d99 31 1 2024-04-26T11:46:38.436 INFO:tasks.workunit.client.0.smithi029.stdout:7/503: fsync d11/d18/d1a/d26/d91/f9f 0 2024-04-26T11:46:38.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/504: chown d11/d18/l24 82296339 1 2024-04-26T11:46:38.437 INFO:tasks.workunit.client.0.smithi029.stdout:1/512: getdents d7/d25/d68 0 2024-04-26T11:46:38.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/505: mknod d11/d18/ca7 1 2024-04-26T11:46:38.438 INFO:tasks.workunit.client.0.smithi029.stdout:7/506: chown d11/d37 3 1 2024-04-26T11:46:38.438 INFO:tasks.workunit.client.0.smithi029.stdout:1/513: mkdir d7/d25/dae 0 2024-04-26T11:46:38.440 INFO:tasks.workunit.client.0.smithi029.stdout:8/377: dwrite dc/de/d2e/d23/d27/f3e [0,4194304] 0 2024-04-26T11:46:38.441 INFO:tasks.workunit.client.0.smithi029.stdout:8/378: dread - dc/de/d2e/d23/d27/d6f/f7a zero size 2024-04-26T11:46:38.443 INFO:tasks.workunit.client.0.smithi029.stdout:8/379: getdents dc/de 0 2024-04-26T11:46:38.444 INFO:tasks.workunit.client.0.smithi029.stdout:8/380: creat dc/de/d26/d6b/f7d x:0 0 0 2024-04-26T11:46:38.448 INFO:tasks.workunit.client.0.smithi029.stdout:1/514: write d7/f77 [540653,129330] 0 2024-04-26T11:46:38.450 INFO:tasks.workunit.client.0.smithi029.stdout:1/515: rmdir d7/db/d10/d1e/d53 39 2024-04-26T11:46:38.451 INFO:tasks.workunit.client.0.smithi029.stdout:1/516: unlink d7/d5b/f84 0 2024-04-26T11:46:38.451 INFO:tasks.workunit.client.0.smithi029.stdout:1/517: chown d7/f52 440393468 1 2024-04-26T11:46:38.453 INFO:tasks.workunit.client.0.smithi029.stdout:8/381: dwrite dc/de/d2e/d23/d27/d73/f3c [0,4194304] 0 2024-04-26T11:46:38.453 INFO:tasks.workunit.client.0.smithi029.stdout:1/518: chown d7/db/d10/d1e/d5e/d9e 1 1 2024-04-26T11:46:38.453 INFO:tasks.workunit.client.0.smithi029.stdout:8/382: chown dc/de/d2e 2513191 1 2024-04-26T11:46:38.453 INFO:tasks.workunit.client.0.smithi029.stdout:8/383: chown dc/de/f29 8 1 2024-04-26T11:46:38.454 INFO:tasks.workunit.client.0.smithi029.stdout:1/519: rename d7/d25/d6d/d8c/f61 to d7/db/d8d/faf 0 2024-04-26T11:46:38.456 INFO:tasks.workunit.client.0.smithi029.stdout:1/520: creat d7/db/d10/d1e/fb0 x:0 0 0 2024-04-26T11:46:38.457 INFO:tasks.workunit.client.0.smithi029.stdout:1/521: chown d7/d25/d68/d4b 450687 1 2024-04-26T11:46:38.457 INFO:tasks.workunit.client.0.smithi029.stdout:5/449: dread db/f52 [0,4194304] 0 2024-04-26T11:46:38.458 INFO:tasks.workunit.client.0.smithi029.stdout:1/522: creat d7/d5b/fb1 x:0 0 0 2024-04-26T11:46:38.463 INFO:tasks.workunit.client.0.smithi029.stdout:7/507: dread d11/d15/f2a [0,4194304] 0 2024-04-26T11:46:38.463 INFO:tasks.workunit.client.0.smithi029.stdout:8/384: dwrite dc/de/d26/f53 [0,4194304] 0 2024-04-26T11:46:38.464 INFO:tasks.workunit.client.0.smithi029.stdout:5/450: dread db/f20 [0,4194304] 0 2024-04-26T11:46:38.465 INFO:tasks.workunit.client.0.smithi029.stdout:8/385: symlink dc/de/d2e/d23/d27/d6f/l7e 0 2024-04-26T11:46:38.465 INFO:tasks.workunit.client.0.smithi029.stdout:5/451: stat db/d40/f66 0 2024-04-26T11:46:38.466 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:38.466 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:38.467 INFO:tasks.workunit.client.0.smithi029.stdout:8/386: symlink dc/d75/l7f 0 2024-04-26T11:46:38.467 INFO:tasks.workunit.client.0.smithi029.stdout:7/508: readlink d11/d15/d79/l82 0 2024-04-26T11:46:38.467 INFO:tasks.workunit.client.0.smithi029.stdout:1/523: dwrite d7/db/f34 [0,4194304] 0 2024-04-26T11:46:38.467 INFO:tasks.workunit.client.0.smithi029.stdout:5/452: creat db/d12/f8d x:0 0 0 2024-04-26T11:46:38.468 INFO:tasks.workunit.client.0.smithi029.stdout:7/509: write d11/d18/d35/f76 [438615,7274] 0 2024-04-26T11:46:38.469 INFO:tasks.workunit.client.0.smithi029.stdout:1/524: mkdir d7/db/d10/d1e/db2 0 2024-04-26T11:46:38.469 INFO:tasks.workunit.client.0.smithi029.stdout:8/387: truncate dc/de/d26/f69 3273943 0 2024-04-26T11:46:38.469 INFO:tasks.workunit.client.0.smithi029.stdout:5/453: truncate db/d12/d72/d39/d3b/f5e 191374 0 2024-04-26T11:46:38.471 INFO:tasks.workunit.client.0.smithi029.stdout:8/388: creat dc/de/d2e/d23/d27/d73/f80 x:0 0 0 2024-04-26T11:46:38.472 INFO:tasks.workunit.client.0.smithi029.stdout:6/471: sync 2024-04-26T11:46:38.472 INFO:tasks.workunit.client.0.smithi029.stdout:2/468: sync 2024-04-26T11:46:38.472 INFO:tasks.workunit.client.0.smithi029.stdout:0/443: sync 2024-04-26T11:46:38.472 INFO:tasks.workunit.client.0.smithi029.stdout:4/396: sync 2024-04-26T11:46:38.472 INFO:tasks.workunit.client.0.smithi029.stdout:3/434: sync 2024-04-26T11:46:38.472 INFO:tasks.workunit.client.0.smithi029.stdout:9/491: sync 2024-04-26T11:46:38.473 INFO:tasks.workunit.client.0.smithi029.stdout:8/389: write dc/d12/d6a/f77 [528855,35130] 0 2024-04-26T11:46:38.473 INFO:tasks.workunit.client.0.smithi029.stdout:4/397: chown d3/d1d/d11/d16 462677 1 2024-04-26T11:46:38.473 INFO:tasks.workunit.client.0.smithi029.stdout:0/444: readlink d9/d16/d33/d2f/d68/l93 0 2024-04-26T11:46:38.474 INFO:tasks.workunit.client.0.smithi029.stdout:2/469: write d12/d6c/d73/d4f/d65/f84 [1779641,114461] 0 2024-04-26T11:46:38.474 INFO:tasks.workunit.client.0.smithi029.stdout:3/435: link d0/d1/d5c/f78 d0/d37/f99 0 2024-04-26T11:46:38.475 INFO:tasks.workunit.client.0.smithi029.stdout:0/445: mknod d9/d16/d33/ca3 1 2024-04-26T11:46:38.475 INFO:tasks.workunit.client.0.smithi029.stdout:9/492: creat d4/d5/d16/d80/f9b x:0 0 0 2024-04-26T11:46:38.475 INFO:tasks.workunit.client.0.smithi029.stdout:8/390: rmdir dc/de/d26/d57 39 2024-04-26T11:46:38.476 INFO:tasks.workunit.client.0.smithi029.stdout:6/472: rename d7/l9 to d7/d25/d5c/d34/d4c/d98/d45/la0 0 2024-04-26T11:46:38.476 INFO:tasks.workunit.client.0.smithi029.stdout:2/470: dread - d12/d6c/f72 zero size 2024-04-26T11:46:38.477 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:38.478 INFO:tasks.workunit.client.0.smithi029.stdout:4/398: mknod d3/d1d/d11/d16/d1f/d3d/c80 1 2024-04-26T11:46:38.478 INFO:tasks.workunit.client.0.smithi029.stdout:6/473: chown d7/d25/l62 1742 1 2024-04-26T11:46:38.479 INFO:tasks.workunit.client.0.smithi029.stdout:4/399: mknod d3/d1d/db/d13/d73/d7e/c81 1 2024-04-26T11:46:38.479 INFO:tasks.workunit.client.0.smithi029.stdout:2/471: mkdir d12/d6c/d73/d4f/d65/d99 0 2024-04-26T11:46:38.479 INFO:tasks.workunit.client.0.smithi029.stdout:9/493: link d4/d49/d58/f53 d4/d46/f9c 0 2024-04-26T11:46:38.481 INFO:tasks.workunit.client.0.smithi029.stdout:4/400: truncate d3/f5 2377940 0 2024-04-26T11:46:38.482 INFO:tasks.workunit.client.0.smithi029.stdout:9/494: creat d4/d49/d58/f9d x:0 0 0 2024-04-26T11:46:38.482 INFO:tasks.workunit.client.0.smithi029.stdout:1/525: dwrite d7/d25/f2a [0,4194304] 0 2024-04-26T11:46:38.485 INFO:tasks.workunit.client.0.smithi029.stdout:4/401: rmdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c 39 2024-04-26T11:46:38.486 INFO:tasks.workunit.client.0.smithi029.stdout:3/436: dread d0/d1/d13/f14 [0,4194304] 0 2024-04-26T11:46:38.486 INFO:tasks.workunit.client.0.smithi029.stdout:4/402: chown d3/l25 127528 1 2024-04-26T11:46:38.487 INFO:tasks.workunit.client.0.smithi029.stdout:6/474: read d7/d25/d5c/f1e [620697,62151] 0 2024-04-26T11:46:38.490 INFO:tasks.workunit.client.0.smithi029.stdout:3/437: mkdir d0/dc/d80/d9a 0 2024-04-26T11:46:38.490 INFO:tasks.workunit.client.0.smithi029.stdout:2/472: dread d12/d6c/d73/d4f/d65/d6f/f77 [0,4194304] 0 2024-04-26T11:46:38.491 INFO:tasks.workunit.client.0.smithi029.stdout:6/475: mkdir d7/d20/d27/da1 0 2024-04-26T11:46:38.491 INFO:tasks.workunit.client.0.smithi029.stdout:3/438: creat d0/d1/d5c/f9b x:0 0 0 2024-04-26T11:46:38.491 INFO:tasks.workunit.client.0.smithi029.stdout:0/446: dwrite d9/d16/d52/fa2 [0,4194304] 0 2024-04-26T11:46:38.492 INFO:tasks.workunit.client.0.smithi029.stdout:2/473: creat d12/d6c/d70/f9a x:0 0 0 2024-04-26T11:46:38.493 INFO:tasks.workunit.client.0.smithi029.stdout:3/439: rmdir d0/d1/d41/d5f 39 2024-04-26T11:46:38.494 INFO:tasks.workunit.client.0.smithi029.stdout:2/474: chown d12/f1b 7325 1 2024-04-26T11:46:38.494 INFO:tasks.workunit.client.0.smithi029.stdout:0/447: fdatasync d9/d16/d33/d2f/d31/f4e 0 2024-04-26T11:46:38.495 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:38.493+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:38.497 INFO:tasks.workunit.client.0.smithi029.stdout:9/495: dwrite d4/d5/d78/f7c [0,4194304] 0 2024-04-26T11:46:38.501 INFO:tasks.workunit.client.0.smithi029.stdout:1/526: dwrite d7/d37/d98/f9a [0,4194304] 0 2024-04-26T11:46:38.501 INFO:tasks.workunit.client.0.smithi029.stdout:9/496: dread - d4/d46/f4d zero size 2024-04-26T11:46:38.501 INFO:tasks.workunit.client.0.smithi029.stdout:2/475: symlink d12/d24/d2f/d76/l9b 0 2024-04-26T11:46:38.503 INFO:tasks.workunit.client.0.smithi029.stdout:5/454: dread db/f6e [0,4194304] 0 2024-04-26T11:46:38.504 INFO:tasks.workunit.client.0.smithi029.stdout:1/527: chown d7/db/d10/d1e/l95 1193248 1 2024-04-26T11:46:38.505 INFO:tasks.workunit.client.0.smithi029.stdout:6/476: dwrite d7/d20/d27/f2b [4194304,4194304] 0 2024-04-26T11:46:38.508 INFO:tasks.workunit.client.0.smithi029.stdout:9/497: write d4/d5/d7/f47 [5587970,126571] 0 2024-04-26T11:46:38.509 INFO:tasks.workunit.client.0.smithi029.stdout:0/448: dwrite d9/f41 [0,4194304] 0 2024-04-26T11:46:38.509 INFO:tasks.workunit.client.0.smithi029.stdout:9/498: mknod d4/d5/d7a/c9e 1 2024-04-26T11:46:38.510 INFO:tasks.workunit.client.0.smithi029.stdout:9/499: fsync d4/d5/d16/f19 0 2024-04-26T11:46:38.510 INFO:tasks.workunit.client.0.smithi029.stdout:1/528: truncate d7/db/d10/d1e/d53/f6c 547020 0 2024-04-26T11:46:38.510 INFO:tasks.workunit.client.0.smithi029.stdout:0/449: write d9/d16/d33/f51 [708737,2150] 0 2024-04-26T11:46:38.510 INFO:tasks.workunit.client.0.smithi029.stdout:6/477: rename d7/d25/d5c/d34 to d7/d46/d69/da2 0 2024-04-26T11:46:38.511 INFO:tasks.workunit.client.0.smithi029.stdout:9/500: creat d4/d5/d7/f9f x:0 0 0 2024-04-26T11:46:38.512 INFO:tasks.workunit.client.0.smithi029.stdout:3/440: dwrite d0/d1/f7c [0,4194304] 0 2024-04-26T11:46:38.513 INFO:tasks.workunit.client.0.smithi029.stdout:1/529: fsync d7/db/d10/d1e/f45 0 2024-04-26T11:46:38.513 INFO:tasks.workunit.client.0.smithi029.stdout:1/530: chown d7/d25/d68 15 1 2024-04-26T11:46:38.515 INFO:tasks.workunit.client.0.smithi029.stdout:6/478: getdents d7/d20/d27/d91 0 2024-04-26T11:46:38.518 INFO:tasks.workunit.client.0.smithi029.stdout:8/391: dread dc/d3b/f41 [0,4194304] 0 2024-04-26T11:46:38.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/501: rename d4/d49/f4b to d4/d5/d7/d74/fa0 0 2024-04-26T11:46:38.519 INFO:tasks.workunit.client.0.smithi029.stdout:8/392: mknod dc/d12/d7c/c81 1 2024-04-26T11:46:38.519 INFO:tasks.workunit.client.0.smithi029.stdout:3/441: chown d0/d1/d41/d5f/d1a/d3b/f4f 1833348 1 2024-04-26T11:46:38.519 INFO:tasks.workunit.client.0.smithi029.stdout:1/531: creat d7/db/d10/d1e/fb3 x:0 0 0 2024-04-26T11:46:38.519 INFO:tasks.workunit.client.0.smithi029.stdout:2/476: write d12/d24/d29/d50/f56 [202465,88445] 0 2024-04-26T11:46:38.519 INFO:tasks.workunit.client.0.smithi029.stdout:6/479: chown d7/d25/d4b/d4d/d65/l7d 46288652 1 2024-04-26T11:46:38.519 INFO:tasks.workunit.client.0.smithi029.stdout:6/480: stat d7/d20/d27/f9c 0 2024-04-26T11:46:38.519 INFO:tasks.workunit.client.0.smithi029.stdout:2/477: creat d12/d6c/f9c x:0 0 0 2024-04-26T11:46:38.520 INFO:tasks.workunit.client.0.smithi029.stdout:1/532: rmdir d7/db/d10/d1e/d5e/d9e 0 2024-04-26T11:46:38.520 INFO:tasks.workunit.client.0.smithi029.stdout:7/510: dread f9 [4194304,4194304] 0 2024-04-26T11:46:38.521 INFO:tasks.workunit.client.0.smithi029.stdout:6/481: mkdir d7/d25/d5c/da3 0 2024-04-26T11:46:38.521 INFO:tasks.workunit.client.0.smithi029.stdout:1/533: creat d7/d5b/fb4 x:0 0 0 2024-04-26T11:46:38.522 INFO:tasks.workunit.client.0.smithi029.stdout:3/442: write d0/d1/d2f/f86 [4298779,87074] 0 2024-04-26T11:46:38.522 INFO:tasks.workunit.client.0.smithi029.stdout:2/478: write d12/d24/d29/d50/d55/f94 [879700,118789] 0 2024-04-26T11:46:38.522 INFO:tasks.workunit.client.0.smithi029.stdout:0/450: dwrite d9/d16/d33/d2f/f50 [0,4194304] 0 2024-04-26T11:46:38.524 INFO:tasks.workunit.client.0.smithi029.stdout:1/534: rmdir d7/db/d10/d1e/d53 39 2024-04-26T11:46:38.525 INFO:tasks.workunit.client.0.smithi029.stdout:3/443: creat d0/d1/d5c/f9c x:0 0 0 2024-04-26T11:46:38.526 INFO:tasks.workunit.client.0.smithi029.stdout:8/393: truncate dc/d12/f20 7032997 0 2024-04-26T11:46:38.526 INFO:tasks.workunit.client.0.smithi029.stdout:2/479: chown d12/d6c/d73/d4f/f7a 25848 1 2024-04-26T11:46:38.527 INFO:tasks.workunit.client.0.smithi029.stdout:9/502: dwrite d4/d5/d16/f19 [0,4194304] 0 2024-04-26T11:46:38.527 INFO:tasks.workunit.client.0.smithi029.stdout:6/482: rename d7/d20/d27/f50 to d7/d46/d69/da2/d4c/d98/fa4 0 2024-04-26T11:46:38.528 INFO:tasks.workunit.client.0.smithi029.stdout:3/444: mkdir d0/d1/d41/d5f/d4d/d9d 0 2024-04-26T11:46:38.529 INFO:tasks.workunit.client.0.smithi029.stdout:9/503: mkdir d4/d5/d7a/da1 0 2024-04-26T11:46:38.529 INFO:tasks.workunit.client.0.smithi029.stdout:8/394: rename dc/de/d2e/d23/d27/f42 to dc/de/d2e/d23/d27/d73/d43/f82 0 2024-04-26T11:46:38.529 INFO:tasks.workunit.client.0.smithi029.stdout:2/480: creat d12/d24/d29/d50/d6a/f9d x:0 0 0 2024-04-26T11:46:38.530 INFO:tasks.workunit.client.0.smithi029.stdout:8/395: readlink dc/d12/d6a/l4b 0 2024-04-26T11:46:38.531 INFO:tasks.workunit.client.0.smithi029.stdout:2/481: creat d12/d6c/d73/d4f/d65/d99/f9e x:0 0 0 2024-04-26T11:46:38.531 INFO:tasks.workunit.client.0.smithi029.stdout:2/482: mknod d12/d47/c9f 1 2024-04-26T11:46:38.537 INFO:tasks.workunit.client.0.smithi029.stdout:3/445: dwrite d0/d1/f7c [0,4194304] 0 2024-04-26T11:46:38.537 INFO:tasks.workunit.client.0.smithi029.stdout:4/403: dread d3/d1d/f21 [0,4194304] 0 2024-04-26T11:46:38.537 INFO:tasks.workunit.client.0.smithi029.stdout:9/504: dwrite d4/d5/d16/d39/f63 [0,4194304] 0 2024-04-26T11:46:38.538 INFO:tasks.workunit.client.0.smithi029.stdout:3/446: symlink d0/l9e 0 2024-04-26T11:46:38.538 INFO:tasks.workunit.client.0.smithi029.stdout:3/447: stat d0/l20 0 2024-04-26T11:46:38.538 INFO:tasks.workunit.client.0.smithi029.stdout:9/505: write d4/d5/d7a/d97/f98 [105472,81562] 0 2024-04-26T11:46:38.540 INFO:tasks.workunit.client.0.smithi029.stdout:9/506: link d4/d5/fd d4/d5/d7/d74/fa2 0 2024-04-26T11:46:38.541 INFO:tasks.workunit.client.0.smithi029.stdout:9/507: mkdir d4/d5/da3 0 2024-04-26T11:46:38.542 INFO:tasks.workunit.client.0.smithi029.stdout:9/508: symlink d4/d5/d7/d74/la4 0 2024-04-26T11:46:38.542 INFO:tasks.workunit.client.0.smithi029.stdout:9/509: readlink d4/d46/l81 0 2024-04-26T11:46:38.549 INFO:tasks.workunit.client.0.smithi029.stdout:1/535: truncate d7/db/d8d/f92 386920 0 2024-04-26T11:46:38.549 INFO:tasks.workunit.client.0.smithi029.stdout:0/451: truncate d9/d16/d33/d2f/f50 3925953 0 2024-04-26T11:46:38.549 INFO:tasks.workunit.client.0.smithi029.stdout:0/452: dread - d9/d16/f89 zero size 2024-04-26T11:46:38.549 INFO:tasks.workunit.client.0.smithi029.stdout:1/536: readlink d7/d25/d68/l12 0 2024-04-26T11:46:38.550 INFO:tasks.workunit.client.0.smithi029.stdout:9/510: dwrite d4/d5/d7/f85 [0,4194304] 0 2024-04-26T11:46:38.551 INFO:tasks.workunit.client.0.smithi029.stdout:5/455: dread db/d12/d72/d39/f41 [0,4194304] 0 2024-04-26T11:46:38.551 INFO:tasks.workunit.client.0.smithi029.stdout:0/453: mknod d9/d16/d33/d2f/d32/d90/ca4 1 2024-04-26T11:46:38.551 INFO:tasks.workunit.client.0.smithi029.stdout:1/537: write d7/d25/d68/d4b/d66/f70 [3647364,6938] 0 2024-04-26T11:46:38.552 INFO:tasks.workunit.client.0.smithi029.stdout:5/456: write db/d12/d1a/f19 [4941737,61576] 0 2024-04-26T11:46:38.552 INFO:tasks.workunit.client.0.smithi029.stdout:9/511: creat d4/d5/d7/d74/fa5 x:0 0 0 2024-04-26T11:46:38.553 INFO:tasks.workunit.client.0.smithi029.stdout:0/454: symlink d9/la5 0 2024-04-26T11:46:38.554 INFO:tasks.workunit.client.0.smithi029.stdout:4/404: write d3/f38 [742019,73597] 0 2024-04-26T11:46:38.555 INFO:tasks.workunit.client.0.smithi029.stdout:5/457: unlink db/d12/d72/d39/d3b/f42 0 2024-04-26T11:46:38.556 INFO:tasks.workunit.client.0.smithi029.stdout:9/512: getdents d4/d5/da3 0 2024-04-26T11:46:38.559 INFO:tasks.workunit.client.0.smithi029.stdout:9/513: fsync d4/d46/f9c 0 2024-04-26T11:46:38.560 INFO:tasks.workunit.client.0.smithi029.stdout:9/514: stat d4/l82 0 2024-04-26T11:46:38.560 INFO:tasks.workunit.client.0.smithi029.stdout:2/483: dwrite d12/d24/d2f/f93 [4194304,4194304] 0 2024-04-26T11:46:38.562 INFO:tasks.workunit.client.0.smithi029.stdout:2/484: chown d12/d6c/d73/d4f/d65/d6f/f77 199049167 1 2024-04-26T11:46:38.565 INFO:tasks.workunit.client.0.smithi029.stdout:2/485: chown d12/d24/d29/d36/l41 49 1 2024-04-26T11:46:38.565 INFO:tasks.workunit.client.0.smithi029.stdout:0/455: dwrite d9/f41 [4194304,4194304] 0 2024-04-26T11:46:38.566 INFO:tasks.workunit.client.0.smithi029.stdout:0/456: fdatasync d9/f36 0 2024-04-26T11:46:38.567 INFO:tasks.workunit.client.0.smithi029.stdout:0/457: unlink d9/d16/d8d/la1 0 2024-04-26T11:46:38.569 INFO:tasks.workunit.client.0.smithi029.stdout:9/515: dread d4/d5/d78/f7c [0,4194304] 0 2024-04-26T11:46:38.571 INFO:tasks.workunit.client.0.smithi029.stdout:9/516: fsync d4/d5/d16/f19 0 2024-04-26T11:46:38.571 INFO:tasks.workunit.client.0.smithi029.stdout:9/517: stat d4/d5/d16/d39 0 2024-04-26T11:46:38.572 INFO:tasks.workunit.client.0.smithi029.stdout:7/511: dread d11/d18/d58/f64 [0,4194304] 0 2024-04-26T11:46:38.572 INFO:tasks.workunit.client.0.smithi029.stdout:9/518: rmdir d4/d5 39 2024-04-26T11:46:38.573 INFO:tasks.workunit.client.0.smithi029.stdout:7/512: read - d11/d15/f8e zero size 2024-04-26T11:46:38.574 INFO:tasks.workunit.client.0.smithi029.stdout:9/519: fsync d4/d5/d16/d80/f92 0 2024-04-26T11:46:38.574 INFO:tasks.workunit.client.0.smithi029.stdout:7/513: read - d11/d15/f8e zero size 2024-04-26T11:46:38.575 INFO:tasks.workunit.client.0.smithi029.stdout:2/486: dwrite d12/d24/d29/f71 [0,4194304] 0 2024-04-26T11:46:38.575 INFO:tasks.workunit.client.0.smithi029.stdout:9/520: fdatasync d4/f1d 0 2024-04-26T11:46:38.575 INFO:tasks.workunit.client.0.smithi029.stdout:7/514: rename d11/d18/d1a/f4d to d11/d15/d79/da6/fa8 0 2024-04-26T11:46:38.576 INFO:tasks.workunit.client.0.smithi029.stdout:7/515: fsync d11/d18/d1a/d26/d91/f9f 0 2024-04-26T11:46:38.578 INFO:tasks.workunit.client.0.smithi029.stdout:7/516: dread - d11/d18/d2d/f86 zero size 2024-04-26T11:46:38.581 INFO:tasks.workunit.client.0.smithi029.stdout:6/483: sync 2024-04-26T11:46:38.581 INFO:tasks.workunit.client.0.smithi029.stdout:4/405: dread d3/d1d/f29 [0,4194304] 0 2024-04-26T11:46:38.581 INFO:tasks.workunit.client.0.smithi029.stdout:7/517: fdatasync d11/d18/d1a/d33/f75 0 2024-04-26T11:46:38.581 INFO:tasks.workunit.client.0.smithi029.stdout:7/518: symlink d11/d18/d1a/d26/la9 0 2024-04-26T11:46:38.586 INFO:tasks.workunit.client.0.smithi029.stdout:6/484: truncate d7/d25/d4b/d4d/f82 78955 0 2024-04-26T11:46:38.589 INFO:tasks.workunit.client.0.smithi029.stdout:0/458: write d9/d16/d25/d2a/d74/f87 [1110898,92033] 0 2024-04-26T11:46:38.589 INFO:tasks.workunit.client.0.smithi029.stdout:2/487: dwrite d12/d6c/d73/d4f/f80 [0,4194304] 0 2024-04-26T11:46:38.589 INFO:tasks.workunit.client.0.smithi029.stdout:6/485: truncate d7/d46/d69/f9d 1126217 0 2024-04-26T11:46:38.589 INFO:tasks.workunit.client.0.smithi029.stdout:8/396: dread dc/d3b/f5a [0,4194304] 0 2024-04-26T11:46:38.589 INFO:tasks.workunit.client.0.smithi029.stdout:6/486: rmdir d7/d46 39 2024-04-26T11:46:38.589 INFO:tasks.workunit.client.0.smithi029.stdout:7/519: getdents d11/d18/d35/d39 0 2024-04-26T11:46:38.589 INFO:tasks.workunit.client.0.smithi029.stdout:1/538: dread d7/d37/d98/fa5 [4194304,4194304] 0 2024-04-26T11:46:38.589 INFO:tasks.workunit.client.0.smithi029.stdout:7/520: stat d11/d18/d58 0 2024-04-26T11:46:38.589 INFO:tasks.workunit.client.0.smithi029.stdout:1/539: mknod d7/db/d10/d1e/cb5 1 2024-04-26T11:46:38.590 INFO:tasks.workunit.client.0.smithi029.stdout:8/397: mkdir dc/de/d2e/d23/d27/d73/d54/d83 0 2024-04-26T11:46:38.590 INFO:tasks.workunit.client.0.smithi029.stdout:7/521: write f8 [1953453,124113] 0 2024-04-26T11:46:38.590 INFO:tasks.workunit.client.0.smithi029.stdout:6/487: write d7/d46/d69/da2/d4c/d98/d45/d76/f99 [940238,56547] 0 2024-04-26T11:46:38.591 INFO:tasks.workunit.client.0.smithi029.stdout:4/406: dwrite d3/d1d/db/d13/f2f [0,4194304] 0 2024-04-26T11:46:38.592 INFO:tasks.workunit.client.0.smithi029.stdout:3/448: dread d0/dc/f71 [0,4194304] 0 2024-04-26T11:46:38.592 INFO:tasks.workunit.client.0.smithi029.stdout:5/458: dread db/d12/d1a/d4c/f58 [0,4194304] 0 2024-04-26T11:46:38.593 INFO:tasks.workunit.client.0.smithi029.stdout:6/488: creat d7/d97/fa5 x:0 0 0 2024-04-26T11:46:38.593 INFO:tasks.workunit.client.0.smithi029.stdout:8/398: write dc/de/d26/d6b/f7d [444818,80314] 0 2024-04-26T11:46:38.593 INFO:tasks.workunit.client.0.smithi029.stdout:1/540: getdents d7/d25/d6d 0 2024-04-26T11:46:38.593 INFO:tasks.workunit.client.0.smithi029.stdout:7/522: getdents d11/d37/d3b 0 2024-04-26T11:46:38.594 INFO:tasks.workunit.client.0.smithi029.stdout:1/541: readlink d7/db/d10/d20/l28 0 2024-04-26T11:46:38.595 INFO:tasks.workunit.client.0.smithi029.stdout:8/399: creat dc/d3b/f84 x:0 0 0 2024-04-26T11:46:38.595 INFO:tasks.workunit.client.0.smithi029.stdout:4/407: fdatasync d3/f38 0 2024-04-26T11:46:38.596 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:38.596 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:38.596 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:38.592+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:38.597 INFO:tasks.workunit.client.0.smithi029.stdout:5/459: truncate db/d12/d6b/f83 641686 0 2024-04-26T11:46:38.597 INFO:tasks.workunit.client.0.smithi029.stdout:7/523: write d11/d15/d79/d97/f9e [47646,107225] 0 2024-04-26T11:46:38.597 INFO:tasks.workunit.client.0.smithi029.stdout:0/459: dread d9/d43/f6d [0,4194304] 0 2024-04-26T11:46:38.597 INFO:tasks.workunit.client.0.smithi029.stdout:1/542: fsync d7/db/d10/d1e/f73 0 2024-04-26T11:46:38.598 INFO:tasks.workunit.client.0.smithi029.stdout:0/460: write d9/d16/d33/f44 [3898211,33387] 0 2024-04-26T11:46:38.598 INFO:tasks.workunit.client.0.smithi029.stdout:8/400: creat dc/de/d26/d57/f85 x:0 0 0 2024-04-26T11:46:38.598 INFO:tasks.workunit.client.0.smithi029.stdout:7/524: mkdir d11/d15/d69/daa 0 2024-04-26T11:46:38.599 INFO:tasks.workunit.client.0.smithi029.stdout:4/408: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f82 x:0 0 0 2024-04-26T11:46:38.599 INFO:tasks.workunit.client.0.smithi029.stdout:2/488: sync 2024-04-26T11:46:38.599 INFO:tasks.workunit.client.0.smithi029.stdout:1/543: symlink d7/d25/lb6 0 2024-04-26T11:46:38.599 INFO:tasks.workunit.client.0.smithi029.stdout:0/461: fsync d9/d16/d52/f2c 0 2024-04-26T11:46:38.600 INFO:tasks.workunit.client.0.smithi029.stdout:7/525: fsync d11/d18/f7d 0 2024-04-26T11:46:38.601 INFO:tasks.workunit.client.0.smithi029.stdout:8/401: mkdir dc/de/d26/d57/d86 0 2024-04-26T11:46:38.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/409: creat d3/d1d/f83 x:0 0 0 2024-04-26T11:46:38.601 INFO:tasks.workunit.client.0.smithi029.stdout:7/526: sync 2024-04-26T11:46:38.601 INFO:tasks.workunit.client.0.smithi029.stdout:2/489: stat d12/d6c/d73/d40/l6d 0 2024-04-26T11:46:38.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/410: write d3/d1d/db/f28 [1071128,9447] 0 2024-04-26T11:46:38.602 INFO:tasks.workunit.client.0.smithi029.stdout:0/462: read d9/d16/d33/f81 [478863,55691] 0 2024-04-26T11:46:38.602 INFO:tasks.workunit.client.0.smithi029.stdout:1/544: truncate d7/db/d8d/f92 462064 0 2024-04-26T11:46:38.602 INFO:tasks.workunit.client.0.smithi029.stdout:2/490: symlink d12/d24/d29/d50/d55/la0 0 2024-04-26T11:46:38.603 INFO:tasks.workunit.client.0.smithi029.stdout:0/463: mkdir d9/d16/d8d/da6 0 2024-04-26T11:46:38.606 INFO:tasks.workunit.client.0.smithi029.stdout:4/411: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84 0 2024-04-26T11:46:38.606 INFO:tasks.workunit.client.0.smithi029.stdout:6/489: dread d7/d46/d69/da2/d4c/f94 [0,4194304] 0 2024-04-26T11:46:38.606 INFO:tasks.workunit.client.0.smithi029.stdout:2/491: truncate d12/d24/d2f/f4e 418731 0 2024-04-26T11:46:38.608 INFO:tasks.workunit.client.0.smithi029.stdout:5/460: truncate db/f1e 8253 0 2024-04-26T11:46:38.608 INFO:tasks.workunit.client.0.smithi029.stdout:9/521: dread d4/d49/f5c [0,4194304] 0 2024-04-26T11:46:38.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:38.610 INFO:tasks.workunit.client.0.smithi029.stdout:6/490: creat d7/d46/d69/da2/d4c/d98/fa6 x:0 0 0 2024-04-26T11:46:38.612 INFO:tasks.workunit.client.0.smithi029.stdout:4/412: symlink d3/d1d/d11/d16/d1f/d3d/d39/d30/l85 0 2024-04-26T11:46:38.613 INFO:tasks.workunit.client.0.smithi029.stdout:7/527: dwrite d11/d18/d2d/f8c [0,4194304] 0 2024-04-26T11:46:38.614 INFO:tasks.workunit.client.0.smithi029.stdout:2/492: truncate d12/f2a 2208780 0 2024-04-26T11:46:38.614 INFO:tasks.workunit.client.0.smithi029.stdout:5/461: write db/d40/f61 [599614,95971] 0 2024-04-26T11:46:38.615 INFO:tasks.workunit.client.0.smithi029.stdout:1/545: dwrite d7/d5b/f81 [0,4194304] 0 2024-04-26T11:46:38.616 INFO:tasks.workunit.client.0.smithi029.stdout:3/449: dwrite d0/f27 [0,4194304] 0 2024-04-26T11:46:38.616 INFO:tasks.workunit.client.0.smithi029.stdout:4/413: rmdir d3/d1d/db/d13/d23 39 2024-04-26T11:46:38.617 INFO:tasks.workunit.client.0.smithi029.stdout:6/491: creat d7/d46/fa7 x:0 0 0 2024-04-26T11:46:38.617 INFO:tasks.workunit.client.0.smithi029.stdout:9/522: truncate d4/d5/d7/f59 2758934 0 2024-04-26T11:46:38.617 INFO:tasks.workunit.client.0.smithi029.stdout:4/414: fsync d3/f38 0 2024-04-26T11:46:38.618 INFO:tasks.workunit.client.0.smithi029.stdout:2/493: creat d12/d24/d29/d50/d6a/fa1 x:0 0 0 2024-04-26T11:46:38.618 INFO:tasks.workunit.client.0.smithi029.stdout:7/528: mkdir d11/d18/d1a/dab 0 2024-04-26T11:46:38.618 INFO:tasks.workunit.client.0.smithi029.stdout:5/462: write db/d12/d1a/f49 [2257196,44770] 0 2024-04-26T11:46:38.618 INFO:tasks.workunit.client.0.smithi029.stdout:1/546: symlink d7/d37/d3e/lb7 0 2024-04-26T11:46:38.619 INFO:tasks.workunit.client.0.smithi029.stdout:7/529: write d11/d18/d35/f76 [951491,54582] 0 2024-04-26T11:46:38.619 INFO:tasks.workunit.client.0.smithi029.stdout:5/463: chown db/d12/d72/d39 6340 1 2024-04-26T11:46:38.619 INFO:tasks.workunit.client.0.smithi029.stdout:5/464: stat db/d40/l4e 0 2024-04-26T11:46:38.621 INFO:tasks.workunit.client.0.smithi029.stdout:7/530: write d11/d18/d1a/f99 [785076,13968] 0 2024-04-26T11:46:38.621 INFO:tasks.workunit.client.0.smithi029.stdout:3/450: link d0/d1/d2b/d33/f8b d0/d1/d2f/f9f 0 2024-04-26T11:46:38.621 INFO:tasks.workunit.client.0.smithi029.stdout:6/492: truncate d7/d20/f40 2585137 0 2024-04-26T11:46:38.622 INFO:tasks.workunit.client.0.smithi029.stdout:1/547: link d7/f75 d7/d5b/fb8 0 2024-04-26T11:46:38.623 INFO:tasks.workunit.client.0.smithi029.stdout:4/415: getdents d3/d1d/db 0 2024-04-26T11:46:38.623 INFO:tasks.workunit.client.0.smithi029.stdout:7/531: creat d11/d15/d69/daa/fac x:0 0 0 2024-04-26T11:46:38.623 INFO:tasks.workunit.client.0.smithi029.stdout:1/548: link d7/db/d8d/f96 d7/d25/d6d/d8c/fb9 0 2024-04-26T11:46:38.623 INFO:tasks.workunit.client.0.smithi029.stdout:6/493: creat d7/d20/d27/da1/fa8 x:0 0 0 2024-04-26T11:46:38.624 INFO:tasks.workunit.client.0.smithi029.stdout:4/416: dread - d3/d1d/d11/d16/d1f/d3d/d39/f5a zero size 2024-04-26T11:46:38.625 INFO:tasks.workunit.client.0.smithi029.stdout:4/417: fdatasync d3/d1d/d11/f79 0 2024-04-26T11:46:38.625 INFO:tasks.workunit.client.0.smithi029.stdout:1/549: truncate d7/db/d10/d1e/f45 1215702 0 2024-04-26T11:46:38.625 INFO:tasks.workunit.client.0.smithi029.stdout:8/402: dread dc/de/d2e/d23/f21 [0,4194304] 0 2024-04-26T11:46:38.625 INFO:tasks.workunit.client.0.smithi029.stdout:6/494: getdents d7/d46/d69/da2/d4c/d98 0 2024-04-26T11:46:38.626 INFO:tasks.workunit.client.0.smithi029.stdout:8/403: mknod dc/d12/d6a/d78/c87 1 2024-04-26T11:46:38.627 INFO:tasks.workunit.client.0.smithi029.stdout:2/494: rename d12/f2a to d12/d24/d29/d50/d6a/fa2 0 2024-04-26T11:46:38.627 INFO:tasks.workunit.client.0.smithi029.stdout:4/418: chown d3/d1d/d11/d16/d1f/d3d/d39/l6f 221256 1 2024-04-26T11:46:38.627 INFO:tasks.workunit.client.0.smithi029.stdout:5/465: dread db/d12/d6b/f83 [0,4194304] 0 2024-04-26T11:46:38.628 INFO:tasks.workunit.client.0.smithi029.stdout:8/404: symlink dc/de/d26/d6b/l88 0 2024-04-26T11:46:38.628 INFO:tasks.workunit.client.0.smithi029.stdout:6/495: mkdir d7/d46/d69/da2/d4c/d98/d45/d83/da9 0 2024-04-26T11:46:38.631 INFO:tasks.workunit.client.0.smithi029.stdout:5/466: creat db/d40/d4d/d79/f8e x:0 0 0 2024-04-26T11:46:38.631 INFO:tasks.workunit.client.0.smithi029.stdout:8/405: stat dc/de/d26/d6b/l88 0 2024-04-26T11:46:38.631 INFO:tasks.workunit.client.0.smithi029.stdout:6/496: write d7/f3e [864805,99214] 0 2024-04-26T11:46:38.632 INFO:tasks.workunit.client.0.smithi029.stdout:4/419: write d3/d1d/d11/d16/d1f/d3d/d39/d30/f42 [1073909,62685] 0 2024-04-26T11:46:38.633 INFO:tasks.workunit.client.0.smithi029.stdout:1/550: dread f2 [0,4194304] 0 2024-04-26T11:46:38.633 INFO:tasks.workunit.client.0.smithi029.stdout:5/467: creat db/d40/d4d/d4f/f8f x:0 0 0 2024-04-26T11:46:38.634 INFO:tasks.workunit.client.0.smithi029.stdout:6/497: rmdir d7/d25/d4b 39 2024-04-26T11:46:38.634 INFO:tasks.workunit.client.0.smithi029.stdout:9/523: dwrite d4/d46/f79 [0,4194304] 0 2024-04-26T11:46:38.634 INFO:tasks.workunit.client.0.smithi029.stdout:7/532: dwrite d11/d15/f8e [0,4194304] 0 2024-04-26T11:46:38.635 INFO:tasks.workunit.client.0.smithi029.stdout:0/464: dread d9/f18 [0,4194304] 0 2024-04-26T11:46:38.635 INFO:tasks.workunit.client.0.smithi029.stdout:1/551: fsync d7/db/d10/d1e/fb3 0 2024-04-26T11:46:38.635 INFO:tasks.workunit.client.0.smithi029.stdout:8/406: rmdir dc/d12/d6a/d78/d62 0 2024-04-26T11:46:38.636 INFO:tasks.workunit.client.0.smithi029.stdout:5/468: creat db/d12/d1a/d4c/f90 x:0 0 0 2024-04-26T11:46:38.638 INFO:tasks.workunit.client.0.smithi029.stdout:4/420: truncate d3/d1d/db/d13/d23/f69 197655 0 2024-04-26T11:46:38.638 INFO:tasks.workunit.client.0.smithi029.stdout:8/407: write dc/de/d26/d57/f63 [1872990,89] 0 2024-04-26T11:46:38.638 INFO:tasks.workunit.client.0.smithi029.stdout:6/498: rename d7/d25/f84 to d7/d25/d4b/d4d/d65/faa 0 2024-04-26T11:46:38.638 INFO:tasks.workunit.client.0.smithi029.stdout:5/469: creat db/d12/d1a/d4c/f91 x:0 0 0 2024-04-26T11:46:38.638 INFO:tasks.workunit.client.0.smithi029.stdout:4/421: write d3/d1d/db/d13/d23/f4f [865966,35125] 0 2024-04-26T11:46:38.639 INFO:tasks.workunit.client.0.smithi029.stdout:6/499: truncate d7/d46/f7f 1257 0 2024-04-26T11:46:38.639 INFO:tasks.workunit.client.0.smithi029.stdout:8/408: symlink dc/de/d2e/d23/d27/d73/d54/l89 0 2024-04-26T11:46:38.639 INFO:tasks.workunit.client.0.smithi029.stdout:5/470: mkdir db/d12/d72/d92 0 2024-04-26T11:46:38.640 INFO:tasks.workunit.client.0.smithi029.stdout:5/471: unlink db/f52 0 2024-04-26T11:46:38.640 INFO:tasks.workunit.client.0.smithi029.stdout:4/422: stat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f6d 0 2024-04-26T11:46:38.641 INFO:tasks.workunit.client.0.smithi029.stdout:2/495: write d12/d24/d2f/f33 [1627623,16962] 0 2024-04-26T11:46:38.642 INFO:tasks.workunit.client.0.smithi029.stdout:8/409: rename dc/de/d2e/d23/d27/f67 to dc/de/d2e/d23/d27/d6f/f8a 0 2024-04-26T11:46:38.642 INFO:tasks.workunit.client.0.smithi029.stdout:5/472: write db/d12/d1a/f18 [2705501,29204] 0 2024-04-26T11:46:38.642 INFO:tasks.workunit.client.0.smithi029.stdout:2/496: mknod d12/d24/d29/d38/ca3 1 2024-04-26T11:46:38.643 INFO:tasks.workunit.client.0.smithi029.stdout:2/497: fdatasync d12/f1a 0 2024-04-26T11:46:38.643 INFO:tasks.workunit.client.0.smithi029.stdout:8/410: symlink dc/de/d2e/l8b 0 2024-04-26T11:46:38.643 INFO:tasks.workunit.client.0.smithi029.stdout:4/423: dread - d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f7d zero size 2024-04-26T11:46:38.645 INFO:tasks.workunit.client.0.smithi029.stdout:4/424: symlink d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/l86 0 2024-04-26T11:46:38.645 INFO:tasks.workunit.client.0.smithi029.stdout:8/411: symlink dc/de/d26/d57/d86/l8c 0 2024-04-26T11:46:38.646 INFO:tasks.workunit.client.0.smithi029.stdout:4/425: write d3/d1d/f5c [251652,109866] 0 2024-04-26T11:46:38.647 INFO:tasks.workunit.client.0.smithi029.stdout:8/412: chown dc/de/d2e/d23/d27/d6f 0 1 2024-04-26T11:46:38.647 INFO:tasks.workunit.client.0.smithi029.stdout:4/426: fsync d3/d1d/db/d13/f2f 0 2024-04-26T11:46:38.648 INFO:tasks.workunit.client.0.smithi029.stdout:9/524: write d4/d5/d16/d39/f76 [33868,7384] 0 2024-04-26T11:46:38.649 INFO:tasks.workunit.client.0.smithi029.stdout:4/427: chown d3/d1d/db/d13/d23/d2b/l7b 4 1 2024-04-26T11:46:38.649 INFO:tasks.workunit.client.0.smithi029.stdout:1/552: truncate d7/d5b/f81 641097 0 2024-04-26T11:46:38.650 INFO:tasks.workunit.client.0.smithi029.stdout:2/498: dwrite d12/d24/d29/f71 [0,4194304] 0 2024-04-26T11:46:38.651 INFO:tasks.workunit.client.0.smithi029.stdout:1/553: dread - d7/db/d10/d1e/d82/f8f zero size 2024-04-26T11:46:38.651 INFO:tasks.workunit.client.0.smithi029.stdout:0/465: truncate d9/d16/d25/d2a/d46/f5a 69048 0 2024-04-26T11:46:38.652 INFO:tasks.workunit.client.0.smithi029.stdout:4/428: dread - d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f7d zero size 2024-04-26T11:46:38.653 INFO:tasks.workunit.client.0.smithi029.stdout:2/499: readlink d12/d24/d29/d36/l41 0 2024-04-26T11:46:38.653 INFO:tasks.workunit.client.0.smithi029.stdout:0/466: unlink d9/d16/d33/f56 0 2024-04-26T11:46:38.654 INFO:tasks.workunit.client.0.smithi029.stdout:3/451: sync 2024-04-26T11:46:38.654 INFO:tasks.workunit.client.0.smithi029.stdout:6/500: sync 2024-04-26T11:46:38.654 INFO:tasks.workunit.client.0.smithi029.stdout:7/533: sync 2024-04-26T11:46:38.655 INFO:tasks.workunit.client.0.smithi029.stdout:8/413: dread dc/de/d2e/f68 [0,4194304] 0 2024-04-26T11:46:38.655 INFO:tasks.workunit.client.0.smithi029.stdout:4/429: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/c87 1 2024-04-26T11:46:38.656 INFO:tasks.workunit.client.0.smithi029.stdout:1/554: rename d7/db/l15 to d7/d25/dae/lba 0 2024-04-26T11:46:38.657 INFO:tasks.workunit.client.0.smithi029.stdout:7/534: fdatasync d11/d18/d1a/f83 0 2024-04-26T11:46:38.657 INFO:tasks.workunit.client.0.smithi029.stdout:0/467: mkdir d9/d16/d25/da7 0 2024-04-26T11:46:38.658 INFO:tasks.workunit.client.0.smithi029.stdout:8/414: mkdir dc/de/d2e/d23/d8d 0 2024-04-26T11:46:38.658 INFO:tasks.workunit.client.0.smithi029.stdout:2/500: stat d12/d6c/d73/d4f/d65/f84 0 2024-04-26T11:46:38.659 INFO:tasks.workunit.client.0.smithi029.stdout:7/535: mkdir d11/d18/dad 0 2024-04-26T11:46:38.659 INFO:tasks.workunit.client.0.smithi029.stdout:9/525: dwrite d4/d5/d7/d74/fa5 [0,4194304] 0 2024-04-26T11:46:38.662 INFO:tasks.workunit.client.0.smithi029.stdout:1/555: getdents d7/d25/dab 0 2024-04-26T11:46:38.662 INFO:tasks.workunit.client.0.smithi029.stdout:1/556: chown d7/d37/d3e/l7f 106225206 1 2024-04-26T11:46:38.662 INFO:tasks.workunit.client.0.smithi029.stdout:0/468: rename d9/d16/d33/d2f/d68/f76 to d9/d16/d8d/fa8 0 2024-04-26T11:46:38.663 INFO:tasks.workunit.client.0.smithi029.stdout:7/536: fsync d11/d18/d2d/f86 0 2024-04-26T11:46:38.663 INFO:tasks.workunit.client.0.smithi029.stdout:9/526: creat d4/d49/d58/fa6 x:0 0 0 2024-04-26T11:46:38.665 INFO:tasks.workunit.client.0.smithi029.stdout:9/527: fsync d4/d5/d7/f94 0 2024-04-26T11:46:38.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/537: chown d11/d15/d79/da6/fa8 6 1 2024-04-26T11:46:38.669 INFO:tasks.workunit.client.0.smithi029.stdout:9/528: chown d4/d5/d16/d39/f3d 22571420 1 2024-04-26T11:46:38.670 INFO:tasks.workunit.client.0.smithi029.stdout:3/452: dwrite d0/d1/d41/d5f/f59 [0,4194304] 0 2024-04-26T11:46:38.670 INFO:tasks.workunit.client.0.smithi029.stdout:7/538: creat d11/d18/d2d/fae x:0 0 0 2024-04-26T11:46:38.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/557: getdents d7/db/d8d 0 2024-04-26T11:46:38.672 INFO:tasks.workunit.client.0.smithi029.stdout:8/415: dwrite dc/de/f5c [4194304,4194304] 0 2024-04-26T11:46:38.672 INFO:tasks.workunit.client.0.smithi029.stdout:6/501: dwrite d7/d25/f47 [0,4194304] 0 2024-04-26T11:46:38.673 INFO:tasks.workunit.client.0.smithi029.stdout:3/453: unlink d0/d1/d2f/l3e 0 2024-04-26T11:46:38.674 INFO:tasks.workunit.client.0.smithi029.stdout:1/558: write d7/d25/dab/f94 [2776182,94366] 0 2024-04-26T11:46:38.674 INFO:tasks.workunit.client.0.smithi029.stdout:8/416: dread - dc/de/d26/d57/f59 zero size 2024-04-26T11:46:38.674 INFO:tasks.workunit.client.0.smithi029.stdout:3/454: mknod d0/d1/d2b/d7e/ca0 1 2024-04-26T11:46:38.674 INFO:tasks.workunit.client.0.smithi029.stdout:6/502: rename d7/d25/d4b/d4d/f75 to d7/d20/d27/fab 0 2024-04-26T11:46:38.675 INFO:tasks.workunit.client.0.smithi029.stdout:1/559: symlink d7/d25/dab/lbb 0 2024-04-26T11:46:38.675 INFO:tasks.workunit.client.0.smithi029.stdout:3/455: chown d0/d1/l91 3 1 2024-04-26T11:46:38.677 INFO:tasks.workunit.client.0.smithi029.stdout:6/503: chown d7/d25/d4b/d6d/f78 569995307 1 2024-04-26T11:46:38.678 INFO:tasks.workunit.client.0.smithi029.stdout:1/560: read d7/d5b/f81 [555360,15777] 0 2024-04-26T11:46:38.679 INFO:tasks.workunit.client.0.smithi029.stdout:7/539: dread d11/d15/f2a [0,4194304] 0 2024-04-26T11:46:38.680 INFO:tasks.workunit.client.0.smithi029.stdout:6/504: stat d7/d25/d4b/d6d/f95 0 2024-04-26T11:46:38.681 INFO:tasks.workunit.client.0.smithi029.stdout:3/456: read d0/d1/d13/f77 [308433,118792] 0 2024-04-26T11:46:38.681 INFO:tasks.workunit.client.0.smithi029.stdout:7/540: creat d11/d18/d58/faf x:0 0 0 2024-04-26T11:46:38.682 INFO:tasks.workunit.client.0.smithi029.stdout:0/469: dwrite d9/f20 [0,4194304] 0 2024-04-26T11:46:38.682 INFO:tasks.workunit.client.0.smithi029.stdout:1/561: truncate d7/d37/f58 537574 0 2024-04-26T11:46:38.683 INFO:tasks.workunit.client.0.smithi029.stdout:8/417: dread dc/d3b/f5a [0,4194304] 0 2024-04-26T11:46:38.684 INFO:tasks.workunit.client.0.smithi029.stdout:5/473: dread db/d12/d1a/f18 [0,4194304] 0 2024-04-26T11:46:38.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/505: creat d7/d25/d4b/fac x:0 0 0 2024-04-26T11:46:38.684 INFO:tasks.workunit.client.0.smithi029.stdout:8/418: mknod dc/c8e 1 2024-04-26T11:46:38.685 INFO:tasks.workunit.client.0.smithi029.stdout:0/470: write d9/d43/f6d [1499231,67407] 0 2024-04-26T11:46:38.685 INFO:tasks.workunit.client.0.smithi029.stdout:7/541: creat d11/fb0 x:0 0 0 2024-04-26T11:46:38.686 INFO:tasks.workunit.client.0.smithi029.stdout:0/471: chown d9/d16/d33/f51 8408 1 2024-04-26T11:46:38.686 INFO:tasks.workunit.client.0.smithi029.stdout:6/506: creat d7/fad x:0 0 0 2024-04-26T11:46:38.687 INFO:tasks.workunit.client.0.smithi029.stdout:8/419: creat dc/d12/d7c/f8f x:0 0 0 2024-04-26T11:46:38.687 INFO:tasks.workunit.client.0.smithi029.stdout:1/562: getdents d7/db/d10/d1e/d53/d9d 0 2024-04-26T11:46:38.687 INFO:tasks.workunit.client.0.smithi029.stdout:7/542: getdents d11/d18/d35/d7c 0 2024-04-26T11:46:38.688 INFO:tasks.workunit.client.0.smithi029.stdout:7/543: sync 2024-04-26T11:46:38.688 INFO:tasks.workunit.client.0.smithi029.stdout:1/563: dread - d7/db/d10/d1e/fb0 zero size 2024-04-26T11:46:38.689 INFO:tasks.workunit.client.0.smithi029.stdout:6/507: creat d7/d25/d4b/d4d/fae x:0 0 0 2024-04-26T11:46:38.689 INFO:tasks.workunit.client.0.smithi029.stdout:0/472: creat d9/d16/d25/da7/fa9 x:0 0 0 2024-04-26T11:46:38.690 INFO:tasks.workunit.client.0.smithi029.stdout:8/420: dread dc/de/d2e/f68 [0,4194304] 0 2024-04-26T11:46:38.690 INFO:tasks.workunit.client.0.smithi029.stdout:7/544: write d11/d15/f3f [3236200,82392] 0 2024-04-26T11:46:38.691 INFO:tasks.workunit.client.0.smithi029.stdout:7/545: sync 2024-04-26T11:46:38.691 INFO:tasks.workunit.client.0.smithi029.stdout:0/473: write d9/d16/d25/f6c [387746,68313] 0 2024-04-26T11:46:38.691 INFO:tasks.workunit.client.0.smithi029.stdout:6/508: write d7/d25/d4b/d4d/f82 [566152,6407] 0 2024-04-26T11:46:38.692 INFO:tasks.workunit.client.0.smithi029.stdout:8/421: mkdir dc/de/d26/d57/d86/d90 0 2024-04-26T11:46:38.693 INFO:tasks.workunit.client.0.smithi029.stdout:7/546: creat d11/d15/d69/daa/fb1 x:0 0 0 2024-04-26T11:46:38.693 INFO:tasks.workunit.client.0.smithi029.stdout:0/474: creat d9/d16/d25/d2a/d46/faa x:0 0 0 2024-04-26T11:46:38.693 INFO:tasks.workunit.client.0.smithi029.stdout:3/457: dwrite d0/d1/d41/d5f/d1a/f61 [4194304,4194304] 0 2024-04-26T11:46:38.694 INFO:tasks.workunit.client.0.smithi029.stdout:7/547: readlink d11/d18/d1a/d92/l94 0 2024-04-26T11:46:38.695 INFO:tasks.workunit.client.0.smithi029.stdout:6/509: mknod d7/d46/d69/da2/d4c/d98/d45/d83/caf 1 2024-04-26T11:46:38.695 INFO:tasks.workunit.client.0.smithi029.stdout:7/548: mknod d11/d37/d3b/cb2 1 2024-04-26T11:46:38.696 INFO:tasks.workunit.client.0.smithi029.stdout:8/422: rename dc/de/d2e/f2a to dc/de/d2e/d23/d27/d73/d54/f91 0 2024-04-26T11:46:38.696 INFO:tasks.workunit.client.0.smithi029.stdout:5/474: dwrite db/d12/d1a/d4c/f8b [0,4194304] 0 2024-04-26T11:46:38.696 INFO:tasks.workunit.client.0.smithi029.stdout:0/475: rename d9/d16 to d9/d16/d33/d2f/d31/dab 22 2024-04-26T11:46:38.697 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:38.692+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:38.697 INFO:tasks.workunit.client.0.smithi029.stdout:7/549: creat d11/d37/fb3 x:0 0 0 2024-04-26T11:46:38.698 INFO:tasks.workunit.client.0.smithi029.stdout:0/476: unlink d9/d16/d8d/fa8 0 2024-04-26T11:46:38.698 INFO:tasks.workunit.client.0.smithi029.stdout:6/510: write d7/d46/d69/da2/d4c/f94 [49039,130240] 0 2024-04-26T11:46:38.698 INFO:tasks.workunit.client.0.smithi029.stdout:3/458: read d0/dc/d80/f8f [258033,80208] 0 2024-04-26T11:46:38.699 INFO:tasks.workunit.client.0.smithi029.stdout:7/550: write d11/d18/f40 [757028,27049] 0 2024-04-26T11:46:38.699 INFO:tasks.workunit.client.0.smithi029.stdout:5/475: mkdir db/d40/d4d/d4f/d73/d93 0 2024-04-26T11:46:38.699 INFO:tasks.workunit.client.0.smithi029.stdout:3/459: stat d0/d1/l7f 0 2024-04-26T11:46:38.700 INFO:tasks.workunit.client.0.smithi029.stdout:0/477: read - d9/d16/d33/d2f/d31/d6a/f8b zero size 2024-04-26T11:46:38.700 INFO:tasks.workunit.client.0.smithi029.stdout:7/551: fdatasync d11/d18/d2d/f77 0 2024-04-26T11:46:38.700 INFO:tasks.workunit.client.0.smithi029.stdout:5/476: dread - db/d12/d6b/f85 zero size 2024-04-26T11:46:38.701 INFO:tasks.workunit.client.0.smithi029.stdout:3/460: dread - d0/d1/d41/d4c/f7b zero size 2024-04-26T11:46:38.701 INFO:tasks.workunit.client.0.smithi029.stdout:7/552: stat d11/d18/d35/d7c 0 2024-04-26T11:46:38.702 INFO:tasks.workunit.client.0.smithi029.stdout:0/478: mkdir d9/d16/d33/d2f/d32/d9f/dac 0 2024-04-26T11:46:38.702 INFO:tasks.workunit.client.0.smithi029.stdout:5/477: rename db/d12/d1a/f49 to db/d89/f94 0 2024-04-26T11:46:38.703 INFO:tasks.workunit.client.0.smithi029.stdout:3/461: unlink d0/dc/f45 0 2024-04-26T11:46:38.703 INFO:tasks.workunit.client.0.smithi029.stdout:4/430: dread d3/d1d/d11/d16/d1f/d3d/d39/f32 [0,4194304] 0 2024-04-26T11:46:38.703 INFO:tasks.workunit.client.0.smithi029.stdout:3/462: readlink d0/d1/d13/l19 0 2024-04-26T11:46:38.703 INFO:tasks.workunit.client.0.smithi029.stdout:5/478: write db/d12/f5c [50208,4987] 0 2024-04-26T11:46:38.704 INFO:tasks.workunit.client.0.smithi029.stdout:4/431: chown d3/d1d/db/d13/d23/f45 2 1 2024-04-26T11:46:38.705 INFO:tasks.workunit.client.0.smithi029.stdout:3/463: getdents d0/d1/d2f/d82 0 2024-04-26T11:46:38.706 INFO:tasks.workunit.client.0.smithi029.stdout:3/464: write d0/d1/f16 [2203963,114235] 0 2024-04-26T11:46:38.707 INFO:tasks.workunit.client.0.smithi029.stdout:6/511: dread d7/d46/f7f [0,4194304] 0 2024-04-26T11:46:38.707 INFO:tasks.workunit.client.0.smithi029.stdout:9/529: dread d4/d5/d16/d39/f3c [0,4194304] 0 2024-04-26T11:46:38.708 INFO:tasks.workunit.client.0.smithi029.stdout:3/465: creat d0/d1/d2b/d33/fa1 x:0 0 0 2024-04-26T11:46:38.708 INFO:tasks.workunit.client.0.smithi029.stdout:2/501: dread d12/d6c/d73/d4f/f7a [4194304,4194304] 0 2024-04-26T11:46:38.708 INFO:tasks.workunit.client.0.smithi029.stdout:0/479: read d9/d16/d33/f44 [1161928,67886] 0 2024-04-26T11:46:38.709 INFO:tasks.workunit.client.0.smithi029.stdout:6/512: creat d7/d25/d4b/d4d/fb0 x:0 0 0 2024-04-26T11:46:38.709 INFO:tasks.workunit.client.0.smithi029.stdout:3/466: chown d0/dc/l93 31 1 2024-04-26T11:46:38.711 INFO:tasks.workunit.client.0.smithi029.stdout:0/480: fsync f3 0 2024-04-26T11:46:38.711 INFO:tasks.workunit.client.0.smithi029.stdout:2/502: truncate d12/d24/d29/f71 4553267 0 2024-04-26T11:46:38.711 INFO:tasks.workunit.client.0.smithi029.stdout:3/467: fsync d0/d1/d41/d5f/d54/f7d 0 2024-04-26T11:46:38.712 INFO:tasks.workunit.client.0.smithi029.stdout:6/513: creat d7/d46/d69/da2/fb1 x:0 0 0 2024-04-26T11:46:38.712 INFO:tasks.workunit.client.0.smithi029.stdout:0/481: symlink d9/d16/d33/d2f/d32/d90/lad 0 2024-04-26T11:46:38.714 INFO:tasks.workunit.client.0.smithi029.stdout:4/432: dwrite d3/d1d/d11/d16/d1f/d3d/f60 [0,4194304] 0 2024-04-26T11:46:38.722 INFO:tasks.workunit.client.0.smithi029.stdout:5/479: write f4 [890979,16711] 0 2024-04-26T11:46:38.722 INFO:tasks.workunit.client.0.smithi029.stdout:6/514: symlink d7/d46/d69/da2/d4c/lb2 0 2024-04-26T11:46:38.722 INFO:tasks.workunit.client.0.smithi029.stdout:9/530: write d4/d5/d16/d39/f8c [1526600,53702] 0 2024-04-26T11:46:38.722 INFO:tasks.workunit.client.0.smithi029.stdout:4/433: mknod d3/d1d/db/d13/c88 1 2024-04-26T11:46:38.722 INFO:tasks.workunit.client.0.smithi029.stdout:3/468: creat d0/d1/d41/d5f/fa2 x:0 0 0 2024-04-26T11:46:38.722 INFO:tasks.workunit.client.0.smithi029.stdout:8/423: sync 2024-04-26T11:46:38.723 INFO:tasks.workunit.client.0.smithi029.stdout:9/531: write d4/d5/d16/d39/f8c [468807,111276] 0 2024-04-26T11:46:38.723 INFO:tasks.workunit.client.0.smithi029.stdout:4/434: rename d3/f38 to d3/d1d/f89 0 2024-04-26T11:46:38.725 INFO:tasks.workunit.client.0.smithi029.stdout:0/482: write d9/d16/d33/d2f/d32/d9d/f9e [4035328,28924] 0 2024-04-26T11:46:38.727 INFO:tasks.workunit.client.0.smithi029.stdout:2/503: dwrite d12/d6c/d73/d4f/d65/f75 [0,4194304] 0 2024-04-26T11:46:38.729 INFO:tasks.workunit.client.0.smithi029.stdout:8/424: truncate dc/de/f29 1966783 0 2024-04-26T11:46:38.731 INFO:tasks.workunit.client.0.smithi029.stdout:5/480: dwrite db/d12/d1a/f19 [0,4194304] 0 2024-04-26T11:46:38.731 INFO:tasks.workunit.client.0.smithi029.stdout:0/483: rename d9/d16/d25/d2a/d74/f87 to d9/d16/d33/d2f/d31/fae 0 2024-04-26T11:46:38.732 INFO:tasks.workunit.client.0.smithi029.stdout:4/435: dread d3/d1d/d11/d16/f57 [0,4194304] 0 2024-04-26T11:46:38.735 INFO:tasks.workunit.client.0.smithi029.stdout:6/515: dwrite d7/d46/d69/da2/d4c/f7a [0,4194304] 0 2024-04-26T11:46:38.735 INFO:tasks.workunit.client.0.smithi029.stdout:8/425: write dc/de/d2e/d23/d27/d6f/f7a [1043277,32776] 0 2024-04-26T11:46:38.735 INFO:tasks.workunit.client.0.smithi029.stdout:2/504: rename d12/d6c/d73/d4f/d65/d8a to d12/d24/d29/d36/da4 0 2024-04-26T11:46:38.735 INFO:tasks.workunit.client.0.smithi029.stdout:5/481: creat db/d40/d4d/f95 x:0 0 0 2024-04-26T11:46:38.736 INFO:tasks.workunit.client.0.smithi029.stdout:4/436: symlink d3/d1d/db/l8a 0 2024-04-26T11:46:38.737 INFO:tasks.workunit.client.0.smithi029.stdout:8/426: mknod dc/de/d26/d6b/c92 1 2024-04-26T11:46:38.737 INFO:tasks.workunit.client.0.smithi029.stdout:2/505: fsync d12/f22 0 2024-04-26T11:46:38.738 INFO:tasks.workunit.client.0.smithi029.stdout:3/469: dwrite d0/d1/f43 [0,4194304] 0 2024-04-26T11:46:38.738 INFO:tasks.workunit.client.0.smithi029.stdout:9/532: dwrite d4/d49/d58/f53 [0,4194304] 0 2024-04-26T11:46:38.739 INFO:tasks.workunit.client.0.smithi029.stdout:5/482: write db/d12/f8d [424610,44726] 0 2024-04-26T11:46:38.739 INFO:tasks.workunit.client.0.smithi029.stdout:2/506: write d12/f39 [6449583,17190] 0 2024-04-26T11:46:38.743 INFO:tasks.workunit.client.0.smithi029.stdout:7/553: dread f9 [0,4194304] 0 2024-04-26T11:46:38.743 INFO:tasks.workunit.client.0.smithi029.stdout:1/564: dread d7/db/f2d [0,4194304] 0 2024-04-26T11:46:38.743 INFO:tasks.workunit.client.0.smithi029.stdout:9/533: creat d4/d49/d58/fa7 x:0 0 0 2024-04-26T11:46:38.743 INFO:tasks.workunit.client.0.smithi029.stdout:8/427: creat dc/f93 x:0 0 0 2024-04-26T11:46:38.743 INFO:tasks.workunit.client.0.smithi029.stdout:3/470: mkdir d0/d1/d2b/d7e/da3 0 2024-04-26T11:46:38.745 INFO:tasks.workunit.client.0.smithi029.stdout:8/428: readlink dc/de/d2e/l39 0 2024-04-26T11:46:38.745 INFO:tasks.workunit.client.0.smithi029.stdout:1/565: fdatasync d7/d25/d68/f79 0 2024-04-26T11:46:38.747 INFO:tasks.workunit.client.0.smithi029.stdout:1/566: chown d7/d25/d6d/d8c/f88 0 1 2024-04-26T11:46:38.747 INFO:tasks.workunit.client.0.smithi029.stdout:8/429: creat dc/de/d2e/f94 x:0 0 0 2024-04-26T11:46:38.748 INFO:tasks.workunit.client.0.smithi029.stdout:5/483: dwrite db/d12/f7c [0,4194304] 0 2024-04-26T11:46:38.748 INFO:tasks.workunit.client.0.smithi029.stdout:2/507: dwrite d12/d6c/d73/d4f/d65/d99/f9e [0,4194304] 0 2024-04-26T11:46:38.749 INFO:tasks.workunit.client.0.smithi029.stdout:8/430: rmdir dc/de/d2e/d23/d27/d73 39 2024-04-26T11:46:38.750 INFO:tasks.workunit.client.0.smithi029.stdout:5/484: creat db/d12/d1a/f96 x:0 0 0 2024-04-26T11:46:38.751 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:38.751 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:38.751 INFO:tasks.workunit.client.0.smithi029.stdout:2/508: mkdir d12/d6c/d73/da5 0 2024-04-26T11:46:38.753 INFO:tasks.workunit.client.0.smithi029.stdout:5/485: creat db/d40/d77/f97 x:0 0 0 2024-04-26T11:46:38.755 INFO:tasks.workunit.client.0.smithi029.stdout:7/554: truncate d11/f13 351397 0 2024-04-26T11:46:38.756 INFO:tasks.workunit.client.0.smithi029.stdout:5/486: mkdir db/d40/d77/d98 0 2024-04-26T11:46:38.758 INFO:tasks.workunit.client.0.smithi029.stdout:4/437: write d3/d1d/db/f51 [298306,31989] 0 2024-04-26T11:46:38.758 INFO:tasks.workunit.client.0.smithi029.stdout:7/555: chown lf 12 1 2024-04-26T11:46:38.758 INFO:tasks.workunit.client.0.smithi029.stdout:1/567: dwrite d7/d37/d3e/f56 [4194304,4194304] 0 2024-04-26T11:46:38.758 INFO:tasks.workunit.client.0.smithi029.stdout:4/438: stat d3/f31 0 2024-04-26T11:46:38.760 INFO:tasks.workunit.client.0.smithi029.stdout:5/487: getdents db/d12/d1a/d4c 0 2024-04-26T11:46:38.760 INFO:tasks.workunit.client.0.smithi029.stdout:7/556: symlink d11/d18/d1a/d33/lb4 0 2024-04-26T11:46:38.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:38.762 INFO:tasks.workunit.client.0.smithi029.stdout:1/568: creat d7/db/d10/d1e/db2/fbc x:0 0 0 2024-04-26T11:46:38.762 INFO:tasks.workunit.client.0.smithi029.stdout:2/509: dwrite d12/f1b [0,4194304] 0 2024-04-26T11:46:38.763 INFO:tasks.workunit.client.0.smithi029.stdout:7/557: fdatasync d11/d18/d1a/f23 0 2024-04-26T11:46:38.763 INFO:tasks.workunit.client.0.smithi029.stdout:8/431: dwrite dc/f66 [0,4194304] 0 2024-04-26T11:46:38.763 INFO:tasks.workunit.client.0.smithi029.stdout:4/439: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84/f8b x:0 0 0 2024-04-26T11:46:38.765 INFO:tasks.workunit.client.0.smithi029.stdout:1/569: creat d7/db/d10/d20/fbd x:0 0 0 2024-04-26T11:46:38.765 INFO:tasks.workunit.client.0.smithi029.stdout:7/558: creat d11/d37/d3b/fb5 x:0 0 0 2024-04-26T11:46:38.765 INFO:tasks.workunit.client.0.smithi029.stdout:5/488: creat db/d12/d72/d39/d3b/d86/f99 x:0 0 0 2024-04-26T11:46:38.766 INFO:tasks.workunit.client.0.smithi029.stdout:2/510: symlink d12/d24/d2f/d8c/la6 0 2024-04-26T11:46:38.768 INFO:tasks.workunit.client.0.smithi029.stdout:1/570: link d7/d25/d68/f60 d7/db/d10/d1e/d53/d9d/fbe 0 2024-04-26T11:46:38.768 INFO:tasks.workunit.client.0.smithi029.stdout:4/440: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f82 949548 0 2024-04-26T11:46:38.770 INFO:tasks.workunit.client.0.smithi029.stdout:7/559: rename d11/d37/d3b to d11/d18/d35/d39/d7e/db6 0 2024-04-26T11:46:38.771 INFO:tasks.workunit.client.0.smithi029.stdout:2/511: rename d12/d24/d29/d36/da4/l8f to d12/d6c/d73/da5/la7 0 2024-04-26T11:46:38.771 INFO:tasks.workunit.client.0.smithi029.stdout:7/560: readlink d11/d18/d1a/d33/lb4 0 2024-04-26T11:46:38.772 INFO:tasks.workunit.client.0.smithi029.stdout:8/432: dread dc/de/d2e/d23/d27/d73/d54/f61 [0,4194304] 0 2024-04-26T11:46:38.774 INFO:tasks.workunit.client.0.smithi029.stdout:8/433: mknod dc/d12/d6a/d78/c95 1 2024-04-26T11:46:38.777 INFO:tasks.workunit.client.0.smithi029.stdout:9/534: dread d4/d5/d16/f73 [0,4194304] 0 2024-04-26T11:46:38.777 INFO:tasks.workunit.client.0.smithi029.stdout:4/441: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f63 [907085,48074] 0 2024-04-26T11:46:38.777 INFO:tasks.workunit.client.0.smithi029.stdout:9/535: stat d4/d5/d16/l4c 0 2024-04-26T11:46:38.777 INFO:tasks.workunit.client.0.smithi029.stdout:1/571: dwrite d7/db/d10/f74 [0,4194304] 0 2024-04-26T11:46:38.778 INFO:tasks.workunit.client.0.smithi029.stdout:8/434: rename dc/de/d2e/d23/d27/d73/d54/d83 to dc/de/d26/d57/d86/d96 0 2024-04-26T11:46:38.781 INFO:tasks.workunit.client.0.smithi029.stdout:1/572: rename d7/l4c to d7/d25/d85/lbf 0 2024-04-26T11:46:38.781 INFO:tasks.workunit.client.0.smithi029.stdout:2/512: dwrite d12/d24/d29/d38/f4a [0,4194304] 0 2024-04-26T11:46:38.781 INFO:tasks.workunit.client.0.smithi029.stdout:4/442: link d3/d1d/f83 d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f8c 0 2024-04-26T11:46:38.782 INFO:tasks.workunit.client.0.smithi029.stdout:1/573: rename d7/f78 to d7/d25/d68/fc0 0 2024-04-26T11:46:38.783 INFO:tasks.workunit.client.0.smithi029.stdout:2/513: creat d12/d6c/d73/d40/fa8 x:0 0 0 2024-04-26T11:46:38.785 INFO:tasks.workunit.client.0.smithi029.stdout:2/514: write d12/f1a [1160028,108623] 0 2024-04-26T11:46:38.785 INFO:tasks.workunit.client.0.smithi029.stdout:4/443: link d3/d1d/db/d13/d23/d2b/f7c d3/f8d 0 2024-04-26T11:46:38.786 INFO:tasks.workunit.client.0.smithi029.stdout:2/515: unlink d12/d6c/d70/f74 0 2024-04-26T11:46:38.789 INFO:tasks.workunit.client.0.smithi029.stdout:9/536: dwrite d4/d5/fb [4194304,4194304] 0 2024-04-26T11:46:38.789 INFO:tasks.workunit.client.0.smithi029.stdout:0/484: dread d9/d16/d33/f72 [0,4194304] 0 2024-04-26T11:46:38.789 INFO:tasks.workunit.client.0.smithi029.stdout:9/537: mkdir d4/d5/d7/d74/da8 0 2024-04-26T11:46:38.790 INFO:tasks.workunit.client.0.smithi029.stdout:0/485: unlink d9/d16/d25/d2a/d46/f70 0 2024-04-26T11:46:38.791 INFO:tasks.workunit.client.0.smithi029.stdout:9/538: write d4/d49/d58/f9d [438557,93658] 0 2024-04-26T11:46:38.791 INFO:tasks.workunit.client.0.smithi029.stdout:1/574: rename d7/d25/d68/l12 to d7/d25/d6d/lc1 0 2024-04-26T11:46:38.794 INFO:tasks.workunit.client.0.smithi029.stdout:0/486: creat d9/d16/d25/d2a/d74/d9a/faf x:0 0 0 2024-04-26T11:46:38.795 INFO:tasks.workunit.client.0.smithi029.stdout:4/444: dwrite d3/f31 [0,4194304] 0 2024-04-26T11:46:38.795 INFO:tasks.workunit.client.0.smithi029.stdout:9/539: dread d4/d5/d16/f73 [0,4194304] 0 2024-04-26T11:46:38.796 INFO:tasks.workunit.client.0.smithi029.stdout:3/471: sync 2024-04-26T11:46:38.796 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:38.793+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:38.797 INFO:tasks.workunit.client.0.smithi029.stdout:6/516: dread d7/d46/d69/da2/d4c/d98/fa4 [0,4194304] 0 2024-04-26T11:46:38.799 INFO:tasks.workunit.client.0.smithi029.stdout:0/487: rename d9/d16/d33/d2f/d32/f42 to d9/d16/d25/d2a/fb0 0 2024-04-26T11:46:38.799 INFO:tasks.workunit.client.0.smithi029.stdout:2/516: dwrite d12/d24/d29/d38/f4a [4194304,4194304] 0 2024-04-26T11:46:38.800 INFO:tasks.workunit.client.0.smithi029.stdout:6/517: rmdir d7/d25/d5c/da3 0 2024-04-26T11:46:38.800 INFO:tasks.workunit.client.0.smithi029.stdout:3/472: truncate d0/d1/d41/d5f/d54/f7d 285140 0 2024-04-26T11:46:38.801 INFO:tasks.workunit.client.0.smithi029.stdout:2/517: creat d12/d24/fa9 x:0 0 0 2024-04-26T11:46:38.804 INFO:tasks.workunit.client.0.smithi029.stdout:3/473: creat d0/d1/d2f/d68/fa4 x:0 0 0 2024-04-26T11:46:38.805 INFO:tasks.workunit.client.0.smithi029.stdout:6/518: getdents d7/d25/d4b/d4d 0 2024-04-26T11:46:38.805 INFO:tasks.workunit.client.0.smithi029.stdout:2/518: creat d12/d6c/d73/d4f/faa x:0 0 0 2024-04-26T11:46:38.811 INFO:tasks.workunit.client.0.smithi029.stdout:9/540: dwrite d4/d5/fb [0,4194304] 0 2024-04-26T11:46:38.811 INFO:tasks.workunit.client.0.smithi029.stdout:1/575: mknod d7/d25/d68/d4b/d66/cc2 1 2024-04-26T11:46:38.811 INFO:tasks.workunit.client.0.smithi029.stdout:5/489: dread db/d12/d72/f21 [0,4194304] 0 2024-04-26T11:46:38.811 INFO:tasks.workunit.client.0.smithi029.stdout:2/519: link d12/d24/d2f/f33 d12/d24/d29/d50/d6a/fab 0 2024-04-26T11:46:38.811 INFO:tasks.workunit.client.0.smithi029.stdout:0/488: dwrite d9/d16/f24 [0,4194304] 0 2024-04-26T11:46:38.812 INFO:tasks.workunit.client.0.smithi029.stdout:4/445: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f6d [0,4194304] 0 2024-04-26T11:46:38.812 INFO:tasks.workunit.client.0.smithi029.stdout:2/520: fdatasync d12/f39 0 2024-04-26T11:46:38.812 INFO:tasks.workunit.client.0.smithi029.stdout:9/541: fdatasync d4/d5/d16/d80/f9b 0 2024-04-26T11:46:38.814 INFO:tasks.workunit.client.0.smithi029.stdout:0/489: chown d9/d16/d52/f7f 49 1 2024-04-26T11:46:38.815 INFO:tasks.workunit.client.0.smithi029.stdout:5/490: getdents db/d40/d4d/d4f/d73/d93 0 2024-04-26T11:46:38.816 INFO:tasks.workunit.client.0.smithi029.stdout:9/542: creat d4/d5/d7a/da1/fa9 x:0 0 0 2024-04-26T11:46:38.817 INFO:tasks.workunit.client.0.smithi029.stdout:0/490: mknod d9/d16/d33/d2f/d32/d9f/cb1 1 2024-04-26T11:46:38.817 INFO:tasks.workunit.client.0.smithi029.stdout:8/435: dread dc/de/d2e/d23/d27/d73/f36 [0,4194304] 0 2024-04-26T11:46:38.818 INFO:tasks.workunit.client.0.smithi029.stdout:3/474: dwrite d0/d1/d2b/d33/f8c [0,4194304] 0 2024-04-26T11:46:38.819 INFO:tasks.workunit.client.0.smithi029.stdout:9/543: creat d4/d5/d16/d80/faa x:0 0 0 2024-04-26T11:46:38.819 INFO:tasks.workunit.client.0.smithi029.stdout:2/521: link f6 d12/d24/d29/d38/fac 0 2024-04-26T11:46:38.820 INFO:tasks.workunit.client.0.smithi029.stdout:5/491: symlink db/d12/d1a/l9a 0 2024-04-26T11:46:38.820 INFO:tasks.workunit.client.0.smithi029.stdout:8/436: creat dc/de/f97 x:0 0 0 2024-04-26T11:46:38.820 INFO:tasks.workunit.client.0.smithi029.stdout:4/446: link d3/d1d/d11/d16/d1f/d3d/d39/f5a d3/d1d/db/d13/d73/f8e 0 2024-04-26T11:46:38.821 INFO:tasks.workunit.client.0.smithi029.stdout:7/561: dread d11/d18/d1a/f53 [0,4194304] 0 2024-04-26T11:46:38.823 INFO:tasks.workunit.client.0.smithi029.stdout:0/491: link d9/d16/d52/l7d d9/d16/d33/d2f/d31/d6a/lb2 0 2024-04-26T11:46:38.823 INFO:tasks.workunit.client.0.smithi029.stdout:6/519: dread d7/f1c [0,4194304] 0 2024-04-26T11:46:38.823 INFO:tasks.workunit.client.0.smithi029.stdout:9/544: mkdir d4/d49/d58/d67/dab 0 2024-04-26T11:46:38.823 INFO:tasks.workunit.client.0.smithi029.stdout:4/447: mknod d3/c8f 1 2024-04-26T11:46:38.824 INFO:tasks.workunit.client.0.smithi029.stdout:2/522: mkdir d12/d6c/d6e/dad 0 2024-04-26T11:46:38.824 INFO:tasks.workunit.client.0.smithi029.stdout:7/562: mkdir d11/d18/db7 0 2024-04-26T11:46:38.824 INFO:tasks.workunit.client.0.smithi029.stdout:5/492: dread - db/d12/d6b/f85 zero size 2024-04-26T11:46:38.825 INFO:tasks.workunit.client.0.smithi029.stdout:8/437: write dc/f11 [498788,85393] 0 2024-04-26T11:46:38.825 INFO:tasks.workunit.client.0.smithi029.stdout:6/520: chown d7/d20/d27/d91 1282 1 2024-04-26T11:46:38.825 INFO:tasks.workunit.client.0.smithi029.stdout:2/523: symlink d12/lae 0 2024-04-26T11:46:38.825 INFO:tasks.workunit.client.0.smithi029.stdout:9/545: write d4/d5/d7/f9f [30865,56624] 0 2024-04-26T11:46:38.825 INFO:tasks.workunit.client.0.smithi029.stdout:7/563: write d11/d18/d1a/f83 [353016,90089] 0 2024-04-26T11:46:38.825 INFO:tasks.workunit.client.0.smithi029.stdout:4/448: write d3/d1d/f12 [3874329,2481] 0 2024-04-26T11:46:38.826 INFO:tasks.workunit.client.0.smithi029.stdout:8/438: truncate dc/f93 838513 0 2024-04-26T11:46:38.827 INFO:tasks.workunit.client.0.smithi029.stdout:2/524: unlink d12/d6c/d73/d4f/f7a 0 2024-04-26T11:46:38.827 INFO:tasks.workunit.client.0.smithi029.stdout:9/546: mkdir d4/dac 0 2024-04-26T11:46:38.827 INFO:tasks.workunit.client.0.smithi029.stdout:9/547: sync 2024-04-26T11:46:38.827 INFO:tasks.workunit.client.0.smithi029.stdout:4/449: readlink d3/d1d/db/d13/l59 0 2024-04-26T11:46:38.827 INFO:tasks.workunit.client.0.smithi029.stdout:1/576: dwrite d7/d25/d68/d4b/d66/f87 [0,4194304] 0 2024-04-26T11:46:38.828 INFO:tasks.workunit.client.0.smithi029.stdout:7/564: fsync d11/d18/d1a/d26/f45 0 2024-04-26T11:46:38.829 INFO:tasks.workunit.client.0.smithi029.stdout:6/521: rename d7/d46/d69/da2/d4c/lb2 to d7/d46/d69/da2/d4c/lb3 0 2024-04-26T11:46:38.831 INFO:tasks.workunit.client.0.smithi029.stdout:4/450: write d3/d1d/db/f41 [762511,34248] 0 2024-04-26T11:46:38.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/522: mkdir d7/d46/d69/db4 0 2024-04-26T11:46:38.831 INFO:tasks.workunit.client.0.smithi029.stdout:8/439: rename dc/de/d2e/d23/d27/l6c to dc/l98 0 2024-04-26T11:46:38.831 INFO:tasks.workunit.client.0.smithi029.stdout:1/577: fsync d7/d25/f2e 0 2024-04-26T11:46:38.833 INFO:tasks.workunit.client.0.smithi029.stdout:3/475: dread d0/d37/f55 [0,4194304] 0 2024-04-26T11:46:38.833 INFO:tasks.workunit.client.0.smithi029.stdout:6/523: unlink d7/d25/f47 0 2024-04-26T11:46:38.833 INFO:tasks.workunit.client.0.smithi029.stdout:2/525: dread d12/d6c/d73/d4f/d65/d99/f9e [0,4194304] 0 2024-04-26T11:46:38.834 INFO:tasks.workunit.client.0.smithi029.stdout:6/524: mkdir d7/d25/d4b/d4d/d65/db5 0 2024-04-26T11:46:38.837 INFO:tasks.workunit.client.0.smithi029.stdout:6/525: readlink d7/d46/d69/da2/d4c/l4f 0 2024-04-26T11:46:38.837 INFO:tasks.workunit.client.0.smithi029.stdout:2/526: write d12/d24/d29/d38/fac [2027770,25570] 0 2024-04-26T11:46:38.837 INFO:tasks.workunit.client.0.smithi029.stdout:8/440: rename dc/de/d2e/d23/d27/d73/f36 to dc/de/d26/f99 0 2024-04-26T11:46:38.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/527: creat d12/faf x:0 0 0 2024-04-26T11:46:38.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/528: link d12/d6c/l62 d12/d24/d29/d50/lb0 0 2024-04-26T11:46:38.843 INFO:tasks.workunit.client.0.smithi029.stdout:6/526: dread d7/d46/d69/da2/d4c/d98/d45/d76/f99 [0,4194304] 0 2024-04-26T11:46:38.843 INFO:tasks.workunit.client.0.smithi029.stdout:6/527: rmdir d7/d46/d69/da2/d4c 39 2024-04-26T11:46:38.843 INFO:tasks.workunit.client.0.smithi029.stdout:5/493: fsync db/d12/d72/d39/d3b/f5e 0 2024-04-26T11:46:38.843 INFO:tasks.workunit.client.0.smithi029.stdout:4/451: read d3/d1d/f29 [2014395,68621] 0 2024-04-26T11:46:38.843 INFO:tasks.workunit.client.0.smithi029.stdout:8/441: dwrite dc/de/d26/f32 [0,4194304] 0 2024-04-26T11:46:38.843 INFO:tasks.workunit.client.0.smithi029.stdout:5/494: fdatasync db/d12/d72/f8c 0 2024-04-26T11:46:38.843 INFO:tasks.workunit.client.0.smithi029.stdout:8/442: chown dc/d12 1 1 2024-04-26T11:46:38.844 INFO:tasks.workunit.client.0.smithi029.stdout:4/452: write d3/d1d/f89 [515872,10406] 0 2024-04-26T11:46:38.849 INFO:tasks.workunit.client.0.smithi029.stdout:8/443: write dc/de/d2e/f94 [263423,125445] 0 2024-04-26T11:46:38.851 INFO:tasks.workunit.client.0.smithi029.stdout:5/495: getdents db/d40/d4d 0 2024-04-26T11:46:38.851 INFO:tasks.workunit.client.0.smithi029.stdout:6/528: link d7/d25/d4b/d4d/d65/faa d7/d46/d69/da2/d4c/d98/fb6 0 2024-04-26T11:46:38.851 INFO:tasks.workunit.client.0.smithi029.stdout:8/444: readlink dc/de/d2e/l8b 0 2024-04-26T11:46:38.851 INFO:tasks.workunit.client.0.smithi029.stdout:5/496: creat db/d40/d77/d98/f9b x:0 0 0 2024-04-26T11:46:38.851 INFO:tasks.workunit.client.0.smithi029.stdout:0/492: dread d9/f1d [0,4194304] 0 2024-04-26T11:46:38.851 INFO:tasks.workunit.client.0.smithi029.stdout:3/476: write d0/f4b [241407,89412] 0 2024-04-26T11:46:38.851 INFO:tasks.workunit.client.0.smithi029.stdout:1/578: write d7/db/d10/d1e/d53/d9d/fbe [540477,73808] 0 2024-04-26T11:46:38.851 INFO:tasks.workunit.client.0.smithi029.stdout:8/445: write dc/de/d2e/d23/d27/d73/d54/f74 [3709576,60682] 0 2024-04-26T11:46:38.851 INFO:tasks.workunit.client.0.smithi029.stdout:0/493: dread - d9/d16/f4d zero size 2024-04-26T11:46:38.851 INFO:tasks.workunit.client.0.smithi029.stdout:6/529: write d7/d46/d69/da2/d4c/d98/f81 [500545,109998] 0 2024-04-26T11:46:38.852 INFO:tasks.workunit.client.0.smithi029.stdout:2/529: dread d12/f26 [0,4194304] 0 2024-04-26T11:46:38.853 INFO:tasks.workunit.client.0.smithi029.stdout:1/579: creat d7/d37/d98/fc3 x:0 0 0 2024-04-26T11:46:38.853 INFO:tasks.workunit.client.0.smithi029.stdout:8/446: fsync dc/de/d26/d57/f85 0 2024-04-26T11:46:38.855 INFO:tasks.workunit.client.0.smithi029.stdout:2/530: write d12/f16 [2649899,112519] 0 2024-04-26T11:46:38.855 INFO:tasks.workunit.client.0.smithi029.stdout:3/477: truncate d0/d37/f55 1071356 0 2024-04-26T11:46:38.856 INFO:tasks.workunit.client.0.smithi029.stdout:6/530: unlink d7/l10 0 2024-04-26T11:46:38.856 INFO:tasks.workunit.client.0.smithi029.stdout:9/548: dwrite d4/d5/d7/f59 [0,4194304] 0 2024-04-26T11:46:38.858 INFO:tasks.workunit.client.0.smithi029.stdout:7/565: dwrite d11/f13 [0,4194304] 0 2024-04-26T11:46:38.859 INFO:tasks.workunit.client.0.smithi029.stdout:4/453: dwrite d3/d1d/d11/d16/f75 [0,4194304] 0 2024-04-26T11:46:38.860 INFO:tasks.workunit.client.0.smithi029.stdout:0/494: truncate d9/d16/d52/f2c 816947 0 2024-04-26T11:46:38.860 INFO:tasks.workunit.client.0.smithi029.stdout:8/447: creat dc/d3b/f9a x:0 0 0 2024-04-26T11:46:38.860 INFO:tasks.workunit.client.0.smithi029.stdout:2/531: mkdir d12/d6c/d73/da5/db1 0 2024-04-26T11:46:38.862 INFO:tasks.workunit.client.0.smithi029.stdout:0/495: write d9/f2d [4681881,45658] 0 2024-04-26T11:46:38.862 INFO:tasks.workunit.client.0.smithi029.stdout:5/497: dwrite db/f20 [0,4194304] 0 2024-04-26T11:46:38.864 INFO:tasks.workunit.client.0.smithi029.stdout:3/478: creat d0/d1/d41/d5f/d1a/d3b/fa5 x:0 0 0 2024-04-26T11:46:38.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/549: mkdir d4/d5/dad 0 2024-04-26T11:46:38.865 INFO:tasks.workunit.client.0.smithi029.stdout:8/448: rename dc/de/d2e/d23/d27/d73 to dc/de/d2e/d23/d27/d6f/d9b 0 2024-04-26T11:46:38.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/454: link d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f6d d3/d1d/d11/d16/d1f/d3d/d46/f90 0 2024-04-26T11:46:38.866 INFO:tasks.workunit.client.0.smithi029.stdout:0/496: dread - d9/d16/d33/d2f/d31/f6f zero size 2024-04-26T11:46:38.867 INFO:tasks.workunit.client.0.smithi029.stdout:1/580: dread d7/d37/f58 [0,4194304] 0 2024-04-26T11:46:38.868 INFO:tasks.workunit.client.0.smithi029.stdout:0/497: unlink d9/d16/d25/l7b 0 2024-04-26T11:46:38.868 INFO:tasks.workunit.client.0.smithi029.stdout:1/581: creat d7/d25/dab/fc4 x:0 0 0 2024-04-26T11:46:38.870 INFO:tasks.workunit.client.0.smithi029.stdout:7/566: dwrite d11/d18/d1a/d26/d91/f9c [0,4194304] 0 2024-04-26T11:46:38.870 INFO:tasks.workunit.client.0.smithi029.stdout:4/455: stat d3/d1d/d11/d16/d1f/d3d/d46/f90 0 2024-04-26T11:46:38.872 INFO:tasks.workunit.client.0.smithi029.stdout:4/456: write d3/d1d/db/f41 [549831,115673] 0 2024-04-26T11:46:38.872 INFO:tasks.workunit.client.0.smithi029.stdout:0/498: creat d9/d16/d33/d2f/d32/d9f/fb3 x:0 0 0 2024-04-26T11:46:38.873 INFO:tasks.workunit.client.0.smithi029.stdout:2/532: read d12/d24/f27 [116149,37716] 0 2024-04-26T11:46:38.875 INFO:tasks.workunit.client.0.smithi029.stdout:5/498: truncate db/d12/d72/f3d 4688666 0 2024-04-26T11:46:38.877 INFO:tasks.workunit.client.0.smithi029.stdout:0/499: fdatasync d9/d16/d25/d2a/f39 0 2024-04-26T11:46:38.877 INFO:tasks.workunit.client.0.smithi029.stdout:8/449: dwrite dc/de/d26/d57/f59 [0,4194304] 0 2024-04-26T11:46:38.878 INFO:tasks.workunit.client.0.smithi029.stdout:9/550: truncate d4/d5/d16/f73 682551 0 2024-04-26T11:46:38.879 INFO:tasks.workunit.client.0.smithi029.stdout:2/533: mkdir d12/d24/d29/db2 0 2024-04-26T11:46:38.880 INFO:tasks.workunit.client.0.smithi029.stdout:3/479: dwrite d0/dc/f71 [0,4194304] 0 2024-04-26T11:46:38.882 INFO:tasks.workunit.client.0.smithi029.stdout:8/450: symlink dc/l9c 0 2024-04-26T11:46:38.882 INFO:tasks.workunit.client.0.smithi029.stdout:5/499: write db/d12/d1a/d4c/f8b [3004075,103907] 0 2024-04-26T11:46:38.882 INFO:tasks.workunit.client.0.smithi029.stdout:9/551: rmdir d4/d5/dad 0 2024-04-26T11:46:38.883 INFO:tasks.workunit.client.0.smithi029.stdout:0/500: mkdir d9/d16/d25/db4 0 2024-04-26T11:46:38.884 INFO:tasks.workunit.client.0.smithi029.stdout:1/582: dwrite d7/d25/d68/fac [0,4194304] 0 2024-04-26T11:46:38.884 INFO:tasks.workunit.client.0.smithi029.stdout:9/552: stat d4/d46 0 2024-04-26T11:46:38.884 INFO:tasks.workunit.client.0.smithi029.stdout:7/567: dwrite d11/d18/d2d/fae [0,4194304] 0 2024-04-26T11:46:38.887 INFO:tasks.workunit.client.0.smithi029.stdout:4/457: read d3/d1d/d11/d16/d1f/f55 [444524,104900] 0 2024-04-26T11:46:38.887 INFO:tasks.workunit.client.0.smithi029.stdout:3/480: mkdir d0/d1/d41/d5f/da6 0 2024-04-26T11:46:38.887 INFO:tasks.workunit.client.0.smithi029.stdout:0/501: dread - d9/d16/d25/d2a/d46/f64 zero size 2024-04-26T11:46:38.888 INFO:tasks.workunit.client.0.smithi029.stdout:7/568: mkdir d11/d18/db8 0 2024-04-26T11:46:38.888 INFO:tasks.workunit.client.0.smithi029.stdout:1/583: mkdir d7/db/dc5 0 2024-04-26T11:46:38.889 INFO:tasks.workunit.client.0.smithi029.stdout:4/458: symlink d3/d1d/db/d13/d73/d7e/l91 0 2024-04-26T11:46:38.889 INFO:tasks.workunit.client.0.smithi029.stdout:9/553: link d4/l12 d4/d5/d16/d80/lae 0 2024-04-26T11:46:38.889 INFO:tasks.workunit.client.0.smithi029.stdout:0/502: readlink d9/d16/d25/d2a/l99 0 2024-04-26T11:46:38.889 INFO:tasks.workunit.client.0.smithi029.stdout:8/451: link dc/de/d2e/f94 dc/de/f9d 0 2024-04-26T11:46:38.889 INFO:tasks.workunit.client.0.smithi029.stdout:7/569: symlink d11/d15/d79/da6/lb9 0 2024-04-26T11:46:38.890 INFO:tasks.workunit.client.0.smithi029.stdout:9/554: mknod d4/d5/d7a/da1/caf 1 2024-04-26T11:46:38.890 INFO:tasks.workunit.client.0.smithi029.stdout:9/555: readlink d4/l88 0 2024-04-26T11:46:38.891 INFO:tasks.workunit.client.0.smithi029.stdout:8/452: readlink dc/de/d2e/d23/d27/d6f/l7e 0 2024-04-26T11:46:38.892 INFO:tasks.workunit.client.0.smithi029.stdout:0/503: rmdir d9/d16/d25/da7 39 2024-04-26T11:46:38.893 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:38.894 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:38.894 INFO:tasks.workunit.client.0.smithi029.stdout:3/481: rename d0/d1/d41/d5f/da6 to d0/d1/d2b/da7 0 2024-04-26T11:46:38.894 INFO:tasks.workunit.client.0.smithi029.stdout:1/584: symlink d7/d37/lc6 0 2024-04-26T11:46:38.894 INFO:tasks.workunit.client.0.smithi029.stdout:1/585: sync 2024-04-26T11:46:38.895 INFO:tasks.workunit.client.0.smithi029.stdout:3/482: stat d0/dc/d1f/d92 0 2024-04-26T11:46:38.895 INFO:tasks.workunit.client.0.smithi029.stdout:8/453: unlink dc/de/d26/d57/f63 0 2024-04-26T11:46:38.895 INFO:tasks.workunit.client.0.smithi029.stdout:2/534: dwrite d12/d24/d29/f31 [0,4194304] 0 2024-04-26T11:46:38.895 INFO:tasks.workunit.client.0.smithi029.stdout:0/504: creat d9/d16/d25/db4/fb5 x:0 0 0 2024-04-26T11:46:38.897 INFO:tasks.workunit.client.0.smithi029.stdout:7/570: link d11/d15/d79/l7f d11/d15/d69/lba 0 2024-04-26T11:46:38.897 INFO:tasks.workunit.client.0.smithi029.stdout:1/586: mkdir d7/db/d8d/dc7 0 2024-04-26T11:46:38.897 INFO:tasks.workunit.client.0.smithi029.stdout:2/535: unlink d12/lae 0 2024-04-26T11:46:38.898 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:38.897+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:38.898 INFO:tasks.workunit.client.0.smithi029.stdout:0/505: creat d9/d16/d25/d2a/d4b/fb6 x:0 0 0 2024-04-26T11:46:38.900 INFO:tasks.workunit.client.0.smithi029.stdout:2/536: link d12/f19 d12/d6c/fb3 0 2024-04-26T11:46:38.900 INFO:tasks.workunit.client.0.smithi029.stdout:8/454: rmdir dc/de/d26/d57/d86/d96 0 2024-04-26T11:46:38.902 INFO:tasks.workunit.client.0.smithi029.stdout:4/459: dwrite d3/d1d/d11/d16/d1f/d3d/d46/f5f [0,4194304] 0 2024-04-26T11:46:38.902 INFO:tasks.workunit.client.0.smithi029.stdout:8/455: mkdir dc/d12/d9e 0 2024-04-26T11:46:38.902 INFO:tasks.workunit.client.0.smithi029.stdout:9/556: dwrite d4/d5/d16/d39/f3c [0,4194304] 0 2024-04-26T11:46:38.903 INFO:tasks.workunit.client.0.smithi029.stdout:2/537: creat d12/d6c/d73/da5/db1/fb4 x:0 0 0 2024-04-26T11:46:38.903 INFO:tasks.workunit.client.0.smithi029.stdout:4/460: unlink d3/d1d/l70 0 2024-04-26T11:46:38.903 INFO:tasks.workunit.client.0.smithi029.stdout:4/461: mknod d3/d50/c92 1 2024-04-26T11:46:38.904 INFO:tasks.workunit.client.0.smithi029.stdout:4/462: sync 2024-04-26T11:46:38.904 INFO:tasks.workunit.client.0.smithi029.stdout:8/456: mkdir dc/d9f 0 2024-04-26T11:46:38.904 INFO:tasks.workunit.client.0.smithi029.stdout:2/538: symlink d12/d24/d29/d36/d4b/lb5 0 2024-04-26T11:46:38.905 INFO:tasks.workunit.client.0.smithi029.stdout:8/457: mkdir dc/d75/da0 0 2024-04-26T11:46:38.905 INFO:tasks.workunit.client.0.smithi029.stdout:4/463: stat d3/d1d/d11/d16/d1f/d3d/d46/f90 0 2024-04-26T11:46:38.906 INFO:tasks.workunit.client.0.smithi029.stdout:2/539: mknod d12/d24/d2f/d76/cb6 1 2024-04-26T11:46:38.907 INFO:tasks.workunit.client.0.smithi029.stdout:4/464: chown d3/l25 110676123 1 2024-04-26T11:46:38.907 INFO:tasks.workunit.client.0.smithi029.stdout:2/540: chown d12/d6c/d73/da5/db1 0 1 2024-04-26T11:46:38.908 INFO:tasks.workunit.client.0.smithi029.stdout:8/458: write dc/d3b/f41 [2194188,96931] 0 2024-04-26T11:46:38.908 INFO:tasks.workunit.client.0.smithi029.stdout:6/531: dread d7/f1a [0,4194304] 0 2024-04-26T11:46:38.908 INFO:tasks.workunit.client.0.smithi029.stdout:2/541: link d12/f39 d12/d6c/d73/d4f/d65/d6f/fb7 0 2024-04-26T11:46:38.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:38.911 INFO:tasks.workunit.client.0.smithi029.stdout:6/532: truncate d7/d46/d69/f8a 543480 0 2024-04-26T11:46:38.911 INFO:tasks.workunit.client.0.smithi029.stdout:2/542: symlink d12/d24/lb8 0 2024-04-26T11:46:38.911 INFO:tasks.workunit.client.0.smithi029.stdout:2/543: creat d12/d6c/fb9 x:0 0 0 2024-04-26T11:46:38.911 INFO:tasks.workunit.client.0.smithi029.stdout:2/544: readlink d12/d24/d29/d50/l78 0 2024-04-26T11:46:38.911 INFO:tasks.workunit.client.0.smithi029.stdout:2/545: fsync d12/d6c/d73/f67 0 2024-04-26T11:46:38.911 INFO:tasks.workunit.client.0.smithi029.stdout:6/533: read d7/d46/d69/da2/d4c/f94 [189805,89890] 0 2024-04-26T11:46:38.911 INFO:tasks.workunit.client.0.smithi029.stdout:6/534: sync 2024-04-26T11:46:38.913 INFO:tasks.workunit.client.0.smithi029.stdout:6/535: chown d7/d25/l62 0 1 2024-04-26T11:46:38.914 INFO:tasks.workunit.client.0.smithi029.stdout:2/546: symlink d12/d24/d29/db2/lba 0 2024-04-26T11:46:38.914 INFO:tasks.workunit.client.0.smithi029.stdout:5/500: truncate db/d12/d72/f2c 2467948 0 2024-04-26T11:46:38.914 INFO:tasks.workunit.client.0.smithi029.stdout:4/465: dread d3/d1d/db/f51 [0,4194304] 0 2024-04-26T11:46:38.914 INFO:tasks.workunit.client.0.smithi029.stdout:2/547: fdatasync d12/d24/d29/f71 0 2024-04-26T11:46:38.914 INFO:tasks.workunit.client.0.smithi029.stdout:5/501: chown db/d40/d4d/d79/f8e 238028140 1 2024-04-26T11:46:38.916 INFO:tasks.workunit.client.0.smithi029.stdout:2/548: mknod d12/d24/d29/d36/da4/cbb 1 2024-04-26T11:46:38.916 INFO:tasks.workunit.client.0.smithi029.stdout:6/536: creat d7/d46/d69/da2/d4c/d98/d45/d83/da9/fb7 x:0 0 0 2024-04-26T11:46:38.916 INFO:tasks.workunit.client.0.smithi029.stdout:4/466: creat d3/d1d/d11/d16/d1f/d3d/d46/f93 x:0 0 0 2024-04-26T11:46:38.916 INFO:tasks.workunit.client.0.smithi029.stdout:8/459: dread dc/d12/d6a/f77 [0,4194304] 0 2024-04-26T11:46:38.916 INFO:tasks.workunit.client.0.smithi029.stdout:6/537: fdatasync d7/d25/d5c/f36 0 2024-04-26T11:46:38.916 INFO:tasks.workunit.client.0.smithi029.stdout:5/502: chown db/d12/d72/f2c 0 1 2024-04-26T11:46:38.916 INFO:tasks.workunit.client.0.smithi029.stdout:2/549: symlink d12/d6c/d73/d4f/lbc 0 2024-04-26T11:46:38.916 INFO:tasks.workunit.client.0.smithi029.stdout:4/467: symlink d3/d1d/db/d13/d23/l94 0 2024-04-26T11:46:38.917 INFO:tasks.workunit.client.0.smithi029.stdout:6/538: unlink d7/d25/d4b/f4e 0 2024-04-26T11:46:38.917 INFO:tasks.workunit.client.0.smithi029.stdout:8/460: rename dc/de/d2e/d23/d27/d6f/d9b/d54 to dc/de/d2e/d23/d27/d6f/d9b/d43/da1 0 2024-04-26T11:46:38.917 INFO:tasks.workunit.client.0.smithi029.stdout:4/468: symlink d3/d50/d7a/l95 0 2024-04-26T11:46:38.919 INFO:tasks.workunit.client.0.smithi029.stdout:3/483: write d0/d1/d41/d5f/d54/f7d [1192257,103431] 0 2024-04-26T11:46:38.919 INFO:tasks.workunit.client.0.smithi029.stdout:8/461: fdatasync dc/d12/f5d 0 2024-04-26T11:46:38.920 INFO:tasks.workunit.client.0.smithi029.stdout:2/550: dread d12/f28 [0,4194304] 0 2024-04-26T11:46:38.920 INFO:tasks.workunit.client.0.smithi029.stdout:4/469: creat d3/d50/d7a/f96 x:0 0 0 2024-04-26T11:46:38.926 INFO:tasks.workunit.client.0.smithi029.stdout:3/484: chown d0/d1/d2f/f39 56293 1 2024-04-26T11:46:38.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/557: write d4/d5/d16/d39/f3d [2645451,61145] 0 2024-04-26T11:46:38.927 INFO:tasks.workunit.client.0.smithi029.stdout:4/470: read - d3/d1d/d11/d16/d1f/f61 zero size 2024-04-26T11:46:38.927 INFO:tasks.workunit.client.0.smithi029.stdout:2/551: chown d12/d24/d29/d38/l3e 47 1 2024-04-26T11:46:38.927 INFO:tasks.workunit.client.0.smithi029.stdout:3/485: dread - d0/d1/d5c/f9b zero size 2024-04-26T11:46:38.928 INFO:tasks.workunit.client.0.smithi029.stdout:1/587: dwrite d7/db/d8d/f92 [0,4194304] 0 2024-04-26T11:46:38.929 INFO:tasks.workunit.client.0.smithi029.stdout:8/462: rmdir dc/de/d26/d6b 39 2024-04-26T11:46:38.929 INFO:tasks.workunit.client.0.smithi029.stdout:6/539: creat d7/d25/d4b/d4d/d65/fb8 x:0 0 0 2024-04-26T11:46:38.930 INFO:tasks.workunit.client.0.smithi029.stdout:1/588: sync 2024-04-26T11:46:38.930 INFO:tasks.workunit.client.0.smithi029.stdout:4/471: read d3/d1d/f89 [268240,111446] 0 2024-04-26T11:46:38.930 INFO:tasks.workunit.client.0.smithi029.stdout:2/552: stat d12/d24/d29/d36/f88 0 2024-04-26T11:46:38.930 INFO:tasks.workunit.client.0.smithi029.stdout:5/503: dwrite db/d40/d4d/d4f/d73/f74 [0,4194304] 0 2024-04-26T11:46:38.930 INFO:tasks.workunit.client.0.smithi029.stdout:9/558: truncate d4/d46/f56 1016430 0 2024-04-26T11:46:38.930 INFO:tasks.workunit.client.0.smithi029.stdout:3/486: rename d0/d1 to d0/d1/d13/d98/da8 22 2024-04-26T11:46:38.931 INFO:tasks.workunit.client.0.smithi029.stdout:7/571: dwrite d11/d18/d35/d39/d7e/f87 [0,4194304] 0 2024-04-26T11:46:38.932 INFO:tasks.workunit.client.0.smithi029.stdout:9/559: mkdir d4/d5/d7a/db0 0 2024-04-26T11:46:38.933 INFO:tasks.workunit.client.0.smithi029.stdout:7/572: mknod d11/d18/d2d/cbb 1 2024-04-26T11:46:38.933 INFO:tasks.workunit.client.0.smithi029.stdout:4/472: mkdir d3/d1d/db/d13/d73/d97 0 2024-04-26T11:46:38.934 INFO:tasks.workunit.client.0.smithi029.stdout:7/573: chown d11/d18/d35/d39/d7e/da2 3021789 1 2024-04-26T11:46:38.934 INFO:tasks.workunit.client.0.smithi029.stdout:8/463: mkdir dc/de/d2e/d23/d27/d6f/d9b/da2 0 2024-04-26T11:46:38.934 INFO:tasks.workunit.client.0.smithi029.stdout:9/560: fsync d4/d5/f51 0 2024-04-26T11:46:38.934 INFO:tasks.workunit.client.0.smithi029.stdout:1/589: write d7/d37/d3e/f8a [578644,103522] 0 2024-04-26T11:46:38.936 INFO:tasks.workunit.client.0.smithi029.stdout:2/553: mkdir d12/d6c/d73/dbd 0 2024-04-26T11:46:38.936 INFO:tasks.workunit.client.0.smithi029.stdout:7/574: chown d11/d18/d1a/d26/l42 367 1 2024-04-26T11:46:38.936 INFO:tasks.workunit.client.0.smithi029.stdout:4/473: symlink d3/l98 0 2024-04-26T11:46:38.936 INFO:tasks.workunit.client.0.smithi029.stdout:5/504: creat db/d12/d72/d92/f9c x:0 0 0 2024-04-26T11:46:38.937 INFO:tasks.workunit.client.0.smithi029.stdout:3/487: link d0/d1/d41/d5f/l26 d0/d1/d2b/d7e/da3/la9 0 2024-04-26T11:46:38.937 INFO:tasks.workunit.client.0.smithi029.stdout:7/575: symlink d11/d18/d2d/lbc 0 2024-04-26T11:46:38.938 INFO:tasks.workunit.client.0.smithi029.stdout:9/561: rename d4/d46/f4d to d4/fb1 0 2024-04-26T11:46:38.938 INFO:tasks.workunit.client.0.smithi029.stdout:2/554: truncate d12/d6c/d73/d40/fa8 1016600 0 2024-04-26T11:46:38.938 INFO:tasks.workunit.client.0.smithi029.stdout:7/576: chown d11/d18/d2d/f8c 5 1 2024-04-26T11:46:38.939 INFO:tasks.workunit.client.0.smithi029.stdout:9/562: stat d4/d5/d16/d39/l8d 0 2024-04-26T11:46:38.940 INFO:tasks.workunit.client.0.smithi029.stdout:1/590: creat d7/d25/d68/fc8 x:0 0 0 2024-04-26T11:46:38.940 INFO:tasks.workunit.client.0.smithi029.stdout:3/488: read d0/d1/d2f/f3a [3599884,123390] 0 2024-04-26T11:46:38.940 INFO:tasks.workunit.client.0.smithi029.stdout:9/563: creat d4/d5/da3/fb2 x:0 0 0 2024-04-26T11:46:38.941 INFO:tasks.workunit.client.0.smithi029.stdout:6/540: write d7/d46/d69/da2/d4c/d98/fa6 [757534,17528] 0 2024-04-26T11:46:38.941 INFO:tasks.workunit.client.0.smithi029.stdout:4/474: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f6d 3365892 0 2024-04-26T11:46:38.941 INFO:tasks.workunit.client.0.smithi029.stdout:0/506: dread d9/f84 [0,4194304] 0 2024-04-26T11:46:38.941 INFO:tasks.workunit.client.0.smithi029.stdout:1/591: symlink d7/db/d8d/lc9 0 2024-04-26T11:46:38.942 INFO:tasks.workunit.client.0.smithi029.stdout:7/577: read d11/d18/d1a/f4a [2175836,47442] 0 2024-04-26T11:46:38.942 INFO:tasks.workunit.client.0.smithi029.stdout:3/489: chown d0/d1/d2b/d33/f74 14018 1 2024-04-26T11:46:38.943 INFO:tasks.workunit.client.0.smithi029.stdout:1/592: creat d7/db/dc5/fca x:0 0 0 2024-04-26T11:46:38.944 INFO:tasks.workunit.client.0.smithi029.stdout:7/578: creat d11/d18/d58/fbd x:0 0 0 2024-04-26T11:46:38.944 INFO:tasks.workunit.client.0.smithi029.stdout:6/541: rmdir d7/d46/d69/da2/d4c/d98/d45 39 2024-04-26T11:46:38.945 INFO:tasks.workunit.client.0.smithi029.stdout:1/593: dread - d7/d37/d98/fc3 zero size 2024-04-26T11:46:38.946 INFO:tasks.workunit.client.0.smithi029.stdout:1/594: write d7/db/d10/d1e/fb3 [35275,48070] 0 2024-04-26T11:46:38.949 INFO:tasks.workunit.client.0.smithi029.stdout:1/595: rename d7/d37/d3e/f8a to d7/d25/d99/fcb 0 2024-04-26T11:46:38.949 INFO:tasks.workunit.client.0.smithi029.stdout:9/564: dread d4/d46/f9c [0,4194304] 0 2024-04-26T11:46:38.951 INFO:tasks.workunit.client.0.smithi029.stdout:1/596: unlink d7/l4d 0 2024-04-26T11:46:38.951 INFO:tasks.workunit.client.0.smithi029.stdout:2/555: dread d12/d24/d29/d36/d4b/f64 [0,4194304] 0 2024-04-26T11:46:38.953 INFO:tasks.workunit.client.0.smithi029.stdout:3/490: dwrite d0/d1/f16 [0,4194304] 0 2024-04-26T11:46:38.956 INFO:tasks.workunit.client.0.smithi029.stdout:7/579: dwrite d11/d18/d1a/f80 [0,4194304] 0 2024-04-26T11:46:38.956 INFO:tasks.workunit.client.0.smithi029.stdout:6/542: dread d7/d46/d69/da2/d4c/f94 [0,4194304] 0 2024-04-26T11:46:38.957 INFO:tasks.workunit.client.0.smithi029.stdout:0/507: dwrite d9/d16/f4d [0,4194304] 0 2024-04-26T11:46:38.958 INFO:tasks.workunit.client.0.smithi029.stdout:7/580: dread - d11/fb0 zero size 2024-04-26T11:46:38.958 INFO:tasks.workunit.client.0.smithi029.stdout:1/597: dread d7/db/d10/d1e/f73 [0,4194304] 0 2024-04-26T11:46:38.959 INFO:tasks.workunit.client.0.smithi029.stdout:6/543: chown d7/d20/d27/fab 437 1 2024-04-26T11:46:38.959 INFO:tasks.workunit.client.0.smithi029.stdout:0/508: stat d9/f10 0 2024-04-26T11:46:38.959 INFO:tasks.workunit.client.0.smithi029.stdout:0/509: sync 2024-04-26T11:46:38.962 INFO:tasks.workunit.client.0.smithi029.stdout:6/544: readlink d7/d25/d4b/d4d/l6f 0 2024-04-26T11:46:38.964 INFO:tasks.workunit.client.0.smithi029.stdout:1/598: mkdir d7/db/dcc 0 2024-04-26T11:46:38.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/565: dwrite d4/f6f [0,4194304] 0 2024-04-26T11:46:38.964 INFO:tasks.workunit.client.0.smithi029.stdout:0/510: mkdir d9/d16/d33/d2f/d32/d9f/db7 0 2024-04-26T11:46:38.964 INFO:tasks.workunit.client.0.smithi029.stdout:4/475: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f6a [0,4194304] 0 2024-04-26T11:46:38.965 INFO:tasks.workunit.client.0.smithi029.stdout:2/556: getdents d12/d6c/d73/d4f/d65 0 2024-04-26T11:46:38.966 INFO:tasks.workunit.client.0.smithi029.stdout:1/599: symlink d7/d5b/lcd 0 2024-04-26T11:46:38.968 INFO:tasks.workunit.client.0.smithi029.stdout:2/557: fdatasync d12/faf 0 2024-04-26T11:46:38.971 INFO:tasks.workunit.client.0.smithi029.stdout:8/464: dread dc/de/d2e/d23/d27/d6f/d9b/f3c [0,4194304] 0 2024-04-26T11:46:38.971 INFO:tasks.workunit.client.0.smithi029.stdout:6/545: unlink d7/d46/d69/da2/d4c/d98/d45/la0 0 2024-04-26T11:46:38.971 INFO:tasks.workunit.client.0.smithi029.stdout:3/491: dwrite d0/dc/d80/f8f [0,4194304] 0 2024-04-26T11:46:38.972 INFO:tasks.workunit.client.0.smithi029.stdout:9/566: creat d4/d5/d78/fb3 x:0 0 0 2024-04-26T11:46:38.973 INFO:tasks.workunit.client.0.smithi029.stdout:2/558: link d12/d24/d29/f31 d12/d24/d29/d50/fbe 0 2024-04-26T11:46:38.973 INFO:tasks.workunit.client.0.smithi029.stdout:0/511: rmdir d9/d16/d8d/da6 0 2024-04-26T11:46:38.973 INFO:tasks.workunit.client.0.smithi029.stdout:0/512: mknod d9/d43/cb8 1 2024-04-26T11:46:38.973 INFO:tasks.workunit.client.0.smithi029.stdout:7/581: dwrite f8 [0,4194304] 0 2024-04-26T11:46:38.974 INFO:tasks.workunit.client.0.smithi029.stdout:3/492: write d0/d1/d2f/f86 [2238004,113032] 0 2024-04-26T11:46:38.976 INFO:tasks.workunit.client.0.smithi029.stdout:6/546: mkdir d7/d25/d4b/d4d/d65/db9 0 2024-04-26T11:46:38.977 INFO:tasks.workunit.client.0.smithi029.stdout:5/505: dread db/d12/d72/f3d [0,4194304] 0 2024-04-26T11:46:38.977 INFO:tasks.workunit.client.0.smithi029.stdout:0/513: chown d9/d16/d25/f34 909 1 2024-04-26T11:46:38.977 INFO:tasks.workunit.client.0.smithi029.stdout:7/582: creat d11/d18/d58/d8d/fbe x:0 0 0 2024-04-26T11:46:38.977 INFO:tasks.workunit.client.0.smithi029.stdout:1/600: read d7/f1c [2196077,114368] 0 2024-04-26T11:46:38.978 INFO:tasks.workunit.client.0.smithi029.stdout:6/547: creat d7/d25/d4b/d4d/d65/fba x:0 0 0 2024-04-26T11:46:38.979 INFO:tasks.workunit.client.0.smithi029.stdout:5/506: fsync db/f1e 0 2024-04-26T11:46:38.979 INFO:tasks.workunit.client.0.smithi029.stdout:5/507: sync 2024-04-26T11:46:38.980 INFO:tasks.workunit.client.0.smithi029.stdout:0/514: creat d9/d16/d25/d2a/d8e/fb9 x:0 0 0 2024-04-26T11:46:38.980 INFO:tasks.workunit.client.0.smithi029.stdout:1/601: creat d7/db/d10/d1e/d5e/fce x:0 0 0 2024-04-26T11:46:38.983 INFO:tasks.workunit.client.0.smithi029.stdout:7/583: rename d11/d18/db7 to d11/d18/d35/dbf 0 2024-04-26T11:46:38.984 INFO:tasks.workunit.client.0.smithi029.stdout:5/508: creat db/d40/d4d/f9d x:0 0 0 2024-04-26T11:46:38.985 INFO:tasks.workunit.client.0.smithi029.stdout:0/515: rmdir d9/d16/d25/db4 39 2024-04-26T11:46:38.985 INFO:tasks.workunit.client.0.smithi029.stdout:1/602: dread - d7/db/d10/d1e/d5e/fce zero size 2024-04-26T11:46:38.986 INFO:tasks.workunit.client.0.smithi029.stdout:6/548: dread d7/d46/d69/da2/d4c/f94 [0,4194304] 0 2024-04-26T11:46:38.987 INFO:tasks.workunit.client.0.smithi029.stdout:7/584: creat d11/d15/d69/daa/fc0 x:0 0 0 2024-04-26T11:46:38.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/559: truncate d12/d24/d29/f31 3500338 0 2024-04-26T11:46:38.988 INFO:tasks.workunit.client.0.smithi029.stdout:8/465: dwrite dc/de/d26/d6b/f7d [0,4194304] 0 2024-04-26T11:46:38.988 INFO:tasks.workunit.client.0.smithi029.stdout:4/476: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f8c [0,4194304] 0 2024-04-26T11:46:38.989 INFO:tasks.workunit.client.0.smithi029.stdout:9/567: dwrite d4/d5/d7/f94 [0,4194304] 0 2024-04-26T11:46:38.990 INFO:tasks.workunit.client.0.smithi029.stdout:1/603: mkdir d7/db/d10/d1e/d82/dcf 0 2024-04-26T11:46:38.990 INFO:tasks.workunit.client.0.smithi029.stdout:3/493: dwrite d0/d1/d41/d4c/f94 [0,4194304] 0 2024-04-26T11:46:38.991 INFO:tasks.workunit.client.0.smithi029.stdout:5/509: write db/d12/d72/d39/d3b/f81 [899078,127467] 0 2024-04-26T11:46:38.992 INFO:tasks.workunit.client.0.smithi029.stdout:9/568: creat d4/d49/d7d/fb4 x:0 0 0 2024-04-26T11:46:38.992 INFO:tasks.workunit.client.0.smithi029.stdout:0/516: symlink d9/d16/d25/d2a/lba 0 2024-04-26T11:46:38.992 INFO:tasks.workunit.client.0.smithi029.stdout:5/510: fsync db/d12/d1a/f33 0 2024-04-26T11:46:38.992 INFO:tasks.workunit.client.0.smithi029.stdout:8/466: creat dc/d75/da0/fa3 x:0 0 0 2024-04-26T11:46:38.993 INFO:tasks.workunit.client.0.smithi029.stdout:7/585: write d11/d18/d2d/f77 [794933,32398] 0 2024-04-26T11:46:38.994 INFO:tasks.workunit.client.0.smithi029.stdout:9/569: dread - d4/d5/d16/d80/f9b zero size 2024-04-26T11:46:38.994 INFO:tasks.workunit.client.0.smithi029.stdout:0/517: write d9/d16/d25/d2a/d4b/fb6 [22595,61471] 0 2024-04-26T11:46:38.996 INFO:tasks.workunit.client.0.smithi029.stdout:5/511: creat db/d12/d6b/f9e x:0 0 0 2024-04-26T11:46:38.997 INFO:tasks.workunit.client.0.smithi029.stdout:8/467: symlink dc/de/d2e/d23/d27/la4 0 2024-04-26T11:46:38.998 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:38.992+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:38.999 INFO:tasks.workunit.client.0.smithi029.stdout:0/518: creat d9/d16/d25/d2a/d46/fbb x:0 0 0 2024-04-26T11:46:38.999 INFO:tasks.workunit.client.0.smithi029.stdout:4/477: getdents d3/d1d/d11/d16/d1f/d3d/d39/d30 0 2024-04-26T11:46:39.000 INFO:tasks.workunit.client.0.smithi029.stdout:6/549: truncate d7/d46/d69/da2/f38 2266973 0 2024-04-26T11:46:39.000 INFO:tasks.workunit.client.0.smithi029.stdout:8/468: mknod dc/de/d2e/d23/ca5 1 2024-04-26T11:46:39.000 INFO:tasks.workunit.client.0.smithi029.stdout:5/512: symlink db/d40/d77/d98/l9f 0 2024-04-26T11:46:39.001 INFO:tasks.workunit.client.0.smithi029.stdout:8/469: fdatasync dc/d3b/f9a 0 2024-04-26T11:46:39.005 INFO:tasks.workunit.client.0.smithi029.stdout:0/519: rename d9 to d9/d16/d25/d2a/d74/d9a/dbc 22 2024-04-26T11:46:39.005 INFO:tasks.workunit.client.0.smithi029.stdout:8/470: unlink dc/d75/l7f 0 2024-04-26T11:46:39.005 INFO:tasks.workunit.client.0.smithi029.stdout:2/560: dwrite d12/d24/d29/d36/d4b/f64 [0,4194304] 0 2024-04-26T11:46:39.006 INFO:tasks.workunit.client.0.smithi029.stdout:5/513: read db/d12/d72/f21 [874241,26187] 0 2024-04-26T11:46:39.006 INFO:tasks.workunit.client.0.smithi029.stdout:9/570: dread d4/d5/fb [0,4194304] 0 2024-04-26T11:46:39.006 INFO:tasks.workunit.client.0.smithi029.stdout:4/478: write d3/d50/d7a/f96 [768852,82557] 0 2024-04-26T11:46:39.007 INFO:tasks.workunit.client.0.smithi029.stdout:3/494: dwrite d0/d1/f16 [0,4194304] 0 2024-04-26T11:46:39.008 INFO:tasks.workunit.client.0.smithi029.stdout:8/471: readlink dc/d12/d6a/l2c 0 2024-04-26T11:46:39.008 INFO:tasks.workunit.client.0.smithi029.stdout:1/604: dwrite d7/d25/d68/f79 [0,4194304] 0 2024-04-26T11:46:39.009 INFO:tasks.workunit.client.0.smithi029.stdout:2/561: creat d12/d6c/d6e/fbf x:0 0 0 2024-04-26T11:46:39.009 INFO:tasks.workunit.client.0.smithi029.stdout:0/520: creat d9/d16/d25/d2a/fbd x:0 0 0 2024-04-26T11:46:39.009 INFO:tasks.workunit.client.0.smithi029.stdout:7/586: dwrite d11/d18/d35/d39/f6a [4194304,4194304] 0 2024-04-26T11:46:39.009 INFO:tasks.workunit.client.0.smithi029.stdout:5/514: write db/f76 [932396,72606] 0 2024-04-26T11:46:39.009 INFO:tasks.workunit.client.0.smithi029.stdout:1/605: dread - d7/db/fa3 zero size 2024-04-26T11:46:39.011 INFO:tasks.workunit.client.0.smithi029.stdout:9/571: truncate d4/d5/d7a/d97/f98 885998 0 2024-04-26T11:46:39.011 INFO:tasks.workunit.client.0.smithi029.stdout:6/550: creat d7/d46/d69/da2/d4c/d98/d45/d83/da9/fbb x:0 0 0 2024-04-26T11:46:39.011 INFO:tasks.workunit.client.0.smithi029.stdout:1/606: chown d7/d37 525392953 1 2024-04-26T11:46:39.012 INFO:tasks.workunit.client.0.smithi029.stdout:0/521: write d9/f41 [5755634,90528] 0 2024-04-26T11:46:39.013 INFO:tasks.workunit.client.0.smithi029.stdout:4/479: link d3/d1d/l2e d3/d1d/d11/d16/d71/l99 0 2024-04-26T11:46:39.013 INFO:tasks.workunit.client.0.smithi029.stdout:6/551: mknod d7/d25/d4b/d4d/d65/db9/cbc 1 2024-04-26T11:46:39.013 INFO:tasks.workunit.client.0.smithi029.stdout:5/515: write db/d12/d72/d39/d3b/f5e [217885,56772] 0 2024-04-26T11:46:39.015 INFO:tasks.workunit.client.0.smithi029.stdout:1/607: write d7/d25/d68/f79 [950487,10279] 0 2024-04-26T11:46:39.016 INFO:tasks.workunit.client.0.smithi029.stdout:6/552: mknod d7/d46/d69/da2/cbd 1 2024-04-26T11:46:39.016 INFO:tasks.workunit.client.0.smithi029.stdout:0/522: creat d9/d16/d33/d2f/d32/d90/fbe x:0 0 0 2024-04-26T11:46:39.016 INFO:tasks.workunit.client.0.smithi029.stdout:1/608: creat d7/db/d8d/dc7/fd0 x:0 0 0 2024-04-26T11:46:39.016 INFO:tasks.workunit.client.0.smithi029.stdout:7/587: link d11/d18/d35/d39/l3e d11/d18/dad/lc1 0 2024-04-26T11:46:39.017 INFO:tasks.workunit.client.0.smithi029.stdout:6/553: creat d7/d25/d4b/fbe x:0 0 0 2024-04-26T11:46:39.017 INFO:tasks.workunit.client.0.smithi029.stdout:5/516: truncate db/d40/d4d/f95 485099 0 2024-04-26T11:46:39.017 INFO:tasks.workunit.client.0.smithi029.stdout:0/523: creat d9/d16/d25/da7/fbf x:0 0 0 2024-04-26T11:46:39.017 INFO:tasks.workunit.client.0.smithi029.stdout:4/480: truncate d3/d1d/db/d13/d23/f45 3081734 0 2024-04-26T11:46:39.018 INFO:tasks.workunit.client.0.smithi029.stdout:1/609: write d7/d25/d68/d4b/d66/f70 [1703032,34789] 0 2024-04-26T11:46:39.019 INFO:tasks.workunit.client.0.smithi029.stdout:0/524: write d9/d16/d25/d2a/d46/faa [232066,87821] 0 2024-04-26T11:46:39.019 INFO:tasks.workunit.client.0.smithi029.stdout:5/517: unlink db/d40/d77/d98/f9b 0 2024-04-26T11:46:39.021 INFO:tasks.workunit.client.0.smithi029.stdout:0/525: symlink d9/d16/d25/lc0 0 2024-04-26T11:46:39.021 INFO:tasks.workunit.client.0.smithi029.stdout:5/518: symlink db/d12/d72/d39/la0 0 2024-04-26T11:46:39.022 INFO:tasks.workunit.client.0.smithi029.stdout:0/526: mknod d9/d43/cc1 1 2024-04-26T11:46:39.023 INFO:tasks.workunit.client.0.smithi029.stdout:3/495: dwrite d0/d1/d41/d5f/d1a/f3d [4194304,4194304] 0 2024-04-26T11:46:39.025 INFO:tasks.workunit.client.0.smithi029.stdout:5/519: dread - db/d12/d1a/d4c/f88 zero size 2024-04-26T11:46:39.026 INFO:tasks.workunit.client.0.smithi029.stdout:6/554: rmdir d7/d46/d69/da2/d4c/d98/d45/d83/da9 39 2024-04-26T11:46:39.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/562: truncate d12/f1a 3963465 0 2024-04-26T11:46:39.027 INFO:tasks.workunit.client.0.smithi029.stdout:4/481: dread d3/f31 [0,4194304] 0 2024-04-26T11:46:39.029 INFO:tasks.workunit.client.0.smithi029.stdout:7/588: dwrite d11/d15/d79/d97/f9e [0,4194304] 0 2024-04-26T11:46:39.030 INFO:tasks.workunit.client.0.smithi029.stdout:3/496: creat d0/faa x:0 0 0 2024-04-26T11:46:39.032 INFO:tasks.workunit.client.0.smithi029.stdout:1/610: dwrite d7/d5b/f81 [0,4194304] 0 2024-04-26T11:46:39.032 INFO:tasks.workunit.client.0.smithi029.stdout:4/482: unlink d3/f5 0 2024-04-26T11:46:39.035 INFO:tasks.workunit.client.0.smithi029.stdout:7/589: rmdir d11/d18/d1a/d92 39 2024-04-26T11:46:39.036 INFO:tasks.workunit.client.0.smithi029.stdout:6/555: write d7/d46/d69/da2/d4c/f94 [1707675,28817] 0 2024-04-26T11:46:39.037 INFO:tasks.workunit.client.0.smithi029.stdout:2/563: creat d12/d6c/d73/d4f/d65/d81/fc0 x:0 0 0 2024-04-26T11:46:39.037 INFO:tasks.workunit.client.0.smithi029.stdout:4/483: creat d3/d1d/db/d13/d23/d2b/f9a x:0 0 0 2024-04-26T11:46:39.038 INFO:tasks.workunit.client.0.smithi029.stdout:0/527: dwrite d9/d16/d25/d2a/d4b/f5d [4194304,4194304] 0 2024-04-26T11:46:39.038 INFO:tasks.workunit.client.0.smithi029.stdout:7/590: write d11/d18/f29 [1754416,112742] 0 2024-04-26T11:46:39.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/611: rename d7/db/d10/d1e/d82/f8f to d7/db/d10/d1e/fd1 0 2024-04-26T11:46:39.040 INFO:tasks.workunit.client.0.smithi029.stdout:5/520: dwrite db/d12/d72/d39/d3b/f5e [0,4194304] 0 2024-04-26T11:46:39.040 INFO:tasks.workunit.client.0.smithi029.stdout:7/591: creat d11/d18/d2d/fc2 x:0 0 0 2024-04-26T11:46:39.041 INFO:tasks.workunit.client.0.smithi029.stdout:4/484: write d3/d1d/d11/d16/d1f/f61 [490222,32899] 0 2024-04-26T11:46:39.042 INFO:tasks.workunit.client.0.smithi029.stdout:1/612: write d7/db/d10/d1e/d5e/fce [521574,58713] 0 2024-04-26T11:46:39.042 INFO:tasks.workunit.client.0.smithi029.stdout:7/592: mkdir d11/d18/d58/d8d/dc3 0 2024-04-26T11:46:39.042 INFO:tasks.workunit.client.0.smithi029.stdout:5/521: symlink db/d40/d4d/d4f/la1 0 2024-04-26T11:46:39.042 INFO:tasks.workunit.client.0.smithi029.stdout:0/528: fdatasync d9/d16/d25/d2a/d46/fbb 0 2024-04-26T11:46:39.043 INFO:tasks.workunit.client.0.smithi029.stdout:7/593: symlink d11/d18/db8/lc4 0 2024-04-26T11:46:39.044 INFO:tasks.workunit.client.0.smithi029.stdout:4/485: read d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f5e [1904054,36019] 0 2024-04-26T11:46:39.044 INFO:tasks.workunit.client.0.smithi029.stdout:5/522: creat db/d12/d72/fa2 x:0 0 0 2024-04-26T11:46:39.045 INFO:tasks.workunit.client.0.smithi029.stdout:0/529: rename d9/d16/f80 to d9/d16/d33/d2f/d32/d90/fc2 0 2024-04-26T11:46:39.045 INFO:tasks.workunit.client.0.smithi029.stdout:5/523: creat db/d89/fa3 x:0 0 0 2024-04-26T11:46:39.046 INFO:tasks.workunit.client.0.smithi029.stdout:4/486: rename d3/d1d/d11/d16/d1f/d3d/d39/d30/l4b to d3/d50/d7a/l9b 0 2024-04-26T11:46:39.046 INFO:tasks.workunit.client.0.smithi029.stdout:5/524: mkdir db/d12/d6b/da4 0 2024-04-26T11:46:39.046 INFO:tasks.workunit.client.0.smithi029.stdout:0/530: symlink d9/d16/d52/lc3 0 2024-04-26T11:46:39.048 INFO:tasks.workunit.client.0.smithi029.stdout:7/594: rename d11/d15/d79/l7f to d11/d15/d69/lc5 0 2024-04-26T11:46:39.048 INFO:tasks.workunit.client.0.smithi029.stdout:2/564: dwrite d12/f1b [0,4194304] 0 2024-04-26T11:46:39.049 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:39.049 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:39.050 INFO:tasks.workunit.client.0.smithi029.stdout:2/565: readlink d12/d24/d2f/l7f 0 2024-04-26T11:46:39.050 INFO:tasks.workunit.client.0.smithi029.stdout:5/525: getdents db/d12/d72/d39/d3b 0 2024-04-26T11:46:39.050 INFO:tasks.workunit.client.0.smithi029.stdout:2/566: dread - d12/d6c/d6e/fbf zero size 2024-04-26T11:46:39.058 INFO:tasks.workunit.client.0.smithi029.stdout:6/556: dread d7/d25/d4b/d6d/f78 [0,4194304] 0 2024-04-26T11:46:39.059 INFO:tasks.workunit.client.0.smithi029.stdout:1/613: truncate d7/d37/d3e/f4e 729785 0 2024-04-26T11:46:39.060 INFO:tasks.workunit.client.0.smithi029.stdout:5/526: dwrite db/d12/d72/d39/f41 [0,4194304] 0 2024-04-26T11:46:39.060 INFO:tasks.workunit.client.0.smithi029.stdout:6/557: write d7/d46/d69/f77 [966806,126141] 0 2024-04-26T11:46:39.061 INFO:tasks.workunit.client.0.smithi029.stdout:4/487: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f82 [677547,75854] 0 2024-04-26T11:46:39.062 INFO:tasks.workunit.client.0.smithi029.stdout:4/488: mknod d3/d1d/c9c 1 2024-04-26T11:46:39.063 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:39.065 INFO:tasks.workunit.client.0.smithi029.stdout:1/614: rmdir d7/db/d8d 39 2024-04-26T11:46:39.065 INFO:tasks.workunit.client.0.smithi029.stdout:1/615: readlink d7/db/d10/la9 0 2024-04-26T11:46:39.065 INFO:tasks.workunit.client.0.smithi029.stdout:4/489: chown d3/d1d/db/d13/d23/l94 92267634 1 2024-04-26T11:46:39.065 INFO:tasks.workunit.client.0.smithi029.stdout:1/616: write d7/d5b/f81 [1874698,17430] 0 2024-04-26T11:46:39.066 INFO:tasks.workunit.client.0.smithi029.stdout:2/567: dwrite d12/d24/d2f/f4e [0,4194304] 0 2024-04-26T11:46:39.067 INFO:tasks.workunit.client.0.smithi029.stdout:1/617: stat d7/db/d10/d1e/l49 0 2024-04-26T11:46:39.067 INFO:tasks.workunit.client.0.smithi029.stdout:4/490: mkdir d3/d1d/db/d13/d23/d2b/d9d 0 2024-04-26T11:46:39.068 INFO:tasks.workunit.client.0.smithi029.stdout:2/568: write d12/d24/d29/f48 [1021608,25621] 0 2024-04-26T11:46:39.069 INFO:tasks.workunit.client.0.smithi029.stdout:8/472: dread dc/de/d2e/d23/d27/d6f/d9b/d43/da1/f74 [0,4194304] 0 2024-04-26T11:46:39.070 INFO:tasks.workunit.client.0.smithi029.stdout:0/531: dread d9/d16/d33/d2f/f6b [0,4194304] 0 2024-04-26T11:46:39.071 INFO:tasks.workunit.client.0.smithi029.stdout:9/572: dread d4/d46/f57 [0,4194304] 0 2024-04-26T11:46:39.071 INFO:tasks.workunit.client.0.smithi029.stdout:8/473: link dc/de/l4a dc/d12/d9e/la6 0 2024-04-26T11:46:39.071 INFO:tasks.workunit.client.0.smithi029.stdout:5/527: truncate db/d12/d72/d39/f41 1583985 0 2024-04-26T11:46:39.077 INFO:tasks.workunit.client.0.smithi029.stdout:0/532: mkdir d9/d78/dc4 0 2024-04-26T11:46:39.078 INFO:tasks.workunit.client.0.smithi029.stdout:3/497: sync 2024-04-26T11:46:39.078 INFO:tasks.workunit.client.0.smithi029.stdout:1/618: dwrite d7/f77 [0,4194304] 0 2024-04-26T11:46:39.078 INFO:tasks.workunit.client.0.smithi029.stdout:4/491: truncate d3/d1d/d11/d16/d1f/d3d/d39/f32 2698721 0 2024-04-26T11:46:39.078 INFO:tasks.workunit.client.0.smithi029.stdout:5/528: readlink db/d12/d72/l34 0 2024-04-26T11:46:39.078 INFO:tasks.workunit.client.0.smithi029.stdout:0/533: stat d9/d16/f89 0 2024-04-26T11:46:39.078 INFO:tasks.workunit.client.0.smithi029.stdout:3/498: write d0/f15 [859543,32466] 0 2024-04-26T11:46:39.078 INFO:tasks.workunit.client.0.smithi029.stdout:1/619: stat d7/db/f34 0 2024-04-26T11:46:39.078 INFO:tasks.workunit.client.0.smithi029.stdout:0/534: mknod d9/d43/cc5 1 2024-04-26T11:46:39.078 INFO:tasks.workunit.client.0.smithi029.stdout:3/499: readlink d0/l48 0 2024-04-26T11:46:39.079 INFO:tasks.workunit.client.0.smithi029.stdout:1/620: truncate f2 344904 0 2024-04-26T11:46:39.079 INFO:tasks.workunit.client.0.smithi029.stdout:3/500: mknod d0/d1/d41/d5f/d1a/d3b/cab 1 2024-04-26T11:46:39.081 INFO:tasks.workunit.client.0.smithi029.stdout:3/501: chown d0/d1/d13/l29 203915 1 2024-04-26T11:46:39.081 INFO:tasks.workunit.client.0.smithi029.stdout:0/535: chown d9/d16/d25/d2a/d74/l95 52673188 1 2024-04-26T11:46:39.081 INFO:tasks.workunit.client.0.smithi029.stdout:8/474: dwrite dc/d12/f49 [0,4194304] 0 2024-04-26T11:46:39.084 INFO:tasks.workunit.client.0.smithi029.stdout:3/502: symlink d0/d1/d13/lac 0 2024-04-26T11:46:39.084 INFO:tasks.workunit.client.0.smithi029.stdout:8/475: symlink dc/d75/da0/la7 0 2024-04-26T11:46:39.084 INFO:tasks.workunit.client.0.smithi029.stdout:1/621: truncate d7/d37/f63 547581 0 2024-04-26T11:46:39.085 INFO:tasks.workunit.client.0.smithi029.stdout:1/622: fsync d7/d37/fa1 0 2024-04-26T11:46:39.086 INFO:tasks.workunit.client.0.smithi029.stdout:3/503: dread - d0/d1/d41/d5f/d1a/d3b/fa5 zero size 2024-04-26T11:46:39.086 INFO:tasks.workunit.client.0.smithi029.stdout:9/573: dwrite d4/d5/d16/d39/f3d [0,4194304] 0 2024-04-26T11:46:39.087 INFO:tasks.workunit.client.0.smithi029.stdout:0/536: truncate d9/d43/f6d 1835872 0 2024-04-26T11:46:39.089 INFO:tasks.workunit.client.0.smithi029.stdout:0/537: chown d9/f84 14769 1 2024-04-26T11:46:39.090 INFO:tasks.workunit.client.0.smithi029.stdout:1/623: symlink d7/d25/d68/d4b/d66/ld2 0 2024-04-26T11:46:39.090 INFO:tasks.workunit.client.0.smithi029.stdout:5/529: dwrite db/d40/f84 [0,4194304] 0 2024-04-26T11:46:39.090 INFO:tasks.workunit.client.0.smithi029.stdout:9/574: read d4/d5/d7/f47 [3298112,39326] 0 2024-04-26T11:46:39.091 INFO:tasks.workunit.client.0.smithi029.stdout:0/538: dread - d9/d43/fa0 zero size 2024-04-26T11:46:39.091 INFO:tasks.workunit.client.0.smithi029.stdout:9/575: stat d4/d5/d7 0 2024-04-26T11:46:39.092 INFO:tasks.workunit.client.0.smithi029.stdout:0/539: stat d9/d16/f3d 0 2024-04-26T11:46:39.093 INFO:tasks.workunit.client.0.smithi029.stdout:5/530: getdents db/d40 0 2024-04-26T11:46:39.093 INFO:tasks.workunit.client.0.smithi029.stdout:9/576: write d4/d5/d7a/d97/f98 [873541,97401] 0 2024-04-26T11:46:39.094 INFO:tasks.workunit.client.0.smithi029.stdout:1/624: link d7/d25/dab/lbb d7/d25/d68/d4b/d66/ld3 0 2024-04-26T11:46:39.094 INFO:tasks.workunit.client.0.smithi029.stdout:0/540: chown d9/d16/d25/d2a/d46/f5a 954979 1 2024-04-26T11:46:39.094 INFO:tasks.workunit.client.0.smithi029.stdout:8/476: dwrite dc/f11 [0,4194304] 0 2024-04-26T11:46:39.095 INFO:tasks.workunit.client.0.smithi029.stdout:5/531: symlink db/la5 0 2024-04-26T11:46:39.095 INFO:tasks.workunit.client.0.smithi029.stdout:8/477: mknod dc/d75/ca8 1 2024-04-26T11:46:39.095 INFO:tasks.workunit.client.0.smithi029.stdout:9/577: truncate d4/d5/f95 965398 0 2024-04-26T11:46:39.095 INFO:tasks.workunit.client.0.smithi029.stdout:1/625: symlink d7/d37/d3e/ld4 0 2024-04-26T11:46:39.095 INFO:tasks.workunit.client.0.smithi029.stdout:0/541: rmdir d9/d16/d33/d2f/d31 39 2024-04-26T11:46:39.096 INFO:tasks.workunit.client.0.smithi029.stdout:8/478: dread - dc/d3b/f84 zero size 2024-04-26T11:46:39.096 INFO:tasks.workunit.client.0.smithi029.stdout:5/532: mkdir db/da6 0 2024-04-26T11:46:39.096 INFO:tasks.workunit.client.0.smithi029.stdout:3/504: dread d0/d1/d41/d5f/d1a/f38 [0,4194304] 0 2024-04-26T11:46:39.096 INFO:tasks.workunit.client.0.smithi029.stdout:7/595: sync 2024-04-26T11:46:39.096 INFO:tasks.workunit.client.0.smithi029.stdout:4/492: sync 2024-04-26T11:46:39.097 INFO:tasks.workunit.client.0.smithi029.stdout:8/479: dread - dc/d75/f79 zero size 2024-04-26T11:46:39.097 INFO:tasks.workunit.client.0.smithi029.stdout:0/542: write f3 [4356158,90223] 0 2024-04-26T11:46:39.097 INFO:tasks.workunit.client.0.smithi029.stdout:9/578: write d4/d49/d58/fa7 [532974,60309] 0 2024-04-26T11:46:39.098 INFO:tasks.workunit.client.0.smithi029.stdout:5/533: fsync db/d12/d1a/d4c/f55 0 2024-04-26T11:46:39.098 INFO:tasks.workunit.client.0.smithi029.stdout:1/626: mkdir d7/db/dc5/dd5 0 2024-04-26T11:46:39.099 INFO:tasks.workunit.client.0.smithi029.stdout:7/596: fdatasync d11/d18/d35/d39/d7e/db6/fb5 0 2024-04-26T11:46:39.099 INFO:tasks.workunit.client.0.smithi029.stdout:3/505: rename d0/d1/d13 to d0/d1/d2b/da7/dad 0 2024-04-26T11:46:39.100 INFO:tasks.workunit.client.0.smithi029.stdout:6/558: dread d7/d46/d69/f77 [0,4194304] 0 2024-04-26T11:46:39.100 INFO:tasks.workunit.client.0.smithi029.stdout:0/543: chown d9/l17 1 1 2024-04-26T11:46:39.100 INFO:tasks.workunit.client.0.smithi029.stdout:1/627: chown d7/d25/d99/fcb 28695021 1 2024-04-26T11:46:39.100 INFO:tasks.workunit.client.0.smithi029.stdout:4/493: creat d3/d1d/db/d13/f9e x:0 0 0 2024-04-26T11:46:39.101 INFO:tasks.workunit.client.0.smithi029.stdout:7/597: write d11/d18/f22 [1609253,43717] 0 2024-04-26T11:46:39.103 INFO:tasks.workunit.client.0.smithi029.stdout:3/506: symlink d0/d1/d2f/d68/lae 0 2024-04-26T11:46:39.104 INFO:tasks.workunit.client.0.smithi029.stdout:7/598: mknod d11/d18/d1a/dab/cc6 1 2024-04-26T11:46:39.104 INFO:tasks.workunit.client.0.smithi029.stdout:2/569: dread d12/d6c/d73/d4f/f80 [0,4194304] 0 2024-04-26T11:46:39.104 INFO:tasks.workunit.client.0.smithi029.stdout:0/544: getdents d9/d16/d25 0 2024-04-26T11:46:39.104 INFO:tasks.workunit.client.0.smithi029.stdout:4/494: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d9f 0 2024-04-26T11:46:39.104 INFO:tasks.workunit.client.0.smithi029.stdout:2/570: fsync d12/faf 0 2024-04-26T11:46:39.105 INFO:tasks.workunit.client.0.smithi029.stdout:0/545: chown d9/f36 6610 1 2024-04-26T11:46:39.106 INFO:tasks.workunit.client.0.smithi029.stdout:7/599: creat d11/d15/d79/d97/d9b/fc7 x:0 0 0 2024-04-26T11:46:39.106 INFO:tasks.workunit.client.0.smithi029.stdout:4/495: chown d3/d1d/db/d13/f9e 5921840 1 2024-04-26T11:46:39.107 INFO:tasks.workunit.client.0.smithi029.stdout:2/571: mknod d12/d24/d29/d50/d55/cc1 1 2024-04-26T11:46:39.108 INFO:tasks.workunit.client.0.smithi029.stdout:3/507: read d0/d1/d2b/d33/f8b [395248,113178] 0 2024-04-26T11:46:39.108 INFO:tasks.workunit.client.0.smithi029.stdout:8/480: dwrite dc/de/d26/f53 [0,4194304] 0 2024-04-26T11:46:39.109 INFO:tasks.workunit.client.0.smithi029.stdout:7/600: creat d11/d18/d1a/d33/fc8 x:0 0 0 2024-04-26T11:46:39.109 INFO:tasks.workunit.client.0.smithi029.stdout:0/546: rename d9/d16/d33/f5e to d9/d43/fc6 0 2024-04-26T11:46:39.110 INFO:tasks.workunit.client.0.smithi029.stdout:9/579: dwrite d4/d5/d78/fb3 [0,4194304] 0 2024-04-26T11:46:39.110 INFO:tasks.workunit.client.0.smithi029.stdout:4/496: mkdir d3/d1d/da0 0 2024-04-26T11:46:39.112 INFO:tasks.workunit.client.0.smithi029.stdout:7/601: fdatasync d11/d18/d35/d39/d7e/f87 0 2024-04-26T11:46:39.112 INFO:tasks.workunit.client.0.smithi029.stdout:0/547: stat d9/d16/d25/d2a/d46/f64 0 2024-04-26T11:46:39.113 INFO:tasks.workunit.client.0.smithi029.stdout:7/602: stat d11/d37 0 2024-04-26T11:46:39.113 INFO:tasks.workunit.client.0.smithi029.stdout:3/508: write d0/d1/d2b/f85 [3041003,68512] 0 2024-04-26T11:46:39.113 INFO:tasks.workunit.client.0.smithi029.stdout:6/559: dwrite d7/d20/d27/f9c [0,4194304] 0 2024-04-26T11:46:39.114 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:39.113+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:39.114 INFO:tasks.workunit.client.0.smithi029.stdout:4/497: truncate d3/d1d/db/f36 5050065 0 2024-04-26T11:46:39.114 INFO:tasks.workunit.client.0.smithi029.stdout:3/509: read - d0/d1/d41/d5f/fa2 zero size 2024-04-26T11:46:39.116 INFO:tasks.workunit.client.0.smithi029.stdout:8/481: rename dc/d12/l18 to dc/de/d26/d57/d86/la9 0 2024-04-26T11:46:39.116 INFO:tasks.workunit.client.0.smithi029.stdout:6/560: unlink d7/d46/d69/da2/d4c/l55 0 2024-04-26T11:46:39.117 INFO:tasks.workunit.client.0.smithi029.stdout:8/482: chown dc/de/d2e/d23/d27/d6f/d9b/d43/da1 3825745 1 2024-04-26T11:46:39.117 INFO:tasks.workunit.client.0.smithi029.stdout:6/561: truncate d7/d25/d5c/f36 1916765 0 2024-04-26T11:46:39.117 INFO:tasks.workunit.client.0.smithi029.stdout:4/498: getdents d3/d1d/db/d13/d73/d97 0 2024-04-26T11:46:39.118 INFO:tasks.workunit.client.0.smithi029.stdout:8/483: mkdir dc/d12/d6a/daa 0 2024-04-26T11:46:39.119 INFO:tasks.workunit.client.0.smithi029.stdout:4/499: mkdir d3/d1d/db/d13/d23/d2b/da1 0 2024-04-26T11:46:39.119 INFO:tasks.workunit.client.0.smithi029.stdout:6/562: mkdir d7/d46/d69/da2/d4c/d98/d45/d83/dbf 0 2024-04-26T11:46:39.120 INFO:tasks.workunit.client.0.smithi029.stdout:8/484: unlink dc/de/d26/d57/f59 0 2024-04-26T11:46:39.121 INFO:tasks.workunit.client.0.smithi029.stdout:8/485: fsync dc/f4f 0 2024-04-26T11:46:39.121 INFO:tasks.workunit.client.0.smithi029.stdout:6/563: mkdir d7/d20/d27/dc0 0 2024-04-26T11:46:39.122 INFO:tasks.workunit.client.0.smithi029.stdout:4/500: chown d3/d1d/d11/d16/d1f/d3d/d46/f90 10424 1 2024-04-26T11:46:39.123 INFO:tasks.workunit.client.0.smithi029.stdout:8/486: chown dc/de/d26/f32 27 1 2024-04-26T11:46:39.123 INFO:tasks.workunit.client.0.smithi029.stdout:6/564: creat d7/d25/d4b/d4d/fc1 x:0 0 0 2024-04-26T11:46:39.124 INFO:tasks.workunit.client.0.smithi029.stdout:3/510: dwrite d0/d1/d41/d4c/f7b [0,4194304] 0 2024-04-26T11:46:39.125 INFO:tasks.workunit.client.0.smithi029.stdout:7/603: dwrite d11/d18/d2d/f86 [0,4194304] 0 2024-04-26T11:46:39.125 INFO:tasks.workunit.client.0.smithi029.stdout:4/501: dread - d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f72 zero size 2024-04-26T11:46:39.125 INFO:tasks.workunit.client.0.smithi029.stdout:8/487: truncate dc/d12/d6a/f4c 490121 0 2024-04-26T11:46:39.130 INFO:tasks.workunit.client.0.smithi029.stdout:3/511: rename d0/d1/d41/d5f/d54/f7d to d0/dc/faf 0 2024-04-26T11:46:39.134 INFO:tasks.workunit.client.0.smithi029.stdout:4/502: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f7d [0,4194304] 0 2024-04-26T11:46:39.135 INFO:tasks.workunit.client.0.smithi029.stdout:4/503: fsync d3/f78 0 2024-04-26T11:46:39.135 INFO:tasks.workunit.client.0.smithi029.stdout:9/580: truncate d4/d49/d58/f53 530109 0 2024-04-26T11:46:39.137 INFO:tasks.workunit.client.0.smithi029.stdout:3/512: truncate d0/dc/f89 380035 0 2024-04-26T11:46:39.137 INFO:tasks.workunit.client.0.smithi029.stdout:6/565: write d7/d46/d69/da2/f38 [1877556,63495] 0 2024-04-26T11:46:39.138 INFO:tasks.workunit.client.0.smithi029.stdout:9/581: chown d4/d5/l38 141075497 1 2024-04-26T11:46:39.139 INFO:tasks.workunit.client.0.smithi029.stdout:6/566: chown d7/d25/d4b/d6d/f78 506012 1 2024-04-26T11:46:39.144 INFO:tasks.workunit.client.0.smithi029.stdout:0/548: dwrite d9/d16/d33/d2f/f6b [0,4194304] 0 2024-04-26T11:46:39.148 INFO:tasks.workunit.client.0.smithi029.stdout:9/582: rename d4/d46/f9c to d4/d5/da3/fb5 0 2024-04-26T11:46:39.148 INFO:tasks.workunit.client.0.smithi029.stdout:4/504: dwrite d3/d1d/f5c [0,4194304] 0 2024-04-26T11:46:39.148 INFO:tasks.workunit.client.0.smithi029.stdout:0/549: rmdir d9/d16/d25/d2a/d46 39 2024-04-26T11:46:39.149 INFO:tasks.workunit.client.0.smithi029.stdout:7/604: dread d11/d15/d79/da6/fa8 [0,4194304] 0 2024-04-26T11:46:39.150 INFO:tasks.workunit.client.0.smithi029.stdout:1/628: dread d7/db/f6b [0,4194304] 0 2024-04-26T11:46:39.151 INFO:tasks.workunit.client.0.smithi029.stdout:3/513: dread d0/d1/d41/d5f/d1a/f1d [0,4194304] 0 2024-04-26T11:46:39.151 INFO:tasks.workunit.client.0.smithi029.stdout:9/583: chown d4/d5/d7a/da1 62851924 1 2024-04-26T11:46:39.152 INFO:tasks.workunit.client.0.smithi029.stdout:3/514: fdatasync d0/d1/d2b/f85 0 2024-04-26T11:46:39.153 INFO:tasks.workunit.client.0.smithi029.stdout:0/550: mkdir d9/d16/d25/d2a/d8e/dc7 0 2024-04-26T11:46:39.153 INFO:tasks.workunit.client.0.smithi029.stdout:1/629: mknod d7/d25/cd6 1 2024-04-26T11:46:39.153 INFO:tasks.workunit.client.0.smithi029.stdout:9/584: rename d4/d5/d16/d39/f3c to d4/d5/d7a/da1/fb6 0 2024-04-26T11:46:39.154 INFO:tasks.workunit.client.0.smithi029.stdout:3/515: mknod d0/d1/d2b/d7e/da3/cb0 1 2024-04-26T11:46:39.155 INFO:tasks.workunit.client.0.smithi029.stdout:4/505: getdents d3/d1d/d11/d16/d1f/d3d/d46 0 2024-04-26T11:46:39.156 INFO:tasks.workunit.client.0.smithi029.stdout:9/585: write d4/d49/d58/f91 [4192669,104693] 0 2024-04-26T11:46:39.156 INFO:tasks.workunit.client.0.smithi029.stdout:7/605: link d11/d15/l56 d11/d18/d1a/dab/lc9 0 2024-04-26T11:46:39.159 INFO:tasks.workunit.client.0.smithi029.stdout:2/572: dread d12/d24/d29/d36/f43 [0,4194304] 0 2024-04-26T11:46:39.161 INFO:tasks.workunit.client.0.smithi029.stdout:5/534: sync 2024-04-26T11:46:39.161 INFO:tasks.workunit.client.0.smithi029.stdout:2/573: stat d12/d6c/d73/da5/db1 0 2024-04-26T11:46:39.161 INFO:tasks.workunit.client.0.smithi029.stdout:6/567: dwrite d7/d46/f7f [0,4194304] 0 2024-04-26T11:46:39.163 INFO:tasks.workunit.client.0.smithi029.stdout:2/574: chown f7 10620 1 2024-04-26T11:46:39.163 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:46:39.165 INFO:tasks.workunit.client.0.smithi029.stdout:3/516: dwrite d0/d1/d41/d5f/d54/f58 [4194304,4194304] 0 2024-04-26T11:46:39.165 INFO:tasks.workunit.client.0.smithi029.stdout:0/551: rename d9/d16/d33/d2f/d68/f88 to d9/d16/d33/d2f/d32/d90/fc8 0 2024-04-26T11:46:39.166 INFO:tasks.workunit.client.0.smithi029.stdout:6/568: rmdir d7/d46/d69/da2/d4c 39 2024-04-26T11:46:39.166 INFO:tasks.workunit.client.0.smithi029.stdout:9/586: link d4/d49/f6a d4/d49/d58/d67/fb7 0 2024-04-26T11:46:39.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/506: link d3/d1d/d11/d16/d1f/d3d/d46/f5f d3/d1d/d11/fa2 0 2024-04-26T11:46:39.167 INFO:tasks.workunit.client.0.smithi029.stdout:9/587: mknod d4/dac/cb8 1 2024-04-26T11:46:39.167 INFO:tasks.workunit.client.0.smithi029.stdout:7/606: dwrite d11/d18/d1a/d33/f75 [0,4194304] 0 2024-04-26T11:46:39.168 INFO:tasks.workunit.client.0.smithi029.stdout:5/535: creat db/d12/fa7 x:0 0 0 2024-04-26T11:46:39.168 INFO:tasks.workunit.client.0.smithi029.stdout:0/552: fsync d9/d16/d25/d2a/f7c 0 2024-04-26T11:46:39.168 INFO:tasks.workunit.client.0.smithi029.stdout:4/507: chown d3/d1d/db/d13/d73/d7e 0 1 2024-04-26T11:46:39.169 INFO:tasks.workunit.client.0.smithi029.stdout:1/630: dread d7/db/d10/d1e/d53/f7a [0,4194304] 0 2024-04-26T11:46:39.169 INFO:tasks.workunit.client.0.smithi029.stdout:0/553: symlink d9/d43/lc9 0 2024-04-26T11:46:39.170 INFO:tasks.workunit.client.0.smithi029.stdout:9/588: creat d4/d5/d7a/d97/fb9 x:0 0 0 2024-04-26T11:46:39.170 INFO:tasks.workunit.client.0.smithi029.stdout:6/569: truncate d7/d25/d5c/f58 4922358 0 2024-04-26T11:46:39.170 INFO:tasks.workunit.client.0.smithi029.stdout:5/536: truncate db/d12/f1b 1580659 0 2024-04-26T11:46:39.171 INFO:tasks.workunit.client.0.smithi029.stdout:1/631: write d7/db/f34 [4470252,33388] 0 2024-04-26T11:46:39.171 INFO:tasks.workunit.client.0.smithi029.stdout:5/537: write db/d40/d4d/f95 [1205819,54476] 0 2024-04-26T11:46:39.172 INFO:tasks.workunit.client.0.smithi029.stdout:3/517: write d0/d37/f99 [22832,107306] 0 2024-04-26T11:46:39.173 INFO:tasks.workunit.client.0.smithi029.stdout:1/632: chown d7/db/d8d/f92 13 1 2024-04-26T11:46:39.174 INFO:tasks.workunit.client.0.smithi029.stdout:1/633: symlink d7/d25/dab/ld7 0 2024-04-26T11:46:39.176 INFO:tasks.workunit.client.0.smithi029.stdout:0/554: dread d9/d16/d25/d2a/d46/faa [0,4194304] 0 2024-04-26T11:46:39.176 INFO:tasks.workunit.client.0.smithi029.stdout:1/634: chown d7/db/d10/d20/l7e 3331 1 2024-04-26T11:46:39.176 INFO:tasks.workunit.client.0.smithi029.stdout:0/555: read d9/f18 [649664,24733] 0 2024-04-26T11:46:39.177 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:39.177 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:39.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/635: write d7/db/f34 [3976630,3596] 0 2024-04-26T11:46:39.178 INFO:tasks.workunit.client.0.smithi029.stdout:0/556: mkdir d9/d16/d8d/dca 0 2024-04-26T11:46:39.178 INFO:tasks.workunit.client.0.smithi029.stdout:1/636: readlink d7/d37/d3e/lb7 0 2024-04-26T11:46:39.179 INFO:tasks.workunit.client.0.smithi029.stdout:1/637: symlink d7/d25/ld8 0 2024-04-26T11:46:39.179 INFO:tasks.workunit.client.0.smithi029.stdout:6/570: dwrite d7/d46/d69/da2/fb1 [0,4194304] 0 2024-04-26T11:46:39.180 INFO:tasks.workunit.client.0.smithi029.stdout:8/488: sync 2024-04-26T11:46:39.180 INFO:tasks.workunit.client.0.smithi029.stdout:2/575: rename d12/d6c/d73/l90 to d12/d6c/d73/d40/lc2 0 2024-04-26T11:46:39.181 INFO:tasks.workunit.client.0.smithi029.stdout:0/557: creat d9/d78/fcb x:0 0 0 2024-04-26T11:46:39.181 INFO:tasks.workunit.client.0.smithi029.stdout:1/638: rmdir d7/d25/d68 39 2024-04-26T11:46:39.182 INFO:tasks.workunit.client.0.smithi029.stdout:6/571: mkdir d7/d97/dc2 0 2024-04-26T11:46:39.182 INFO:tasks.workunit.client.0.smithi029.stdout:8/489: unlink dc/d12/d6a/l4b 0 2024-04-26T11:46:39.183 INFO:tasks.workunit.client.0.smithi029.stdout:0/558: stat d9/d16/d25/d2a/d46 0 2024-04-26T11:46:39.183 INFO:tasks.workunit.client.0.smithi029.stdout:0/559: readlink d9/la5 0 2024-04-26T11:46:39.184 INFO:tasks.workunit.client.0.smithi029.stdout:9/589: dwrite d4/d49/f87 [0,4194304] 0 2024-04-26T11:46:39.184 INFO:tasks.workunit.client.0.smithi029.stdout:4/508: truncate d3/d1d/d11/d16/d1f/f61 19384 0 2024-04-26T11:46:39.184 INFO:tasks.workunit.client.0.smithi029.stdout:2/576: rename d12/d24/d29/d36/f43 to d12/d24/d29/d38/d52/fc3 0 2024-04-26T11:46:39.184 INFO:tasks.workunit.client.0.smithi029.stdout:0/560: readlink d9/d16/d52/lc3 0 2024-04-26T11:46:39.184 INFO:tasks.workunit.client.0.smithi029.stdout:3/518: write d0/d1/d41/d5f/f59 [1476575,117954] 0 2024-04-26T11:46:39.185 INFO:tasks.workunit.client.0.smithi029.stdout:1/639: link d7/db/d10/d1e/l49 d7/d37/d3e/ld9 0 2024-04-26T11:46:39.185 INFO:tasks.workunit.client.0.smithi029.stdout:2/577: mknod d12/d24/d29/d36/d4b/cc4 1 2024-04-26T11:46:39.187 INFO:tasks.workunit.client.0.smithi029.stdout:3/519: symlink d0/dc/d80/d9a/lb1 0 2024-04-26T11:46:39.187 INFO:tasks.workunit.client.0.smithi029.stdout:0/561: symlink d9/d16/d33/d2f/d32/d9d/lcc 0 2024-04-26T11:46:39.187 INFO:tasks.workunit.client.0.smithi029.stdout:1/640: getdents d7/db 0 2024-04-26T11:46:39.188 INFO:tasks.workunit.client.0.smithi029.stdout:4/509: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f77 776410 0 2024-04-26T11:46:39.189 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:39.190 INFO:tasks.workunit.client.0.smithi029.stdout:0/562: getdents d9/d16/d33/d2f/d32 0 2024-04-26T11:46:39.190 INFO:tasks.workunit.client.0.smithi029.stdout:8/490: read dc/de/f29 [1360561,64482] 0 2024-04-26T11:46:39.190 INFO:tasks.workunit.client.0.smithi029.stdout:0/563: mknod d9/d16/d25/ccd 1 2024-04-26T11:46:39.190 INFO:tasks.workunit.client.0.smithi029.stdout:6/572: write d7/d46/d69/f9d [110184,106552] 0 2024-04-26T11:46:39.191 INFO:tasks.workunit.client.0.smithi029.stdout:0/564: fdatasync d9/f85 0 2024-04-26T11:46:39.191 INFO:tasks.workunit.client.0.smithi029.stdout:9/590: write d4/d5/da3/fb5 [1523213,125869] 0 2024-04-26T11:46:39.192 INFO:tasks.workunit.client.0.smithi029.stdout:8/491: chown dc/de/d26/f53 34 1 2024-04-26T11:46:39.193 INFO:tasks.workunit.client.0.smithi029.stdout:0/565: mknod d9/d16/d8d/dca/cce 1 2024-04-26T11:46:39.193 INFO:tasks.workunit.client.0.smithi029.stdout:9/591: mknod d4/d46/cba 1 2024-04-26T11:46:39.194 INFO:tasks.workunit.client.0.smithi029.stdout:1/641: link d7/db/d8d/faf d7/db/d10/d20/fda 0 2024-04-26T11:46:39.197 INFO:tasks.workunit.client.0.smithi029.stdout:1/642: dread - d7/d25/dab/fc4 zero size 2024-04-26T11:46:39.197 INFO:tasks.workunit.client.0.smithi029.stdout:0/566: write d9/d16/d33/f38 [914540,112149] 0 2024-04-26T11:46:39.198 INFO:tasks.workunit.client.0.smithi029.stdout:2/578: dwrite d12/d24/d29/d50/f58 [0,4194304] 0 2024-04-26T11:46:39.198 INFO:tasks.workunit.client.0.smithi029.stdout:5/538: dread f4 [0,4194304] 0 2024-04-26T11:46:39.199 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:39.197+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:39.199 INFO:tasks.workunit.client.0.smithi029.stdout:8/492: write dc/de/d2e/d23/d27/d6f/f7a [605235,128211] 0 2024-04-26T11:46:39.199 INFO:tasks.workunit.client.0.smithi029.stdout:7/607: dread d11/d18/d1a/f83 [0,4194304] 0 2024-04-26T11:46:39.202 INFO:tasks.workunit.client.0.smithi029.stdout:9/592: getdents d4/d5/d7 0 2024-04-26T11:46:39.203 INFO:tasks.workunit.client.0.smithi029.stdout:3/520: dwrite d0/d1/d2b/d33/f66 [0,4194304] 0 2024-04-26T11:46:39.205 INFO:tasks.workunit.client.0.smithi029.stdout:2/579: mknod d12/d24/d29/d50/d55/cc5 1 2024-04-26T11:46:39.207 INFO:tasks.workunit.client.0.smithi029.stdout:7/608: write d11/d18/d1a/f83 [2678617,56663] 0 2024-04-26T11:46:39.207 INFO:tasks.workunit.client.0.smithi029.stdout:6/573: dwrite d7/d46/fa7 [0,4194304] 0 2024-04-26T11:46:39.208 INFO:tasks.workunit.client.0.smithi029.stdout:4/510: dwrite d3/d1d/f12 [4194304,4194304] 0 2024-04-26T11:46:39.209 INFO:tasks.workunit.client.0.smithi029.stdout:9/593: write d4/d5/d7/f94 [668176,31400] 0 2024-04-26T11:46:39.210 INFO:tasks.workunit.client.0.smithi029.stdout:3/521: readlink d0/d1/d41/d5f/l17 0 2024-04-26T11:46:39.214 INFO:tasks.workunit.client.0.smithi029.stdout:5/539: truncate db/d12/d72/d39/d3b/f5e 2990645 0 2024-04-26T11:46:39.215 INFO:tasks.workunit.client.0.smithi029.stdout:7/609: getdents d11/d18/d35/d39 0 2024-04-26T11:46:39.216 INFO:tasks.workunit.client.0.smithi029.stdout:4/511: rename d3/f7f to d3/d1d/d11/d16/d1f/d3d/d39/d30/fa3 0 2024-04-26T11:46:39.217 INFO:tasks.workunit.client.0.smithi029.stdout:1/643: dwrite d7/d25/dab/fc4 [0,4194304] 0 2024-04-26T11:46:39.217 INFO:tasks.workunit.client.0.smithi029.stdout:7/610: stat d11/d15 0 2024-04-26T11:46:39.218 INFO:tasks.workunit.client.0.smithi029.stdout:8/493: dwrite dc/de/d26/d57/f85 [0,4194304] 0 2024-04-26T11:46:39.218 INFO:tasks.workunit.client.0.smithi029.stdout:2/580: truncate d12/d6c/d73/d4f/f80 1728526 0 2024-04-26T11:46:39.219 INFO:tasks.workunit.client.0.smithi029.stdout:5/540: rename db/d12/d1a/d4c/f90 to db/d12/d1a/fa8 0 2024-04-26T11:46:39.220 INFO:tasks.workunit.client.0.smithi029.stdout:9/594: read d4/d5/d7a/da1/fb6 [5336742,22545] 0 2024-04-26T11:46:39.220 INFO:tasks.workunit.client.0.smithi029.stdout:4/512: mkdir d3/d1d/db/da4 0 2024-04-26T11:46:39.221 INFO:tasks.workunit.client.0.smithi029.stdout:8/494: write dc/d3b/f9a [608646,58029] 0 2024-04-26T11:46:39.221 INFO:tasks.workunit.client.0.smithi029.stdout:6/574: getdents d7/d46/d69/da2/d4c/d98/d45/d83 0 2024-04-26T11:46:39.222 INFO:tasks.workunit.client.0.smithi029.stdout:1/644: creat d7/db/d10/d1e/d5e/fdb x:0 0 0 2024-04-26T11:46:39.223 INFO:tasks.workunit.client.0.smithi029.stdout:7/611: rename d11/d15/f3f to d11/d15/d69/d84/fca 0 2024-04-26T11:46:39.223 INFO:tasks.workunit.client.0.smithi029.stdout:0/567: dwrite d9/d16/d33/d2f/d32/d9d/f9e [0,4194304] 0 2024-04-26T11:46:39.224 INFO:tasks.workunit.client.0.smithi029.stdout:4/513: stat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84/f8b 0 2024-04-26T11:46:39.226 INFO:tasks.workunit.client.0.smithi029.stdout:0/568: symlink d9/d16/d33/d2f/d31/lcf 0 2024-04-26T11:46:39.226 INFO:tasks.workunit.client.0.smithi029.stdout:4/514: creat d3/d1d/da0/fa5 x:0 0 0 2024-04-26T11:46:39.228 INFO:tasks.workunit.client.0.smithi029.stdout:6/575: write d7/d20/d27/f2b [386709,2596] 0 2024-04-26T11:46:39.228 INFO:tasks.workunit.client.0.smithi029.stdout:0/569: link d9/d78/f83 d9/d78/fd0 0 2024-04-26T11:46:39.230 INFO:tasks.workunit.client.0.smithi029.stdout:6/576: readlink d7/d46/d69/da2/d4c/d98/l7c 0 2024-04-26T11:46:39.231 INFO:tasks.workunit.client.0.smithi029.stdout:8/495: dwrite dc/f93 [0,4194304] 0 2024-04-26T11:46:39.231 INFO:tasks.workunit.client.0.smithi029.stdout:3/522: dread d0/d1/d5c/f87 [0,4194304] 0 2024-04-26T11:46:39.234 INFO:tasks.workunit.client.0.smithi029.stdout:3/523: chown d0/d1/d2b/d7e/da3 5357 1 2024-04-26T11:46:39.234 INFO:tasks.workunit.client.0.smithi029.stdout:8/496: chown dc/de/d26/d6b/f7d 4239008 1 2024-04-26T11:46:39.235 INFO:tasks.workunit.client.0.smithi029.stdout:2/581: write d12/d24/d2f/f44 [1175748,118119] 0 2024-04-26T11:46:39.238 INFO:tasks.workunit.client.0.smithi029.stdout:1/645: dwrite d7/d37/d98/fc3 [0,4194304] 0 2024-04-26T11:46:39.238 INFO:tasks.workunit.client.0.smithi029.stdout:3/524: fdatasync d0/d1/d2f/f86 0 2024-04-26T11:46:39.238 INFO:tasks.workunit.client.0.smithi029.stdout:7/612: dwrite fc [0,4194304] 0 2024-04-26T11:46:39.238 INFO:tasks.workunit.client.0.smithi029.stdout:8/497: mkdir dc/d3b/dab 0 2024-04-26T11:46:39.238 INFO:tasks.workunit.client.0.smithi029.stdout:2/582: mkdir d12/d24/d29/dc6 0 2024-04-26T11:46:39.239 INFO:tasks.workunit.client.0.smithi029.stdout:1/646: dread - d7/db/d10/f89 zero size 2024-04-26T11:46:39.239 INFO:tasks.workunit.client.0.smithi029.stdout:5/541: dread db/d12/d6b/f7e [0,4194304] 0 2024-04-26T11:46:39.240 INFO:tasks.workunit.client.0.smithi029.stdout:4/515: dwrite d3/d1d/db/d13/d23/d2b/f9a [0,4194304] 0 2024-04-26T11:46:39.240 INFO:tasks.workunit.client.0.smithi029.stdout:3/525: write d0/d1/d41/d4c/f94 [812793,98747] 0 2024-04-26T11:46:39.240 INFO:tasks.workunit.client.0.smithi029.stdout:7/613: write d11/d18/d35/d39/d7e/db6/f5a [3150832,66316] 0 2024-04-26T11:46:39.240 INFO:tasks.workunit.client.0.smithi029.stdout:8/498: write dc/de/d26/d57/f6d [668605,72634] 0 2024-04-26T11:46:39.243 INFO:tasks.workunit.client.0.smithi029.stdout:1/647: symlink d7/d25/dae/ldc 0 2024-04-26T11:46:39.243 INFO:tasks.workunit.client.0.smithi029.stdout:8/499: symlink dc/de/d2e/lac 0 2024-04-26T11:46:39.243 INFO:tasks.workunit.client.0.smithi029.stdout:7/614: read d11/d18/d58/f64 [4325799,69301] 0 2024-04-26T11:46:39.243 INFO:tasks.workunit.client.0.smithi029.stdout:1/648: fdatasync d7/db/d10/d1e/d53/f6c 0 2024-04-26T11:46:39.243 INFO:tasks.workunit.client.0.smithi029.stdout:1/649: chown d7/d25/dae/ldc 493995615 1 2024-04-26T11:46:39.244 INFO:tasks.workunit.client.0.smithi029.stdout:8/500: truncate dc/d75/f79 42271 0 2024-04-26T11:46:39.244 INFO:tasks.workunit.client.0.smithi029.stdout:7/615: symlink d11/d18/d58/d8d/dc3/lcb 0 2024-04-26T11:46:39.244 INFO:tasks.workunit.client.0.smithi029.stdout:2/583: write d12/f39 [4763073,4452] 0 2024-04-26T11:46:39.246 INFO:tasks.workunit.client.0.smithi029.stdout:7/616: chown d11/d15/d69/f7a 426453 1 2024-04-26T11:46:39.247 INFO:tasks.workunit.client.0.smithi029.stdout:1/650: rmdir d7/db/d10/d1e/d82/dcf 0 2024-04-26T11:46:39.248 INFO:tasks.workunit.client.0.smithi029.stdout:7/617: mknod d11/ccc 1 2024-04-26T11:46:39.248 INFO:tasks.workunit.client.0.smithi029.stdout:2/584: creat d12/d6c/d73/fc7 x:0 0 0 2024-04-26T11:46:39.248 INFO:tasks.workunit.client.0.smithi029.stdout:8/501: mkdir dc/de/d2e/d23/d27/d6f/d9b/d43/dad 0 2024-04-26T11:46:39.249 INFO:tasks.workunit.client.0.smithi029.stdout:1/651: symlink d7/db/dc5/ldd 0 2024-04-26T11:46:39.250 INFO:tasks.workunit.client.0.smithi029.stdout:8/502: stat dc/d3b/dab 0 2024-04-26T11:46:39.251 INFO:tasks.workunit.client.0.smithi029.stdout:2/585: creat d12/d24/fc8 x:0 0 0 2024-04-26T11:46:39.252 INFO:tasks.workunit.client.0.smithi029.stdout:4/516: dwrite d3/f66 [0,4194304] 0 2024-04-26T11:46:39.254 INFO:tasks.workunit.client.0.smithi029.stdout:5/542: dwrite db/d12/d1a/f18 [4194304,4194304] 0 2024-04-26T11:46:39.255 INFO:tasks.workunit.client.0.smithi029.stdout:1/652: getdents d7/d25/d99 0 2024-04-26T11:46:39.255 INFO:tasks.workunit.client.0.smithi029.stdout:2/586: creat d12/d24/d29/d36/d4b/fc9 x:0 0 0 2024-04-26T11:46:39.257 INFO:tasks.workunit.client.0.smithi029.stdout:1/653: fdatasync d7/f1c 0 2024-04-26T11:46:39.257 INFO:tasks.workunit.client.0.smithi029.stdout:3/526: dwrite d0/f1b [0,4194304] 0 2024-04-26T11:46:39.257 INFO:tasks.workunit.client.0.smithi029.stdout:8/503: symlink dc/de/d2e/d23/d27/d6f/d9b/d43/dad/lae 0 2024-04-26T11:46:39.257 INFO:tasks.workunit.client.0.smithi029.stdout:4/517: rmdir d3/d1d/d11/d16/d1f/d3d/d46 39 2024-04-26T11:46:39.257 INFO:tasks.workunit.client.0.smithi029.stdout:2/587: creat d12/d6c/d73/dbd/fca x:0 0 0 2024-04-26T11:46:39.258 INFO:tasks.workunit.client.0.smithi029.stdout:5/543: creat db/d40/d4d/d79/fa9 x:0 0 0 2024-04-26T11:46:39.258 INFO:tasks.workunit.client.0.smithi029.stdout:8/504: creat dc/d12/faf x:0 0 0 2024-04-26T11:46:39.259 INFO:tasks.workunit.client.0.smithi029.stdout:5/544: dread - db/d12/fa7 zero size 2024-04-26T11:46:39.259 INFO:tasks.workunit.client.0.smithi029.stdout:2/588: creat d12/d6c/d73/d4f/d65/d81/fcb x:0 0 0 2024-04-26T11:46:39.261 INFO:tasks.workunit.client.0.smithi029.stdout:8/505: fsync dc/de/d2e/d23/d27/d6f/d9b/d43/da1/f74 0 2024-04-26T11:46:39.261 INFO:tasks.workunit.client.0.smithi029.stdout:2/589: creat d12/d24/fcc x:0 0 0 2024-04-26T11:46:39.261 INFO:tasks.workunit.client.0.smithi029.stdout:4/518: truncate d3/d1d/db/f51 925572 0 2024-04-26T11:46:39.262 INFO:tasks.workunit.client.0.smithi029.stdout:4/519: chown d3/d1d/d11/d16/d1f/d3d/d46 1120562 1 2024-04-26T11:46:39.264 INFO:tasks.workunit.client.0.smithi029.stdout:4/520: rename d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c to d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d9f/da6 22 2024-04-26T11:46:39.265 INFO:tasks.workunit.client.0.smithi029.stdout:4/521: creat d3/d1d/d11/fa7 x:0 0 0 2024-04-26T11:46:39.266 INFO:tasks.workunit.client.0.smithi029.stdout:3/527: read d0/d1/f49 [105917,14275] 0 2024-04-26T11:46:39.266 INFO:tasks.workunit.client.0.smithi029.stdout:7/618: truncate d11/d15/d79/da6/fa8 1579666 0 2024-04-26T11:46:39.268 INFO:tasks.workunit.client.0.smithi029.stdout:4/522: stat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f6a 0 2024-04-26T11:46:39.268 INFO:tasks.workunit.client.0.smithi029.stdout:8/506: truncate f1 8384092 0 2024-04-26T11:46:39.268 INFO:tasks.workunit.client.0.smithi029.stdout:7/619: creat d11/fcd x:0 0 0 2024-04-26T11:46:39.269 INFO:tasks.workunit.client.0.smithi029.stdout:7/620: dread - d11/fb0 zero size 2024-04-26T11:46:39.269 INFO:tasks.workunit.client.0.smithi029.stdout:2/590: dwrite d12/d24/d29/d57/f89 [0,4194304] 0 2024-04-26T11:46:39.270 INFO:tasks.workunit.client.0.smithi029.stdout:7/621: mknod d11/d15/d79/d97/d9b/cce 1 2024-04-26T11:46:39.271 INFO:tasks.workunit.client.0.smithi029.stdout:2/591: creat d12/d6c/d73/da5/db1/fcd x:0 0 0 2024-04-26T11:46:39.271 INFO:tasks.workunit.client.0.smithi029.stdout:7/622: creat d11/d15/d79/fcf x:0 0 0 2024-04-26T11:46:39.272 INFO:tasks.workunit.client.0.smithi029.stdout:4/523: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f7d 4382568 0 2024-04-26T11:46:39.272 INFO:tasks.workunit.client.0.smithi029.stdout:2/592: chown d12/d6c/fb9 327434 1 2024-04-26T11:46:39.274 INFO:tasks.workunit.client.0.smithi029.stdout:7/623: truncate d11/d18/d1a/d26/f45 662931 0 2024-04-26T11:46:39.274 INFO:tasks.workunit.client.0.smithi029.stdout:3/528: truncate d0/d37/f55 647627 0 2024-04-26T11:46:39.275 INFO:tasks.workunit.client.0.smithi029.stdout:4/524: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f72 [246004,34244] 0 2024-04-26T11:46:39.276 INFO:tasks.workunit.client.0.smithi029.stdout:3/529: creat d0/d1/d2f/fb2 x:0 0 0 2024-04-26T11:46:39.276 INFO:tasks.workunit.client.0.smithi029.stdout:7/624: rename d11/d18/d1a/f99 to d11/d18/d58/d8d/fd0 0 2024-04-26T11:46:39.276 INFO:tasks.workunit.client.0.smithi029.stdout:4/525: symlink d3/d1d/db/d13/d23/la8 0 2024-04-26T11:46:39.277 INFO:tasks.workunit.client.0.smithi029.stdout:3/530: creat d0/d1/d2f/fb3 x:0 0 0 2024-04-26T11:46:39.277 INFO:tasks.workunit.client.0.smithi029.stdout:7/625: creat d11/d15/d79/fd1 x:0 0 0 2024-04-26T11:46:39.278 INFO:tasks.workunit.client.0.smithi029.stdout:3/531: write d0/f4b [653232,124880] 0 2024-04-26T11:46:39.279 INFO:tasks.workunit.client.0.smithi029.stdout:8/507: truncate dc/d3b/f50 963807 0 2024-04-26T11:46:39.279 INFO:tasks.workunit.client.0.smithi029.stdout:4/526: chown d3/d1d/d11/d16/d1f/d3d/l3e 84 1 2024-04-26T11:46:39.279 INFO:tasks.workunit.client.0.smithi029.stdout:7/626: dread - d11/d18/d1a/d33/fa3 zero size 2024-04-26T11:46:39.279 INFO:tasks.workunit.client.0.smithi029.stdout:8/508: stat dc/d75 0 2024-04-26T11:46:39.281 INFO:tasks.workunit.client.0.smithi029.stdout:3/532: creat d0/dc/d80/d9a/fb4 x:0 0 0 2024-04-26T11:46:39.281 INFO:tasks.workunit.client.0.smithi029.stdout:2/593: write d12/d24/d29/d50/d6a/fa2 [78779,119433] 0 2024-04-26T11:46:39.283 INFO:tasks.workunit.client.0.smithi029.stdout:4/527: chown d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/l5b 397292928 1 2024-04-26T11:46:39.283 INFO:tasks.workunit.client.0.smithi029.stdout:7/627: rename d11/d15/d69/daa/fb1 to d11/d18/d58/fd2 0 2024-04-26T11:46:39.284 INFO:tasks.workunit.client.0.smithi029.stdout:7/628: mkdir d11/dd3 0 2024-04-26T11:46:39.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/594: link d12/d6c/d73/fc7 d12/d6c/d73/d4f/d65/d81/fce 0 2024-04-26T11:46:39.285 INFO:tasks.workunit.client.0.smithi029.stdout:4/528: write d3/d1d/f3f [1512537,59112] 0 2024-04-26T11:46:39.285 INFO:tasks.workunit.client.0.smithi029.stdout:7/629: chown d11/d15/d79/d97/d9b 5928276 1 2024-04-26T11:46:39.285 INFO:tasks.workunit.client.0.smithi029.stdout:2/595: read - d12/d24/d29/d36/d4b/fc9 zero size 2024-04-26T11:46:39.286 INFO:tasks.workunit.client.0.smithi029.stdout:7/630: mknod d11/d15/d79/d97/cd4 1 2024-04-26T11:46:39.287 INFO:tasks.workunit.client.0.smithi029.stdout:5/545: dread db/d12/d72/f21 [0,4194304] 0 2024-04-26T11:46:39.287 INFO:tasks.workunit.client.0.smithi029.stdout:4/529: symlink d3/d1d/db/d13/d23/d2b/d9d/la9 0 2024-04-26T11:46:39.287 INFO:tasks.workunit.client.0.smithi029.stdout:5/546: mknod db/caa 1 2024-04-26T11:46:39.289 INFO:tasks.workunit.client.0.smithi029.stdout:5/547: symlink db/lab 0 2024-04-26T11:46:39.289 INFO:tasks.workunit.client.0.smithi029.stdout:7/631: rename d11/d15/d69/lba to d11/d18/d1a/d33/ld5 0 2024-04-26T11:46:39.289 INFO:tasks.workunit.client.0.smithi029.stdout:2/596: read d12/d24/d29/f48 [2107842,48668] 0 2024-04-26T11:46:39.289 INFO:tasks.workunit.client.0.smithi029.stdout:4/530: creat d3/d1d/db/d13/d23/d2b/d9d/faa x:0 0 0 2024-04-26T11:46:39.290 INFO:tasks.workunit.client.0.smithi029.stdout:5/548: read - db/d40/d4d/d4f/f8f zero size 2024-04-26T11:46:39.290 INFO:tasks.workunit.client.0.smithi029.stdout:7/632: rename d11/l34 to d11/d18/ld6 0 2024-04-26T11:46:39.290 INFO:tasks.workunit.client.0.smithi029.stdout:2/597: write d12/d24/fc8 [49451,32304] 0 2024-04-26T11:46:39.293 INFO:tasks.workunit.client.0.smithi029.stdout:2/598: write f6 [242709,120974] 0 2024-04-26T11:46:39.293 INFO:tasks.workunit.client.0.smithi029.stdout:4/531: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/fab x:0 0 0 2024-04-26T11:46:39.293 INFO:tasks.workunit.client.0.smithi029.stdout:7/633: mkdir d11/d18/db8/dd7 0 2024-04-26T11:46:39.293 INFO:tasks.workunit.client.0.smithi029.stdout:5/549: rename db/f75 to db/d12/d6b/fac 0 2024-04-26T11:46:39.293 INFO:tasks.workunit.client.0.smithi029.stdout:4/532: rmdir d3/d1d/db 39 2024-04-26T11:46:39.293 INFO:tasks.workunit.client.0.smithi029.stdout:7/634: chown d11/d15/d67 3 1 2024-04-26T11:46:39.294 INFO:tasks.workunit.client.0.smithi029.stdout:2/599: creat d12/d24/d29/db2/fcf x:0 0 0 2024-04-26T11:46:39.295 INFO:tasks.workunit.client.0.smithi029.stdout:5/550: truncate db/d12/f1b 2401851 0 2024-04-26T11:46:39.295 INFO:tasks.workunit.client.0.smithi029.stdout:2/600: dread - d12/d24/fa9 zero size 2024-04-26T11:46:39.295 INFO:tasks.workunit.client.0.smithi029.stdout:4/533: truncate d3/d50/d7a/f96 1682686 0 2024-04-26T11:46:39.296 INFO:tasks.workunit.client.0.smithi029.stdout:7/635: creat d11/d18/d1a/fd8 x:0 0 0 2024-04-26T11:46:39.296 INFO:tasks.workunit.client.0.smithi029.stdout:2/601: chown d12/d6c/f72 31467 1 2024-04-26T11:46:39.296 INFO:tasks.workunit.client.0.smithi029.stdout:7/636: write d11/d15/f8e [873125,7611] 0 2024-04-26T11:46:39.296 INFO:tasks.workunit.client.0.smithi029.stdout:4/534: write d3/d1d/d11/d16/d1f/d3d/d46/f93 [95402,111374] 0 2024-04-26T11:46:39.297 INFO:tasks.workunit.client.0.smithi029.stdout:7/637: symlink d11/d18/d35/dbf/ld9 0 2024-04-26T11:46:39.297 INFO:tasks.workunit.client.0.smithi029.stdout:7/638: fdatasync f8 0 2024-04-26T11:46:39.299 INFO:tasks.workunit.client.0.smithi029.stdout:7/639: creat d11/d18/d35/d39/d7e/da2/fda x:0 0 0 2024-04-26T11:46:39.300 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:39.296+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:39.301 INFO:tasks.workunit.client.0.smithi029.stdout:4/535: truncate d3/d1d/f83 603737 0 2024-04-26T11:46:39.301 INFO:tasks.workunit.client.0.smithi029.stdout:8/509: dread dc/de/d26/d6b/f7d [0,4194304] 0 2024-04-26T11:46:39.302 INFO:tasks.workunit.client.0.smithi029.stdout:4/536: creat d3/fac x:0 0 0 2024-04-26T11:46:39.303 INFO:tasks.workunit.client.0.smithi029.stdout:5/551: dwrite db/d40/d4d/d79/f8e [0,4194304] 0 2024-04-26T11:46:39.303 INFO:tasks.workunit.client.0.smithi029.stdout:4/537: creat d3/d1d/da0/fad x:0 0 0 2024-04-26T11:46:39.306 INFO:tasks.workunit.client.0.smithi029.stdout:4/538: write d3/d1d/d11/d16/d1f/d3d/f60 [176699,35403] 0 2024-04-26T11:46:39.307 INFO:tasks.workunit.client.0.smithi029.stdout:8/510: dread dc/f93 [0,4194304] 0 2024-04-26T11:46:39.308 INFO:tasks.workunit.client.0.smithi029.stdout:7/640: dwrite d11/d15/d69/d84/fca [0,4194304] 0 2024-04-26T11:46:39.309 INFO:tasks.workunit.client.0.smithi029.stdout:8/511: unlink dc/de/d2e/d23/l35 0 2024-04-26T11:46:39.310 INFO:tasks.workunit.client.0.smithi029.stdout:5/552: truncate db/f6e 523621 0 2024-04-26T11:46:39.310 INFO:tasks.workunit.client.0.smithi029.stdout:7/641: link d11/d15/d69/daa/fc0 d11/d18/d35/dbf/fdb 0 2024-04-26T11:46:39.312 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:39.312 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:39.312 INFO:tasks.workunit.client.0.smithi029.stdout:8/512: fsync dc/de/d2e/d23/d27/d6f/f8a 0 2024-04-26T11:46:39.313 INFO:tasks.workunit.client.0.smithi029.stdout:5/553: symlink db/d12/d72/d39/d3b/d86/lad 0 2024-04-26T11:46:39.314 INFO:tasks.workunit.client.0.smithi029.stdout:7/642: creat d11/d18/d35/fdc x:0 0 0 2024-04-26T11:46:39.315 INFO:tasks.workunit.client.0.smithi029.stdout:8/513: creat dc/de/d26/d57/fb0 x:0 0 0 2024-04-26T11:46:39.315 INFO:tasks.workunit.client.0.smithi029.stdout:5/554: write db/d89/f94 [4955260,75788] 0 2024-04-26T11:46:39.315 INFO:tasks.workunit.client.0.smithi029.stdout:7/643: read - d11/d18/d1a/d33/f93 zero size 2024-04-26T11:46:39.316 INFO:tasks.workunit.client.0.smithi029.stdout:8/514: creat dc/d12/fb1 x:0 0 0 2024-04-26T11:46:39.316 INFO:tasks.workunit.client.0.smithi029.stdout:4/539: dwrite d3/f66 [4194304,4194304] 0 2024-04-26T11:46:39.317 INFO:tasks.workunit.client.0.smithi029.stdout:7/644: symlink d11/d18/d35/d39/ldd 0 2024-04-26T11:46:39.317 INFO:tasks.workunit.client.0.smithi029.stdout:8/515: mkdir dc/d9f/db2 0 2024-04-26T11:46:39.318 INFO:tasks.workunit.client.0.smithi029.stdout:4/540: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/cae 1 2024-04-26T11:46:39.319 INFO:tasks.workunit.client.0.smithi029.stdout:7/645: rename d11/d18/d35/d39/d7e/db6 to d11/d18/d35/d39/d7e/dde 0 2024-04-26T11:46:39.319 INFO:tasks.workunit.client.0.smithi029.stdout:4/541: creat d3/d50/d7a/faf x:0 0 0 2024-04-26T11:46:39.319 INFO:tasks.workunit.client.0.smithi029.stdout:7/646: write d11/d18/d1a/d33/f93 [1021062,23052] 0 2024-04-26T11:46:39.321 INFO:tasks.workunit.client.0.smithi029.stdout:7/647: stat d11/d18/dad/lc1 0 2024-04-26T11:46:39.321 INFO:tasks.workunit.client.0.smithi029.stdout:7/648: creat d11/d18/d1a/d33/fdf x:0 0 0 2024-04-26T11:46:39.322 INFO:tasks.workunit.client.0.smithi029.stdout:7/649: dread - d11/d15/d79/fcf zero size 2024-04-26T11:46:39.323 INFO:tasks.workunit.client.0.smithi029.stdout:7/650: mkdir d11/d18/d35/de0 0 2024-04-26T11:46:39.324 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:39.326 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:39.328 INFO:tasks.workunit.client.0.smithi029.stdout:7/651: mkdir d11/d18/dad/de1 0 2024-04-26T11:46:39.328 INFO:tasks.workunit.client.0.smithi029.stdout:4/542: write d3/d1d/d11/d16/d1f/f61 [944846,60611] 0 2024-04-26T11:46:39.328 INFO:tasks.workunit.client.0.smithi029.stdout:2/602: dread d12/d6c/d73/d40/f5b [4194304,4194304] 0 2024-04-26T11:46:39.328 INFO:tasks.workunit.client.0.smithi029.stdout:7/652: creat d11/d15/d69/d84/fe2 x:0 0 0 2024-04-26T11:46:39.331 INFO:tasks.workunit.client.0.smithi029.stdout:4/543: write d3/d1d/d11/d16/d1f/d3d/f60 [4443689,119281] 0 2024-04-26T11:46:39.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/653: chown d11/d18/d1a/d33/f75 6 1 2024-04-26T11:46:39.331 INFO:tasks.workunit.client.0.smithi029.stdout:4/544: write d3/f31 [4301196,124139] 0 2024-04-26T11:46:39.331 INFO:tasks.workunit.client.0.smithi029.stdout:8/516: dread dc/de/d26/f69 [0,4194304] 0 2024-04-26T11:46:39.331 INFO:tasks.workunit.client.0.smithi029.stdout:4/545: rename d3/d1d to d3/d1d/d11/d16/db0 22 2024-04-26T11:46:39.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/654: creat d11/d15/d79/d97/d9b/fe3 x:0 0 0 2024-04-26T11:46:39.332 INFO:tasks.workunit.client.0.smithi029.stdout:4/546: read d3/f14 [2537732,50027] 0 2024-04-26T11:46:39.334 INFO:tasks.workunit.client.0.smithi029.stdout:5/555: read db/d12/d72/f2c [1443920,13704] 0 2024-04-26T11:46:39.338 INFO:tasks.workunit.client.0.smithi029.stdout:5/556: creat db/da6/fae x:0 0 0 2024-04-26T11:46:39.338 INFO:tasks.workunit.client.0.smithi029.stdout:7/655: rename d11/d15/d69 to d11/dd3/de4 0 2024-04-26T11:46:39.338 INFO:tasks.workunit.client.0.smithi029.stdout:2/603: dwrite d12/d24/d29/d50/f58 [4194304,4194304] 0 2024-04-26T11:46:39.338 INFO:tasks.workunit.client.0.smithi029.stdout:5/557: truncate db/d12/d6b/f9e 1028648 0 2024-04-26T11:46:39.338 INFO:tasks.workunit.client.0.smithi029.stdout:7/656: write d11/dd3/de4/d84/fe2 [984080,62187] 0 2024-04-26T11:46:39.339 INFO:tasks.workunit.client.0.smithi029.stdout:2/604: creat d12/d6c/d73/da5/db1/fd0 x:0 0 0 2024-04-26T11:46:39.339 INFO:tasks.workunit.client.0.smithi029.stdout:7/657: fdatasync d11/d18/d35/f5e 0 2024-04-26T11:46:39.339 INFO:tasks.workunit.client.0.smithi029.stdout:2/605: fsync d12/f1b 0 2024-04-26T11:46:39.340 INFO:tasks.workunit.client.0.smithi029.stdout:5/558: getdents db/d12/d72/d39/d3b/d86 0 2024-04-26T11:46:39.341 INFO:tasks.workunit.client.0.smithi029.stdout:2/606: dread - d12/d6c/d73/d4f/f8d zero size 2024-04-26T11:46:39.342 INFO:tasks.workunit.client.0.smithi029.stdout:5/559: write db/d40/d4d/d79/fa9 [459667,60568] 0 2024-04-26T11:46:39.342 INFO:tasks.workunit.client.0.smithi029.stdout:8/517: truncate dc/de/d26/f32 1544817 0 2024-04-26T11:46:39.342 INFO:tasks.workunit.client.0.smithi029.stdout:2/607: mkdir d12/d24/d29/d50/d6a/dd1 0 2024-04-26T11:46:39.344 INFO:tasks.workunit.client.0.smithi029.stdout:8/518: write dc/d12/d6a/f4c [1089610,127031] 0 2024-04-26T11:46:39.344 INFO:tasks.workunit.client.0.smithi029.stdout:5/560: fdatasync db/d12/d1a/d4c/f91 0 2024-04-26T11:46:39.347 INFO:tasks.workunit.client.0.smithi029.stdout:5/561: creat db/d12/d72/d39/faf x:0 0 0 2024-04-26T11:46:39.348 INFO:tasks.workunit.client.0.smithi029.stdout:4/547: dwrite d3/d1d/d11/d16/d1f/d3d/d39/f5a [0,4194304] 0 2024-04-26T11:46:39.348 INFO:tasks.workunit.client.0.smithi029.stdout:7/658: dwrite f8 [4194304,4194304] 0 2024-04-26T11:46:39.348 INFO:tasks.workunit.client.0.smithi029.stdout:5/562: mknod db/d12/d72/d39/d3b/d86/cb0 1 2024-04-26T11:46:39.349 INFO:tasks.workunit.client.0.smithi029.stdout:2/608: write d12/f1a [697244,57984] 0 2024-04-26T11:46:39.350 INFO:tasks.workunit.client.0.smithi029.stdout:2/609: chown d12/d24/d2f/d8c 32703559 1 2024-04-26T11:46:39.352 INFO:tasks.workunit.client.0.smithi029.stdout:2/610: chown d12/d24/d2f/d8c/f8e 3 1 2024-04-26T11:46:39.355 INFO:tasks.workunit.client.0.smithi029.stdout:4/548: dread - d3/d1d/db/d13/d23/d2b/d9d/faa zero size 2024-04-26T11:46:39.356 INFO:tasks.workunit.client.0.smithi029.stdout:2/611: creat d12/d24/d2f/fd2 x:0 0 0 2024-04-26T11:46:39.359 INFO:tasks.workunit.client.0.smithi029.stdout:4/549: chown d3/d1d/d11/d16/d1f/d3d/d39/f32 3163 1 2024-04-26T11:46:39.359 INFO:tasks.workunit.client.0.smithi029.stdout:2/612: write d12/d24/d29/db2/fcf [831196,12210] 0 2024-04-26T11:46:39.360 INFO:tasks.workunit.client.0.smithi029.stdout:8/519: dwrite dc/de/d2e/d23/d27/d6f/d9b/f45 [0,4194304] 0 2024-04-26T11:46:39.360 INFO:tasks.workunit.client.0.smithi029.stdout:5/563: dwrite db/d12/d1a/f18 [0,4194304] 0 2024-04-26T11:46:39.361 INFO:tasks.workunit.client.0.smithi029.stdout:7/659: dwrite d11/d18/d58/faf [0,4194304] 0 2024-04-26T11:46:39.361 INFO:tasks.workunit.client.0.smithi029.stdout:8/520: chown dc/d12/faf 14020 1 2024-04-26T11:46:39.361 INFO:tasks.workunit.client.0.smithi029.stdout:2/613: write d12/f39 [1304772,33661] 0 2024-04-26T11:46:39.362 INFO:tasks.workunit.client.0.smithi029.stdout:5/564: rmdir db/d12/d1a/d4c 39 2024-04-26T11:46:39.362 INFO:tasks.workunit.client.0.smithi029.stdout:4/550: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/cb1 1 2024-04-26T11:46:39.362 INFO:tasks.workunit.client.0.smithi029.stdout:8/521: rmdir dc 39 2024-04-26T11:46:39.362 INFO:tasks.workunit.client.0.smithi029.stdout:7/660: dread - d11/d18/d58/fd2 zero size 2024-04-26T11:46:39.363 INFO:tasks.workunit.client.0.smithi029.stdout:7/661: dread - d11/d18/d35/d39/d7e/da2/fda zero size 2024-04-26T11:46:39.365 INFO:tasks.workunit.client.0.smithi029.stdout:5/565: symlink db/d40/d4d/d4f/d73/lb1 0 2024-04-26T11:46:39.365 INFO:tasks.workunit.client.0.smithi029.stdout:8/522: creat dc/de/fb3 x:0 0 0 2024-04-26T11:46:39.367 INFO:tasks.workunit.client.0.smithi029.stdout:5/566: chown db/d40/d4d/d4f/d73/lb1 29 1 2024-04-26T11:46:39.367 INFO:tasks.workunit.client.0.smithi029.stdout:8/523: creat dc/de/d2e/d23/d27/d6f/d9b/da2/fb4 x:0 0 0 2024-04-26T11:46:39.369 INFO:tasks.workunit.client.0.smithi029.stdout:2/614: dwrite d12/d24/f92 [0,4194304] 0 2024-04-26T11:46:39.370 INFO:tasks.workunit.client.0.smithi029.stdout:8/524: creat dc/de/d2e/d23/d27/d6f/d9b/fb5 x:0 0 0 2024-04-26T11:46:39.371 INFO:tasks.workunit.client.0.smithi029.stdout:8/525: chown dc/de/d26/f69 9 1 2024-04-26T11:46:39.371 INFO:tasks.workunit.client.0.smithi029.stdout:2/615: link d12/d24/d2f/f33 d12/d6c/d73/d4f/d65/d81/fd3 0 2024-04-26T11:46:39.372 INFO:tasks.workunit.client.0.smithi029.stdout:8/526: rename dc/de/f5c to dc/de/d2e/d23/d27/fb6 0 2024-04-26T11:46:39.372 INFO:tasks.workunit.client.0.smithi029.stdout:8/527: mkdir dc/d12/db7 0 2024-04-26T11:46:39.374 INFO:tasks.workunit.client.0.smithi029.stdout:7/662: truncate d11/d18/d2d/fae 2861955 0 2024-04-26T11:46:39.382 INFO:tasks.workunit.client.0.smithi029.stdout:2/616: dwrite d12/d6c/d73/f67 [0,4194304] 0 2024-04-26T11:46:39.382 INFO:tasks.workunit.client.0.smithi029.stdout:6/577: sync 2024-04-26T11:46:39.382 INFO:tasks.workunit.client.0.smithi029.stdout:9/595: sync 2024-04-26T11:46:39.382 INFO:tasks.workunit.client.0.smithi029.stdout:3/533: sync 2024-04-26T11:46:39.382 INFO:tasks.workunit.client.0.smithi029.stdout:1/654: sync 2024-04-26T11:46:39.383 INFO:tasks.workunit.client.0.smithi029.stdout:0/570: sync 2024-04-26T11:46:39.383 INFO:tasks.workunit.client.0.smithi029.stdout:2/617: creat d12/d6c/d73/d40/fd4 x:0 0 0 2024-04-26T11:46:39.384 INFO:tasks.workunit.client.0.smithi029.stdout:6/578: mknod d7/d46/d69/da2/d4c/d98/d45/d76/cc3 1 2024-04-26T11:46:39.385 INFO:tasks.workunit.client.0.smithi029.stdout:6/579: readlink d7/lc 0 2024-04-26T11:46:39.385 INFO:tasks.workunit.client.0.smithi029.stdout:7/663: dwrite d11/d18/d35/f76 [0,4194304] 0 2024-04-26T11:46:39.387 INFO:tasks.workunit.client.0.smithi029.stdout:3/534: mkdir d0/d1/d41/d5f/d1a/d3b/db5 0 2024-04-26T11:46:39.387 INFO:tasks.workunit.client.0.smithi029.stdout:6/580: stat d7/d46/d69/da2/d4c/d98/d45/d83/da9/fbb 0 2024-04-26T11:46:39.389 INFO:tasks.workunit.client.0.smithi029.stdout:0/571: symlink d9/d16/d25/d2a/ld1 0 2024-04-26T11:46:39.389 INFO:tasks.workunit.client.0.smithi029.stdout:6/581: fsync d7/d25/d4b/d4d/d65/fb8 0 2024-04-26T11:46:39.389 INFO:tasks.workunit.client.0.smithi029.stdout:3/535: write d0/d1/d41/d5f/d1a/d3b/f4f [1032577,49293] 0 2024-04-26T11:46:39.393 INFO:tasks.workunit.client.0.smithi029.stdout:6/582: truncate d7/d25/d4b/d4d/fc1 172218 0 2024-04-26T11:46:39.393 INFO:tasks.workunit.client.0.smithi029.stdout:0/572: rename d9/d16/d33/d2f/d31/d6a to d9/d16/d33/d2f/d32/dd2 0 2024-04-26T11:46:39.393 INFO:tasks.workunit.client.0.smithi029.stdout:3/536: truncate d0/d1/d2f/f3a 4808835 0 2024-04-26T11:46:39.393 INFO:tasks.workunit.client.0.smithi029.stdout:1/655: dwrite d7/f55 [4194304,4194304] 0 2024-04-26T11:46:39.393 INFO:tasks.workunit.client.0.smithi029.stdout:7/664: read d11/d18/d35/d39/d7e/dde/f5a [855121,25004] 0 2024-04-26T11:46:39.393 INFO:tasks.workunit.client.0.smithi029.stdout:6/583: dread - d7/d25/d5c/f9f zero size 2024-04-26T11:46:39.393 INFO:tasks.workunit.client.0.smithi029.stdout:4/551: dread d3/d1d/d11/d16/d1f/d3d/d39/f32 [0,4194304] 0 2024-04-26T11:46:39.394 INFO:tasks.workunit.client.0.smithi029.stdout:9/596: truncate d4/d5/d78/f7c 991970 0 2024-04-26T11:46:39.394 INFO:tasks.workunit.client.0.smithi029.stdout:6/584: fsync d7/d25/d4b/d4d/d65/f8c 0 2024-04-26T11:46:39.394 INFO:tasks.workunit.client.0.smithi029.stdout:3/537: creat d0/d1/d41/d5f/d54/fb6 x:0 0 0 2024-04-26T11:46:39.395 INFO:tasks.workunit.client.0.smithi029.stdout:0/573: chown d9/d16/d33/f5c 43129015 1 2024-04-26T11:46:39.395 INFO:tasks.workunit.client.0.smithi029.stdout:4/552: dread - d3/fac zero size 2024-04-26T11:46:39.395 INFO:tasks.workunit.client.0.smithi029.stdout:9/597: stat d4/d5/fb 0 2024-04-26T11:46:39.397 INFO:tasks.workunit.client.0.smithi029.stdout:0/574: creat d9/d78/dc4/fd3 x:0 0 0 2024-04-26T11:46:39.397 INFO:tasks.workunit.client.0.smithi029.stdout:1/656: rename d7/d25/d68/d4b/d66/f70 to d7/db/d10/d20/fde 0 2024-04-26T11:46:39.398 INFO:tasks.workunit.client.0.smithi029.stdout:0/575: mknod d9/d16/d25/d2a/d74/d9a/cd4 1 2024-04-26T11:46:39.398 INFO:tasks.workunit.client.0.smithi029.stdout:4/553: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/fb2 x:0 0 0 2024-04-26T11:46:39.399 INFO:tasks.workunit.client.0.smithi029.stdout:3/538: write d0/d1/d5c/f9c [150168,27246] 0 2024-04-26T11:46:39.400 INFO:tasks.workunit.client.0.smithi029.stdout:0/576: truncate f3 3320074 0 2024-04-26T11:46:39.400 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:39.397+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:39.401 INFO:tasks.workunit.client.0.smithi029.stdout:2/618: dread d12/d24/d2f/f33 [0,4194304] 0 2024-04-26T11:46:39.403 INFO:tasks.workunit.client.0.smithi029.stdout:4/554: chown d3/d1d/db/d13/d23/d2b/f7c 567947 1 2024-04-26T11:46:39.403 INFO:tasks.workunit.client.0.smithi029.stdout:3/539: write d0/dc/d80/f8f [3921880,1138] 0 2024-04-26T11:46:39.404 INFO:tasks.workunit.client.0.smithi029.stdout:0/577: creat d9/d16/d25/d2a/d74/d9a/fd5 x:0 0 0 2024-04-26T11:46:39.404 INFO:tasks.workunit.client.0.smithi029.stdout:7/665: dwrite d11/d18/d35/f76 [0,4194304] 0 2024-04-26T11:46:39.405 INFO:tasks.workunit.client.0.smithi029.stdout:8/528: dread dc/de/d2e/d23/d27/d6f/f8a [0,4194304] 0 2024-04-26T11:46:39.405 INFO:tasks.workunit.client.0.smithi029.stdout:2/619: creat d12/d6c/d73/d4f/d65/d99/fd5 x:0 0 0 2024-04-26T11:46:39.408 INFO:tasks.workunit.client.0.smithi029.stdout:7/666: write d11/dd3/de4/daa/fac [505461,3613] 0 2024-04-26T11:46:39.409 INFO:tasks.workunit.client.0.smithi029.stdout:8/529: creat dc/d9f/fb8 x:0 0 0 2024-04-26T11:46:39.409 INFO:tasks.workunit.client.0.smithi029.stdout:3/540: rename d0/d1/d5c/f78 to d0/d1/d2f/d82/fb7 0 2024-04-26T11:46:39.409 INFO:tasks.workunit.client.0.smithi029.stdout:2/620: symlink d12/d6c/d73/d4f/d65/d99/ld6 0 2024-04-26T11:46:39.411 INFO:tasks.workunit.client.0.smithi029.stdout:7/667: truncate d11/fb0 496711 0 2024-04-26T11:46:39.412 INFO:tasks.workunit.client.0.smithi029.stdout:9/598: dwrite d4/f6f [0,4194304] 0 2024-04-26T11:46:39.413 INFO:tasks.workunit.client.0.smithi029.stdout:2/621: getdents d12/d24/d29/d50/d6a 0 2024-04-26T11:46:39.414 INFO:tasks.workunit.client.0.smithi029.stdout:5/567: dread db/d12/d1a/f19 [0,4194304] 0 2024-04-26T11:46:39.414 INFO:tasks.workunit.client.0.smithi029.stdout:8/530: rename dc/de/d26/d57/d86/la9 to dc/de/d2e/lb9 0 2024-04-26T11:46:39.417 INFO:tasks.workunit.client.0.smithi029.stdout:8/531: rmdir dc/d12/d7c 39 2024-04-26T11:46:39.418 INFO:tasks.workunit.client.0.smithi029.stdout:2/622: rename d12/d6c/d73/da5/db1/fb4 to d12/d24/d29/d36/d4b/fd7 0 2024-04-26T11:46:39.423 INFO:tasks.workunit.client.0.smithi029.stdout:4/555: dwrite d3/f8d [0,4194304] 0 2024-04-26T11:46:39.423 INFO:tasks.workunit.client.0.smithi029.stdout:2/623: chown d12/d24/d29/d36/d4b/f64 1117039 1 2024-04-26T11:46:39.423 INFO:tasks.workunit.client.0.smithi029.stdout:0/578: dwrite d9/f18 [0,4194304] 0 2024-04-26T11:46:39.426 INFO:tasks.workunit.client.0.smithi029.stdout:6/585: dread d7/d25/d5c/f58 [0,4194304] 0 2024-04-26T11:46:39.426 INFO:tasks.workunit.client.0.smithi029.stdout:7/668: dwrite d11/d18/d1a/fd8 [0,4194304] 0 2024-04-26T11:46:39.427 INFO:tasks.workunit.client.0.smithi029.stdout:2/624: creat d12/d6c/d73/d4f/d65/d81/fd8 x:0 0 0 2024-04-26T11:46:39.427 INFO:tasks.workunit.client.0.smithi029.stdout:0/579: symlink d9/d16/d25/d2a/ld6 0 2024-04-26T11:46:39.427 INFO:tasks.workunit.client.0.smithi029.stdout:7/669: mkdir d11/d18/dad/de5 0 2024-04-26T11:46:39.428 INFO:tasks.workunit.client.0.smithi029.stdout:9/599: dwrite d4/d5/d7/f59 [0,4194304] 0 2024-04-26T11:46:39.429 INFO:tasks.workunit.client.0.smithi029.stdout:6/586: rmdir d7/d20/d27/da1 39 2024-04-26T11:46:39.429 INFO:tasks.workunit.client.0.smithi029.stdout:4/556: rename d3/d1d/d11/d16/f75 to d3/d1d/d11/d16/d1f/d3d/fb3 0 2024-04-26T11:46:39.430 INFO:tasks.workunit.client.0.smithi029.stdout:9/600: mknod d4/d5/d16/d39/cbb 1 2024-04-26T11:46:39.432 INFO:tasks.workunit.client.0.smithi029.stdout:0/580: write d9/d16/d25/d2a/d4b/f5d [4133299,124641] 0 2024-04-26T11:46:39.432 INFO:tasks.workunit.client.0.smithi029.stdout:2/625: creat d12/d6c/d73/da5/fd9 x:0 0 0 2024-04-26T11:46:39.432 INFO:tasks.workunit.client.0.smithi029.stdout:7/670: creat d11/d15/d79/da6/fe6 x:0 0 0 2024-04-26T11:46:39.433 INFO:tasks.workunit.client.0.smithi029.stdout:4/557: truncate d3/d1d/d11/d16/d1f/f67 1855398 0 2024-04-26T11:46:39.433 INFO:tasks.workunit.client.0.smithi029.stdout:6/587: fdatasync d7/d25/d5c/f58 0 2024-04-26T11:46:39.437 INFO:tasks.workunit.client.0.smithi029.stdout:6/588: chown d7/d46/d69/f77 11 1 2024-04-26T11:46:39.438 INFO:tasks.workunit.client.0.smithi029.stdout:4/558: write d3/f14 [24400,63474] 0 2024-04-26T11:46:39.438 INFO:tasks.workunit.client.0.smithi029.stdout:0/581: symlink d9/d16/d25/d2a/d46/ld7 0 2024-04-26T11:46:39.438 INFO:tasks.workunit.client.0.smithi029.stdout:2/626: mkdir d12/d24/d29/dda 0 2024-04-26T11:46:39.438 INFO:tasks.workunit.client.0.smithi029.stdout:9/601: unlink d4/d5/d16/d39/f8c 0 2024-04-26T11:46:39.438 INFO:tasks.workunit.client.0.smithi029.stdout:6/589: stat d7/d25/d4b/d4d/d65/fb8 0 2024-04-26T11:46:39.438 INFO:tasks.workunit.client.0.smithi029.stdout:4/559: write d3/d1d/db/d13/f9e [959271,48739] 0 2024-04-26T11:46:39.438 INFO:tasks.workunit.client.0.smithi029.stdout:9/602: chown d4/d5/d7/d74/da8 1161 1 2024-04-26T11:46:39.438 INFO:tasks.workunit.client.0.smithi029.stdout:6/590: mknod d7/d46/d69/da2/d4c/cc4 1 2024-04-26T11:46:39.438 INFO:tasks.workunit.client.0.smithi029.stdout:0/582: getdents d9/d16/d25/d2a/d4b 0 2024-04-26T11:46:39.439 INFO:tasks.workunit.client.0.smithi029.stdout:2/627: truncate d12/f1a 4702161 0 2024-04-26T11:46:39.439 INFO:tasks.workunit.client.0.smithi029.stdout:4/560: write d3/d1d/db/d13/d23/f45 [1916286,109430] 0 2024-04-26T11:46:39.439 INFO:tasks.workunit.client.0.smithi029.stdout:0/583: unlink d9/f85 0 2024-04-26T11:46:39.439 INFO:tasks.workunit.client.0.smithi029.stdout:2/628: creat d12/d6c/d73/da5/fdb x:0 0 0 2024-04-26T11:46:39.439 INFO:tasks.workunit.client.0.smithi029.stdout:4/561: chown d3/d1d/lf 29382145 1 2024-04-26T11:46:39.439 INFO:tasks.workunit.client.0.smithi029.stdout:8/532: dread dc/de/f9d [0,4194304] 0 2024-04-26T11:46:39.440 INFO:tasks.workunit.client.0.smithi029.stdout:0/584: unlink d9/d16/d25/d2a/fbd 0 2024-04-26T11:46:39.440 INFO:tasks.workunit.client.0.smithi029.stdout:4/562: write d3/f6e [496345,68356] 0 2024-04-26T11:46:39.440 INFO:tasks.workunit.client.0.smithi029.stdout:4/563: mkdir d3/d50/db4 0 2024-04-26T11:46:39.441 INFO:tasks.workunit.client.0.smithi029.stdout:4/564: creat d3/d1d/d11/d16/d1f/d3d/d39/fb5 x:0 0 0 2024-04-26T11:46:39.444 INFO:tasks.workunit.client.0.smithi029.stdout:6/591: dwrite d7/f1a [0,4194304] 0 2024-04-26T11:46:39.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/603: truncate d4/d5/d7/f36 3688015 0 2024-04-26T11:46:39.448 INFO:tasks.workunit.client.0.smithi029.stdout:2/629: dwrite d12/d6c/d73/dbd/fca [0,4194304] 0 2024-04-26T11:46:39.449 INFO:tasks.workunit.client.0.smithi029.stdout:6/592: write d7/d46/d69/f8a [1492465,93246] 0 2024-04-26T11:46:39.449 INFO:tasks.workunit.client.0.smithi029.stdout:9/604: unlink d4/d5/d78/fb3 0 2024-04-26T11:46:39.449 INFO:tasks.workunit.client.0.smithi029.stdout:0/585: rename d9/f2d to d9/d16/fd8 0 2024-04-26T11:46:39.449 INFO:tasks.workunit.client.0.smithi029.stdout:4/565: link d3/d1d/db/d13/d73/f8e d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/fb6 0 2024-04-26T11:46:39.450 INFO:tasks.workunit.client.0.smithi029.stdout:2/630: fdatasync d12/d24/fa9 0 2024-04-26T11:46:39.450 INFO:tasks.workunit.client.0.smithi029.stdout:4/566: fsync d3/d1d/d11/d16/d1f/d3d/d46/f54 0 2024-04-26T11:46:39.451 INFO:tasks.workunit.client.0.smithi029.stdout:9/605: chown d4/d49/d58/f9d 61233717 1 2024-04-26T11:46:39.451 INFO:tasks.workunit.client.0.smithi029.stdout:2/631: chown d12/d24/d29 3085954 1 2024-04-26T11:46:39.451 INFO:tasks.workunit.client.0.smithi029.stdout:0/586: mkdir d9/d16/d25/d2a/d4b/dd9 0 2024-04-26T11:46:39.451 INFO:tasks.workunit.client.0.smithi029.stdout:6/593: creat d7/d46/d69/da2/d4c/d98/fc5 x:0 0 0 2024-04-26T11:46:39.452 INFO:tasks.workunit.client.0.smithi029.stdout:4/567: rmdir d3/d1d/db/d13/d73 39 2024-04-26T11:46:39.452 INFO:tasks.workunit.client.0.smithi029.stdout:8/533: dwrite dc/de/d2e/d23/d27/d6f/d9b/d43/da1/f74 [0,4194304] 0 2024-04-26T11:46:39.453 INFO:tasks.workunit.client.0.smithi029.stdout:2/632: creat d12/d24/d29/d36/fdc x:0 0 0 2024-04-26T11:46:39.453 INFO:tasks.workunit.client.0.smithi029.stdout:9/606: truncate d4/d49/d58/f53 1798435 0 2024-04-26T11:46:39.453 INFO:tasks.workunit.client.0.smithi029.stdout:6/594: symlink d7/d20/lc6 0 2024-04-26T11:46:39.454 INFO:tasks.workunit.client.0.smithi029.stdout:4/568: chown d3/d1d/d11/fa2 1 1 2024-04-26T11:46:39.456 INFO:tasks.workunit.client.0.smithi029.stdout:6/595: mknod d7/d20/d27/dc0/cc7 1 2024-04-26T11:46:39.456 INFO:tasks.workunit.client.0.smithi029.stdout:8/534: fsync dc/de/d2e/d23/d27/d6f/d9b/f80 0 2024-04-26T11:46:39.456 INFO:tasks.workunit.client.0.smithi029.stdout:3/541: dread d0/d1/d41/d5f/d54/f58 [0,4194304] 0 2024-04-26T11:46:39.456 INFO:tasks.workunit.client.0.smithi029.stdout:6/596: dread - d7/d46/d69/da2/d4c/d98/fc5 zero size 2024-04-26T11:46:39.457 INFO:tasks.workunit.client.0.smithi029.stdout:3/542: write d0/d1/d2b/da7/dad/f77 [671272,23076] 0 2024-04-26T11:46:39.457 INFO:tasks.workunit.client.0.smithi029.stdout:9/607: readlink d4/d46/l81 0 2024-04-26T11:46:39.457 INFO:tasks.workunit.client.0.smithi029.stdout:8/535: creat dc/d75/fba x:0 0 0 2024-04-26T11:46:39.461 INFO:tasks.workunit.client.0.smithi029.stdout:5/568: dread db/f20 [0,4194304] 0 2024-04-26T11:46:39.461 INFO:tasks.workunit.client.0.smithi029.stdout:2/633: write d12/d6c/d73/d4f/d65/d6f/f77 [2684034,110671] 0 2024-04-26T11:46:39.461 INFO:tasks.workunit.client.0.smithi029.stdout:4/569: mkdir d3/d1d/db/d13/d73/d97/db7 0 2024-04-26T11:46:39.462 INFO:tasks.workunit.client.0.smithi029.stdout:8/536: chown dc/de/d2e/d23/d27/d6f/d9b/d43/dad 2 1 2024-04-26T11:46:39.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/543: link d0/f27 d0/d1/d41/d5f/d54/fb8 0 2024-04-26T11:46:39.462 INFO:tasks.workunit.client.0.smithi029.stdout:2/634: fsync f7 0 2024-04-26T11:46:39.463 INFO:tasks.workunit.client.0.smithi029.stdout:5/569: chown db/d12/d6b/f85 0 1 2024-04-26T11:46:39.463 INFO:tasks.workunit.client.0.smithi029.stdout:3/544: unlink d0/dc/l93 0 2024-04-26T11:46:39.464 INFO:tasks.workunit.client.0.smithi029.stdout:4/570: creat d3/fb8 x:0 0 0 2024-04-26T11:46:39.464 INFO:tasks.workunit.client.0.smithi029.stdout:0/587: dwrite d9/d16/d33/d2f/d32/dd2/f8b [0,4194304] 0 2024-04-26T11:46:39.464 INFO:tasks.workunit.client.0.smithi029.stdout:2/635: write d12/d24/d2f/f4e [2882580,47578] 0 2024-04-26T11:46:39.465 INFO:tasks.workunit.client.0.smithi029.stdout:3/545: fdatasync d0/f27 0 2024-04-26T11:46:39.465 INFO:tasks.workunit.client.0.smithi029.stdout:5/570: chown db/d12/d72/d39/d3b/d86/lad 385731011 1 2024-04-26T11:46:39.467 INFO:tasks.workunit.client.0.smithi029.stdout:3/546: read - d0/d1/d2f/fb3 zero size 2024-04-26T11:46:39.467 INFO:tasks.workunit.client.0.smithi029.stdout:0/588: mknod d9/d16/d33/d2f/d32/d9f/db7/cda 1 2024-04-26T11:46:39.467 INFO:tasks.workunit.client.0.smithi029.stdout:2/636: fdatasync d12/d6c/d73/da5/fdb 0 2024-04-26T11:46:39.467 INFO:tasks.workunit.client.0.smithi029.stdout:5/571: symlink db/da6/lb2 0 2024-04-26T11:46:39.469 INFO:tasks.workunit.client.0.smithi029.stdout:3/547: fsync d0/d1/d41/d5f/d1a/d3b/f4f 0 2024-04-26T11:46:39.469 INFO:tasks.workunit.client.0.smithi029.stdout:0/589: stat d9/d16/d25/d2a/f39 0 2024-04-26T11:46:39.469 INFO:tasks.workunit.client.0.smithi029.stdout:2/637: readlink d12/d24/d29/d36/d4b/lb5 0 2024-04-26T11:46:39.470 INFO:tasks.workunit.client.0.smithi029.stdout:5/572: write db/d12/d1a/f18 [7012140,22629] 0 2024-04-26T11:46:39.470 INFO:tasks.workunit.client.0.smithi029.stdout:8/537: rename dc/de/d2e/d23/d27/d6f/d9b/d43/da1/f74 to dc/de/d2e/d23/d27/d6f/d9b/da2/fbb 0 2024-04-26T11:46:39.470 INFO:tasks.workunit.client.0.smithi029.stdout:6/597: dwrite d7/d46/d69/da2/d4c/f7a [0,4194304] 0 2024-04-26T11:46:39.471 INFO:tasks.workunit.client.0.smithi029.stdout:7/671: dread d11/d18/d35/f5e [0,4194304] 0 2024-04-26T11:46:39.471 INFO:tasks.workunit.client.0.smithi029.stdout:3/548: unlink d0/dc/d80/l95 0 2024-04-26T11:46:39.471 INFO:tasks.workunit.client.0.smithi029.stdout:0/590: unlink d9/d16/d33/d2f/f6b 0 2024-04-26T11:46:39.472 INFO:tasks.workunit.client.0.smithi029.stdout:6/598: chown d7/d25/d5c 17041 1 2024-04-26T11:46:39.472 INFO:tasks.workunit.client.0.smithi029.stdout:4/571: rename d3/d1d/d11/fa7 to d3/d50/db4/fb9 0 2024-04-26T11:46:39.472 INFO:tasks.workunit.client.0.smithi029.stdout:4/572: stat d3 0 2024-04-26T11:46:39.474 INFO:tasks.workunit.client.0.smithi029.stdout:8/538: symlink dc/de/d26/d57/d86/d90/lbc 0 2024-04-26T11:46:39.474 INFO:tasks.workunit.client.0.smithi029.stdout:5/573: rename db/d12/d72/d39/l46 to db/d40/d70/lb3 0 2024-04-26T11:46:39.475 INFO:tasks.workunit.client.0.smithi029.stdout:7/672: symlink d11/d18/db8/dd7/le7 0 2024-04-26T11:46:39.476 INFO:tasks.workunit.client.0.smithi029.stdout:8/539: write dc/f66 [4501943,78166] 0 2024-04-26T11:46:39.476 INFO:tasks.workunit.client.0.smithi029.stdout:5/574: chown db/d40/l43 6095 1 2024-04-26T11:46:39.477 INFO:tasks.workunit.client.0.smithi029.stdout:0/591: truncate d9/d16/f89 73991 0 2024-04-26T11:46:39.478 INFO:tasks.workunit.client.0.smithi029.stdout:3/549: getdents d0/d1/d41/d5f/d1a/d3b/db5 0 2024-04-26T11:46:39.480 INFO:tasks.workunit.client.0.smithi029.stdout:0/592: dread - d9/d16/d25/d2a/fb0 zero size 2024-04-26T11:46:39.481 INFO:tasks.workunit.client.0.smithi029.stdout:2/638: dwrite d12/d6c/d73/d4f/d65/d81/fc0 [0,4194304] 0 2024-04-26T11:46:39.481 INFO:tasks.workunit.client.0.smithi029.stdout:4/573: rename d3/d1d/db/d13/d23/d2b/da1 to d3/dba 0 2024-04-26T11:46:39.481 INFO:tasks.workunit.client.0.smithi029.stdout:5/575: truncate db/d12/d72/d39/d3b/f6d 720020 0 2024-04-26T11:46:39.482 INFO:tasks.workunit.client.0.smithi029.stdout:8/540: write dc/de/d26/d6b/f7d [2675159,99376] 0 2024-04-26T11:46:39.483 INFO:tasks.workunit.client.0.smithi029.stdout:3/550: chown d0/d1/d5c/f9b 849641 1 2024-04-26T11:46:39.484 INFO:tasks.workunit.client.0.smithi029.stdout:7/673: truncate d11/d18/f22 519236 0 2024-04-26T11:46:39.484 INFO:tasks.workunit.client.0.smithi029.stdout:0/593: mkdir d9/d16/d33/d2f/d32/d90/ddb 0 2024-04-26T11:46:39.484 INFO:tasks.workunit.client.0.smithi029.stdout:2/639: mkdir d12/d6c/d73/d40/ddd 0 2024-04-26T11:46:39.485 INFO:tasks.workunit.client.0.smithi029.stdout:8/541: creat dc/fbd x:0 0 0 2024-04-26T11:46:39.486 INFO:tasks.workunit.client.0.smithi029.stdout:2/640: write d12/d6c/d73/d4f/d65/d81/fcb [952270,44149] 0 2024-04-26T11:46:39.487 INFO:tasks.workunit.client.0.smithi029.stdout:8/542: symlink dc/d75/lbe 0 2024-04-26T11:46:39.487 INFO:tasks.workunit.client.0.smithi029.stdout:0/594: read d9/d16/d33/d2f/d68/f79 [1587357,12473] 0 2024-04-26T11:46:39.488 INFO:tasks.workunit.client.0.smithi029.stdout:6/599: dwrite d7/d46/d69/da2/d4c/d98/fa6 [0,4194304] 0 2024-04-26T11:46:39.490 INFO:tasks.workunit.client.0.smithi029.stdout:8/543: write dc/d75/f79 [65287,126812] 0 2024-04-26T11:46:39.490 INFO:tasks.workunit.client.0.smithi029.stdout:9/608: dwrite d4/d5/d7/f36 [0,4194304] 0 2024-04-26T11:46:39.490 INFO:tasks.workunit.client.0.smithi029.stdout:8/544: chown dc/de/f9d 178072 1 2024-04-26T11:46:39.491 INFO:tasks.workunit.client.0.smithi029.stdout:9/609: read - d4/d5/d16/d80/faa zero size 2024-04-26T11:46:39.491 INFO:tasks.workunit.client.0.smithi029.stdout:2/641: write d12/f28 [1457779,111813] 0 2024-04-26T11:46:39.492 INFO:tasks.workunit.client.0.smithi029.stdout:2/642: stat d12/d6c/f72 0 2024-04-26T11:46:39.492 INFO:tasks.workunit.client.0.smithi029.stdout:9/610: chown d4/d49/d58/d67/fb7 6778 1 2024-04-26T11:46:39.493 INFO:tasks.workunit.client.0.smithi029.stdout:5/576: dwrite db/d12/d1a/f51 [0,4194304] 0 2024-04-26T11:46:39.493 INFO:tasks.workunit.client.0.smithi029.stdout:2/643: dread - d12/d6c/f72 zero size 2024-04-26T11:46:39.495 INFO:tasks.workunit.client.0.smithi029.stdout:6/600: mkdir d7/d46/d69/da2/dc8 0 2024-04-26T11:46:39.496 INFO:tasks.workunit.client.0.smithi029.stdout:0/595: read d9/d16/f28 [5610,98197] 0 2024-04-26T11:46:39.498 INFO:tasks.workunit.client.0.smithi029.stdout:0/596: write d9/f1d [8903,40] 0 2024-04-26T11:46:39.499 INFO:tasks.workunit.client.0.smithi029.stdout:6/601: link d7/d25/d4b/f6e d7/d46/d69/da2/d4c/d98/fc9 0 2024-04-26T11:46:39.499 INFO:tasks.workunit.client.0.smithi029.stdout:0/597: mkdir d9/d16/d25/ddc 0 2024-04-26T11:46:39.501 INFO:tasks.workunit.client.0.smithi029.stdout:6/602: fdatasync d7/d46/d69/da2/d4c/d98/fc5 0 2024-04-26T11:46:39.501 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:39.496+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:39.502 INFO:tasks.workunit.client.0.smithi029.stdout:5/577: dwrite db/d40/d4d/d79/f8e [0,4194304] 0 2024-04-26T11:46:39.502 INFO:tasks.workunit.client.0.smithi029.stdout:6/603: write d7/d46/d69/f8a [802443,32628] 0 2024-04-26T11:46:39.504 INFO:tasks.workunit.client.0.smithi029.stdout:6/604: mkdir d7/d20/d27/d91/dca 0 2024-04-26T11:46:39.505 INFO:tasks.workunit.client.0.smithi029.stdout:5/578: creat db/d12/d72/d39/fb4 x:0 0 0 2024-04-26T11:46:39.505 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:39.505 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:39.506 INFO:tasks.workunit.client.0.smithi029.stdout:5/579: dread - db/d12/d6b/f85 zero size 2024-04-26T11:46:39.506 INFO:tasks.workunit.client.0.smithi029.stdout:6/605: creat d7/d20/d27/da1/fcb x:0 0 0 2024-04-26T11:46:39.509 INFO:tasks.workunit.client.0.smithi029.stdout:0/598: read - d9/d16/d25/d2a/d74/f91 zero size 2024-04-26T11:46:39.509 INFO:tasks.workunit.client.0.smithi029.stdout:6/606: rename d7/d25/d4b/d4d/f54 to d7/d46/d69/da2/d4c/d98/d45/d83/dbf/fcc 0 2024-04-26T11:46:39.509 INFO:tasks.workunit.client.0.smithi029.stdout:0/599: mknod d9/d43/cdd 1 2024-04-26T11:46:39.509 INFO:tasks.workunit.client.0.smithi029.stdout:8/545: dread dc/de/d26/f99 [0,4194304] 0 2024-04-26T11:46:39.510 INFO:tasks.workunit.client.0.smithi029.stdout:8/546: mknod dc/de/cbf 1 2024-04-26T11:46:39.511 INFO:tasks.workunit.client.0.smithi029.stdout:0/600: mkdir d9/d16/d25/d2a/d4b/dde 0 2024-04-26T11:46:39.511 INFO:tasks.workunit.client.0.smithi029.stdout:8/547: chown dc/f66 31 1 2024-04-26T11:46:39.511 INFO:tasks.workunit.client.0.smithi029.stdout:0/601: read - d9/d16/d52/f7f zero size 2024-04-26T11:46:39.512 INFO:tasks.workunit.client.0.smithi029.stdout:0/602: mknod d9/d16/d25/cdf 1 2024-04-26T11:46:39.513 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:39.513 INFO:tasks.workunit.client.0.smithi029.stdout:4/574: dread d3/d1d/db/d13/f2f [0,4194304] 0 2024-04-26T11:46:39.513 INFO:tasks.workunit.client.0.smithi029.stdout:0/603: dread - d9/f36 zero size 2024-04-26T11:46:39.514 INFO:tasks.workunit.client.0.smithi029.stdout:0/604: read d9/d16/f89 [49546,83578] 0 2024-04-26T11:46:39.516 INFO:tasks.workunit.client.0.smithi029.stdout:8/548: dread dc/de/d26/d6b/f7d [0,4194304] 0 2024-04-26T11:46:39.518 INFO:tasks.workunit.client.0.smithi029.stdout:8/549: dread - dc/de/d2e/d23/d27/d6f/d9b/f80 zero size 2024-04-26T11:46:39.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:39.519 INFO:tasks.workunit.client.0.smithi029.stdout:8/550: mkdir dc/de/d26/d57/d86/dc0 0 2024-04-26T11:46:39.521 INFO:tasks.workunit.client.0.smithi029.stdout:8/551: write dc/de/d26/f53 [4386872,76283] 0 2024-04-26T11:46:39.521 INFO:tasks.workunit.client.0.smithi029.stdout:6/607: truncate d7/d20/d27/f7b 1419952 0 2024-04-26T11:46:39.521 INFO:tasks.workunit.client.0.smithi029.stdout:4/575: dwrite d3/f31 [0,4194304] 0 2024-04-26T11:46:39.523 INFO:tasks.workunit.client.0.smithi029.stdout:2/644: dread d12/f1d [8388608,4194304] 0 2024-04-26T11:46:39.524 INFO:tasks.workunit.client.0.smithi029.stdout:2/645: dread - d12/d24/d2f/fd2 zero size 2024-04-26T11:46:39.526 INFO:tasks.workunit.client.0.smithi029.stdout:4/576: unlink d3/d1d/db/d13/f2f 0 2024-04-26T11:46:39.527 INFO:tasks.workunit.client.0.smithi029.stdout:6/608: creat d7/d46/d69/db4/fcd x:0 0 0 2024-04-26T11:46:39.527 INFO:tasks.workunit.client.0.smithi029.stdout:4/577: chown d3/d1d/db/d13 507861 1 2024-04-26T11:46:39.530 INFO:tasks.workunit.client.0.smithi029.stdout:4/578: readlink d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/l86 0 2024-04-26T11:46:39.530 INFO:tasks.workunit.client.0.smithi029.stdout:6/609: creat d7/d46/d69/da2/d4c/d98/d45/d83/da9/fce x:0 0 0 2024-04-26T11:46:39.532 INFO:tasks.workunit.client.0.smithi029.stdout:8/552: dwrite dc/f11 [8388608,4194304] 0 2024-04-26T11:46:39.534 INFO:tasks.workunit.client.0.smithi029.stdout:7/674: dread d11/d18/d35/d39/f6a [4194304,4194304] 0 2024-04-26T11:46:39.535 INFO:tasks.workunit.client.0.smithi029.stdout:4/579: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f82 [376439,70024] 0 2024-04-26T11:46:39.535 INFO:tasks.workunit.client.0.smithi029.stdout:9/611: dread d4/d5/fd [4194304,4194304] 0 2024-04-26T11:46:39.536 INFO:tasks.workunit.client.0.smithi029.stdout:2/646: dwrite d12/f26 [0,4194304] 0 2024-04-26T11:46:39.536 INFO:tasks.workunit.client.0.smithi029.stdout:9/612: fsync d4/d5/d7/f59 0 2024-04-26T11:46:39.537 INFO:tasks.workunit.client.0.smithi029.stdout:7/675: symlink d11/d18/d1a/d92/le8 0 2024-04-26T11:46:39.537 INFO:tasks.workunit.client.0.smithi029.stdout:8/553: link dc/f11 dc/de/d26/d57/d86/dc0/fc1 0 2024-04-26T11:46:39.545 INFO:tasks.workunit.client.0.smithi029.stdout:9/613: mknod d4/d49/d58/d67/dab/cbc 1 2024-04-26T11:46:39.545 INFO:tasks.workunit.client.0.smithi029.stdout:4/580: mkdir d3/d1d/db/d13/dbb 0 2024-04-26T11:46:39.545 INFO:tasks.workunit.client.0.smithi029.stdout:2/647: rename d12/d24/d29/d38/l3e to d12/d6c/d73/d4f/d65/lde 0 2024-04-26T11:46:39.545 INFO:tasks.workunit.client.0.smithi029.stdout:8/554: write dc/de/d26/d57/f6d [1623978,129101] 0 2024-04-26T11:46:39.545 INFO:tasks.workunit.client.0.smithi029.stdout:7/676: fsync d11/d15/d79/da6/fa8 0 2024-04-26T11:46:39.545 INFO:tasks.workunit.client.0.smithi029.stdout:4/581: write d3/d1d/d11/d16/f57 [266141,106618] 0 2024-04-26T11:46:39.545 INFO:tasks.workunit.client.0.smithi029.stdout:8/555: chown dc/d3b/f50 107 1 2024-04-26T11:46:39.545 INFO:tasks.workunit.client.0.smithi029.stdout:7/677: write d11/d18/d35/f5e [1995498,16381] 0 2024-04-26T11:46:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:2/648: creat d12/d6c/d73/fdf x:0 0 0 2024-04-26T11:46:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:7/678: creat d11/d18/fe9 x:0 0 0 2024-04-26T11:46:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:7/679: mknod d11/d15/d79/d97/d9b/cea 1 2024-04-26T11:46:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:4/582: mkdir d3/d1d/db/d13/d23/d2b/dbc 0 2024-04-26T11:46:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:2/649: rename d12/d24/d2f/l34 to d12/d6c/d73/d4f/d65/d81/le0 0 2024-04-26T11:46:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:4/583: dread - d3/d1d/d11/d16/d1f/d3d/d39/fb5 zero size 2024-04-26T11:46:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:8/556: link dc/d12/d6a/l38 dc/de/d26/lc2 0 2024-04-26T11:46:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:7/680: write d11/d18/d1a/d33/fa3 [512947,129265] 0 2024-04-26T11:46:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:2/650: write d12/d6c/d73/f67 [687464,36172] 0 2024-04-26T11:46:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:4/584: rmdir d3/d50/d7a 39 2024-04-26T11:46:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:7/681: mknod d11/d18/dad/ceb 1 2024-04-26T11:46:39.547 INFO:tasks.workunit.client.0.smithi029.stdout:7/682: readlink d11/l46 0 2024-04-26T11:46:39.547 INFO:tasks.workunit.client.0.smithi029.stdout:2/651: write d12/d24/d29/d50/f58 [6090688,104255] 0 2024-04-26T11:46:39.547 INFO:tasks.workunit.client.0.smithi029.stdout:7/683: chown d11/d18/d2d/f8c 537994421 1 2024-04-26T11:46:39.548 INFO:tasks.workunit.client.0.smithi029.stdout:6/610: dread d7/d46/d69/da2/d4c/d98/d45/d76/f99 [0,4194304] 0 2024-04-26T11:46:39.548 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:39.548 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:39.548 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:39.548 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:39.549 INFO:tasks.workunit.client.0.smithi029.stdout:2/652: unlink d12/d6c/d73/da5/fd9 0 2024-04-26T11:46:39.549 INFO:tasks.workunit.client.0.smithi029.stdout:2/653: fsync d12/d24/d29/d36/d4b/fc9 0 2024-04-26T11:46:39.549 INFO:tasks.workunit.client.0.smithi029.stdout:0/605: dread d9/f41 [0,4194304] 0 2024-04-26T11:46:39.549 INFO:tasks.workunit.client.0.smithi029.stdout:2/654: symlink d12/d24/d2f/d76/le1 0 2024-04-26T11:46:39.550 INFO:tasks.workunit.client.0.smithi029.stdout:0/606: dread - d9/d16/d25/d2a/d74/d9a/faf zero size 2024-04-26T11:46:39.550 INFO:tasks.workunit.client.0.smithi029.stdout:2/655: rmdir d12/d24/d29/d50/d55/d5f 39 2024-04-26T11:46:39.551 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:39.551 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:39.552 INFO:tasks.workunit.client.0.smithi029.stdout:7/684: dread d11/dd3/de4/d84/fca [0,4194304] 0 2024-04-26T11:46:39.552 INFO:tasks.workunit.client.0.smithi029.stdout:0/607: creat d9/d16/d25/da7/fe0 x:0 0 0 2024-04-26T11:46:39.552 INFO:tasks.workunit.client.0.smithi029.stdout:2/656: fsync d12/d24/d29/d38/fac 0 2024-04-26T11:46:39.552 INFO:tasks.workunit.client.0.smithi029.stdout:7/685: creat d11/d18/d35/d39/fec x:0 0 0 2024-04-26T11:46:39.553 INFO:tasks.workunit.client.0.smithi029.stdout:2/657: creat d12/d24/d29/d38/d52/fe2 x:0 0 0 2024-04-26T11:46:39.553 INFO:tasks.workunit.client.0.smithi029.stdout:4/585: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f6a [4194304,4194304] 0 2024-04-26T11:46:39.554 INFO:tasks.workunit.client.0.smithi029.stdout:2/658: mkdir d12/de3 0 2024-04-26T11:46:39.554 INFO:tasks.workunit.client.0.smithi029.stdout:4/586: mknod d3/d1d/db/d13/d23/d2b/dbc/cbd 1 2024-04-26T11:46:39.554 INFO:tasks.workunit.client.0.smithi029.stdout:2/659: write d12/d6c/d73/d40/fd4 [42594,22474] 0 2024-04-26T11:46:39.555 INFO:tasks.workunit.client.0.smithi029.stdout:4/587: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f82 [684132,32763] 0 2024-04-26T11:46:39.556 INFO:tasks.workunit.client.0.smithi029.stdout:2/660: mkdir d12/d6c/d6e/de4 0 2024-04-26T11:46:39.557 INFO:tasks.workunit.client.0.smithi029.stdout:2/661: symlink d12/d6c/d73/d4f/d65/d6f/le5 0 2024-04-26T11:46:39.558 INFO:tasks.workunit.client.0.smithi029.stdout:2/662: chown l2 2 1 2024-04-26T11:46:39.558 INFO:tasks.workunit.client.0.smithi029.stdout:2/663: stat d12/d6c/d73/d4f/d65/d81/fc0 0 2024-04-26T11:46:39.558 INFO:tasks.workunit.client.0.smithi029.stdout:2/664: write d12/d24/f92 [3146518,22092] 0 2024-04-26T11:46:39.560 INFO:tasks.workunit.client.0.smithi029.stdout:2/665: rename fd to d12/d24/d29/d50/d55/fe6 0 2024-04-26T11:46:39.561 INFO:tasks.workunit.client.0.smithi029.stdout:2/666: creat d12/d6c/d73/fe7 x:0 0 0 2024-04-26T11:46:39.562 INFO:tasks.workunit.client.0.smithi029.stdout:2/667: readlink d12/d24/d29/d57/l60 0 2024-04-26T11:46:39.564 INFO:tasks.workunit.client.0.smithi029.stdout:7/686: dread d11/d18/f40 [0,4194304] 0 2024-04-26T11:46:39.565 INFO:tasks.workunit.client.0.smithi029.stdout:7/687: write d11/d18/d1a/f4a [4759082,63874] 0 2024-04-26T11:46:39.567 INFO:tasks.workunit.client.0.smithi029.stdout:7/688: truncate d11/d18/d1a/f4a 4835371 0 2024-04-26T11:46:39.568 INFO:tasks.workunit.client.0.smithi029.stdout:7/689: mknod d11/d18/d1a/ced 1 2024-04-26T11:46:39.569 INFO:tasks.workunit.client.0.smithi029.stdout:7/690: unlink d11/d18/d35/d39/d7e/dde/fb5 0 2024-04-26T11:46:39.569 INFO:tasks.workunit.client.0.smithi029.stdout:7/691: chown d11/d15/l81 1933 1 2024-04-26T11:46:39.571 INFO:tasks.workunit.client.0.smithi029.stdout:2/668: truncate d12/d6c/d73/d4f/d65/d6f/fb7 1404005 0 2024-04-26T11:46:39.572 INFO:tasks.workunit.client.0.smithi029.stdout:2/669: dread - d12/d6c/f72 zero size 2024-04-26T11:46:39.574 INFO:tasks.workunit.client.0.smithi029.stdout:4/588: dread d3/d1d/f21 [0,4194304] 0 2024-04-26T11:46:39.575 INFO:tasks.workunit.client.0.smithi029.stdout:6/611: write d7/d20/d27/f7b [1241194,26803] 0 2024-04-26T11:46:39.575 INFO:tasks.workunit.client.0.smithi029.stdout:4/589: write d3/d1d/f29 [4284421,55731] 0 2024-04-26T11:46:39.577 INFO:tasks.workunit.client.0.smithi029.stdout:7/692: rmdir d11 39 2024-04-26T11:46:39.578 INFO:tasks.workunit.client.0.smithi029.stdout:6/612: link d7/d25/d4b/l6a d7/d25/d5c/lcf 0 2024-04-26T11:46:39.579 INFO:tasks.workunit.client.0.smithi029.stdout:4/590: truncate d3/d50/d7a/f96 1939589 0 2024-04-26T11:46:39.579 INFO:tasks.workunit.client.0.smithi029.stdout:7/693: write d11/dd3/de4/daa/fac [1203436,101288] 0 2024-04-26T11:46:39.580 INFO:tasks.workunit.client.0.smithi029.stdout:6/613: mkdir d7/d20/d27/dc0/dd0 0 2024-04-26T11:46:39.581 INFO:tasks.workunit.client.0.smithi029.stdout:4/591: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/dbe 0 2024-04-26T11:46:39.582 INFO:tasks.workunit.client.0.smithi029.stdout:7/694: creat d11/d18/d1a/dab/fee x:0 0 0 2024-04-26T11:46:39.582 INFO:tasks.workunit.client.0.smithi029.stdout:6/614: creat d7/d46/d69/da2/fd1 x:0 0 0 2024-04-26T11:46:39.583 INFO:tasks.workunit.client.0.smithi029.stdout:2/670: dwrite d12/d24/d2f/f33 [0,4194304] 0 2024-04-26T11:46:39.583 INFO:tasks.workunit.client.0.smithi029.stdout:7/695: readlink d11/d18/d1a/d33/ld5 0 2024-04-26T11:46:39.584 INFO:tasks.workunit.client.0.smithi029.stdout:7/696: stat d11/d18/d1a/d26/d91/f9c 0 2024-04-26T11:46:39.585 INFO:tasks.workunit.client.0.smithi029.stdout:2/671: creat d12/d24/d29/d36/fe8 x:0 0 0 2024-04-26T11:46:39.587 INFO:tasks.workunit.client.0.smithi029.stdout:2/672: dread - d12/d6c/d70/f9a zero size 2024-04-26T11:46:39.587 INFO:tasks.workunit.client.0.smithi029.stdout:6/615: rename d7/d46/d69/da2/d4c/d98/l6b to d7/d97/dc2/ld2 0 2024-04-26T11:46:39.587 INFO:tasks.workunit.client.0.smithi029.stdout:1/657: sync 2024-04-26T11:46:39.587 INFO:tasks.workunit.client.0.smithi029.stdout:2/673: creat d12/d24/fe9 x:0 0 0 2024-04-26T11:46:39.591 INFO:tasks.workunit.client.0.smithi029.stdout:1/658: rename d7/db/d10/l1a to d7/d25/d68/ldf 0 2024-04-26T11:46:39.591 INFO:tasks.workunit.client.0.smithi029.stdout:7/697: write d11/d18/d1a/d26/d91/f9f [416976,64561] 0 2024-04-26T11:46:39.593 INFO:tasks.workunit.client.0.smithi029.stdout:1/659: stat d7/db/d10/d20/fda 0 2024-04-26T11:46:39.593 INFO:tasks.workunit.client.0.smithi029.stdout:4/592: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/fb6 [4194304,4194304] 0 2024-04-26T11:46:39.594 INFO:tasks.workunit.client.0.smithi029.stdout:1/660: chown d7/d25/d68/f6e 739 1 2024-04-26T11:46:39.597 INFO:tasks.workunit.client.0.smithi029.stdout:1/661: chown d7/db/d10/d1e/fb3 14819264 1 2024-04-26T11:46:39.597 INFO:tasks.workunit.client.0.smithi029.stdout:6/616: dwrite d7/d25/d4b/d4d/d65/faa [0,4194304] 0 2024-04-26T11:46:39.597 INFO:tasks.workunit.client.0.smithi029.stdout:1/662: mkdir d7/d37/de0 0 2024-04-26T11:46:39.598 INFO:tasks.workunit.client.0.smithi029.stdout:6/617: chown d7/d25/d4b/d6d/f95 154703 1 2024-04-26T11:46:39.599 INFO:tasks.workunit.client.0.smithi029.stdout:1/663: rename d7/f35 to d7/db/dcc/fe1 0 2024-04-26T11:46:39.600 INFO:tasks.workunit.client.0.smithi029.stdout:1/664: creat d7/db/d8d/fe2 x:0 0 0 2024-04-26T11:46:39.601 INFO:tasks.workunit.client.0.smithi029.stdout:7/698: dwrite d11/d18/d1a/d33/fc8 [0,4194304] 0 2024-04-26T11:46:39.602 INFO:tasks.workunit.client.0.smithi029.stdout:1/665: chown d7/d25/d68/fc0 231739037 1 2024-04-26T11:46:39.602 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:39.596+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:39.602 INFO:tasks.workunit.client.0.smithi029.stdout:1/666: stat d7/d25/d68/d4b/d66/f87 0 2024-04-26T11:46:39.603 INFO:tasks.workunit.client.0.smithi029.stdout:7/699: creat d11/d18/d1a/fef x:0 0 0 2024-04-26T11:46:39.605 INFO:tasks.workunit.client.0.smithi029.stdout:1/667: creat d7/db/d8d/dc7/fe3 x:0 0 0 2024-04-26T11:46:39.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/668: rmdir d7/d37 39 2024-04-26T11:46:39.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/669: chown d7/db/dc5/ldd 79100187 1 2024-04-26T11:46:39.607 INFO:tasks.workunit.client.0.smithi029.stdout:1/670: symlink d7/d25/d68/d4b/d66/le4 0 2024-04-26T11:46:39.608 INFO:tasks.workunit.client.0.smithi029.stdout:4/593: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/fb6 2978144 0 2024-04-26T11:46:39.609 INFO:tasks.workunit.client.0.smithi029.stdout:4/594: creat d3/d1d/d11/d16/d1f/d3d/d46/fbf x:0 0 0 2024-04-26T11:46:39.610 INFO:tasks.workunit.client.0.smithi029.stdout:4/595: stat d3/d1d/f83 0 2024-04-26T11:46:39.612 INFO:tasks.workunit.client.0.smithi029.stdout:4/596: mkdir d3/d1d/db/dc0 0 2024-04-26T11:46:39.616 INFO:tasks.workunit.client.0.smithi029.stdout:1/671: dwrite d7/d37/d3e/fa7 [0,4194304] 0 2024-04-26T11:46:39.617 INFO:tasks.workunit.client.0.smithi029.stdout:1/672: fdatasync d7/d25/d6d/d8c/f88 0 2024-04-26T11:46:39.619 INFO:tasks.workunit.client.0.smithi029.stdout:1/673: creat d7/d25/d6d/fe5 x:0 0 0 2024-04-26T11:46:39.622 INFO:tasks.workunit.client.0.smithi029.stdout:4/597: dwrite d3/d1d/d11/d16/d1f/f67 [0,4194304] 0 2024-04-26T11:46:39.622 INFO:tasks.workunit.client.0.smithi029.stdout:7/700: dread d11/d18/d1a/f4a [0,4194304] 0 2024-04-26T11:46:39.625 INFO:tasks.workunit.client.0.smithi029.stdout:7/701: getdents d11/d18/d1a/dab 0 2024-04-26T11:46:39.626 INFO:tasks.workunit.client.0.smithi029.stdout:7/702: chown d11/d18/d1a/d33/fa3 214340787 1 2024-04-26T11:46:39.626 INFO:tasks.workunit.client.0.smithi029.stdout:7/703: rmdir d11/d18/dad 39 2024-04-26T11:46:39.628 INFO:tasks.workunit.client.0.smithi029.stdout:4/598: write d3/d1d/d11/fa2 [2399700,82224] 0 2024-04-26T11:46:39.628 INFO:tasks.workunit.client.0.smithi029.stdout:7/704: write d11/d18/d1a/d33/f93 [449201,93077] 0 2024-04-26T11:46:39.631 INFO:tasks.workunit.client.0.smithi029.stdout:4/599: unlink d3/d1d/db/f28 0 2024-04-26T11:46:39.631 INFO:tasks.workunit.client.0.smithi029.stdout:6/618: dread d7/f22 [0,4194304] 0 2024-04-26T11:46:39.631 INFO:tasks.workunit.client.0.smithi029.stdout:4/600: stat d3/d1d/d11/d16/d1f/d3d/d46/f90 0 2024-04-26T11:46:39.631 INFO:tasks.workunit.client.0.smithi029.stdout:6/619: creat d7/fd3 x:0 0 0 2024-04-26T11:46:39.632 INFO:tasks.workunit.client.0.smithi029.stdout:4/601: stat d3/d1d/d11/d16/d1f/d3d/d46/f90 0 2024-04-26T11:46:39.632 INFO:tasks.workunit.client.0.smithi029.stdout:6/620: read - d7/d20/f9b zero size 2024-04-26T11:46:39.632 INFO:tasks.workunit.client.0.smithi029.stdout:4/602: write d3/fac [811424,45480] 0 2024-04-26T11:46:39.632 INFO:tasks.workunit.client.0.smithi029.stdout:6/621: chown d7/d46/d69/da2/f38 30283592 1 2024-04-26T11:46:39.636 INFO:tasks.workunit.client.0.smithi029.stdout:6/622: truncate d7/d46/d69/da2/f4a 2065690 0 2024-04-26T11:46:39.641 INFO:tasks.workunit.client.0.smithi029.stdout:6/623: read d7/d20/d27/f41 [1262476,85197] 0 2024-04-26T11:46:39.647 INFO:tasks.workunit.client.0.smithi029.stdout:6/624: dread d7/d46/d69/da2/d4c/d98/fa6 [0,4194304] 0 2024-04-26T11:46:39.648 INFO:tasks.workunit.client.0.smithi029.stdout:6/625: truncate d7/d25/d5c/f9f 862274 0 2024-04-26T11:46:39.652 INFO:tasks.workunit.client.0.smithi029.stdout:6/626: truncate d7/d46/d69/da2/d4c/d98/d45/d83/da9/fce 226599 0 2024-04-26T11:46:39.652 INFO:tasks.workunit.client.0.smithi029.stdout:6/627: readlink d7/d20/lc6 0 2024-04-26T11:46:39.653 INFO:tasks.workunit.client.0.smithi029.stdout:6/628: stat d7/d46/d69/da2/d4c/d98/d45/d76 0 2024-04-26T11:46:39.654 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:39.654 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:39.654 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:39.654 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:39.656 INFO:tasks.workunit.client.0.smithi029.stdout:6/629: rename d7/f32 to d7/fd4 0 2024-04-26T11:46:39.656 INFO:tasks.workunit.client.0.smithi029.stdout:4/603: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f6d [0,4194304] 0 2024-04-26T11:46:39.658 INFO:tasks.workunit.client.0.smithi029.stdout:6/630: getdents d7/d46/d69 0 2024-04-26T11:46:39.658 INFO:tasks.workunit.client.0.smithi029.stdout:4/604: creat d3/d1d/d11/d16/d1f/fc1 x:0 0 0 2024-04-26T11:46:39.659 INFO:tasks.workunit.client.0.smithi029.stdout:6/631: mknod d7/d46/d69/da2/d4c/d98/d45/cd5 1 2024-04-26T11:46:39.660 INFO:tasks.workunit.client.0.smithi029.stdout:1/674: dread d7/d25/d68/f6e [0,4194304] 0 2024-04-26T11:46:39.660 INFO:tasks.workunit.client.0.smithi029.stdout:6/632: readlink d7/d25/d5c/lcf 0 2024-04-26T11:46:39.664 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:39.665 INFO:tasks.workunit.client.0.smithi029.stdout:4/605: rmdir d3/d1d/d11 39 2024-04-26T11:46:39.666 INFO:tasks.workunit.client.0.smithi029.stdout:1/675: truncate d7/d37/d98/fc3 3227297 0 2024-04-26T11:46:39.666 INFO:tasks.workunit.client.0.smithi029.stdout:4/606: chown d3/d1d/lf 3 1 2024-04-26T11:46:39.672 INFO:tasks.workunit.client.0.smithi029.stdout:4/607: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f82 1874367 0 2024-04-26T11:46:39.678 INFO:tasks.workunit.client.0.smithi029.stdout:1/676: dwrite d7/db/d10/d1e/f73 [0,4194304] 0 2024-04-26T11:46:39.679 INFO:tasks.workunit.client.0.smithi029.stdout:1/677: chown d7/db/f91 1 1 2024-04-26T11:46:39.681 INFO:tasks.workunit.client.0.smithi029.stdout:4/608: truncate d3/d1d/d11/d16/d1f/d3d/fb3 2289715 0 2024-04-26T11:46:39.682 INFO:tasks.workunit.client.0.smithi029.stdout:1/678: rename d7/d25/d68/l32 to d7/db/d10/d1e/d53/d9d/le6 0 2024-04-26T11:46:39.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/633: dread d7/f11 [0,4194304] 0 2024-04-26T11:46:39.685 INFO:tasks.workunit.client.0.smithi029.stdout:6/634: chown d7/d46/d69/da2/d4c/d98 5586 1 2024-04-26T11:46:39.686 INFO:tasks.workunit.client.0.smithi029.stdout:4/609: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f8c [1612885,40535] 0 2024-04-26T11:46:39.687 INFO:tasks.workunit.client.0.smithi029.stdout:6/635: mkdir d7/d25/d4b/d6d/dd6 0 2024-04-26T11:46:39.690 INFO:tasks.workunit.client.0.smithi029.stdout:6/636: symlink d7/d46/d69/da2/ld7 0 2024-04-26T11:46:39.690 INFO:tasks.workunit.client.0.smithi029.stdout:4/610: chown d3/d1d/d11/d16/d1f/d3d/d46/fbf 61634190 1 2024-04-26T11:46:39.690 INFO:tasks.workunit.client.0.smithi029.stdout:6/637: readlink d7/d20/l29 0 2024-04-26T11:46:39.693 INFO:tasks.workunit.client.0.smithi029.stdout:1/679: dwrite d7/db/d10/d20/fbd [0,4194304] 0 2024-04-26T11:46:39.693 INFO:tasks.workunit.client.0.smithi029.stdout:6/638: getdents d7/d25/d4b/d4d/d65 0 2024-04-26T11:46:39.695 INFO:tasks.workunit.client.0.smithi029.stdout:6/639: mknod d7/d46/d69/da2/d4c/d98/d45/d76/cd8 1 2024-04-26T11:46:39.695 INFO:tasks.workunit.client.0.smithi029.stdout:1/680: creat d7/db/d10/d1e/db2/fe7 x:0 0 0 2024-04-26T11:46:39.696 INFO:tasks.workunit.client.0.smithi029.stdout:1/681: chown d7/d25/d99/l9c 12543373 1 2024-04-26T11:46:39.697 INFO:tasks.workunit.client.0.smithi029.stdout:6/640: link d7/d20/d27/f9c d7/d25/d4b/d4d/fd9 0 2024-04-26T11:46:39.697 INFO:tasks.workunit.client.0.smithi029.stdout:1/682: creat d7/db/dc5/dd5/fe8 x:0 0 0 2024-04-26T11:46:39.703 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:39.696+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:39.707 INFO:tasks.workunit.client.0.smithi029.stdout:1/683: dwrite d7/db/d10/d1e/d53/f6c [0,4194304] 0 2024-04-26T11:46:39.709 INFO:tasks.workunit.client.0.smithi029.stdout:1/684: rename d7/f55 to d7/db/dc5/dd5/fe9 0 2024-04-26T11:46:39.710 INFO:tasks.workunit.client.0.smithi029.stdout:1/685: symlink d7/db/dcc/lea 0 2024-04-26T11:46:39.714 INFO:tasks.workunit.client.0.smithi029.stdout:1/686: mkdir d7/db/dcc/deb 0 2024-04-26T11:46:39.714 INFO:tasks.workunit.client.0.smithi029.stdout:1/687: symlink d7/db/d8d/dc7/lec 0 2024-04-26T11:46:39.716 INFO:tasks.workunit.client.0.smithi029.stdout:1/688: write d7/d25/d68/f6e [4621123,124090] 0 2024-04-26T11:46:39.717 INFO:tasks.workunit.client.0.smithi029.stdout:6/641: dread d7/d25/f73 [0,4194304] 0 2024-04-26T11:46:39.718 INFO:tasks.workunit.client.0.smithi029.stdout:1/689: rmdir d7/d25/d6d/d8c 39 2024-04-26T11:46:39.719 INFO:tasks.workunit.client.0.smithi029.stdout:1/690: symlink d7/d25/dae/led 0 2024-04-26T11:46:39.719 INFO:tasks.workunit.client.0.smithi029.stdout:6/642: creat d7/d46/d69/da2/fda x:0 0 0 2024-04-26T11:46:39.720 INFO:tasks.workunit.client.0.smithi029.stdout:1/691: chown d7/db/d10/d1e/f73 31233 1 2024-04-26T11:46:39.721 INFO:tasks.workunit.client.0.smithi029.stdout:1/692: rename d7/d37 to d7/db/d10/d1e/db2/dee 0 2024-04-26T11:46:39.722 INFO:tasks.workunit.client.0.smithi029.stdout:1/693: chown d7/d5b/fb4 1387789329 1 2024-04-26T11:46:39.724 INFO:tasks.workunit.client.0.smithi029.stdout:4/611: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/fb6 [0,4194304] 0 2024-04-26T11:46:39.724 INFO:tasks.workunit.client.0.smithi029.stdout:1/694: rename d7/d25/l64 to d7/db/d10/d1e/d53/lef 0 2024-04-26T11:46:39.725 INFO:tasks.workunit.client.0.smithi029.stdout:4/612: symlink d3/d1d/db/d13/d73/lc2 0 2024-04-26T11:46:39.727 INFO:tasks.workunit.client.0.smithi029.stdout:1/695: read d7/d5b/f81 [3079315,112387] 0 2024-04-26T11:46:39.729 INFO:tasks.workunit.client.0.smithi029.stdout:1/696: mkdir d7/d25/d6d/d8c/df0 0 2024-04-26T11:46:39.730 INFO:tasks.workunit.client.0.smithi029.stdout:6/643: dwrite d7/d46/d69/da2/d4c/d98/d45/d83/da9/fb7 [0,4194304] 0 2024-04-26T11:46:39.731 INFO:tasks.workunit.client.0.smithi029.stdout:1/697: unlink d7/d25/d68/f6e 0 2024-04-26T11:46:39.731 INFO:tasks.workunit.client.0.smithi029.stdout:6/644: dread - d7/d97/fa5 zero size 2024-04-26T11:46:39.732 INFO:tasks.workunit.client.0.smithi029.stdout:1/698: chown d7/d25/lb6 1 1 2024-04-26T11:46:39.733 INFO:tasks.workunit.client.0.smithi029.stdout:1/699: mkdir d7/d25/dab/df1 0 2024-04-26T11:46:39.733 INFO:tasks.workunit.client.0.smithi029.stdout:6/645: write d7/d25/d4b/d4d/d65/fb8 [507483,19685] 0 2024-04-26T11:46:39.734 INFO:tasks.workunit.client.0.smithi029.stdout:1/700: mknod d7/d25/d68/cf2 1 2024-04-26T11:46:39.735 INFO:tasks.workunit.client.0.smithi029.stdout:1/701: symlink d7/db/dcc/lf3 0 2024-04-26T11:46:39.735 INFO:tasks.workunit.client.0.smithi029.stdout:1/702: mknod d7/d25/dab/df1/cf4 1 2024-04-26T11:46:39.736 INFO:tasks.workunit.client.0.smithi029.stdout:6/646: getdents d7/d46/d69/da2/d4c/d98/d45 0 2024-04-26T11:46:39.736 INFO:tasks.workunit.client.0.smithi029.stdout:1/703: mknod d7/db/dcc/deb/cf5 1 2024-04-26T11:46:39.738 INFO:tasks.workunit.client.0.smithi029.stdout:1/704: symlink d7/db/d10/d1e/db2/dee/lf6 0 2024-04-26T11:46:39.738 INFO:tasks.workunit.client.0.smithi029.stdout:6/647: rename d7/d46/d69/da2/d4c/d98/d45/d83/da9/fbb to d7/d25/d4b/d4d/fdb 0 2024-04-26T11:46:39.740 INFO:tasks.workunit.client.0.smithi029.stdout:1/705: getdents d7/db/dc5/dd5 0 2024-04-26T11:46:39.750 INFO:tasks.workunit.client.0.smithi029.stdout:4/613: dread d3/d1d/d11/fa2 [0,4194304] 0 2024-04-26T11:46:39.750 INFO:tasks.workunit.client.0.smithi029.stdout:1/706: dread d7/db/d10/d1e/f45 [0,4194304] 0 2024-04-26T11:46:39.750 INFO:tasks.workunit.client.0.smithi029.stdout:4/614: stat d3/d1d/d11/d16/d1f/d3d/d46 0 2024-04-26T11:46:39.752 INFO:tasks.workunit.client.0.smithi029.stdout:4/615: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f63 [4070619,1650] 0 2024-04-26T11:46:39.753 INFO:tasks.workunit.client.0.smithi029.stdout:4/616: mknod d3/d1d/d11/d16/d71/cc3 1 2024-04-26T11:46:39.754 INFO:tasks.workunit.client.0.smithi029.stdout:4/617: symlink d3/dba/lc4 0 2024-04-26T11:46:39.756 INFO:tasks.workunit.client.0.smithi029.stdout:1/707: dread d7/db/d8d/f96 [0,4194304] 0 2024-04-26T11:46:39.756 INFO:tasks.workunit.client.0.smithi029.stdout:4/618: truncate d3/fb8 239920 0 2024-04-26T11:46:39.757 INFO:tasks.workunit.client.0.smithi029.stdout:1/708: creat d7/db/d8d/ff7 x:0 0 0 2024-04-26T11:46:39.757 INFO:tasks.workunit.client.0.smithi029.stdout:1/709: fsync d7/f77 0 2024-04-26T11:46:39.760 INFO:tasks.workunit.client.0.smithi029.stdout:4/619: write d3/d1d/d11/d16/d1f/d3d/f60 [3093787,118598] 0 2024-04-26T11:46:39.762 INFO:tasks.workunit.client.0.smithi029.stdout:4/620: chown d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f58 555 1 2024-04-26T11:46:39.764 INFO:tasks.workunit.client.0.smithi029.stdout:4/621: unlink d3/d1d/db/f36 0 2024-04-26T11:46:39.769 INFO:tasks.workunit.client.0.smithi029.stdout:1/710: dwrite d7/db/dc5/dd5/fe9 [0,4194304] 0 2024-04-26T11:46:39.771 INFO:tasks.workunit.client.0.smithi029.stdout:1/711: symlink d7/db/d10/lf8 0 2024-04-26T11:46:39.780 INFO:tasks.workunit.client.0.smithi029.stdout:4/622: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f77 [0,4194304] 0 2024-04-26T11:46:39.782 INFO:tasks.workunit.client.0.smithi029.stdout:4/623: write d3/d1d/d11/d16/d1f/d3d/d46/fbf [985030,34902] 0 2024-04-26T11:46:39.783 INFO:tasks.workunit.client.0.smithi029.stdout:1/712: dwrite d7/db/d10/d1e/d53/f7a [0,4194304] 0 2024-04-26T11:46:39.785 INFO:tasks.workunit.client.0.smithi029.stdout:1/713: creat d7/db/d10/d1e/ff9 x:0 0 0 2024-04-26T11:46:39.787 INFO:tasks.workunit.client.0.smithi029.stdout:1/714: rename d7/db/d8d/dc7/lec to d7/db/lfa 0 2024-04-26T11:46:39.787 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:39.788 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:39.788 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:39.788 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:39.788 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:39.791 INFO:tasks.workunit.client.0.smithi029.stdout:1/715: write d7/db/d10/d1e/d53/f7a [3804517,3936] 0 2024-04-26T11:46:39.792 INFO:tasks.workunit.client.0.smithi029.stdout:4/624: dwrite d3/f8d [0,4194304] 0 2024-04-26T11:46:39.795 INFO:tasks.workunit.client.0.smithi029.stdout:4/625: rename d3/d1d/d11/d16/d1f/f67 to d3/d1d/db/d13/d23/d2b/d9d/fc5 0 2024-04-26T11:46:39.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:39.799 INFO:tasks.workunit.client.0.smithi029.stdout:1/716: dread d7/db/d10/d1e/db2/dee/f58 [0,4194304] 0 2024-04-26T11:46:39.800 INFO:tasks.workunit.client.0.smithi029.stdout:4/626: dread d3/fac [0,4194304] 0 2024-04-26T11:46:39.801 INFO:tasks.workunit.client.0.smithi029.stdout:1/717: symlink d7/d25/d6d/d8c/lfb 0 2024-04-26T11:46:39.801 INFO:tasks.workunit.client.0.smithi029.stdout:1/718: chown d7/d25/dae/led 116372 1 2024-04-26T11:46:39.803 INFO:tasks.workunit.client.0.smithi029.stdout:4/627: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f77 [1189279,21648] 0 2024-04-26T11:46:39.804 INFO:tasks.workunit.client.0.smithi029.stdout:1/719: mkdir d7/db/d10/d1e/d53/d9d/dfc 0 2024-04-26T11:46:39.804 INFO:tasks.workunit.client.0.smithi029.stdout:4/628: rmdir d3/dba 39 2024-04-26T11:46:39.805 INFO:tasks.workunit.client.0.smithi029.stdout:1/720: chown d7/db/d10/d1e/db2/dee/d3e/ld 12003430 1 2024-04-26T11:46:39.805 INFO:tasks.workunit.client.0.smithi029.stdout:4/629: write d3/d1d/d11/d16/d1f/d3d/f60 [2767698,92382] 0 2024-04-26T11:46:39.806 INFO:tasks.workunit.client.0.smithi029.stdout:1/721: mkdir d7/d25/d85/dfd 0 2024-04-26T11:46:39.807 INFO:tasks.workunit.client.0.smithi029.stdout:4/630: symlink d3/d1d/db/d13/d23/d2b/dbc/lc6 0 2024-04-26T11:46:39.807 INFO:tasks.workunit.client.0.smithi029.stdout:1/722: write d7/db/d10/d1e/d5e/fce [1569959,50329] 0 2024-04-26T11:46:39.808 INFO:tasks.workunit.client.0.smithi029.stdout:4/631: dread - d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f58 zero size 2024-04-26T11:46:39.809 INFO:tasks.workunit.client.0.smithi029.stdout:1/723: rmdir d7/db/d10/d1e/db2/dee/de0 0 2024-04-26T11:46:39.810 INFO:tasks.workunit.client.0.smithi029.stdout:4/632: symlink d3/d1d/db/d13/d23/d2b/d9d/lc7 0 2024-04-26T11:46:39.810 INFO:tasks.workunit.client.0.smithi029.stdout:1/724: truncate d7/d25/d68/f60 4056805 0 2024-04-26T11:46:39.812 INFO:tasks.workunit.client.0.smithi029.stdout:4/633: rmdir d3/d1d/db/d13/d73/d97/db7 0 2024-04-26T11:46:39.813 INFO:tasks.workunit.client.0.smithi029.stdout:4/634: rmdir d3/dba 39 2024-04-26T11:46:39.815 INFO:tasks.workunit.client.0.smithi029.stdout:4/635: chown d3/d1d/db/d13/d23/d2b/d9d/fc5 1087 1 2024-04-26T11:46:39.818 INFO:tasks.workunit.client.0.smithi029.stdout:4/636: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/dc8 0 2024-04-26T11:46:39.818 INFO:tasks.workunit.client.0.smithi029.stdout:4/637: mknod d3/d1d/db/d13/dbb/cc9 1 2024-04-26T11:46:39.821 INFO:tasks.workunit.client.0.smithi029.stdout:4/638: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f77 [4068944,72427] 0 2024-04-26T11:46:39.821 INFO:tasks.workunit.client.0.smithi029.stdout:1/725: dwrite d7/db/f91 [0,4194304] 0 2024-04-26T11:46:39.823 INFO:tasks.workunit.client.0.smithi029.stdout:1/726: mkdir d7/db/dcc/dfe 0 2024-04-26T11:46:39.824 INFO:tasks.workunit.client.0.smithi029.stdout:4/639: getdents d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d9f 0 2024-04-26T11:46:39.824 INFO:tasks.workunit.client.0.smithi029.stdout:1/727: chown d7/d25/d6d/d8c 52069 1 2024-04-26T11:46:39.824 INFO:tasks.workunit.client.0.smithi029.stdout:3/551: sync 2024-04-26T11:46:39.825 INFO:tasks.workunit.client.0.smithi029.stdout:4/640: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/cca 1 2024-04-26T11:46:39.827 INFO:tasks.workunit.client.0.smithi029.stdout:3/552: rename d0/f15 to d0/d1/d2b/da7/fb9 0 2024-04-26T11:46:39.827 INFO:tasks.workunit.client.0.smithi029.stdout:1/728: rename d7/d25/d68/f60 to d7/d25/d68/d4b/d66/fff 0 2024-04-26T11:46:39.828 INFO:tasks.workunit.client.0.smithi029.stdout:3/553: rename d0/d1/d2b/f6d to d0/d1/d2f/fba 0 2024-04-26T11:46:39.829 INFO:tasks.workunit.client.0.smithi029.stdout:3/554: mknod d0/d1/d41/d5f/d1a/d3b/cbb 1 2024-04-26T11:46:39.830 INFO:tasks.workunit.client.0.smithi029.stdout:1/729: rename d7/db/d10/d1e/db2/dee/d3e/f4e to d7/d25/f100 0 2024-04-26T11:46:39.832 INFO:tasks.workunit.client.0.smithi029.stdout:1/730: creat d7/db/dc5/f101 x:0 0 0 2024-04-26T11:46:39.833 INFO:tasks.workunit.client.0.smithi029.stdout:4/641: dread d3/d1d/db/d13/d23/f43 [0,4194304] 0 2024-04-26T11:46:39.839 INFO:tasks.workunit.client.0.smithi029.stdout:1/731: dread d7/db/d10/d20/fbd [0,4194304] 0 2024-04-26T11:46:39.840 INFO:tasks.workunit.client.0.smithi029.stdout:3/555: dwrite d0/d1/d2b/d33/f74 [0,4194304] 0 2024-04-26T11:46:39.841 INFO:tasks.workunit.client.0.smithi029.stdout:1/732: symlink d7/db/dc5/dd5/l102 0 2024-04-26T11:46:39.841 INFO:tasks.workunit.client.0.smithi029.stdout:3/556: symlink d0/d1/d2f/d82/lbc 0 2024-04-26T11:46:39.843 INFO:tasks.workunit.client.0.smithi029.stdout:3/557: mkdir d0/d1/d2b/dbd 0 2024-04-26T11:46:39.843 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:39.840+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:39.843 INFO:tasks.workunit.client.0.smithi029.stdout:4/642: dwrite d3/d1d/d11/d16/d1f/d3d/f62 [4194304,4194304] 0 2024-04-26T11:46:39.850 INFO:tasks.workunit.client.0.smithi029.stdout:1/733: readlink d7/l3a 0 2024-04-26T11:46:39.850 INFO:tasks.workunit.client.0.smithi029.stdout:3/558: getdents d0/d1/d41/d5f/d4d 0 2024-04-26T11:46:39.850 INFO:tasks.workunit.client.0.smithi029.stdout:3/559: rename d0/d1 to d0/d1/d2f/d82/dbe 22 2024-04-26T11:46:39.850 INFO:tasks.workunit.client.0.smithi029.stdout:4/643: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/dc8/fcb x:0 0 0 2024-04-26T11:46:39.851 INFO:tasks.workunit.client.0.smithi029.stdout:3/560: truncate d0/f52 2645226 0 2024-04-26T11:46:39.851 INFO:tasks.workunit.client.0.smithi029.stdout:3/561: chown d0/d1/d41/d5f/d4d 2511 1 2024-04-26T11:46:39.853 INFO:tasks.workunit.client.0.smithi029.stdout:3/562: chown d0/dc/f6c 247653 1 2024-04-26T11:46:39.853 INFO:tasks.workunit.client.0.smithi029.stdout:1/734: dwrite d7/d25/d68/d4b/f6f [0,4194304] 0 2024-04-26T11:46:39.855 INFO:tasks.workunit.client.0.smithi029.stdout:3/563: link d0/dc/d1f/f6f d0/d1/d41/d5f/d54/fbf 0 2024-04-26T11:46:39.857 INFO:tasks.workunit.client.0.smithi029.stdout:1/735: rename d7/db/d10/la9 to d7/db/d10/d1e/l103 0 2024-04-26T11:46:39.857 INFO:tasks.workunit.client.0.smithi029.stdout:3/564: write d0/d1/d2b/d33/f66 [4939529,124188] 0 2024-04-26T11:46:39.858 INFO:tasks.workunit.client.0.smithi029.stdout:1/736: symlink d7/d25/dab/df1/l104 0 2024-04-26T11:46:39.858 INFO:tasks.workunit.client.0.smithi029.stdout:3/565: creat d0/d1/d41/d5f/d4d/d9d/fc0 x:0 0 0 2024-04-26T11:46:39.860 INFO:tasks.workunit.client.0.smithi029.stdout:4/644: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f82 [0,4194304] 0 2024-04-26T11:46:39.860 INFO:tasks.workunit.client.0.smithi029.stdout:3/566: write d0/d1/d41/d5f/d1a/f38 [346051,65203] 0 2024-04-26T11:46:39.860 INFO:tasks.workunit.client.0.smithi029.stdout:1/737: rename d7/db/d10/d20/l3b to d7/db/d10/d1e/d5e/l105 0 2024-04-26T11:46:39.862 INFO:tasks.workunit.client.0.smithi029.stdout:1/738: symlink d7/d25/d99/l106 0 2024-04-26T11:46:39.862 INFO:tasks.workunit.client.0.smithi029.stdout:4/645: write d3/d1d/d11/d16/d1f/d3d/f60 [3996075,11850] 0 2024-04-26T11:46:39.862 INFO:tasks.workunit.client.0.smithi029.stdout:9/614: sync 2024-04-26T11:46:39.862 INFO:tasks.workunit.client.0.smithi029.stdout:5/580: sync 2024-04-26T11:46:39.862 INFO:tasks.workunit.client.0.smithi029.stdout:8/557: sync 2024-04-26T11:46:39.862 INFO:tasks.workunit.client.0.smithi029.stdout:2/674: sync 2024-04-26T11:46:39.862 INFO:tasks.workunit.client.0.smithi029.stdout:6/648: sync 2024-04-26T11:46:39.863 INFO:tasks.workunit.client.0.smithi029.stdout:7/705: sync 2024-04-26T11:46:39.863 INFO:tasks.workunit.client.0.smithi029.stdout:0/608: sync 2024-04-26T11:46:39.863 INFO:tasks.workunit.client.0.smithi029.stdout:3/567: creat d0/d1/d2b/d7e/da3/fc1 x:0 0 0 2024-04-26T11:46:39.863 INFO:tasks.workunit.client.0.smithi029.stdout:4/646: mknod d3/d1d/d11/d16/d1f/ccc 1 2024-04-26T11:46:39.864 INFO:tasks.workunit.client.0.smithi029.stdout:5/581: readlink db/d40/d70/lb3 0 2024-04-26T11:46:39.864 INFO:tasks.workunit.client.0.smithi029.stdout:0/609: chown d9/fc 298 1 2024-04-26T11:46:39.865 INFO:tasks.workunit.client.0.smithi029.stdout:8/558: mkdir dc/d12/d6a/d78/dc3 0 2024-04-26T11:46:39.866 INFO:tasks.workunit.client.0.smithi029.stdout:3/568: fdatasync d0/d1/d41/d5f/d54/f58 0 2024-04-26T11:46:39.867 INFO:tasks.workunit.client.0.smithi029.stdout:9/615: getdents d4/d49/d58 0 2024-04-26T11:46:39.867 INFO:tasks.workunit.client.0.smithi029.stdout:7/706: dread d11/d18/d35/f96 [0,4194304] 0 2024-04-26T11:46:39.867 INFO:tasks.workunit.client.0.smithi029.stdout:1/739: unlink d7/d25/d68/d4b/d66/ld3 0 2024-04-26T11:46:39.868 INFO:tasks.workunit.client.0.smithi029.stdout:7/707: write f8 [5127626,93042] 0 2024-04-26T11:46:39.870 INFO:tasks.workunit.client.0.smithi029.stdout:9/616: mkdir d4/d5/d7a/dbd 0 2024-04-26T11:46:39.870 INFO:tasks.workunit.client.0.smithi029.stdout:0/610: rename d9/d16/d33/f44 to d9/d16/d25/d2a/d4b/dde/fe1 0 2024-04-26T11:46:39.870 INFO:tasks.workunit.client.0.smithi029.stdout:1/740: chown d7/db/d10/d1e/db2 197596 1 2024-04-26T11:46:39.870 INFO:tasks.workunit.client.0.smithi029.stdout:8/559: write dc/de/d2e/d23/d27/d6f/d9b/da2/fbb [3208861,9381] 0 2024-04-26T11:46:39.870 INFO:tasks.workunit.client.0.smithi029.stdout:3/569: chown d0/d1/d2b/d33/f8c 169160 1 2024-04-26T11:46:39.874 INFO:tasks.workunit.client.0.smithi029.stdout:0/611: write d9/d78/fcb [595660,22650] 0 2024-04-26T11:46:39.874 INFO:tasks.workunit.client.0.smithi029.stdout:2/675: write d12/d24/d29/f31 [3584582,12638] 0 2024-04-26T11:46:39.874 INFO:tasks.workunit.client.0.smithi029.stdout:4/647: truncate d3/f14 1247443 0 2024-04-26T11:46:39.875 INFO:tasks.workunit.client.0.smithi029.stdout:6/649: dwrite d7/d46/d69/f9d [0,4194304] 0 2024-04-26T11:46:39.875 INFO:tasks.workunit.client.0.smithi029.stdout:1/741: rename d7/l93 to d7/db/dcc/l107 0 2024-04-26T11:46:39.877 INFO:tasks.workunit.client.0.smithi029.stdout:8/560: write dc/de/d2e/d23/d27/d6f/d9b/f3c [541132,44341] 0 2024-04-26T11:46:39.877 INFO:tasks.workunit.client.0.smithi029.stdout:4/648: dread d3/fb8 [0,4194304] 0 2024-04-26T11:46:39.878 INFO:tasks.workunit.client.0.smithi029.stdout:3/570: read d0/d1/d2b/d33/f8c [1736798,62773] 0 2024-04-26T11:46:39.881 INFO:tasks.workunit.client.0.smithi029.stdout:0/612: getdents d9/d16/d33/d2f/d32/d9f/dac 0 2024-04-26T11:46:39.882 INFO:tasks.workunit.client.0.smithi029.stdout:4/649: chown d3/d1d/f3f 108 1 2024-04-26T11:46:39.883 INFO:tasks.workunit.client.0.smithi029.stdout:1/742: fsync d7/db/d10/d1e/d53/d9d/fbe 0 2024-04-26T11:46:39.886 INFO:tasks.workunit.client.0.smithi029.stdout:3/571: mkdir d0/d1/d2b/d7e/dc2 0 2024-04-26T11:46:39.886 INFO:tasks.workunit.client.0.smithi029.stdout:7/708: dwrite d11/d15/d79/da6/fe6 [0,4194304] 0 2024-04-26T11:46:39.886 INFO:tasks.workunit.client.0.smithi029.stdout:0/613: chown d9/f20 21626452 1 2024-04-26T11:46:39.886 INFO:tasks.workunit.client.0.smithi029.stdout:9/617: dwrite d4/d5/d16/d80/faa [0,4194304] 0 2024-04-26T11:46:39.886 INFO:tasks.workunit.client.0.smithi029.stdout:4/650: mknod d3/d1d/db/ccd 1 2024-04-26T11:46:39.887 INFO:tasks.workunit.client.0.smithi029.stdout:6/650: creat d7/d46/d69/da2/fdc x:0 0 0 2024-04-26T11:46:39.888 INFO:tasks.workunit.client.0.smithi029.stdout:2/676: dread d12/d24/d2f/f33 [0,4194304] 0 2024-04-26T11:46:39.888 INFO:tasks.workunit.client.0.smithi029.stdout:0/614: stat d9/d78/dc4 0 2024-04-26T11:46:39.889 INFO:tasks.workunit.client.0.smithi029.stdout:1/743: rmdir d7/db/d10/d1e/d82 0 2024-04-26T11:46:39.890 INFO:tasks.workunit.client.0.smithi029.stdout:3/572: write d0/d1/d41/d4c/f94 [1900853,63713] 0 2024-04-26T11:46:39.890 INFO:tasks.workunit.client.0.smithi029.stdout:5/582: dwrite db/d12/d72/f3d [0,4194304] 0 2024-04-26T11:46:39.891 INFO:tasks.workunit.client.0.smithi029.stdout:3/573: mkdir d0/d1/d2f/d82/dc3 0 2024-04-26T11:46:39.892 INFO:tasks.workunit.client.0.smithi029.stdout:8/561: read dc/de/d2e/d23/d27/d6f/f8a [2557622,47174] 0 2024-04-26T11:46:39.893 INFO:tasks.workunit.client.0.smithi029.stdout:3/574: fsync d0/d1/d2f/f86 0 2024-04-26T11:46:39.893 INFO:tasks.workunit.client.0.smithi029.stdout:4/651: chown d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f5e 35335239 1 2024-04-26T11:46:39.894 INFO:tasks.workunit.client.0.smithi029.stdout:1/744: rename d7/d25/dab/fc4 to d7/d25/d68/d4b/f108 0 2024-04-26T11:46:39.894 INFO:tasks.workunit.client.0.smithi029.stdout:4/652: write d3/f78 [641703,69564] 0 2024-04-26T11:46:39.894 INFO:tasks.workunit.client.0.smithi029.stdout:3/575: unlink d0/d1/d2f/f86 0 2024-04-26T11:46:39.894 INFO:tasks.workunit.client.0.smithi029.stdout:8/562: rmdir dc/de/d2e/d23/d27/d6f/d9b/d43/da1 39 2024-04-26T11:46:39.895 INFO:tasks.workunit.client.0.smithi029.stdout:7/709: link d11/d15/l54 d11/d18/d35/d39/d7e/lf0 0 2024-04-26T11:46:39.895 INFO:tasks.workunit.client.0.smithi029.stdout:1/745: chown d7/f36 2064371 1 2024-04-26T11:46:39.896 INFO:tasks.workunit.client.0.smithi029.stdout:1/746: mknod d7/db/d10/d20/c109 1 2024-04-26T11:46:39.896 INFO:tasks.workunit.client.0.smithi029.stdout:6/651: write d7/f11 [2291705,89312] 0 2024-04-26T11:46:39.897 INFO:tasks.workunit.client.0.smithi029.stdout:8/563: chown dc/de/d2e/d23/d27/d6f/l7e 2019203 1 2024-04-26T11:46:39.897 INFO:tasks.workunit.client.0.smithi029.stdout:8/564: dread - dc/d9f/fb8 zero size 2024-04-26T11:46:39.899 INFO:tasks.workunit.client.0.smithi029.stdout:2/677: dread d12/d24/fc8 [0,4194304] 0 2024-04-26T11:46:39.899 INFO:tasks.workunit.client.0.smithi029.stdout:1/747: write d7/d25/d99/fcb [1311176,83821] 0 2024-04-26T11:46:39.899 INFO:tasks.workunit.client.0.smithi029.stdout:6/652: creat d7/d46/d69/db4/fdd x:0 0 0 2024-04-26T11:46:39.899 INFO:tasks.workunit.client.0.smithi029.stdout:4/653: getdents d3/d1d/d11/d16/d1f 0 2024-04-26T11:46:39.901 INFO:tasks.workunit.client.0.smithi029.stdout:0/615: write d9/d16/f89 [296331,53843] 0 2024-04-26T11:46:39.901 INFO:tasks.workunit.client.0.smithi029.stdout:5/583: dwrite db/d12/d1a/fa8 [0,4194304] 0 2024-04-26T11:46:39.902 INFO:tasks.workunit.client.0.smithi029.stdout:6/653: fsync d7/d25/d5c/f51 0 2024-04-26T11:46:39.902 INFO:tasks.workunit.client.0.smithi029.stdout:7/710: dread d11/d18/d1a/d33/fa3 [0,4194304] 0 2024-04-26T11:46:39.902 INFO:tasks.workunit.client.0.smithi029.stdout:4/654: rmdir d3/d1d/d11/d16/d71 39 2024-04-26T11:46:39.902 INFO:tasks.workunit.client.0.smithi029.stdout:1/748: fdatasync d7/db/dc5/f101 0 2024-04-26T11:46:39.902 INFO:tasks.workunit.client.0.smithi029.stdout:6/654: fsync d7/d25/d4b/d4d/fdb 0 2024-04-26T11:46:39.903 INFO:tasks.workunit.client.0.smithi029.stdout:2/678: rename d12/d24/d29/d38/d52 to d12/d24/d29/d38/dea 0 2024-04-26T11:46:39.904 INFO:tasks.workunit.client.0.smithi029.stdout:8/565: write dc/de/d2e/d23/d27/d6f/d9b/d43/da1/f61 [709845,56370] 0 2024-04-26T11:46:39.904 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:39.900+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:39.904 INFO:tasks.workunit.client.0.smithi029.stdout:6/655: fsync d7/d25/d4b/d6d/f8e 0 2024-04-26T11:46:39.906 INFO:tasks.workunit.client.0.smithi029.stdout:0/616: read d9/f1d [656888,37453] 0 2024-04-26T11:46:39.907 INFO:tasks.workunit.client.0.smithi029.stdout:2/679: rmdir d12/d24/d29/d50 39 2024-04-26T11:46:39.907 INFO:tasks.workunit.client.0.smithi029.stdout:8/566: creat dc/de/d2e/d23/d27/d6f/d9b/d43/dad/fc4 x:0 0 0 2024-04-26T11:46:39.908 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:39.908 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:39.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.75278866, 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:39.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:39.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.914 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.752761931999999, 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:39.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:39.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:39.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:39.920 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.752730980999999, 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:39.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:39.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7507689639999997, 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:39.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.750743344, 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:39.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:39.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7506831500000004, 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:39.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.750656373, 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:39.940 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7506003249999997, 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:39.945 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:39.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:39.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:39.951 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7505603589999996, 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:39.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:39.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.750529749, 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:39.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:39.961 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7504552410000001, 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:39.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:39.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7503871760000003, 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:39.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:39.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.971 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7502870289999999, 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:39.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:332 3.2 3:4272d415:::200.0000000b:head [write 1522559~21066 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7408017359999999, 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042100678000000002, 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166237+0000", 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999971 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166309+0000", 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1858000000000002e-05 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166405+0000", 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6333000000000001e-05 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166451+0000", 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6529999999999997e-05 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204736+0000", 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.038284158999999998 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204876+0000", 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014074700000000001 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208177+0000", 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003301179 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208220+0000", 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2098000000000002e-05 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208340+0000", 2024-04-26T11:46:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120685 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:337 3.2 3:4272d415:::200.0000000b:head [write 1555976~2447 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7304628659999999, 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041570257999999999, 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176578+0000", 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176582+0000", 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8480000000000003e-06 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176587+0000", 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9570000000000001e-06 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176591+0000", 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2100000000000003e-06 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.209125+0000", 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032533714999999998 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.209208+0000", 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3633000000000004e-05 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.217980+0000", 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0087716340000000004 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.218039+0000", 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9021000000000003e-05 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.218149+0000", 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000109595 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7304379269999997, 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:39.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:39.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:39.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7303796279999997, 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:39.990 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.7283423689999999, 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:39.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:39.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:39.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:39.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1329842689999996, 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:40.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:40.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:11559 4.22 4:454f8e6e:::100000030e5.00000001:head [write 0~4194304 [3@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:36.972822+0000", 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.934219497, 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042020137999999999, 2024-04-26T11:46:40.005 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 11559 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.972822+0000", 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.972822+0000", 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.972819+0000", 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.976866+0000", 2024-04-26T11:46:40.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040466410000000001 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.976887+0000", 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.105e-05 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.976898+0000", 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0763e-05 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.976985+0000", 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7088000000000004e-05 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.977111+0000", 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012639199999999999 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.977245+0000", 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133473 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.995855+0000", 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018610646000000002 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:37.014730+0000", 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018874526999999999 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:37.014772+0000", 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2033999999999998e-05 2024-04-26T11:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:40.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:37.014842+0000", 2024-04-26T11:46:40.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0010000000000002e-05 2024-04-26T11:46:40.011 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.011 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:40.011 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.011 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.011 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:40.011 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:40.013 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:40.009+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:40.014 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:40.032 INFO:tasks.workunit.client.0.smithi029.stdout:1/749: getdents d7/d25/d68/d4b 0 2024-04-26T11:46:40.032 INFO:tasks.workunit.client.0.smithi029.stdout:2/680: creat d12/d24/d2f/feb x:0 0 0 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:2/681: stat d12/f16 0 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:1/750: write d7/db/d8d/dc7/fe3 [566854,57276] 0 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:6/656: dread d7/d25/d5c/f1e [0,4194304] 0 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:1/751: rmdir d7/db/dc5 39 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:5/584: dwrite db/d12/d6b/f83 [0,4194304] 0 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:7/711: dwrite d11/d18/d35/fdc [0,4194304] 0 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:8/567: truncate dc/de/d2e/d23/d27/d6f/d9b/fb5 797939 0 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:6/657: chown d7/d46/d69/da2/d4c/d98/l7c 3 1 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:5/585: unlink db/d40/f84 0 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:1/752: symlink d7/d25/l10a 0 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:1/753: sync 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:7/712: unlink d11/d18/d2d/fae 0 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:6/658: fdatasync d7/d25/d4b/d6d/f95 0 2024-04-26T11:46:40.033 INFO:tasks.workunit.client.0.smithi029.stdout:1/754: fsync d7/d25/d68/f79 0 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:8/568: mkdir dc/de/d2e/d23/d27/dc5 0 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:6/659: symlink d7/d25/d4b/d6d/lde 0 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:7/713: creat d11/d18/d58/d8d/dc3/ff1 x:0 0 0 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:4/655: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f82 [0,4194304] 0 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:1/755: dread - d7/db/d10/d20/fda zero size 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:4/656: rmdir d3/d1d/d11/d16/d1f 39 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:1/756: dread - d7/db/d8d/fe2 zero size 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/682: dread d12/d6c/d73/d4f/d65/d6f/f77 [0,4194304] 0 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/683: sync 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:8/569: dwrite dc/f66 [0,4194304] 0 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/684: mkdir d12/d6c/d73/dbd/dec 0 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:5/586: rename db/d40/d4d/d79/fa9 to db/d12/d1a/d4c/fb5 0 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:1/757: truncate d7/d25/f2e 674933 0 2024-04-26T11:46:40.034 INFO:tasks.workunit.client.0.smithi029.stdout:0/617: dread d9/d16/d52/f45 [4194304,4194304] 0 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/570: rmdir dc/de/d26 39 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:5/587: stat db/d12/d72/d92 0 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:5/588: unlink db/lab 0 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:2/685: write d12/d6c/d73/d4f/d65/d6f/f77 [1797036,80874] 0 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/571: chown dc/d12/faf 31482422 1 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:2/686: dread - d12/d24/fa9 zero size 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:0/618: getdents d9/d16/d25/d2a/d74/d9a 0 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:0/619: fdatasync d9/f36 0 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/572: read - dc/de/d2e/d23/d27/d6f/d9b/da2/fb4 zero size 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:2/687: chown d12/f19 7453468 1 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/573: creat dc/d9f/db2/fc6 x:0 0 0 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:0/620: dread - d9/d16/d25/d2a/d74/d9a/faf zero size 2024-04-26T11:46:40.035 INFO:tasks.workunit.client.0.smithi029.stdout:2/688: creat d12/d24/d29/d50/d6a/dd1/fed x:0 0 0 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:0/621: write d9/f84 [85226,46599] 0 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:0/622: fsync d9/d16/d25/d2a/d4b/fb6 0 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:6/660: dread d7/d46/d69/da2/d4c/d98/f81 [0,4194304] 0 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:8/574: dread dc/de/d2e/d23/d27/d6f/d9b/fb5 [0,4194304] 0 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:5/589: read db/d12/d1a/f18 [2221540,29758] 0 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:1/758: dread f2 [0,4194304] 0 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:5/590: chown db/d40/d4d 845785 1 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:0/623: creat d9/d16/d52/fe2 x:0 0 0 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:6/661: rename d7 to d7/d46/d69/da2/d4c/d98/ddf 22 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:8/575: symlink dc/de/d2e/d23/d27/d6f/d9b/d43/lc7 0 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:0/624: rmdir d9/d16/d25/d2a/d4b/dde 39 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:9/618: dread d4/d5/d7a/da1/fb6 [0,4194304] 0 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:1/759: write d7/db/d10/d1e/ff9 [441038,32005] 0 2024-04-26T11:46:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:9/619: readlink d4/d5/d7a/l90 0 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:2/689: dwrite d12/d24/d29/d36/fe8 [0,4194304] 0 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:8/576: readlink dc/de/d26/d57/d86/l8c 0 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:7/714: truncate d11/dd3/de4/f7a 618219 0 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:1/760: dread - d7/db/dc5/dd5/fe8 zero size 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:1/761: sync 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:7/715: readlink d11/d18/d1a/d33/ld5 0 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:9/620: link d4/d5/d7/f47 d4/d49/d58/d67/dab/fbe 0 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:0/625: rename d9/d16/d8d/dca to d9/d16/d33/d2f/de3 0 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:8/577: mkdir dc/de/d2e/d23/d27/d6f/dc8 0 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:3/576: dread d0/d1/d41/f42 [0,4194304] 0 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:1/762: symlink d7/db/d10/d1e/db2/l10b 0 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:8/578: stat dc/de/d2e/d23/d27/l5e 0 2024-04-26T11:46:40.037 INFO:tasks.workunit.client.0.smithi029.stdout:7/716: creat d11/d18/d35/ff2 x:0 0 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:9/621: getdents d4/d5 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:7/717: rmdir d11/d37 39 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:8/579: write dc/d12/d6a/f77 [637061,56877] 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:5/591: dwrite db/d12/d72/d39/f41 [0,4194304] 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:9/622: unlink d4/d5/d16/d39/l8d 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:7/718: symlink d11/d18/d1a/d33/lf3 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:8/580: symlink dc/d12/d6a/daa/lc9 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:9/623: creat d4/d5/d7a/dbd/fbf x:0 0 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:5/592: write db/d12/d72/d39/f41 [2885080,37601] 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:8/581: stat dc/d3b/f41 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:6/662: dwrite d7/d25/d5c/f1e [0,4194304] 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:3/577: dwrite d0/d1/d2b/d33/f51 [0,4194304] 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:1/763: dwrite d7/d25/d68/d4b/d66/f90 [0,4194304] 0 2024-04-26T11:46:40.038 INFO:tasks.workunit.client.0.smithi029.stdout:6/663: read - d7/d25/d4b/d4d/d65/f89 zero size 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/764: fdatasync d7/db/d8d/faf 0 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:5/593: chown db/d12/d1a/f6f 1625 1 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:0/626: dwrite d9/d16/d33/d2f/d68/f79 [0,4194304] 0 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:4/657: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f6a [0,4194304] 0 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:3/578: truncate d0/d1/d2b/d33/fa1 906554 0 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:5/594: write db/d12/d1a/f6f [879909,50984] 0 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:8/582: rename dc/de/d2e/d23/d27/d6f/d9b/d43/dad/fc4 to dc/de/d2e/d23/d27/dc5/fca 0 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:4/658: truncate d3/d1d/da0/fa5 914156 0 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:8/583: chown dc/d12/d6a/l38 7321 1 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/765: link d7/db/d10/d1e/d53/f7a d7/db/d10/d1e/db2/f10c 0 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:3/579: getdents d0/dc 0 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:8/584: rename dc/d75/f79 to dc/de/fcb 0 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:9/624: dwrite d4/f6f [0,4194304] 0 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:3/580: rmdir d0/dc 39 2024-04-26T11:46:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/766: chown d7/db/d8d/lc9 797 1 2024-04-26T11:46:40.040 INFO:tasks.workunit.client.0.smithi029.stdout:9/625: chown d4/d5/d16 52566877 1 2024-04-26T11:46:40.040 INFO:tasks.workunit.client.0.smithi029.stdout:8/585: mknod dc/de/d2e/ccc 1 2024-04-26T11:46:40.040 INFO:tasks.workunit.client.0.smithi029.stdout:1/767: mknod d7/d25/c10d 1 2024-04-26T11:46:40.040 INFO:tasks.workunit.client.0.smithi029.stdout:6/664: dread d7/d46/d69/f9d [0,4194304] 0 2024-04-26T11:46:40.040 INFO:tasks.workunit.client.0.smithi029.stdout:9/626: mkdir d4/d5/da3/dc0 0 2024-04-26T11:46:40.040 INFO:tasks.workunit.client.0.smithi029.stdout:4/659: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/fce x:0 0 0 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:7/719: sync 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:3/581: sync 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:1/768: symlink d7/d25/l10e 0 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:3/582: readlink d0/d1/d41/l8e 0 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:9/627: rename d4/l12 to d4/d5/d16/d39/lc1 0 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:8/586: symlink dc/de/d2e/d23/d27/dc5/lcd 0 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:3/583: mknod d0/d1/d2b/d7e/cc4 1 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:6/665: creat d7/d46/d69/da2/d4c/d98/d45/d83/da9/fe0 x:0 0 0 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:4/660: write d3/d1d/db/d13/d23/d2b/d9d/fc5 [3798535,71183] 0 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:3/584: creat d0/d1/d2f/d82/fc5 x:0 0 0 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:8/587: creat dc/d12/d6a/fce x:0 0 0 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:7/720: link d11/d18/d35/d39/d7e/dde/f5a d11/d18/d35/dbf/ff4 0 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:6/666: write d7/d46/d69/da2/d4c/d98/f3d [521247,44055] 0 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:7/721: chown d11/f13 2616225 1 2024-04-26T11:46:40.041 INFO:tasks.workunit.client.0.smithi029.stdout:4/661: link d3/d1d/da0/fad d3/d1d/d11/d16/d1f/d3d/fcf 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:7/722: fsync d11/d18/d1a/d26/f2c 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:4/662: mknod d3/d1d/cd0 1 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:6/667: creat d7/d25/d4b/d4d/d65/fe1 x:0 0 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:3/585: rename d0/dc/faf to d0/d1/d41/d5f/d1a/d3b/db5/fc6 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:1/769: dwrite d7/db/d10/d1e/d53/f6c [0,4194304] 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:7/723: creat d11/d18/d35/d7c/ff5 x:0 0 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:6/668: creat d7/d46/d69/da2/d4c/d98/d45/fe2 x:0 0 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:3/586: mkdir d0/d1/d2f/d82/dc3/dc7 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:2/690: dread d12/f19 [0,4194304] 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:3/587: mknod d0/dc/d80/cc8 1 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:7/724: link d11/l62 d11/d18/d35/d39/d7e/da2/lf6 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:3/588: write d0/d1/d41/d5f/d54/fb6 [75791,64420] 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:6/669: dread d7/d46/d69/da2/d4c/f68 [0,4194304] 0 2024-04-26T11:46:40.042 INFO:tasks.workunit.client.0.smithi029.stdout:2/691: mkdir d12/d6c/d73/d40/ddd/dee 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:4/663: dwrite d3/d1d/f3f [0,4194304] 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:2/692: write f7 [132582,126574] 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:3/589: symlink d0/lc9 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:1/770: getdents d7/d25/dab/df1 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:3/590: readlink d0/d1/d41/d4c/l8a 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:9/628: truncate d4/d49/d58/f91 2011707 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:6/670: mkdir d7/d25/d4b/d6d/de3 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:6/671: readlink d7/d20/lc6 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:1/771: mkdir d7/db/d10/d1e/d5e/d10f 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:8/588: dread dc/d12/d6a/f4c [0,4194304] 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:6/672: symlink d7/d25/d5c/le4 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:1/772: fsync d7/db/d8d/faf 0 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:9/629: chown d4/d5/d7/f59 24 1 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:6/673: mknod d7/d97/ce5 1 2024-04-26T11:46:40.043 INFO:tasks.workunit.client.0.smithi029.stdout:7/725: dwrite d11/d18/d58/d8d/fbe [0,4194304] 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:2/693: dwrite d12/f1c [0,4194304] 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:3/591: write d0/f52 [1017293,81960] 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:8/589: mkdir dc/d12/d6a/d78/dc3/dcf 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:5/595: dread db/d12/f1b [0,4194304] 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:1/773: mknod d7/db/d10/d1e/d5e/c110 1 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:6/674: write d7/d25/d5c/f51 [798438,32932] 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:9/630: rename d4/d5/da3 to d4/d5/d16/d80/dc2 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:7/726: chown d11/d18/f40 415519383 1 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:2/694: mkdir d12/d24/d29/d57/def 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:4/664: dwrite d3/d1d/db/d13/d73/f8e [0,4194304] 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:8/590: mkdir dc/de/dd0 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:6/675: creat d7/d97/fe6 x:0 0 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:2/695: fdatasync d12/faf 0 2024-04-26T11:46:40.044 INFO:tasks.workunit.client.0.smithi029.stdout:7/727: write d11/d18/d35/d7c/ff5 [222077,8552] 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:1/774: rename d7/d25/d68/d4b/f108 to d7/db/dcc/deb/f111 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:6/676: creat d7/d97/fe7 x:0 0 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:3/592: creat d0/d1/d2f/d82/dc3/dc7/fca x:0 0 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:3/593: write d0/f52 [6175,13403] 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:7/728: write d11/d18/d35/d7c/ff5 [3160,124883] 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:3/594: fdatasync d0/d1/d2f/fb2 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:1/775: mkdir d7/db/d10/d1e/d5e/d10f/d112 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:4/665: rename d3/d1d/d11/d16/d1f/d3d/l3e to d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/ld1 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:2/696: dread d12/d24/d2f/f44 [0,4194304] 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:7/729: link d11/d18/d2d/f77 d11/d15/d67/ff7 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:5/596: dread db/d12/d1a/f68 [0,4194304] 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:1/776: symlink d7/d25/dab/l113 0 2024-04-26T11:46:40.045 INFO:tasks.workunit.client.0.smithi029.stdout:5/597: mknod db/d40/d70/cb6 1 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:4/666: truncate d3/d50/d7a/faf 538974 0 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:7/730: write d11/d18/d1a/fef [117747,19919] 0 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:8/591: dwrite dc/d9f/db2/fc6 [0,4194304] 0 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:0/627: dread d9/f84 [0,4194304] 0 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:5/598: stat db/d12/d72/f3d 0 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:2/697: creat d12/de3/ff0 x:0 0 0 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:1/777: creat d7/d25/d6d/d8c/df0/f114 x:0 0 0 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:7/731: creat d11/d18/d35/dbf/ff8 x:0 0 0 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:0/628: mknod d9/d16/d33/d2f/d31/ce4 1 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:5/599: symlink db/d12/d72/d92/lb7 0 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:1/778: mknod d7/c115 1 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:4/667: write d3/d1d/d11/d16/d1f/d3d/d46/fbf [1672635,118987] 0 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:8/592: mkdir dc/de/d26/d57/dd1 0 2024-04-26T11:46:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:5/600: stat db/d12/d72/d39/faf 0 2024-04-26T11:46:40.047 INFO:tasks.workunit.client.0.smithi029.stdout:0/629: creat d9/d16/d33/fe5 x:0 0 0 2024-04-26T11:46:40.047 INFO:tasks.workunit.client.0.smithi029.stdout:2/698: rename d12/f28 to d12/d6c/d73/ff1 0 2024-04-26T11:46:40.047 INFO:tasks.workunit.client.0.smithi029.stdout:1/779: rmdir d7/db/d10/d1e/db2/dee 39 2024-04-26T11:46:40.049 INFO:tasks.workunit.client.0.smithi029.stdout:7/732: rename fc to d11/d18/d35/d39/d7e/ff9 0 2024-04-26T11:46:40.049 INFO:tasks.workunit.client.0.smithi029.stdout:0/630: mkdir d9/d16/d33/d2f/d32/d9f/de6 0 2024-04-26T11:46:40.049 INFO:tasks.workunit.client.0.smithi029.stdout:4/668: stat d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/ld1 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:2/699: readlink d12/d24/d29/d50/lb0 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:7/733: fsync d11/d18/f29 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:9/631: creat d4/d5/d16/d80/fc3 x:0 0 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:2/700: unlink d12/d24/d29/db2/fcf 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:5/601: rename db/d40/l43 to db/d40/d4d/lb8 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:0/631: getdents d9/d16/d25/d2a/d4b/dd9 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:1/780: creat d7/db/d10/d1e/db2/dee/f116 x:0 0 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:9/632: rmdir d4/d5/d7 39 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:4/669: dread d3/f78 [0,4194304] 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:6/677: dwrite d7/d46/d69/da2/d4c/d98/fc9 [0,4194304] 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:5/602: fsync db/d12/d1a/d4c/f8b 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:3/595: dwrite d0/dc/f89 [0,4194304] 0 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:5/603: chown db/d12 29 1 2024-04-26T11:46:40.050 INFO:tasks.workunit.client.0.smithi029.stdout:4/670: mknod d3/d1d/d11/cd2 1 2024-04-26T11:46:40.051 INFO:tasks.workunit.client.0.smithi029.stdout:9/633: fdatasync d4/d5/f45 0 2024-04-26T11:46:40.051 INFO:tasks.workunit.client.0.smithi029.stdout:6/678: mknod d7/d46/d69/da2/d4c/d98/d45/d83/ce8 1 2024-04-26T11:46:40.051 INFO:tasks.workunit.client.0.smithi029.stdout:0/632: rename d9/d16/d33/d2f/d32/dd2 to d9/d16/de7 0 2024-04-26T11:46:40.051 INFO:tasks.workunit.client.0.smithi029.stdout:5/604: write db/d12/d1a/fa8 [2425396,74972] 0 2024-04-26T11:46:40.051 INFO:tasks.workunit.client.0.smithi029.stdout:5/605: fdatasync db/d12/d6b/f83 0 2024-04-26T11:46:40.051 INFO:tasks.workunit.client.0.smithi029.stdout:3/596: write d0/d1/d41/d5f/d1a/d3b/fa5 [593576,55573] 0 2024-04-26T11:46:40.051 INFO:tasks.workunit.client.0.smithi029.stdout:1/781: rename d7/db/d10/d1e/db2/dee/d3e/ld9 to d7/db/dc5/dd5/l117 0 2024-04-26T11:46:40.051 INFO:tasks.workunit.client.0.smithi029.stdout:2/701: dwrite d12/d24/d2f/feb [0,4194304] 0 2024-04-26T11:46:40.052 INFO:tasks.workunit.client.0.smithi029.stdout:3/597: write d0/d1/d2b/da7/dad/f14 [98554,121317] 0 2024-04-26T11:46:40.052 INFO:tasks.workunit.client.0.smithi029.stdout:6/679: dread d7/fd4 [0,4194304] 0 2024-04-26T11:46:40.054 INFO:tasks.workunit.client.0.smithi029.stdout:6/680: truncate d7/d46/d69/db4/fcd 561592 0 2024-04-26T11:46:40.054 INFO:tasks.workunit.client.0.smithi029.stdout:4/671: rename d3/d1d/d11/d16/d1f/d3d/d46/f90 to d3/d1d/db/d13/d23/fd3 0 2024-04-26T11:46:40.055 INFO:tasks.workunit.client.0.smithi029.stdout:0/633: write d9/d16/d33/f35 [2122603,20457] 0 2024-04-26T11:46:40.055 INFO:tasks.workunit.client.0.smithi029.stdout:9/634: dwrite d4/d49/d58/f6d [0,4194304] 0 2024-04-26T11:46:40.056 INFO:tasks.workunit.client.0.smithi029.stdout:1/782: getdents d7/d25/d85 0 2024-04-26T11:46:40.057 INFO:tasks.workunit.client.0.smithi029.stdout:4/672: chown d3/d1d/d11/d16/d1f/d3d/d46/f93 1665739 1 2024-04-26T11:46:40.057 INFO:tasks.workunit.client.0.smithi029.stdout:6/681: truncate d7/d97/fa5 815791 0 2024-04-26T11:46:40.057 INFO:tasks.workunit.client.0.smithi029.stdout:1/783: mknod d7/db/dcc/deb/c118 1 2024-04-26T11:46:40.058 INFO:tasks.workunit.client.0.smithi029.stdout:6/682: write d7/fd3 [26605,24462] 0 2024-04-26T11:46:40.058 INFO:tasks.workunit.client.0.smithi029.stdout:7/734: sync 2024-04-26T11:46:40.058 INFO:tasks.workunit.client.0.smithi029.stdout:4/673: mknod d3/d1d/d11/d16/d1f/d3d/cd4 1 2024-04-26T11:46:40.059 INFO:tasks.workunit.client.0.smithi029.stdout:1/784: mkdir d7/d25/d6d/d119 0 2024-04-26T11:46:40.059 INFO:tasks.workunit.client.0.smithi029.stdout:7/735: chown f8 12244 1 2024-04-26T11:46:40.059 INFO:tasks.workunit.client.0.smithi029.stdout:6/683: link d7/d97/fe6 d7/d46/d69/db4/fe9 0 2024-04-26T11:46:40.060 INFO:tasks.workunit.client.0.smithi029.stdout:1/785: rename d7/d25/d99 to d7/db/d8d/d11a 0 2024-04-26T11:46:40.060 INFO:tasks.workunit.client.0.smithi029.stdout:7/736: creat d11/d18/d1a/d26/ffa x:0 0 0 2024-04-26T11:46:40.060 INFO:tasks.workunit.client.0.smithi029.stdout:4/674: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84/f8b [426367,24458] 0 2024-04-26T11:46:40.060 INFO:tasks.workunit.client.0.smithi029.stdout:3/598: dread d0/d1/d2b/d33/f74 [0,4194304] 0 2024-04-26T11:46:40.061 INFO:tasks.workunit.client.0.smithi029.stdout:6/684: creat d7/d20/fea x:0 0 0 2024-04-26T11:46:40.062 INFO:tasks.workunit.client.0.smithi029.stdout:3/599: mkdir d0/d1/d2b/d33/dcb 0 2024-04-26T11:46:40.063 INFO:tasks.workunit.client.0.smithi029.stdout:4/675: link d3/d1d/f29 d3/d1d/da0/fd5 0 2024-04-26T11:46:40.063 INFO:tasks.workunit.client.0.smithi029.stdout:1/786: write d7/db/d10/d1e/db2/fbc [300359,17881] 0 2024-04-26T11:46:40.063 INFO:tasks.workunit.client.0.smithi029.stdout:7/737: fsync d11/d18/d1a/d26/f45 0 2024-04-26T11:46:40.064 INFO:tasks.workunit.client.0.smithi029.stdout:2/702: truncate d12/d24/d29/d57/f89 3982066 0 2024-04-26T11:46:40.064 INFO:tasks.workunit.client.0.smithi029.stdout:6/685: chown d7/d25/d5c/l8f 186949993 1 2024-04-26T11:46:40.068 INFO:tasks.workunit.client.0.smithi029.stdout:3/600: creat d0/d1/d41/d5f/d4d/d9d/fcc x:0 0 0 2024-04-26T11:46:40.068 INFO:tasks.workunit.client.0.smithi029.stdout:4/676: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/fd6 x:0 0 0 2024-04-26T11:46:40.068 INFO:tasks.workunit.client.0.smithi029.stdout:7/738: read - d11/d18/d35/dbf/ff8 zero size 2024-04-26T11:46:40.069 INFO:tasks.workunit.client.0.smithi029.stdout:6/686: truncate d7/d25/d4b/fac 760233 0 2024-04-26T11:46:40.069 INFO:tasks.workunit.client.0.smithi029.stdout:5/606: dwrite db/d12/f1b [0,4194304] 0 2024-04-26T11:46:40.069 INFO:tasks.workunit.client.0.smithi029.stdout:9/635: dwrite d4/d5/d7/d74/fa2 [0,4194304] 0 2024-04-26T11:46:40.069 INFO:tasks.workunit.client.0.smithi029.stdout:3/601: mknod d0/dc/d80/ccd 1 2024-04-26T11:46:40.071 INFO:tasks.workunit.client.0.smithi029.stdout:2/703: link d12/d24/d2f/f4e d12/d6c/d73/d4f/d65/d99/ff2 0 2024-04-26T11:46:40.071 INFO:tasks.workunit.client.0.smithi029.stdout:3/602: mkdir d0/d1/d2f/d82/dce 0 2024-04-26T11:46:40.072 INFO:tasks.workunit.client.0.smithi029.stdout:4/677: symlink d3/d1d/d11/d16/d71/ld7 0 2024-04-26T11:46:40.073 INFO:tasks.workunit.client.0.smithi029.stdout:7/739: stat d11/d18/d58/d8d/fbe 0 2024-04-26T11:46:40.074 INFO:tasks.workunit.client.0.smithi029.stdout:2/704: mknod d12/d24/d29/d50/d55/cf3 1 2024-04-26T11:46:40.075 INFO:tasks.workunit.client.0.smithi029.stdout:1/787: dwrite d7/f1c [0,4194304] 0 2024-04-26T11:46:40.076 INFO:tasks.workunit.client.0.smithi029.stdout:3/603: dread - d0/d1/d2f/d82/dc3/dc7/fca zero size 2024-04-26T11:46:40.076 INFO:tasks.workunit.client.0.smithi029.stdout:2/705: stat d12/d6c/d73/d40/lc2 0 2024-04-26T11:46:40.076 INFO:tasks.workunit.client.0.smithi029.stdout:7/740: dread d11/d18/d1a/d33/fa3 [0,4194304] 0 2024-04-26T11:46:40.078 INFO:tasks.workunit.client.0.smithi029.stdout:2/706: stat d12/d6c/d73/d4f/d65/d6f 0 2024-04-26T11:46:40.078 INFO:tasks.workunit.client.0.smithi029.stdout:7/741: stat d11/d15/d79/fd1 0 2024-04-26T11:46:40.078 INFO:tasks.workunit.client.0.smithi029.stdout:3/604: creat d0/d1/d2f/d82/dce/fcf x:0 0 0 2024-04-26T11:46:40.079 INFO:tasks.workunit.client.0.smithi029.stdout:3/605: write d0/f1b [1010660,88331] 0 2024-04-26T11:46:40.079 INFO:tasks.workunit.client.0.smithi029.stdout:7/742: unlink d11/d18/d2d/f8c 0 2024-04-26T11:46:40.080 INFO:tasks.workunit.client.0.smithi029.stdout:6/687: dwrite d7/d46/d69/da2/f38 [0,4194304] 0 2024-04-26T11:46:40.080 INFO:tasks.workunit.client.0.smithi029.stdout:2/707: creat d12/ff4 x:0 0 0 2024-04-26T11:46:40.081 INFO:tasks.workunit.client.0.smithi029.stdout:3/606: stat d0/d1/d2b/d33/f8b 0 2024-04-26T11:46:40.083 INFO:tasks.workunit.client.0.smithi029.stdout:1/788: sync 2024-04-26T11:46:40.083 INFO:tasks.workunit.client.0.smithi029.stdout:6/688: mkdir d7/d46/d69/da2/deb 0 2024-04-26T11:46:40.083 INFO:tasks.workunit.client.0.smithi029.stdout:7/743: getdents d11/d18/d35/d39 0 2024-04-26T11:46:40.084 INFO:tasks.workunit.client.0.smithi029.stdout:1/789: dread - d7/db/d10/d1e/db2/fe7 zero size 2024-04-26T11:46:40.084 INFO:tasks.workunit.client.0.smithi029.stdout:2/708: getdents d12/d24/d29/d50/d6a/dd1 0 2024-04-26T11:46:40.084 INFO:tasks.workunit.client.0.smithi029.stdout:6/689: fdatasync d7/d25/d4b/d4d/d65/fba 0 2024-04-26T11:46:40.085 INFO:tasks.workunit.client.0.smithi029.stdout:4/678: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f6a [4194304,4194304] 0 2024-04-26T11:46:40.085 INFO:tasks.workunit.client.0.smithi029.stdout:8/593: dread dc/de/d2e/d23/d27/d6f/d9b/f45 [0,4194304] 0 2024-04-26T11:46:40.085 INFO:tasks.workunit.client.0.smithi029.stdout:2/709: stat d12/d6c/d73/d4f/d65/d81/fce 0 2024-04-26T11:46:40.086 INFO:tasks.workunit.client.0.smithi029.stdout:6/690: chown d7/d25/d4b/d4d/d65/f8c 24 1 2024-04-26T11:46:40.087 INFO:tasks.workunit.client.0.smithi029.stdout:4/679: read - d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/fce zero size 2024-04-26T11:46:40.088 INFO:tasks.workunit.client.0.smithi029.stdout:2/710: symlink d12/d6c/d70/lf5 0 2024-04-26T11:46:40.088 INFO:tasks.workunit.client.0.smithi029.stdout:8/594: mkdir dc/d3b/dd2 0 2024-04-26T11:46:40.088 INFO:tasks.workunit.client.0.smithi029.stdout:6/691: symlink d7/d46/d69/db4/lec 0 2024-04-26T11:46:40.092 INFO:tasks.workunit.client.0.smithi029.stdout:6/692: write d7/d46/d69/da2/d4c/d98/fc5 [53341,44322] 0 2024-04-26T11:46:40.093 INFO:tasks.workunit.client.0.smithi029.stdout:2/711: fdatasync d12/d24/d29/d36/f88 0 2024-04-26T11:46:40.096 INFO:tasks.workunit.client.0.smithi029.stdout:7/744: dwrite d11/d18/d1a/d33/f75 [4194304,4194304] 0 2024-04-26T11:46:40.097 INFO:tasks.workunit.client.0.smithi029.stdout:0/634: dread d9/d16/d25/f34 [0,4194304] 0 2024-04-26T11:46:40.097 INFO:tasks.workunit.client.0.smithi029.stdout:0/635: sync 2024-04-26T11:46:40.098 INFO:tasks.workunit.client.0.smithi029.stdout:8/595: dwrite dc/f93 [4194304,4194304] 0 2024-04-26T11:46:40.098 INFO:tasks.workunit.client.0.smithi029.stdout:7/745: getdents d11/d18/d1a/dab 0 2024-04-26T11:46:40.104 INFO:tasks.workunit.client.0.smithi029.stdout:8/596: creat dc/de/d2e/d23/d27/fd3 x:0 0 0 2024-04-26T11:46:40.104 INFO:tasks.workunit.client.0.smithi029.stdout:1/790: dwrite d7/db/d10/d1e/db2/f10c [0,4194304] 0 2024-04-26T11:46:40.106 INFO:tasks.workunit.client.0.smithi029.stdout:8/597: symlink dc/de/d2e/d23/ld4 0 2024-04-26T11:46:40.107 INFO:tasks.workunit.client.0.smithi029.stdout:9/636: fdatasync d4/d5/d7/d74/fa2 0 2024-04-26T11:46:40.109 INFO:tasks.workunit.client.0.smithi029.stdout:6/693: dwrite d7/d46/d69/da2/d4c/d98/f3d [0,4194304] 0 2024-04-26T11:46:40.111 INFO:tasks.workunit.client.0.smithi029.stdout:0/636: dwrite d9/d78/dc4/fd3 [0,4194304] 0 2024-04-26T11:46:40.113 INFO:tasks.workunit.client.0.smithi029.stdout:7/746: write d11/d18/d1a/f31 [178833,15667] 0 2024-04-26T11:46:40.113 INFO:tasks.workunit.client.0.smithi029.stdout:8/598: stat dc/de/d26/f32 0 2024-04-26T11:46:40.113 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:40.108+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:40.114 INFO:tasks.workunit.client.0.smithi029.stdout:6/694: mkdir d7/d46/d69/da2/dc8/ded 0 2024-04-26T11:46:40.115 INFO:tasks.workunit.client.0.smithi029.stdout:5/607: dread db/f20 [0,4194304] 0 2024-04-26T11:46:40.115 INFO:tasks.workunit.client.0.smithi029.stdout:7/747: unlink d11/d15/la1 0 2024-04-26T11:46:40.116 INFO:tasks.workunit.client.0.smithi029.stdout:0/637: creat d9/d16/d25/d2a/d4b/fe8 x:0 0 0 2024-04-26T11:46:40.117 INFO:tasks.workunit.client.0.smithi029.stdout:1/791: dwrite d7/d25/d68/fc0 [0,4194304] 0 2024-04-26T11:46:40.118 INFO:tasks.workunit.client.0.smithi029.stdout:9/637: dwrite d4/d49/d58/d67/fb7 [0,4194304] 0 2024-04-26T11:46:40.119 INFO:tasks.workunit.client.0.smithi029.stdout:8/599: mknod dc/de/d2e/d23/d27/d6f/d9b/d43/dad/cd5 1 2024-04-26T11:46:40.119 INFO:tasks.workunit.client.0.smithi029.stdout:5/608: creat db/d40/d4d/d4f/fb9 x:0 0 0 2024-04-26T11:46:40.119 INFO:tasks.workunit.client.0.smithi029.stdout:1/792: chown d7/db/dc5/f101 597353963 1 2024-04-26T11:46:40.120 INFO:tasks.workunit.client.0.smithi029.stdout:9/638: creat d4/d5/d16/d80/dc2/fc4 x:0 0 0 2024-04-26T11:46:40.120 INFO:tasks.workunit.client.0.smithi029.stdout:1/793: mknod d7/db/dcc/c11b 1 2024-04-26T11:46:40.122 INFO:tasks.workunit.client.0.smithi029.stdout:2/712: dread d12/d24/d29/d38/dea/fc3 [0,4194304] 0 2024-04-26T11:46:40.122 INFO:tasks.workunit.client.0.smithi029.stdout:0/638: mkdir d9/d16/d25/d2a/d74/de9 0 2024-04-26T11:46:40.123 INFO:tasks.workunit.client.0.smithi029.stdout:8/600: rename dc/d75/fba to dc/de/d2e/d23/d27/d6f/d9b/da2/fd6 0 2024-04-26T11:46:40.123 INFO:tasks.workunit.client.0.smithi029.stdout:9/639: chown d4/d5/d16/d80/dc2/fb5 1059103219 1 2024-04-26T11:46:40.123 INFO:tasks.workunit.client.0.smithi029.stdout:1/794: rename d7/db/dcc/lea to d7/db/dcc/l11c 0 2024-04-26T11:46:40.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/713: dread - d12/d6c/f72 zero size 2024-04-26T11:46:40.124 INFO:tasks.workunit.client.0.smithi029.stdout:9/640: dread - d4/d5/d16/d80/f92 zero size 2024-04-26T11:46:40.125 INFO:tasks.workunit.client.0.smithi029.stdout:8/601: symlink dc/d12/d7c/ld7 0 2024-04-26T11:46:40.127 INFO:tasks.workunit.client.0.smithi029.stdout:0/639: stat d9/d16/d33/d2f/d32/d90/l97 0 2024-04-26T11:46:40.128 INFO:tasks.workunit.client.0.smithi029.stdout:1/795: symlink d7/d25/d6d/d8c/l11d 0 2024-04-26T11:46:40.128 INFO:tasks.workunit.client.0.smithi029.stdout:8/602: mknod dc/de/d26/d57/d86/cd8 1 2024-04-26T11:46:40.128 INFO:tasks.workunit.client.0.smithi029.stdout:2/714: mknod d12/d24/d29/d50/d55/d5f/cf6 1 2024-04-26T11:46:40.128 INFO:tasks.workunit.client.0.smithi029.stdout:9/641: mkdir d4/d5/d16/d39/dc5 0 2024-04-26T11:46:40.128 INFO:tasks.workunit.client.0.smithi029.stdout:9/642: fsync d4/f1d 0 2024-04-26T11:46:40.129 INFO:tasks.workunit.client.0.smithi029.stdout:2/715: chown d12/d24/fa9 3 1 2024-04-26T11:46:40.129 INFO:tasks.workunit.client.0.smithi029.stdout:7/748: dwrite d11/d18/d1a/f38 [0,4194304] 0 2024-04-26T11:46:40.129 INFO:tasks.workunit.client.0.smithi029.stdout:1/796: creat d7/db/d10/d1e/d5e/d10f/f11e x:0 0 0 2024-04-26T11:46:40.130 INFO:tasks.workunit.client.0.smithi029.stdout:9/643: write d4/d5/d7/f85 [2402346,44769] 0 2024-04-26T11:46:40.131 INFO:tasks.workunit.client.0.smithi029.stdout:7/749: fsync d11/d18/d35/d7c/ff5 0 2024-04-26T11:46:40.132 INFO:tasks.workunit.client.0.smithi029.stdout:8/603: link dc/de/d2e/f94 dc/de/d2e/d23/d27/dc5/fd9 0 2024-04-26T11:46:40.132 INFO:tasks.workunit.client.0.smithi029.stdout:7/750: readlink d11/d18/d1a/d33/lb4 0 2024-04-26T11:46:40.132 INFO:tasks.workunit.client.0.smithi029.stdout:5/609: read db/d12/d1a/f51 [3900789,109596] 0 2024-04-26T11:46:40.132 INFO:tasks.workunit.client.0.smithi029.stdout:9/644: mkdir d4/d49/d58/d67/dab/dc6 0 2024-04-26T11:46:40.134 INFO:tasks.workunit.client.0.smithi029.stdout:5/610: fsync db/da6/fae 0 2024-04-26T11:46:40.135 INFO:tasks.workunit.client.0.smithi029.stdout:2/716: dread d12/d24/f27 [0,4194304] 0 2024-04-26T11:46:40.135 INFO:tasks.workunit.client.0.smithi029.stdout:9/645: chown d4/d5/d7a/da1/fb6 136 1 2024-04-26T11:46:40.136 INFO:tasks.workunit.client.0.smithi029.stdout:6/695: dread d7/d20/d27/f2b [0,4194304] 0 2024-04-26T11:46:40.137 INFO:tasks.workunit.client.0.smithi029.stdout:6/696: chown d7/d97 628039242 1 2024-04-26T11:46:40.137 INFO:tasks.workunit.client.0.smithi029.stdout:2/717: mknod d12/d24/d29/d57/def/cf7 1 2024-04-26T11:46:40.137 INFO:tasks.workunit.client.0.smithi029.stdout:4/680: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f63 [0,4194304] 0 2024-04-26T11:46:40.137 INFO:tasks.workunit.client.0.smithi029.stdout:9/646: chown d4/d46/l81 208469 1 2024-04-26T11:46:40.137 INFO:tasks.workunit.client.0.smithi029.stdout:4/681: sync 2024-04-26T11:46:40.137 INFO:tasks.workunit.client.0.smithi029.stdout:0/640: dwrite d9/d16/d52/fa2 [0,4194304] 0 2024-04-26T11:46:40.138 INFO:tasks.workunit.client.0.smithi029.stdout:2/718: stat d12/d6c/fb3 0 2024-04-26T11:46:40.138 INFO:tasks.workunit.client.0.smithi029.stdout:5/611: creat db/d12/d72/d39/fba x:0 0 0 2024-04-26T11:46:40.138 INFO:tasks.workunit.client.0.smithi029.stdout:6/697: readlink d7/d46/d69/da2/ld7 0 2024-04-26T11:46:40.139 INFO:tasks.workunit.client.0.smithi029.stdout:5/612: stat db/d12/f1b 0 2024-04-26T11:46:40.139 INFO:tasks.workunit.client.0.smithi029.stdout:9/647: mkdir d4/d5/d7/dc7 0 2024-04-26T11:46:40.139 INFO:tasks.workunit.client.0.smithi029.stdout:0/641: creat d9/d16/d25/d2a/d46/fea x:0 0 0 2024-04-26T11:46:40.140 INFO:tasks.workunit.client.0.smithi029.stdout:5/613: stat db/d89 0 2024-04-26T11:46:40.140 INFO:tasks.workunit.client.0.smithi029.stdout:0/642: fdatasync d9/d43/f75 0 2024-04-26T11:46:40.140 INFO:tasks.workunit.client.0.smithi029.stdout:2/719: rmdir d12/d24/d29/d36/da4 0 2024-04-26T11:46:40.141 INFO:tasks.workunit.client.0.smithi029.stdout:6/698: write d7/d25/d4b/fac [1485264,34121] 0 2024-04-26T11:46:40.142 INFO:tasks.workunit.client.0.smithi029.stdout:5/614: creat db/d40/d4d/d4f/d73/fbb x:0 0 0 2024-04-26T11:46:40.142 INFO:tasks.workunit.client.0.smithi029.stdout:9/648: getdents d4/d5/d7a/da1 0 2024-04-26T11:46:40.143 INFO:tasks.workunit.client.0.smithi029.stdout:6/699: write d7/d46/fa7 [4842562,48983] 0 2024-04-26T11:46:40.143 INFO:tasks.workunit.client.0.smithi029.stdout:0/643: truncate d9/d16/d33/f81 961398 0 2024-04-26T11:46:40.144 INFO:tasks.workunit.client.0.smithi029.stdout:2/720: truncate d12/d6c/d73/d4f/d65/d6f/fb7 1203343 0 2024-04-26T11:46:40.144 INFO:tasks.workunit.client.0.smithi029.stdout:3/607: dread d0/d1/d41/d5f/d1a/f1d [0,4194304] 0 2024-04-26T11:46:40.144 INFO:tasks.workunit.client.0.smithi029.stdout:9/649: symlink d4/d5/d7a/db0/lc8 0 2024-04-26T11:46:40.145 INFO:tasks.workunit.client.0.smithi029.stdout:8/604: rename dc/d75 to dc/de/d26/d57/d86/dda 0 2024-04-26T11:46:40.145 INFO:tasks.workunit.client.0.smithi029.stdout:6/700: mkdir d7/d20/d27/d91/dee 0 2024-04-26T11:46:40.145 INFO:tasks.workunit.client.0.smithi029.stdout:2/721: creat d12/d6c/d73/da5/ff8 x:0 0 0 2024-04-26T11:46:40.146 INFO:tasks.workunit.client.0.smithi029.stdout:3/608: chown d0/d1/d41/d5f/d1a/f61 11883149 1 2024-04-26T11:46:40.146 INFO:tasks.workunit.client.0.smithi029.stdout:4/682: dread d3/d1d/d11/d16/f57 [0,4194304] 0 2024-04-26T11:46:40.146 INFO:tasks.workunit.client.0.smithi029.stdout:9/650: mkdir d4/d5/d16/d80/dc9 0 2024-04-26T11:46:40.147 INFO:tasks.workunit.client.0.smithi029.stdout:2/722: creat d12/d6c/d73/da5/ff9 x:0 0 0 2024-04-26T11:46:40.147 INFO:tasks.workunit.client.0.smithi029.stdout:6/701: symlink d7/d20/d27/lef 0 2024-04-26T11:46:40.147 INFO:tasks.workunit.client.0.smithi029.stdout:8/605: stat dc/de/d26/d57/d86/dda/da0 0 2024-04-26T11:46:40.147 INFO:tasks.workunit.client.0.smithi029.stdout:3/609: creat d0/dc/d1f/fd0 x:0 0 0 2024-04-26T11:46:40.148 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:40.148 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:40.148 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:40.148 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:40.148 INFO:tasks.workunit.client.0.smithi029.stdout:1/797: truncate d7/db/d10/d1e/db2/dee/d3e/f56 1272473 0 2024-04-26T11:46:40.149 INFO:tasks.workunit.client.0.smithi029.stdout:3/610: symlink d0/d1/d2b/d7e/ld1 0 2024-04-26T11:46:40.149 INFO:tasks.workunit.client.0.smithi029.stdout:2/723: chown d12/d6c/d73/d4f/d65/f84 250229 1 2024-04-26T11:46:40.150 INFO:tasks.workunit.client.0.smithi029.stdout:4/683: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/cd8 1 2024-04-26T11:46:40.150 INFO:tasks.workunit.client.0.smithi029.stdout:8/606: mknod dc/de/d2e/d23/d27/d6f/cdb 1 2024-04-26T11:46:40.150 INFO:tasks.workunit.client.0.smithi029.stdout:6/702: truncate d7/d20/f63 810930 0 2024-04-26T11:46:40.151 INFO:tasks.workunit.client.0.smithi029.stdout:0/644: creat d9/d16/d33/d2f/d32/d9f/de6/feb x:0 0 0 2024-04-26T11:46:40.151 INFO:tasks.workunit.client.0.smithi029.stdout:8/607: chown dc/d3b/dab 19413 1 2024-04-26T11:46:40.152 INFO:tasks.workunit.client.0.smithi029.stdout:4/684: write d3/d1d/db/f41 [1286644,98465] 0 2024-04-26T11:46:40.152 INFO:tasks.workunit.client.0.smithi029.stdout:1/798: write d7/db/f38 [255056,121838] 0 2024-04-26T11:46:40.153 INFO:tasks.workunit.client.0.smithi029.stdout:5/615: dwrite db/d12/d1a/d4c/f88 [0,4194304] 0 2024-04-26T11:46:40.153 INFO:tasks.workunit.client.0.smithi029.stdout:3/611: read d0/d1/f49 [250975,22385] 0 2024-04-26T11:46:40.154 INFO:tasks.workunit.client.0.smithi029.stdout:8/608: unlink dc/de/d2e/d23/d27/d6f/d9b/f3c 0 2024-04-26T11:46:40.154 INFO:tasks.workunit.client.0.smithi029.stdout:2/724: creat d12/d6c/d73/d4f/d65/d81/ffa x:0 0 0 2024-04-26T11:46:40.158 INFO:tasks.workunit.client.0.smithi029.stdout:4/685: creat d3/d50/d7a/fd9 x:0 0 0 2024-04-26T11:46:40.159 INFO:tasks.workunit.client.0.smithi029.stdout:1/799: read - d7/db/fa3 zero size 2024-04-26T11:46:40.159 INFO:tasks.workunit.client.0.smithi029.stdout:0/645: rename d9/d16/d25/d2a/f7c to d9/d16/d25/da7/fec 0 2024-04-26T11:46:40.159 INFO:tasks.workunit.client.0.smithi029.stdout:8/609: chown dc/d12/l1c 198840925 1 2024-04-26T11:46:40.159 INFO:tasks.workunit.client.0.smithi029.stdout:5/616: symlink db/d40/d77/lbc 0 2024-04-26T11:46:40.159 INFO:tasks.workunit.client.0.smithi029.stdout:4/686: creat d3/d1d/d11/d16/d71/fda x:0 0 0 2024-04-26T11:46:40.159 INFO:tasks.workunit.client.0.smithi029.stdout:5/617: creat db/d40/d4d/d4f/fbd x:0 0 0 2024-04-26T11:46:40.159 INFO:tasks.workunit.client.0.smithi029.stdout:1/800: rename d7/db/l17 to d7/db/d8d/dc7/l11f 0 2024-04-26T11:46:40.159 INFO:tasks.workunit.client.0.smithi029.stdout:4/687: fsync d3/d1d/d11/d16/d1f/d3d/d39/fb5 0 2024-04-26T11:46:40.159 INFO:tasks.workunit.client.0.smithi029.stdout:6/703: truncate d7/f1a 7836499 0 2024-04-26T11:46:40.160 INFO:tasks.workunit.client.0.smithi029.stdout:8/610: creat dc/d12/d6a/d78/dc3/fdc x:0 0 0 2024-04-26T11:46:40.161 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:40.163 INFO:tasks.workunit.client.0.smithi029.stdout:5/618: unlink db/d12/d72/l2d 0 2024-04-26T11:46:40.165 INFO:tasks.workunit.client.0.smithi029.stdout:4/688: fsync d3/d1d/d11/d16/d1f/f55 0 2024-04-26T11:46:40.165 INFO:tasks.workunit.client.0.smithi029.stdout:2/725: dwrite d12/d6c/d73/f67 [4194304,4194304] 0 2024-04-26T11:46:40.165 INFO:tasks.workunit.client.0.smithi029.stdout:8/611: rename dc/de/d26/d57/d86/dda/da0 to dc/de/d2e/d23/d27/dc5/ddd 0 2024-04-26T11:46:40.166 INFO:tasks.workunit.client.0.smithi029.stdout:2/726: write d12/d24/d29/f31 [887122,126210] 0 2024-04-26T11:46:40.167 INFO:tasks.workunit.client.0.smithi029.stdout:8/612: truncate dc/de/d2e/d23/f5f 1030712 0 2024-04-26T11:46:40.167 INFO:tasks.workunit.client.0.smithi029.stdout:2/727: dread - d12/d6c/d73/fc7 zero size 2024-04-26T11:46:40.167 INFO:tasks.workunit.client.0.smithi029.stdout:2/728: read - d12/d24/fe9 zero size 2024-04-26T11:46:40.168 INFO:tasks.workunit.client.0.smithi029.stdout:5/619: write db/d12/d72/d39/faf [432108,113069] 0 2024-04-26T11:46:40.168 INFO:tasks.workunit.client.0.smithi029.stdout:4/689: fsync d3/d1d/f89 0 2024-04-26T11:46:40.169 INFO:tasks.workunit.client.0.smithi029.stdout:8/613: mkdir dc/de/d26/d6b/dde 0 2024-04-26T11:46:40.169 INFO:tasks.workunit.client.0.smithi029.stdout:0/646: getdents d9/d16/d33/d2f 0 2024-04-26T11:46:40.169 INFO:tasks.workunit.client.0.smithi029.stdout:6/704: link d7/d25/d4b/d4d/fc1 d7/d20/d27/d91/dee/ff0 0 2024-04-26T11:46:40.169 INFO:tasks.workunit.client.0.smithi029.stdout:2/729: creat d12/d24/d29/d57/ffb x:0 0 0 2024-04-26T11:46:40.170 INFO:tasks.workunit.client.0.smithi029.stdout:1/801: creat d7/d25/d68/f120 x:0 0 0 2024-04-26T11:46:40.171 INFO:tasks.workunit.client.0.smithi029.stdout:0/647: mknod d9/d16/d25/d2a/ced 1 2024-04-26T11:46:40.173 INFO:tasks.workunit.client.0.smithi029.stdout:2/730: link l2 d12/d24/d29/d50/d6a/lfc 0 2024-04-26T11:46:40.173 INFO:tasks.workunit.client.0.smithi029.stdout:6/705: rename d7/d46/d69/db4/fdd to d7/d46/d69/da2/d4c/d98/ff1 0 2024-04-26T11:46:40.174 INFO:tasks.workunit.client.0.smithi029.stdout:6/706: chown l3 37 1 2024-04-26T11:46:40.175 INFO:tasks.workunit.client.0.smithi029.stdout:7/751: dread d11/d18/d1a/d33/f75 [0,4194304] 0 2024-04-26T11:46:40.175 INFO:tasks.workunit.client.0.smithi029.stdout:6/707: dread - d7/d46/d69/da2/fd1 zero size 2024-04-26T11:46:40.177 INFO:tasks.workunit.client.0.smithi029.stdout:2/731: link d12/d24/d29/d57/f89 d12/d6c/d73/dbd/dec/ffd 0 2024-04-26T11:46:40.177 INFO:tasks.workunit.client.0.smithi029.stdout:6/708: fdatasync d7/d25/d4b/d4d/d65/f89 0 2024-04-26T11:46:40.177 INFO:tasks.workunit.client.0.smithi029.stdout:7/752: rmdir d11/d18/dad/de1 0 2024-04-26T11:46:40.178 INFO:tasks.workunit.client.0.smithi029.stdout:6/709: mknod d7/d25/d4b/d4d/d65/cf2 1 2024-04-26T11:46:40.178 INFO:tasks.workunit.client.0.smithi029.stdout:3/612: dread d0/dc/d80/f8f [0,4194304] 0 2024-04-26T11:46:40.178 INFO:tasks.workunit.client.0.smithi029.stdout:2/732: creat d12/d6c/d73/d4f/ffe x:0 0 0 2024-04-26T11:46:40.178 INFO:tasks.workunit.client.0.smithi029.stdout:8/614: dread dc/de/f9d [0,4194304] 0 2024-04-26T11:46:40.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/710: symlink d7/d20/d27/dc0/lf3 0 2024-04-26T11:46:40.180 INFO:tasks.workunit.client.0.smithi029.stdout:2/733: fsync d12/d24/d29/d38/dea/fc3 0 2024-04-26T11:46:40.181 INFO:tasks.workunit.client.0.smithi029.stdout:7/753: link d11/d15/d79/l82 d11/d18/d1a/lfb 0 2024-04-26T11:46:40.181 INFO:tasks.workunit.client.0.smithi029.stdout:3/613: chown d0/d1/d2b/d33/f8c 783 1 2024-04-26T11:46:40.181 INFO:tasks.workunit.client.0.smithi029.stdout:6/711: chown d7/d46/d69/da2/fdc 1096608 1 2024-04-26T11:46:40.181 INFO:tasks.workunit.client.0.smithi029.stdout:2/734: mkdir d12/d6c/d70/dff 0 2024-04-26T11:46:40.181 INFO:tasks.workunit.client.0.smithi029.stdout:3/614: write d0/d1/d2b/d33/f51 [3204987,55663] 0 2024-04-26T11:46:40.182 INFO:tasks.workunit.client.0.smithi029.stdout:6/712: chown d7/d20/f74 509 1 2024-04-26T11:46:40.183 INFO:tasks.workunit.client.0.smithi029.stdout:7/754: write d11/d18/d35/d39/d7e/ff9 [1919194,113072] 0 2024-04-26T11:46:40.183 INFO:tasks.workunit.client.0.smithi029.stdout:2/735: unlink d12/d6c/fb9 0 2024-04-26T11:46:40.183 INFO:tasks.workunit.client.0.smithi029.stdout:0/648: dread d9/d16/d25/da7/fec [0,4194304] 0 2024-04-26T11:46:40.185 INFO:tasks.workunit.client.0.smithi029.stdout:6/713: creat d7/d46/d69/da2/dc8/ded/ff4 x:0 0 0 2024-04-26T11:46:40.185 INFO:tasks.workunit.client.0.smithi029.stdout:2/736: fsync d12/d6c/d73/d4f/d65/d81/fcb 0 2024-04-26T11:46:40.185 INFO:tasks.workunit.client.0.smithi029.stdout:3/615: rename d0/d1/d2b/da7/dad/f77 to d0/d1/d2f/d82/dce/fd2 0 2024-04-26T11:46:40.185 INFO:tasks.workunit.client.0.smithi029.stdout:0/649: fdatasync d9/d16/d25/d2a/d4b/f5d 0 2024-04-26T11:46:40.185 INFO:tasks.workunit.client.0.smithi029.stdout:7/755: creat d11/d18/dad/de5/ffc x:0 0 0 2024-04-26T11:46:40.186 INFO:tasks.workunit.client.0.smithi029.stdout:9/651: dread d4/f7f [0,4194304] 0 2024-04-26T11:46:40.186 INFO:tasks.workunit.client.0.smithi029.stdout:2/737: dread - d12/d6c/d73/d4f/d65/d99/fd5 zero size 2024-04-26T11:46:40.186 INFO:tasks.workunit.client.0.smithi029.stdout:6/714: read d7/d97/fa5 [636865,10629] 0 2024-04-26T11:46:40.187 INFO:tasks.workunit.client.0.smithi029.stdout:0/650: unlink d9/d16/d25/d2a/d74/f91 0 2024-04-26T11:46:40.187 INFO:tasks.workunit.client.0.smithi029.stdout:7/756: mkdir d11/d18/d35/dfd 0 2024-04-26T11:46:40.189 INFO:tasks.workunit.client.0.smithi029.stdout:3/616: rename d0/d1/d2b/dbd to d0/d1/d41/d5f/dd3 0 2024-04-26T11:46:40.189 INFO:tasks.workunit.client.0.smithi029.stdout:4/690: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f8c [0,4194304] 0 2024-04-26T11:46:40.189 INFO:tasks.workunit.client.0.smithi029.stdout:9/652: creat d4/d5/d16/fca x:0 0 0 2024-04-26T11:46:40.189 INFO:tasks.workunit.client.0.smithi029.stdout:8/615: dwrite dc/d12/d6a/f4c [0,4194304] 0 2024-04-26T11:46:40.190 INFO:tasks.workunit.client.0.smithi029.stdout:2/738: getdents d12/d24/d2f 0 2024-04-26T11:46:40.190 INFO:tasks.workunit.client.0.smithi029.stdout:7/757: dread d11/d18/d1a/d33/fa3 [0,4194304] 0 2024-04-26T11:46:40.191 INFO:tasks.workunit.client.0.smithi029.stdout:8/616: mknod dc/de/d26/d57/cdf 1 2024-04-26T11:46:40.191 INFO:tasks.workunit.client.0.smithi029.stdout:4/691: chown d3/d1d/db/d13/d23/d2b/f7c 16237 1 2024-04-26T11:46:40.191 INFO:tasks.workunit.client.0.smithi029.stdout:7/758: chown d11/d18/d58/d8d/dc3/lcb 254419 1 2024-04-26T11:46:40.191 INFO:tasks.workunit.client.0.smithi029.stdout:6/715: creat d7/d46/d69/da2/d4c/d98/ff5 x:0 0 0 2024-04-26T11:46:40.192 INFO:tasks.workunit.client.0.smithi029.stdout:5/620: write db/d12/d1a/f27 [889212,6438] 0 2024-04-26T11:46:40.192 INFO:tasks.workunit.client.0.smithi029.stdout:1/802: truncate d7/db/d10/d1e/d53/f6c 637907 0 2024-04-26T11:46:40.193 INFO:tasks.workunit.client.0.smithi029.stdout:6/716: symlink d7/d20/d27/dc0/lf6 0 2024-04-26T11:46:40.193 INFO:tasks.workunit.client.0.smithi029.stdout:7/759: truncate d11/d18/d35/dbf/fdb 276495 0 2024-04-26T11:46:40.193 INFO:tasks.workunit.client.0.smithi029.stdout:1/803: creat d7/f121 x:0 0 0 2024-04-26T11:46:40.194 INFO:tasks.workunit.client.0.smithi029.stdout:6/717: fsync d7/d46/d69/db4/fcd 0 2024-04-26T11:46:40.196 INFO:tasks.workunit.client.0.smithi029.stdout:0/651: write d9/d16/d52/f2c [1238102,7632] 0 2024-04-26T11:46:40.196 INFO:tasks.workunit.client.0.smithi029.stdout:3/617: dread d0/d37/f99 [0,4194304] 0 2024-04-26T11:46:40.196 INFO:tasks.workunit.client.0.smithi029.stdout:1/804: symlink d7/d25/d68/d4b/d66/l122 0 2024-04-26T11:46:40.197 INFO:tasks.workunit.client.0.smithi029.stdout:6/718: chown d7/d46/d69/da2/d4c/d98/fb6 9735228 1 2024-04-26T11:46:40.197 INFO:tasks.workunit.client.0.smithi029.stdout:5/621: read db/d12/d1a/f80 [1621005,60571] 0 2024-04-26T11:46:40.197 INFO:tasks.workunit.client.0.smithi029.stdout:2/739: write d12/d6c/d73/d4f/d65/d81/fce [884042,113107] 0 2024-04-26T11:46:40.197 INFO:tasks.workunit.client.0.smithi029.stdout:8/617: dread dc/d12/d6a/f77 [0,4194304] 0 2024-04-26T11:46:40.198 INFO:tasks.workunit.client.0.smithi029.stdout:2/740: chown l10 1 1 2024-04-26T11:46:40.199 INFO:tasks.workunit.client.0.smithi029.stdout:0/652: chown d9/d16/d25/db4/fb5 879 1 2024-04-26T11:46:40.200 INFO:tasks.workunit.client.0.smithi029.stdout:0/653: mknod d9/d16/d25/db4/cee 1 2024-04-26T11:46:40.201 INFO:tasks.workunit.client.0.smithi029.stdout:3/618: symlink d0/d1/d41/d5f/d1a/d3b/db5/ld4 0 2024-04-26T11:46:40.201 INFO:tasks.workunit.client.0.smithi029.stdout:6/719: mkdir d7/d25/d4b/d6d/dd6/df7 0 2024-04-26T11:46:40.201 INFO:tasks.workunit.client.0.smithi029.stdout:4/692: dwrite d3/f31 [4194304,4194304] 0 2024-04-26T11:46:40.202 INFO:tasks.workunit.client.0.smithi029.stdout:3/619: dread - d0/d37/f7a zero size 2024-04-26T11:46:40.202 INFO:tasks.workunit.client.0.smithi029.stdout:2/741: getdents d12/d24 0 2024-04-26T11:46:40.203 INFO:tasks.workunit.client.0.smithi029.stdout:7/760: dread d11/d18/d1a/f31 [0,4194304] 0 2024-04-26T11:46:40.203 INFO:tasks.workunit.client.0.smithi029.stdout:8/618: write dc/de/d2e/d23/d27/d6f/f8a [3517850,103290] 0 2024-04-26T11:46:40.204 INFO:tasks.workunit.client.0.smithi029.stdout:0/654: chown d9/d16/d25/d2a/d74/l7a 89328 1 2024-04-26T11:46:40.204 INFO:tasks.workunit.client.0.smithi029.stdout:4/693: stat d3/d1d/db/d13/d73/d97 0 2024-04-26T11:46:40.205 INFO:tasks.workunit.client.0.smithi029.stdout:3/620: chown d0/d1/d41/d5f/d4d/d9d 4 1 2024-04-26T11:46:40.206 INFO:tasks.workunit.client.0.smithi029.stdout:7/761: mknod d11/d18/d1a/dab/cfe 1 2024-04-26T11:46:40.207 INFO:tasks.workunit.client.0.smithi029.stdout:8/619: fdatasync dc/f11 0 2024-04-26T11:46:40.207 INFO:tasks.workunit.client.0.smithi029.stdout:0/655: creat d9/d16/d52/fef x:0 0 0 2024-04-26T11:46:40.207 INFO:tasks.workunit.client.0.smithi029.stdout:6/720: rename d7/d46/d69/da2/fd1 to d7/d46/d69/da2/ff8 0 2024-04-26T11:46:40.208 INFO:tasks.workunit.client.0.smithi029.stdout:8/620: fsync dc/f11 0 2024-04-26T11:46:40.208 INFO:tasks.workunit.client.0.smithi029.stdout:3/621: mknod d0/d1/d41/d5f/d1a/cd5 1 2024-04-26T11:46:40.208 INFO:tasks.workunit.client.0.smithi029.stdout:6/721: stat d7/d46/d69/da2/f38 0 2024-04-26T11:46:40.208 INFO:tasks.workunit.client.0.smithi029.stdout:7/762: symlink d11/d15/d79/da6/lff 0 2024-04-26T11:46:40.210 INFO:tasks.workunit.client.0.smithi029.stdout:1/805: dwrite d7/db/f2d [0,4194304] 0 2024-04-26T11:46:40.210 INFO:tasks.workunit.client.0.smithi029.stdout:8/621: truncate f1 4091054 0 2024-04-26T11:46:40.211 INFO:tasks.workunit.client.0.smithi029.stdout:7/763: read - d11/d18/d1a/d33/fdf zero size 2024-04-26T11:46:40.212 INFO:tasks.workunit.client.0.smithi029.stdout:0/656: dread d9/d16/d25/da7/fec [0,4194304] 0 2024-04-26T11:46:40.212 INFO:tasks.workunit.client.0.smithi029.stdout:1/806: dread - d7/f121 zero size 2024-04-26T11:46:40.212 INFO:tasks.workunit.client.0.smithi029.stdout:1/807: chown d7/db/dc5 2 1 2024-04-26T11:46:40.213 INFO:tasks.workunit.client.0.smithi029.stdout:5/622: dwrite db/d12/d1a/f16 [0,4194304] 0 2024-04-26T11:46:40.213 INFO:tasks.workunit.client.0.smithi029.stdout:1/808: chown l5 6956690 1 2024-04-26T11:46:40.214 INFO:tasks.workunit.client.0.smithi029.stdout:1/809: symlink d7/db/dcc/l123 0 2024-04-26T11:46:40.215 INFO:tasks.workunit.client.0.smithi029.stdout:0/657: creat d9/d16/de7/ff0 x:0 0 0 2024-04-26T11:46:40.215 INFO:tasks.workunit.client.0.smithi029.stdout:3/622: creat d0/d1/d2b/da7/dad/fd6 x:0 0 0 2024-04-26T11:46:40.215 INFO:tasks.workunit.client.0.smithi029.stdout:0/658: mknod d9/d16/d25/ddc/cf1 1 2024-04-26T11:46:40.215 INFO:tasks.workunit.client.0.smithi029.stdout:5/623: rename db/d12/d1a/l9a to db/d40/d4d/d79/lbe 0 2024-04-26T11:46:40.216 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:40.208+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:40.217 INFO:tasks.workunit.client.0.smithi029.stdout:2/742: truncate d12/d24/d29/d36/f3b 734531 0 2024-04-26T11:46:40.217 INFO:tasks.workunit.client.0.smithi029.stdout:5/624: mknod db/d12/d72/d39/d3b/cbf 1 2024-04-26T11:46:40.217 INFO:tasks.workunit.client.0.smithi029.stdout:3/623: rename d0/dc/d1f/f6b to d0/d1/d2b/d33/dcb/fd7 0 2024-04-26T11:46:40.218 INFO:tasks.workunit.client.0.smithi029.stdout:3/624: rmdir d0/d1/d2f 39 2024-04-26T11:46:40.218 INFO:tasks.workunit.client.0.smithi029.stdout:5/625: creat db/d12/d72/d39/d3b/d86/fc0 x:0 0 0 2024-04-26T11:46:40.219 INFO:tasks.workunit.client.0.smithi029.stdout:5/626: write db/d12/fa7 [317009,92737] 0 2024-04-26T11:46:40.219 INFO:tasks.workunit.client.0.smithi029.stdout:3/625: write d0/d1/d41/d4c/f7b [3751463,109184] 0 2024-04-26T11:46:40.220 INFO:tasks.workunit.client.0.smithi029.stdout:0/659: dread d9/d16/d25/d2a/d4b/fb6 [0,4194304] 0 2024-04-26T11:46:40.221 INFO:tasks.workunit.client.0.smithi029.stdout:6/722: read d7/d46/d69/da2/d4c/d98/fa6 [1250637,107224] 0 2024-04-26T11:46:40.221 INFO:tasks.workunit.client.0.smithi029.stdout:8/622: dwrite dc/de/d2e/d23/d27/d6f/d9b/da2/fbb [0,4194304] 0 2024-04-26T11:46:40.224 INFO:tasks.workunit.client.0.smithi029.stdout:6/723: chown d7/d25/d4b/d4d 87610 1 2024-04-26T11:46:40.225 INFO:tasks.workunit.client.0.smithi029.stdout:9/653: dread d4/d5/d16/f1c [0,4194304] 0 2024-04-26T11:46:40.226 INFO:tasks.workunit.client.0.smithi029.stdout:1/810: dwrite d7/db/d10/d20/fbd [0,4194304] 0 2024-04-26T11:46:40.226 INFO:tasks.workunit.client.0.smithi029.stdout:0/660: rename d9/d16/d33/d2f/d31/fae to d9/d16/d25/db4/ff2 0 2024-04-26T11:46:40.227 INFO:tasks.workunit.client.0.smithi029.stdout:9/654: mknod d4/d5/d7a/d97/ccb 1 2024-04-26T11:46:40.230 INFO:tasks.workunit.client.0.smithi029.stdout:6/724: read - d7/d46/d69/da2/d4c/d98/d45/d83/da9/fe0 zero size 2024-04-26T11:46:40.230 INFO:tasks.workunit.client.0.smithi029.stdout:0/661: creat d9/d16/d25/d2a/d4b/dd9/ff3 x:0 0 0 2024-04-26T11:46:40.232 INFO:tasks.workunit.client.0.smithi029.stdout:2/743: dwrite d12/d6c/d73/d4f/d65/d81/fd3 [0,4194304] 0 2024-04-26T11:46:40.234 INFO:tasks.workunit.client.0.smithi029.stdout:5/627: dwrite db/f76 [0,4194304] 0 2024-04-26T11:46:40.234 INFO:tasks.workunit.client.0.smithi029.stdout:6/725: write d7/d46/d69/da2/d4c/d98/fc9 [2272028,89622] 0 2024-04-26T11:46:40.236 INFO:tasks.workunit.client.0.smithi029.stdout:2/744: chown d12/d24/fe9 111898 1 2024-04-26T11:46:40.237 INFO:tasks.workunit.client.0.smithi029.stdout:3/626: dwrite d0/d1/d2f/fb3 [0,4194304] 0 2024-04-26T11:46:40.237 INFO:tasks.workunit.client.0.smithi029.stdout:5/628: mknod db/d40/d77/d98/cc1 1 2024-04-26T11:46:40.237 INFO:tasks.workunit.client.0.smithi029.stdout:2/745: mknod d12/d6c/d73/dbd/c100 1 2024-04-26T11:46:40.237 INFO:tasks.workunit.client.0.smithi029.stdout:3/627: rmdir d0/d1 39 2024-04-26T11:46:40.238 INFO:tasks.workunit.client.0.smithi029.stdout:5/629: symlink db/d12/d72/d92/lc2 0 2024-04-26T11:46:40.239 INFO:tasks.workunit.client.0.smithi029.stdout:6/726: rename d7/d25/d4b/d6d/de3 to d7/d46/d69/da2/d4c/d98/d45/d76/df9 0 2024-04-26T11:46:40.239 INFO:tasks.workunit.client.0.smithi029.stdout:0/662: dread d9/d16/d25/d2a/d46/f5a [0,4194304] 0 2024-04-26T11:46:40.239 INFO:tasks.workunit.client.0.smithi029.stdout:5/630: mknod db/d40/d70/cc3 1 2024-04-26T11:46:40.240 INFO:tasks.workunit.client.0.smithi029.stdout:5/631: mknod db/d12/d6b/cc4 1 2024-04-26T11:46:40.240 INFO:tasks.workunit.client.0.smithi029.stdout:6/727: readlink d7/d46/d69/da2/d4c/lb3 0 2024-04-26T11:46:40.241 INFO:tasks.workunit.client.0.smithi029.stdout:1/811: dwrite d7/db/d10/d1e/db2/f10c [0,4194304] 0 2024-04-26T11:46:40.241 INFO:tasks.workunit.client.0.smithi029.stdout:5/632: symlink db/d40/d77/d98/lc5 0 2024-04-26T11:46:40.242 INFO:tasks.workunit.client.0.smithi029.stdout:1/812: truncate d7/d25/d68/f120 831043 0 2024-04-26T11:46:40.247 INFO:tasks.workunit.client.0.smithi029.stdout:7/764: dread f9 [0,4194304] 0 2024-04-26T11:46:40.248 INFO:tasks.workunit.client.0.smithi029.stdout:0/663: dwrite d9/d16/d25/f6c [0,4194304] 0 2024-04-26T11:46:40.249 INFO:tasks.workunit.client.0.smithi029.stdout:0/664: chown d9/d16/f3d 31360 1 2024-04-26T11:46:40.250 INFO:tasks.workunit.client.0.smithi029.stdout:5/633: fsync db/d12/d72/f2c 0 2024-04-26T11:46:40.251 INFO:tasks.workunit.client.0.smithi029.stdout:5/634: mkdir db/d40/d4d/d4f/dc6 0 2024-04-26T11:46:40.253 INFO:tasks.workunit.client.0.smithi029.stdout:5/635: chown db/d40/d4d/d4f/d73/f74 1021582511 1 2024-04-26T11:46:40.254 INFO:tasks.workunit.client.0.smithi029.stdout:5/636: symlink db/d12/d6b/lc7 0 2024-04-26T11:46:40.256 INFO:tasks.workunit.client.0.smithi029.stdout:5/637: fdatasync db/d12/d1a/f19 0 2024-04-26T11:46:40.256 INFO:tasks.workunit.client.0.smithi029.stdout:6/728: dread d7/d25/d4b/d6d/f78 [0,4194304] 0 2024-04-26T11:46:40.257 INFO:tasks.workunit.client.0.smithi029.stdout:6/729: dread - d7/d46/d69/da2/dc8/ded/ff4 zero size 2024-04-26T11:46:40.257 INFO:tasks.workunit.client.0.smithi029.stdout:0/665: dwrite d9/f20 [0,4194304] 0 2024-04-26T11:46:40.259 INFO:tasks.workunit.client.0.smithi029.stdout:6/730: unlink d7/f90 0 2024-04-26T11:46:40.259 INFO:tasks.workunit.client.0.smithi029.stdout:6/731: mkdir d7/d46/d69/db4/dfa 0 2024-04-26T11:46:40.261 INFO:tasks.workunit.client.0.smithi029.stdout:6/732: rename d7/d46/d69/da2/d4c/d98/d45/l86 to d7/d46/d69/db4/lfb 0 2024-04-26T11:46:40.262 INFO:tasks.workunit.client.0.smithi029.stdout:6/733: creat d7/ffc x:0 0 0 2024-04-26T11:46:40.264 INFO:tasks.workunit.client.0.smithi029.stdout:6/734: write d7/d20/d27/f2b [523757,59942] 0 2024-04-26T11:46:40.268 INFO:tasks.workunit.client.0.smithi029.stdout:7/765: dread d11/d18/d1a/d26/f45 [0,4194304] 0 2024-04-26T11:46:40.268 INFO:tasks.workunit.client.0.smithi029.stdout:7/766: mknod d11/d18/d35/dbf/c100 1 2024-04-26T11:46:40.277 INFO:tasks.workunit.client.0.smithi029.stdout:5/638: truncate db/d40/d4d/d79/f8e 1621634 0 2024-04-26T11:46:40.278 INFO:tasks.workunit.client.0.smithi029.stdout:7/767: dwrite d11/d18/d1a/fd8 [0,4194304] 0 2024-04-26T11:46:40.279 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:40.279 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:40.279 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:40.279 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:40.279 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:40.279 INFO:tasks.workunit.client.0.smithi029.stdout:2/746: dread d12/d24/d29/d38/f4a [0,4194304] 0 2024-04-26T11:46:40.281 INFO:tasks.workunit.client.0.smithi029.stdout:7/768: write d11/d18/d35/d39/f8f [4413861,14286] 0 2024-04-26T11:46:40.281 INFO:tasks.workunit.client.0.smithi029.stdout:3/628: dread d0/d1/f5d [0,4194304] 0 2024-04-26T11:46:40.281 INFO:tasks.workunit.client.0.smithi029.stdout:2/747: mkdir d12/d24/d29/d36/d4b/d101 0 2024-04-26T11:46:40.282 INFO:tasks.workunit.client.0.smithi029.stdout:7/769: write d11/d18/fe9 [1013258,27611] 0 2024-04-26T11:46:40.283 INFO:tasks.workunit.client.0.smithi029.stdout:3/629: chown d0/d1/d41/d5f/dd3 2075308 1 2024-04-26T11:46:40.284 INFO:tasks.workunit.client.0.smithi029.stdout:4/694: sync 2024-04-26T11:46:40.284 INFO:tasks.workunit.client.0.smithi029.stdout:8/623: sync 2024-04-26T11:46:40.285 INFO:tasks.workunit.client.0.smithi029.stdout:3/630: rename d0/d37 to d0/d1/d2f/dd8 0 2024-04-26T11:46:40.286 INFO:tasks.workunit.client.0.smithi029.stdout:2/748: truncate d12/d6c/d73/d40/f5b 575903 0 2024-04-26T11:46:40.288 INFO:tasks.workunit.client.0.smithi029.stdout:4/695: mkdir d3/d1d/db/d13/d73/d97/ddb 0 2024-04-26T11:46:40.288 INFO:tasks.workunit.client.0.smithi029.stdout:1/813: dread d7/db/d10/d20/fde [0,4194304] 0 2024-04-26T11:46:40.289 INFO:tasks.workunit.client.0.smithi029.stdout:8/624: write dc/d12/d6a/d78/dc3/fdc [580223,107016] 0 2024-04-26T11:46:40.289 INFO:tasks.workunit.client.0.smithi029.stdout:2/749: unlink d12/d24/d29/d50/l78 0 2024-04-26T11:46:40.289 INFO:tasks.workunit.client.0.smithi029.stdout:7/770: write d11/d18/d35/f96 [1323389,77935] 0 2024-04-26T11:46:40.291 INFO:tasks.workunit.client.0.smithi029.stdout:1/814: read d7/db/d10/d1e/d53/d9d/fa0 [635284,101757] 0 2024-04-26T11:46:40.292 INFO:tasks.workunit.client.0.smithi029.stdout:0/666: dread d9/d16/d33/d2f/d32/d9d/f9e [0,4194304] 0 2024-04-26T11:46:40.292 INFO:tasks.workunit.client.0.smithi029.stdout:3/631: truncate d0/d1/d41/d5f/d4d/d9d/fcc 200105 0 2024-04-26T11:46:40.292 INFO:tasks.workunit.client.0.smithi029.stdout:4/696: getdents d3/d50/d7a 0 2024-04-26T11:46:40.293 INFO:tasks.workunit.client.0.smithi029.stdout:5/639: dwrite db/d12/d1a/f96 [0,4194304] 0 2024-04-26T11:46:40.294 INFO:tasks.workunit.client.0.smithi029.stdout:8/625: mkdir dc/de/d2e/d23/d27/d6f/d9b/d43/da1/de0 0 2024-04-26T11:46:40.294 INFO:tasks.workunit.client.0.smithi029.stdout:0/667: chown d9/d78/fcb 262775 1 2024-04-26T11:46:40.294 INFO:tasks.workunit.client.0.smithi029.stdout:7/771: rename d11/d18/d1a/d92/l94 to d11/d18/d35/dfd/l101 0 2024-04-26T11:46:40.295 INFO:tasks.workunit.client.0.smithi029.stdout:1/815: chown d7/db/dc5/dd5/l117 14 1 2024-04-26T11:46:40.295 INFO:tasks.workunit.client.0.smithi029.stdout:0/668: dread - d9/d16/d25/d2a/d46/fea zero size 2024-04-26T11:46:40.295 INFO:tasks.workunit.client.0.smithi029.stdout:5/640: fdatasync db/d12/d72/d39/fba 0 2024-04-26T11:46:40.296 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:40.297 INFO:tasks.workunit.client.0.smithi029.stdout:8/626: dread - dc/de/d2e/f6e zero size 2024-04-26T11:46:40.298 INFO:tasks.workunit.client.0.smithi029.stdout:7/772: write d11/d18/f29 [727268,85022] 0 2024-04-26T11:46:40.298 INFO:tasks.workunit.client.0.smithi029.stdout:4/697: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/cdc 1 2024-04-26T11:46:40.298 INFO:tasks.workunit.client.0.smithi029.stdout:1/816: chown d7/db/d10/d1e/d5e/l105 1362223536 1 2024-04-26T11:46:40.302 INFO:tasks.workunit.client.0.smithi029.stdout:4/698: chown d3/f47 370 1 2024-04-26T11:46:40.302 INFO:tasks.workunit.client.0.smithi029.stdout:8/627: mkdir dc/de/d2e/d23/d8d/de1 0 2024-04-26T11:46:40.302 INFO:tasks.workunit.client.0.smithi029.stdout:5/641: getdents db/d12/d1a 0 2024-04-26T11:46:40.302 INFO:tasks.workunit.client.0.smithi029.stdout:0/669: truncate d9/d43/f8a 58963 0 2024-04-26T11:46:40.303 INFO:tasks.workunit.client.0.smithi029.stdout:8/628: fdatasync dc/d12/faf 0 2024-04-26T11:46:40.303 INFO:tasks.workunit.client.0.smithi029.stdout:1/817: chown d7/db/d8d/d11a 419666 1 2024-04-26T11:46:40.303 INFO:tasks.workunit.client.0.smithi029.stdout:6/735: dread d7/d25/d5c/f1e [0,4194304] 0 2024-04-26T11:46:40.303 INFO:tasks.workunit.client.0.smithi029.stdout:5/642: readlink db/d12/d72/l5a 0 2024-04-26T11:46:40.303 INFO:tasks.workunit.client.0.smithi029.stdout:7/773: link d11/d18/d1a/d33/l61 d11/d18/l102 0 2024-04-26T11:46:40.303 INFO:tasks.workunit.client.0.smithi029.stdout:4/699: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/cdd 1 2024-04-26T11:46:40.303 INFO:tasks.workunit.client.0.smithi029.stdout:8/629: unlink f1 0 2024-04-26T11:46:40.304 INFO:tasks.workunit.client.0.smithi029.stdout:0/670: mkdir d9/d16/d33/d2f/d32/d90/df4 0 2024-04-26T11:46:40.304 INFO:tasks.workunit.client.0.smithi029.stdout:6/736: fdatasync d7/d46/d69/f8a 0 2024-04-26T11:46:40.304 INFO:tasks.workunit.client.0.smithi029.stdout:1/818: unlink d7/d25/d6d/d8c/f88 0 2024-04-26T11:46:40.304 INFO:tasks.workunit.client.0.smithi029.stdout:5/643: mkdir db/d40/d4d/d79/dc8 0 2024-04-26T11:46:40.304 INFO:tasks.workunit.client.0.smithi029.stdout:7/774: mkdir d11/d18/d35/d103 0 2024-04-26T11:46:40.304 INFO:tasks.workunit.client.0.smithi029.stdout:4/700: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/cde 1 2024-04-26T11:46:40.308 INFO:tasks.workunit.client.0.smithi029.stdout:0/671: symlink d9/d16/de7/lf5 0 2024-04-26T11:46:40.308 INFO:tasks.workunit.client.0.smithi029.stdout:6/737: chown d7/d25/d4b/d4d/d65/db5 7640 1 2024-04-26T11:46:40.308 INFO:tasks.workunit.client.0.smithi029.stdout:7/775: rmdir d11/d18/d58 39 2024-04-26T11:46:40.308 INFO:tasks.workunit.client.0.smithi029.stdout:1/819: unlink d7/db/d10/d1e/db2/fbc 0 2024-04-26T11:46:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:2/750: dread d12/d6c/d73/d4f/d65/d81/fcb [0,4194304] 0 2024-04-26T11:46:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:5/644: link db/d40/d4d/d4f/d73/f74 db/d12/d1a/fc9 0 2024-04-26T11:46:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:0/672: mknod d9/d16/d33/d2f/d32/d9f/cf6 1 2024-04-26T11:46:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:6/738: write d7/d46/d69/da2/dc8/ded/ff4 [681553,105644] 0 2024-04-26T11:46:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:1/820: rmdir d7/db/dcc/dfe 0 2024-04-26T11:46:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:5/645: write db/d12/f7c [2185829,6040] 0 2024-04-26T11:46:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:2/751: mkdir d12/d24/d29/dda/d102 0 2024-04-26T11:46:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:7/776: truncate d11/d18/d58/fbd 250641 0 2024-04-26T11:46:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:5/646: readlink db/d12/l5d 0 2024-04-26T11:46:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:1/821: stat d7/d25/d6d/d8c/df0/f114 0 2024-04-26T11:46:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:2/752: write d12/f1b [2445077,68304] 0 2024-04-26T11:46:40.311 INFO:tasks.workunit.client.0.smithi029.stdout:8/630: dwrite dc/d12/fb1 [0,4194304] 0 2024-04-26T11:46:40.311 INFO:tasks.workunit.client.0.smithi029.stdout:0/673: truncate d9/d16/d25/d2a/d4b/fb6 35966 0 2024-04-26T11:46:40.314 INFO:tasks.workunit.client.0.smithi029.stdout:8/631: chown dc/d3b/f50 1811654 1 2024-04-26T11:46:40.314 INFO:tasks.workunit.client.0.smithi029.stdout:4/701: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/f42 [4194304,4194304] 0 2024-04-26T11:46:40.314 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:40.313+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:40.315 INFO:tasks.workunit.client.0.smithi029.stdout:0/674: write d9/d16/d25/d2a/d4b/f5d [7894559,122893] 0 2024-04-26T11:46:40.316 INFO:tasks.workunit.client.0.smithi029.stdout:2/753: rename d12/d24/d29/d36/d4b/f64 to d12/de3/f103 0 2024-04-26T11:46:40.318 INFO:tasks.workunit.client.0.smithi029.stdout:2/754: write d12/faf [427855,94231] 0 2024-04-26T11:46:40.319 INFO:tasks.workunit.client.0.smithi029.stdout:4/702: fdatasync d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f58 0 2024-04-26T11:46:40.320 INFO:tasks.workunit.client.0.smithi029.stdout:7/777: dwrite d11/d18/d35/d39/fec [0,4194304] 0 2024-04-26T11:46:40.320 INFO:tasks.workunit.client.0.smithi029.stdout:8/632: truncate dc/de/d2e/d23/d27/d6f/f8a 4247050 0 2024-04-26T11:46:40.321 INFO:tasks.workunit.client.0.smithi029.stdout:1/822: dwrite d7/d25/d68/fc8 [0,4194304] 0 2024-04-26T11:46:40.322 INFO:tasks.workunit.client.0.smithi029.stdout:7/778: mkdir d11/d15/d104 0 2024-04-26T11:46:40.322 INFO:tasks.workunit.client.0.smithi029.stdout:4/703: symlink d3/d1d/db/d13/d23/d2b/ldf 0 2024-04-26T11:46:40.323 INFO:tasks.workunit.client.0.smithi029.stdout:2/755: rename d12/d6c/d73/d4f/ffe to d12/d6c/d73/da5/f104 0 2024-04-26T11:46:40.323 INFO:tasks.workunit.client.0.smithi029.stdout:8/633: creat dc/de/d2e/d23/fe2 x:0 0 0 2024-04-26T11:46:40.323 INFO:tasks.workunit.client.0.smithi029.stdout:7/779: read d11/d18/f22 [405233,4324] 0 2024-04-26T11:46:40.324 INFO:tasks.workunit.client.0.smithi029.stdout:2/756: write d12/f26 [4848735,10635] 0 2024-04-26T11:46:40.325 INFO:tasks.workunit.client.0.smithi029.stdout:8/634: write dc/f4f [255234,55362] 0 2024-04-26T11:46:40.325 INFO:tasks.workunit.client.0.smithi029.stdout:9/655: sync 2024-04-26T11:46:40.325 INFO:tasks.workunit.client.0.smithi029.stdout:3/632: sync 2024-04-26T11:46:40.328 INFO:tasks.workunit.client.0.smithi029.stdout:1/823: rename d7/db/d10/d1e/d5e/fce to d7/db/dcc/deb/f124 0 2024-04-26T11:46:40.328 INFO:tasks.workunit.client.0.smithi029.stdout:3/633: chown d0/d1/d2b/d7e 853 1 2024-04-26T11:46:40.328 INFO:tasks.workunit.client.0.smithi029.stdout:4/704: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/fb6 [588144,52927] 0 2024-04-26T11:46:40.328 INFO:tasks.workunit.client.0.smithi029.stdout:8/635: read dc/f93 [4948253,6551] 0 2024-04-26T11:46:40.329 INFO:tasks.workunit.client.0.smithi029.stdout:2/757: chown d12/d24/d29/d50/lb0 15128177 1 2024-04-26T11:46:40.329 INFO:tasks.workunit.client.0.smithi029.stdout:4/705: chown d3/d1d/db/da4 11750 1 2024-04-26T11:46:40.329 INFO:tasks.workunit.client.0.smithi029.stdout:8/636: chown dc/d3b/f9a 4033565 1 2024-04-26T11:46:40.332 INFO:tasks.workunit.client.0.smithi029.stdout:8/637: mknod dc/d12/ce3 1 2024-04-26T11:46:40.332 INFO:tasks.workunit.client.0.smithi029.stdout:2/758: creat d12/d24/d29/d36/d4b/f105 x:0 0 0 2024-04-26T11:46:40.332 INFO:tasks.workunit.client.0.smithi029.stdout:0/675: dwrite d9/d16/d33/d2f/d32/d90/fbe [0,4194304] 0 2024-04-26T11:46:40.332 INFO:tasks.workunit.client.0.smithi029.stdout:3/634: link d0/d1/d2f/d82/fc5 d0/dc/d1f/fd9 0 2024-04-26T11:46:40.334 INFO:tasks.workunit.client.0.smithi029.stdout:2/759: symlink d12/d24/d2f/d76/l106 0 2024-04-26T11:46:40.334 INFO:tasks.workunit.client.0.smithi029.stdout:8/638: mknod dc/de/d26/d57/d86/d90/ce4 1 2024-04-26T11:46:40.334 INFO:tasks.workunit.client.0.smithi029.stdout:3/635: mknod d0/d1/d2b/d7e/dc2/cda 1 2024-04-26T11:46:40.334 INFO:tasks.workunit.client.0.smithi029.stdout:7/780: read d11/d15/d67/ff7 [39491,116755] 0 2024-04-26T11:46:40.335 INFO:tasks.workunit.client.0.smithi029.stdout:0/676: truncate d9/d16/d25/f3e 202756 0 2024-04-26T11:46:40.336 INFO:tasks.workunit.client.0.smithi029.stdout:2/760: mknod d12/d6c/d73/d40/ddd/dee/c107 1 2024-04-26T11:46:40.336 INFO:tasks.workunit.client.0.smithi029.stdout:8/639: truncate dc/d9f/fb8 411395 0 2024-04-26T11:46:40.337 INFO:tasks.workunit.client.0.smithi029.stdout:2/761: chown d12/d24 1 1 2024-04-26T11:46:40.339 INFO:tasks.workunit.client.0.smithi029.stdout:8/640: mknod dc/d12/d6a/d78/dc3/dcf/ce5 1 2024-04-26T11:46:40.340 INFO:tasks.workunit.client.0.smithi029.stdout:9/656: dwrite d4/d5/d16/f19 [0,4194304] 0 2024-04-26T11:46:40.340 INFO:tasks.workunit.client.0.smithi029.stdout:4/706: dwrite d3/d1d/db/d13/d23/d2b/f9a [0,4194304] 0 2024-04-26T11:46:40.340 INFO:tasks.workunit.client.0.smithi029.stdout:8/641: chown dc/de/d2e/d23/f21 172 1 2024-04-26T11:46:40.341 INFO:tasks.workunit.client.0.smithi029.stdout:8/642: mknod dc/d12/d6a/ce6 1 2024-04-26T11:46:40.342 INFO:tasks.workunit.client.0.smithi029.stdout:2/762: rename d12/d24/d29/d50/d55/f94 to d12/d6c/d73/f108 0 2024-04-26T11:46:40.342 INFO:tasks.workunit.client.0.smithi029.stdout:4/707: symlink d3/dba/le0 0 2024-04-26T11:46:40.343 INFO:tasks.workunit.client.0.smithi029.stdout:9/657: getdents d4/d49/d58 0 2024-04-26T11:46:40.343 INFO:tasks.workunit.client.0.smithi029.stdout:1/824: read d7/f75 [2668350,130884] 0 2024-04-26T11:46:40.348 INFO:tasks.workunit.client.0.smithi029.stdout:9/658: write d4/d5/d16/d80/dc2/fb2 [414676,41086] 0 2024-04-26T11:46:40.349 INFO:tasks.workunit.client.0.smithi029.stdout:4/708: creat d3/d1d/d11/d16/d1f/d3d/d39/fe1 x:0 0 0 2024-04-26T11:46:40.350 INFO:tasks.workunit.client.0.smithi029.stdout:1/825: creat d7/d25/d85/dfd/f125 x:0 0 0 2024-04-26T11:46:40.350 INFO:tasks.workunit.client.0.smithi029.stdout:0/677: dwrite d9/d16/d25/f3e [0,4194304] 0 2024-04-26T11:46:40.351 INFO:tasks.workunit.client.0.smithi029.stdout:9/659: mknod d4/ccc 1 2024-04-26T11:46:40.352 INFO:tasks.workunit.client.0.smithi029.stdout:3/636: dwrite d0/d1/d2b/d33/f8c [0,4194304] 0 2024-04-26T11:46:40.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/739: dread d7/d46/d69/da2/d4c/f7a [0,4194304] 0 2024-04-26T11:46:40.354 INFO:tasks.workunit.client.0.smithi029.stdout:9/660: dread - d4/d5/d16/fca zero size 2024-04-26T11:46:40.355 INFO:tasks.workunit.client.0.smithi029.stdout:0/678: creat d9/d78/ff7 x:0 0 0 2024-04-26T11:46:40.355 INFO:tasks.workunit.client.0.smithi029.stdout:9/661: fdatasync d4/f6f 0 2024-04-26T11:46:40.356 INFO:tasks.workunit.client.0.smithi029.stdout:6/740: dread - d7/d25/d4b/d4d/d65/f8c zero size 2024-04-26T11:46:40.357 INFO:tasks.workunit.client.0.smithi029.stdout:4/709: mkdir d3/d1d/db/de2 0 2024-04-26T11:46:40.357 INFO:tasks.workunit.client.0.smithi029.stdout:2/763: dwrite d12/d6c/d73/da5/ff8 [0,4194304] 0 2024-04-26T11:46:40.358 INFO:tasks.workunit.client.0.smithi029.stdout:1/826: creat d7/d25/d6d/f126 x:0 0 0 2024-04-26T11:46:40.358 INFO:tasks.workunit.client.0.smithi029.stdout:8/643: dwrite dc/de/d2e/d23/d27/f3e [0,4194304] 0 2024-04-26T11:46:40.360 INFO:tasks.workunit.client.0.smithi029.stdout:6/741: mknod d7/d46/d69/da2/d4c/d98/cfd 1 2024-04-26T11:46:40.360 INFO:tasks.workunit.client.0.smithi029.stdout:1/827: dread - d7/db/d10/d1e/d5e/fdb zero size 2024-04-26T11:46:40.360 INFO:tasks.workunit.client.0.smithi029.stdout:0/679: symlink d9/d16/d33/d2f/d32/lf8 0 2024-04-26T11:46:40.361 INFO:tasks.workunit.client.0.smithi029.stdout:2/764: unlink d12/d6c/d73/d4f/d65/d81/fce 0 2024-04-26T11:46:40.362 INFO:tasks.workunit.client.0.smithi029.stdout:3/637: read d0/d1/d2f/fba [1842881,109289] 0 2024-04-26T11:46:40.363 INFO:tasks.workunit.client.0.smithi029.stdout:6/742: creat d7/d20/d27/ffe x:0 0 0 2024-04-26T11:46:40.366 INFO:tasks.workunit.client.0.smithi029.stdout:4/710: rename d3/d1d/db/d13/d23/d2b/l7b to d3/d1d/d11/d16/d1f/d3d/le3 0 2024-04-26T11:46:40.366 INFO:tasks.workunit.client.0.smithi029.stdout:3/638: mkdir d0/d1/d2b/ddb 0 2024-04-26T11:46:40.366 INFO:tasks.workunit.client.0.smithi029.stdout:6/743: dread - d7/d46/d69/da2/fdc zero size 2024-04-26T11:46:40.366 INFO:tasks.workunit.client.0.smithi029.stdout:3/639: mknod d0/d1/d2b/d7e/cdc 1 2024-04-26T11:46:40.366 INFO:tasks.workunit.client.0.smithi029.stdout:4/711: symlink d3/d1d/db/d13/d73/le4 0 2024-04-26T11:46:40.366 INFO:tasks.workunit.client.0.smithi029.stdout:2/765: write d12/d6c/d73/d4f/d65/f84 [1241794,128469] 0 2024-04-26T11:46:40.367 INFO:tasks.workunit.client.0.smithi029.stdout:3/640: stat d0/dc/d80/f8f 0 2024-04-26T11:46:40.368 INFO:tasks.workunit.client.0.smithi029.stdout:3/641: write d0/d1/d41/d5f/d54/f58 [4644158,50557] 0 2024-04-26T11:46:40.370 INFO:tasks.workunit.client.0.smithi029.stdout:4/712: symlink d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/le5 0 2024-04-26T11:46:40.370 INFO:tasks.workunit.client.0.smithi029.stdout:2/766: link d12/d24/d2f/fd2 d12/d6c/d73/d4f/d65/d81/f109 0 2024-04-26T11:46:40.371 INFO:tasks.workunit.client.0.smithi029.stdout:8/644: dwrite dc/d3b/f56 [0,4194304] 0 2024-04-26T11:46:40.371 INFO:tasks.workunit.client.0.smithi029.stdout:1/828: dwrite d7/d25/d68/fc0 [0,4194304] 0 2024-04-26T11:46:40.371 INFO:tasks.workunit.client.0.smithi029.stdout:6/744: rename d7/d46/d69/da2/d4c/d98/fb6 to d7/d46/d69/da2/d4c/d98/d45/fff 0 2024-04-26T11:46:40.371 INFO:tasks.workunit.client.0.smithi029.stdout:0/680: read d9/d43/f65 [4152358,22089] 0 2024-04-26T11:46:40.372 INFO:tasks.workunit.client.0.smithi029.stdout:3/642: write d0/d1/d41/d5f/fa2 [172639,73250] 0 2024-04-26T11:46:40.373 INFO:tasks.workunit.client.0.smithi029.stdout:1/829: chown d7/db/d10/d1e/db2 52446613 1 2024-04-26T11:46:40.373 INFO:tasks.workunit.client.0.smithi029.stdout:2/767: write d12/d24/d29/f48 [3025308,34627] 0 2024-04-26T11:46:40.374 INFO:tasks.workunit.client.0.smithi029.stdout:5/647: dread db/d12/d1a/d4c/f8b [0,4194304] 0 2024-04-26T11:46:40.374 INFO:tasks.workunit.client.0.smithi029.stdout:3/643: write d0/dc/d80/d9a/fb4 [476979,52222] 0 2024-04-26T11:46:40.378 INFO:tasks.workunit.client.0.smithi029.stdout:4/713: rename d3/d1d/d11/d16/d1f/f52 to d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/dbe/fe6 0 2024-04-26T11:46:40.378 INFO:tasks.workunit.client.0.smithi029.stdout:1/830: write d7/db/dc5/dd5/fe9 [5006159,36171] 0 2024-04-26T11:46:40.378 INFO:tasks.workunit.client.0.smithi029.stdout:5/648: fsync db/d12/d72/f21 0 2024-04-26T11:46:40.378 INFO:tasks.workunit.client.0.smithi029.stdout:6/745: write d7/d46/d69/da2/d4c/d98/d45/d83/da9/fe0 [836954,5735] 0 2024-04-26T11:46:40.379 INFO:tasks.workunit.client.0.smithi029.stdout:1/831: write d7/db/d10/d1e/db2/dee/fa1 [466264,73656] 0 2024-04-26T11:46:40.381 INFO:tasks.workunit.client.0.smithi029.stdout:2/768: dread d12/d24/d2f/f33 [0,4194304] 0 2024-04-26T11:46:40.381 INFO:tasks.workunit.client.0.smithi029.stdout:4/714: write d3/d1d/d11/d16/d1f/d3d/d39/d30/fa3 [715996,119101] 0 2024-04-26T11:46:40.383 INFO:tasks.workunit.client.0.smithi029.stdout:4/715: fsync d3/f8d 0 2024-04-26T11:46:40.383 INFO:tasks.workunit.client.0.smithi029.stdout:9/662: dread d4/d5/d16/d80/dc2/fb2 [0,4194304] 0 2024-04-26T11:46:40.384 INFO:tasks.workunit.client.0.smithi029.stdout:4/716: fdatasync d3/d1d/f12 0 2024-04-26T11:46:40.384 INFO:tasks.workunit.client.0.smithi029.stdout:2/769: write d12/d24/d2f/d8c/f8e [406420,18136] 0 2024-04-26T11:46:40.384 INFO:tasks.workunit.client.0.smithi029.stdout:8/645: dread dc/de/d2e/d23/d27/d6f/d9b/fb5 [0,4194304] 0 2024-04-26T11:46:40.385 INFO:tasks.workunit.client.0.smithi029.stdout:9/663: readlink d4/d5/d78/l8b 0 2024-04-26T11:46:40.386 INFO:tasks.workunit.client.0.smithi029.stdout:7/781: dread d11/d18/d1a/f23 [0,4194304] 0 2024-04-26T11:46:40.389 INFO:tasks.workunit.client.0.smithi029.stdout:5/649: dwrite db/d12/d6b/fac [8388608,4194304] 0 2024-04-26T11:46:40.389 INFO:tasks.workunit.client.0.smithi029.stdout:4/717: stat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f6a 0 2024-04-26T11:46:40.391 INFO:tasks.workunit.client.0.smithi029.stdout:9/664: chown d4/d49/d58/d67/l6c 830059 1 2024-04-26T11:46:40.395 INFO:tasks.workunit.client.0.smithi029.stdout:1/832: dread d7/db/dcc/deb/f124 [0,4194304] 0 2024-04-26T11:46:40.395 INFO:tasks.workunit.client.0.smithi029.stdout:0/681: read d9/d16/d33/d2f/d32/d90/fc8 [1190867,128193] 0 2024-04-26T11:46:40.396 INFO:tasks.workunit.client.0.smithi029.stdout:6/746: dwrite d7/d20/d27/d91/dee/ff0 [0,4194304] 0 2024-04-26T11:46:40.397 INFO:tasks.workunit.client.0.smithi029.stdout:3/644: dwrite d0/d1/d2f/f9f [0,4194304] 0 2024-04-26T11:46:40.399 INFO:tasks.workunit.client.0.smithi029.stdout:1/833: chown d7/d5b/fb1 39411786 1 2024-04-26T11:46:40.400 INFO:tasks.workunit.client.0.smithi029.stdout:0/682: fdatasync d9/d43/fa0 0 2024-04-26T11:46:40.401 INFO:tasks.workunit.client.0.smithi029.stdout:4/718: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/fe7 x:0 0 0 2024-04-26T11:46:40.401 INFO:tasks.workunit.client.0.smithi029.stdout:2/770: dwrite d12/d6c/d73/d4f/d65/d99/f9e [4194304,4194304] 0 2024-04-26T11:46:40.402 INFO:tasks.workunit.client.0.smithi029.stdout:8/646: dwrite dc/d12/fb1 [0,4194304] 0 2024-04-26T11:46:40.402 INFO:tasks.workunit.client.0.smithi029.stdout:9/665: write d4/f7f [2368448,35089] 0 2024-04-26T11:46:40.403 INFO:tasks.workunit.client.0.smithi029.stdout:4/719: rmdir d3/d1d/d11/d16/d1f 39 2024-04-26T11:46:40.404 INFO:tasks.workunit.client.0.smithi029.stdout:0/683: chown d9/d16/d33/f81 820293 1 2024-04-26T11:46:40.405 INFO:tasks.workunit.client.0.smithi029.stdout:7/782: dwrite d11/d18/d35/dbf/fdb [0,4194304] 0 2024-04-26T11:46:40.405 INFO:tasks.workunit.client.0.smithi029.stdout:1/834: write d7/db/d8d/d11a/fcb [768328,10269] 0 2024-04-26T11:46:40.405 INFO:tasks.workunit.client.0.smithi029.stdout:8/647: creat dc/de/d2e/d23/d8d/fe7 x:0 0 0 2024-04-26T11:46:40.406 INFO:tasks.workunit.client.0.smithi029.stdout:2/771: creat d12/d6c/d6e/f10a x:0 0 0 2024-04-26T11:46:40.406 INFO:tasks.workunit.client.0.smithi029.stdout:9/666: symlink d4/d5/d7a/d97/lcd 0 2024-04-26T11:46:40.407 INFO:tasks.workunit.client.0.smithi029.stdout:0/684: dread - d9/d16/d52/f9b zero size 2024-04-26T11:46:40.408 INFO:tasks.workunit.client.0.smithi029.stdout:5/650: dwrite f4 [0,4194304] 0 2024-04-26T11:46:40.408 INFO:tasks.workunit.client.0.smithi029.stdout:7/783: chown d11/d18/d1a/d33/f93 13 1 2024-04-26T11:46:40.409 INFO:tasks.workunit.client.0.smithi029.stdout:2/772: creat d12/d6c/d70/f10b x:0 0 0 2024-04-26T11:46:40.409 INFO:tasks.workunit.client.0.smithi029.stdout:0/685: creat d9/d16/d33/ff9 x:0 0 0 2024-04-26T11:46:40.409 INFO:tasks.workunit.client.0.smithi029.stdout:9/667: symlink d4/d5/d7/d74/lce 0 2024-04-26T11:46:40.409 INFO:tasks.workunit.client.0.smithi029.stdout:1/835: creat d7/db/d10/d1e/d5e/d10f/d112/f127 x:0 0 0 2024-04-26T11:46:40.410 INFO:tasks.workunit.client.0.smithi029.stdout:5/651: stat db/d12/l3e 0 2024-04-26T11:46:40.411 INFO:tasks.workunit.client.0.smithi029.stdout:8/648: write dc/d3b/f9a [640072,113062] 0 2024-04-26T11:46:40.411 INFO:tasks.workunit.client.0.smithi029.stdout:0/686: symlink d9/d16/d33/d2f/d32/d90/lfa 0 2024-04-26T11:46:40.412 INFO:tasks.workunit.client.0.smithi029.stdout:2/773: rename d12/d24/d29/f71 to d12/d24/d2f/d76/f10c 0 2024-04-26T11:46:40.413 INFO:tasks.workunit.client.0.smithi029.stdout:7/784: getdents d11/d18/d58/d8d 0 2024-04-26T11:46:40.413 INFO:tasks.workunit.client.0.smithi029.stdout:5/652: getdents db/d40/d77 0 2024-04-26T11:46:40.413 INFO:tasks.workunit.client.0.smithi029.stdout:0/687: creat d9/d16/d25/d2a/d46/ffb x:0 0 0 2024-04-26T11:46:40.413 INFO:tasks.workunit.client.0.smithi029.stdout:8/649: truncate dc/d3b/f56 4685813 0 2024-04-26T11:46:40.414 INFO:tasks.workunit.client.0.smithi029.stdout:2/774: readlink d12/d24/d29/d36/l79 0 2024-04-26T11:46:40.415 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:40.408+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:40.415 INFO:tasks.workunit.client.0.smithi029.stdout:5/653: unlink db/d12/d1a/f68 0 2024-04-26T11:46:40.415 INFO:tasks.workunit.client.0.smithi029.stdout:8/650: mkdir dc/de/d26/d57/d86/d90/de8 0 2024-04-26T11:46:40.416 INFO:tasks.workunit.client.0.smithi029.stdout:2/775: symlink d12/d6c/d73/dbd/dec/l10d 0 2024-04-26T11:46:40.416 INFO:tasks.workunit.client.0.smithi029.stdout:0/688: creat d9/d16/d33/d2f/d32/d90/ffc x:0 0 0 2024-04-26T11:46:40.416 INFO:tasks.workunit.client.0.smithi029.stdout:5/654: stat db/d40/d4d/d79 0 2024-04-26T11:46:40.418 INFO:tasks.workunit.client.0.smithi029.stdout:7/785: creat d11/d18/d58/d8d/f105 x:0 0 0 2024-04-26T11:46:40.418 INFO:tasks.workunit.client.0.smithi029.stdout:4/720: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f58 [0,4194304] 0 2024-04-26T11:46:40.419 INFO:tasks.workunit.client.0.smithi029.stdout:5/655: write db/d12/d1a/f27 [1138002,14504] 0 2024-04-26T11:46:40.419 INFO:tasks.workunit.client.0.smithi029.stdout:2/776: rename d12/faf to d12/d24/d29/d50/d55/d5f/f10e 0 2024-04-26T11:46:40.420 INFO:tasks.workunit.client.0.smithi029.stdout:5/656: write db/d40/d4d/f9d [638608,60623] 0 2024-04-26T11:46:40.421 INFO:tasks.workunit.client.0.smithi029.stdout:2/777: chown d12/d6c/d73/f67 91785 1 2024-04-26T11:46:40.423 INFO:tasks.workunit.client.0.smithi029.stdout:4/721: getdents d3/d1d/da0 0 2024-04-26T11:46:40.423 INFO:tasks.workunit.client.0.smithi029.stdout:2/778: mkdir d12/d24/d29/d36/d10f 0 2024-04-26T11:46:40.423 INFO:tasks.workunit.client.0.smithi029.stdout:4/722: mkdir d3/d1d/db/d13/d23/de8 0 2024-04-26T11:46:40.424 INFO:tasks.workunit.client.0.smithi029.stdout:5/657: rename db/d12/d72/l34 to db/d12/d72/lca 0 2024-04-26T11:46:40.424 INFO:tasks.workunit.client.0.smithi029.stdout:2/779: readlink d12/d24/d29/db2/lba 0 2024-04-26T11:46:40.424 INFO:tasks.workunit.client.0.smithi029.stdout:8/651: dwrite dc/fbd [0,4194304] 0 2024-04-26T11:46:40.425 INFO:tasks.workunit.client.0.smithi029.stdout:2/780: chown d12/d24/d29/d50/f7d 88 1 2024-04-26T11:46:40.425 INFO:tasks.workunit.client.0.smithi029.stdout:8/652: dread - dc/d12/f5d zero size 2024-04-26T11:46:40.426 INFO:tasks.workunit.client.0.smithi029.stdout:5/658: rename db/d40/d77/d98/l9f to db/d40/d4d/d79/lcb 0 2024-04-26T11:46:40.426 INFO:tasks.workunit.client.0.smithi029.stdout:4/723: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/fe9 x:0 0 0 2024-04-26T11:46:40.426 INFO:tasks.workunit.client.0.smithi029.stdout:2/781: truncate d12/d6c/f9c 577910 0 2024-04-26T11:46:40.427 INFO:tasks.workunit.client.0.smithi029.stdout:5/659: dread - db/d40/d4d/d4f/fb9 zero size 2024-04-26T11:46:40.428 INFO:tasks.workunit.client.0.smithi029.stdout:2/782: creat d12/d24/d29/d36/f110 x:0 0 0 2024-04-26T11:46:40.428 INFO:tasks.workunit.client.0.smithi029.stdout:5/660: stat db/d12/d6b/lc7 0 2024-04-26T11:46:40.428 INFO:tasks.workunit.client.0.smithi029.stdout:4/724: write d3/d1d/d11/d16/d1f/d3d/d39/f5a [1241355,11147] 0 2024-04-26T11:46:40.429 INFO:tasks.workunit.client.0.smithi029.stdout:8/653: rename dc/de/d2e/d23/d27/d6f/f7a to dc/de/d2e/d23/d27/d6f/d9b/d43/da1/de0/fe9 0 2024-04-26T11:46:40.430 INFO:tasks.workunit.client.0.smithi029.stdout:2/783: truncate d12/d24/d29/d36/f3b 1220202 0 2024-04-26T11:46:40.430 INFO:tasks.workunit.client.0.smithi029.stdout:5/661: truncate db/d12/d6b/f83 3345491 0 2024-04-26T11:46:40.430 INFO:tasks.workunit.client.0.smithi029.stdout:8/654: dread - dc/de/d2e/d23/fe2 zero size 2024-04-26T11:46:40.431 INFO:tasks.workunit.client.0.smithi029.stdout:5/662: readlink db/d40/d4d/d4f/la1 0 2024-04-26T11:46:40.431 INFO:tasks.workunit.client.0.smithi029.stdout:8/655: mknod dc/de/d2e/d23/d8d/de1/cea 1 2024-04-26T11:46:40.432 INFO:tasks.workunit.client.0.smithi029.stdout:2/784: rmdir d12/d6c/d6e/dad 0 2024-04-26T11:46:40.433 INFO:tasks.workunit.client.0.smithi029.stdout:3/645: dread d0/d1/d41/d5f/d1a/d3b/fa5 [0,4194304] 0 2024-04-26T11:46:40.434 INFO:tasks.workunit.client.0.smithi029.stdout:2/785: dread - d12/d24/d29/d36/d4b/fc9 zero size 2024-04-26T11:46:40.434 INFO:tasks.workunit.client.0.smithi029.stdout:6/747: sync 2024-04-26T11:46:40.434 INFO:tasks.workunit.client.0.smithi029.stdout:9/668: sync 2024-04-26T11:46:40.434 INFO:tasks.workunit.client.0.smithi029.stdout:8/656: chown dc/de/d2e/d23/d27/d6f/d9b/d43/da1/f91 1 1 2024-04-26T11:46:40.437 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:40.437 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:40.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:40.437 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:40.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.437 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:40.437 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:40.437 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7131402739999997, 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:46:40.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:46:40.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:46:40.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:46:40.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:40.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:46:40.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:46:40.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:46:40.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:46:40.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:40.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:46:40.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:46:40.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:46:40.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:46:40.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:46:40.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:46:40.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.446 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.447 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.447 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:40.447 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2923715680000001, 2024-04-26T11:46:40.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:46:40.447 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.447 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.448 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:40.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:40.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:40.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:46:40.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:46:40.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:46:40.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:40.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:46:40.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:46:40.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:46:40.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:46:40.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:46:40.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:46:40.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:46:40.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:46:40.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:46:40.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:46:40.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:46:40.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:46:40.457 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.457 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.457 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.458 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.458 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:40.458 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2923430900000001, 2024-04-26T11:46:40.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:46:40.459 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.460 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.460 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:40.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:40.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:46:40.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:46:40.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:46:40.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:46:40.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:46:40.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:46:40.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:46:40.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:46:40.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:46:40.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:46:40.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:46:40.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:46:40.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:46:40.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:46:40.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:46:40.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:46:40.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:46:40.469 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.469 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.469 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.469 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.470 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:40.470 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.292317873, 2024-04-26T11:46:40.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:46:40.470 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.470 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.470 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:40.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:40.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:46:40.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:46:40.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:46:40.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:46:40.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:46:40.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:46:40.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:46:40.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:46:40.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:46:40.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:46:40.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:46:40.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:46:40.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:46:40.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:46:40.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:46:40.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:46:40.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:46:40.479 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.479 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.480 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.480 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.480 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:40.480 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2922817869999998, 2024-04-26T11:46:40.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:46:40.481 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.481 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.481 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:40.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:40.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:46:40.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:46:40.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:46:40.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:46:40.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:46:40.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:46:40.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:46:40.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:46:40.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:46:40.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:46:40.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:46:40.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:46:40.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:46:40.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:46:40.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:46:40.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:46:40.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:46:40.487 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.488 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.488 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.488 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.488 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:40.488 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2922549650000001, 2024-04-26T11:46:40.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:46:40.488 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.489 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.489 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:40.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:40.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:46:40.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:46:40.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:46:40.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:46:40.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:46:40.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:46:40.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:46:40.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:46:40.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:46:40.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:46:40.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:46:40.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:46:40.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:46:40.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:46:40.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:46:40.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:46:40.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:46:40.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.495 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.496 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.496 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:40.496 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.289655727, 2024-04-26T11:46:40.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:46:40.496 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.496 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.497 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:40.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:40.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:46:40.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:46:40.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:46:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:46:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:46:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:46:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:46:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:46:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:46:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:46:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:46:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:46:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:46:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:46:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:46:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:46:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:46:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2891784689999999, 2024-04-26T11:46:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:46:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:46:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.285111267, 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:46:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:46:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.284947147, 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:46:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:46:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2820144870000001, 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:40.524 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2798318960000001, 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2773208609999998, 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.530 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:46:40.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:46:40.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2749262200000002, 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2747411610000001, 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.539 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.543 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.544 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.544 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.544 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:40.545 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.274701275, 2024-04-26T11:46:40.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:46:40.545 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.545 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:40.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.272962031, 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:46:40.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:46:40.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:46:40.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2722603220000002, 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:46:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:46:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2683808910000001, 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:46:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.268352052, 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:46:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:46:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:46:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:46:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:46:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:40.568 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:40.570 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:40.564+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:40.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:40.590 INFO:tasks.workunit.client.0.smithi029.stdout:9/669: rmdir d4/d5/d7a/da1 39 2024-04-26T11:46:40.590 INFO:tasks.workunit.client.0.smithi029.stdout:7/786: dwrite d11/d18/d35/d7c/fa5 [0,4194304] 0 2024-04-26T11:46:40.590 INFO:tasks.workunit.client.0.smithi029.stdout:8/657: mknod dc/de/d2e/d23/d27/d6f/d9b/d43/dad/ceb 1 2024-04-26T11:46:40.590 INFO:tasks.workunit.client.0.smithi029.stdout:6/748: getdents d7/d97/dc2 0 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:2/786: creat d12/d24/d29/d50/d55/d5f/f111 x:0 0 0 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:9/670: symlink d4/d5/d7/lcf 0 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:4/725: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f58 [4194304,4194304] 0 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:6/749: rmdir d7/d46 39 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:7/787: mknod d11/d18/d35/d39/d7e/da2/c106 1 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:8/658: chown dc/de/d2e/d23/d27/d6f/d9b/f45 11 1 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:9/671: creat d4/d46/fd0 x:0 0 0 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:5/663: dwrite db/f76 [0,4194304] 0 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:8/659: mknod dc/d12/d6a/cec 1 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:7/788: symlink d11/d18/l107 0 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:8/660: readlink dc/de/d2e/d23/d27/la4 0 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:9/672: symlink d4/d49/d58/d67/dab/ld1 0 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:8/661: chown dc/d12/d6a/daa 61 1 2024-04-26T11:46:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:4/726: rename d3/d1d/d11/d16/d1f/d3d/d46/f93 to d3/d1d/d11/d16/d1f/fea 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:5/664: creat db/d40/d4d/fcc x:0 0 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:8/662: fsync dc/de/d2e/d23/d27/d6f/d9b/da2/fb4 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:6/750: write d7/f1a [6932049,77829] 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/727: symlink d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/dc8/leb 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:6/751: mknod d7/d97/c100 1 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/728: write d3/f47 [14177,126189] 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/729: write d3/d1d/d11/d16/d1f/d3d/f60 [3350143,28508] 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:0/689: dread d9/d43/f65 [0,4194304] 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/730: creat d3/d1d/db/d13/d23/fec x:0 0 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:5/665: sync 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:2/787: truncate d12/d24/d2f/d76/f10c 2101195 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:0/690: creat d9/d16/d52/ffd x:0 0 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:7/789: dwrite d11/d18/d1a/d26/f2c [0,4194304] 0 2024-04-26T11:46:40.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/731: mkdir d3/d50/d7a/ded 0 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:8/663: link dc/de/d2e/d23/d27/d6f/d9b/d43/da1/f61 dc/de/d2e/d23/d27/d6f/fed 0 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:5/666: mknod db/d12/d72/d92/ccd 1 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:2/788: dread - d12/d6c/d70/f10b zero size 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:0/691: chown d9/d16/de7/lb2 975534 1 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:9/673: dwrite d4/d5/d16/d80/faa [4194304,4194304] 0 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:6/752: dread d7/d46/d69/da2/d4c/d98/d45/d76/f99 [0,4194304] 0 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:2/789: mknod d12/d6c/d73/c112 1 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:0/692: dread - d9/d78/ff7 zero size 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:8/664: rename dc/l9c to dc/de/d26/d6b/dde/lee 0 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:5/667: creat db/d12/d72/fce x:0 0 0 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:9/674: stat d4/d5/d16/d80/dc2/fb2 0 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:2/790: rename d12/d24/fa9 to d12/d6c/d6e/de4/f113 0 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:6/753: unlink d7/d46/d69/da2/d4c/d98/d45/d83/dbf/fcc 0 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:9/675: chown d4/d49/d58/d67/dab 7575 1 2024-04-26T11:46:40.593 INFO:tasks.workunit.client.0.smithi029.stdout:3/646: dread d0/d1/d41/d5f/d54/fb8 [0,4194304] 0 2024-04-26T11:46:40.594 INFO:tasks.workunit.client.0.smithi029.stdout:5/668: rename db/d12/d1a/d4c/f8b to db/d89/fcf 0 2024-04-26T11:46:40.594 INFO:tasks.workunit.client.0.smithi029.stdout:3/647: sync 2024-04-26T11:46:40.594 INFO:tasks.workunit.client.0.smithi029.stdout:0/693: chown d9/d43/f75 6753 1 2024-04-26T11:46:40.594 INFO:tasks.workunit.client.0.smithi029.stdout:9/676: creat d4/fd2 x:0 0 0 2024-04-26T11:46:40.594 INFO:tasks.workunit.client.0.smithi029.stdout:1/836: dread d7/db/d8d/f92 [0,4194304] 0 2024-04-26T11:46:40.594 INFO:tasks.workunit.client.0.smithi029.stdout:5/669: chown db/d12/d72/d92/lb7 80145 1 2024-04-26T11:46:40.595 INFO:tasks.workunit.client.0.smithi029.stdout:0/694: creat d9/d16/d33/d2f/ffe x:0 0 0 2024-04-26T11:46:40.595 INFO:tasks.workunit.client.0.smithi029.stdout:3/648: write d0/d1/d2f/f3a [4683163,76903] 0 2024-04-26T11:46:40.595 INFO:tasks.workunit.client.0.smithi029.stdout:9/677: mknod d4/d5/d16/d39/dc5/cd3 1 2024-04-26T11:46:40.595 INFO:tasks.workunit.client.0.smithi029.stdout:5/670: creat db/d89/fd0 x:0 0 0 2024-04-26T11:46:40.595 INFO:tasks.workunit.client.0.smithi029.stdout:1/837: chown d7/db/d10/d1e/db2/dee/f116 1690 1 2024-04-26T11:46:40.595 INFO:tasks.workunit.client.0.smithi029.stdout:9/678: chown d4/d5/d16/fca 0 1 2024-04-26T11:46:40.595 INFO:tasks.workunit.client.0.smithi029.stdout:1/838: mknod d7/d25/d85/dfd/c128 1 2024-04-26T11:46:40.595 INFO:tasks.workunit.client.0.smithi029.stdout:3/649: rename d0/d1/d41/d5f/l88 to d0/d1/d2b/d33/ldd 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:0/695: truncate d9/d16/d25/d2a/d46/fbb 708558 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:8/665: dwrite dc/de/d26/d57/f85 [0,4194304] 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:1/839: stat d7/db/f1d 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:4/732: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/fa3 347497 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:9/679: truncate d4/d5/f51 5714777 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:6/754: truncate d7/d46/d69/da2/d4c/d98/d45/d76/f99 639392 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:6/755: readlink l3 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:4/733: mknod d3/d1d/db/da4/cee 1 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:0/696: mkdir d9/d16/de7/dff 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:1/840: truncate f2 1142601 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:2/791: rename d12/d6c/d6e/de4/f113 to d12/d24/d2f/f114 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:9/680: mkdir d4/d5/d78/dd4 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:4/734: mkdir d3/d1d/db/d13/d73/d7e/def 0 2024-04-26T11:46:40.596 INFO:tasks.workunit.client.0.smithi029.stdout:2/792: stat d12/d6c/d70 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:8/666: truncate dc/de/d2e/d23/d27/d6f/fed 1036371 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:1/841: unlink d7/d25/dab/df1/l104 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:0/697: write d9/d16/d25/d2a/d46/f64 [54459,61321] 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:9/681: link d4/d5/f4a d4/d5/d7/d74/fd5 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:5/671: dwrite db/d12/d1a/d4c/f58 [0,4194304] 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:8/667: truncate dc/d12/f20 4302765 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:4/735: write d3/d1d/db/d13/d23/f43 [5253050,129030] 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:9/682: write d4/d49/d58/f6d [1364552,23711] 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:1/842: rename d7/d25/d6d/d8c/fb9 to d7/db/d8d/d11a/f129 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:8/668: chown dc/de/d26/d6b 1685632 1 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:2/793: rename d12/d6c/d73/da5/f104 to d12/d24/d29/dda/d102/f115 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:1/843: mkdir d7/d25/d68/d4b/d66/d12a 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:0/698: unlink d9/d16/d33/d2f/d32/d90/fc2 0 2024-04-26T11:46:40.597 INFO:tasks.workunit.client.0.smithi029.stdout:4/736: rmdir d3/d1d/db/d13/d73/d7e/def 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:2/794: stat d12/d24/d29/d36/d4b/f105 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:6/756: rename d7/d46/d69/da2/d4c/f7a to d7/d46/d69/da2/dc8/f101 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:8/669: write dc/d12/d6a/f77 [429275,56742] 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:0/699: mkdir d9/d16/d33/d2f/d31/d100 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:4/737: chown d3/d1d/d11/d16/d1f/d3d/d39/fe1 0 1 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:9/683: dread d4/d49/d58/fa7 [0,4194304] 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:4/738: creat d3/d1d/d11/d16/d1f/d3d/d39/ff0 x:0 0 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:7/790: dread d11/d18/d58/d8d/fd0 [0,4194304] 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:5/672: dwrite db/d12/d1a/d4c/fb5 [0,4194304] 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:7/791: truncate d11/fcd 761005 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:2/795: dwrite d12/d24/d29/d36/d4b/f105 [0,4194304] 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:5/673: rename db/d12/d72/l5b to db/da6/ld1 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:5/674: creat db/da6/fd2 x:0 0 0 2024-04-26T11:46:40.598 INFO:tasks.workunit.client.0.smithi029.stdout:0/700: dread d9/d16/d25/da7/fec [0,4194304] 0 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:2/796: dread - d12/d6c/d73/d4f/d65/d99/fd5 zero size 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:3/650: dread d0/d1/d2b/d33/f74 [0,4194304] 0 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:5/675: mknod db/d40/d4d/cd3 1 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:8/670: dwrite dc/de/d2e/d23/d27/d6f/d9b/f45 [4194304,4194304] 0 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:8/671: sync 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:6/757: truncate d7/d46/d69/da2/d4c/d98/f33 5061506 0 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:2/797: fsync d12/d24/d29/d36/f88 0 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:5/676: creat db/d40/d77/fd4 x:0 0 0 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:8/672: creat dc/d12/d6a/daa/fef x:0 0 0 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:3/651: dread - d0/d1/d2f/dd8/f7a zero size 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:6/758: creat d7/d25/d4b/d6d/dd6/df7/f102 x:0 0 0 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:5/677: creat db/d40/d77/d98/fd5 x:0 0 0 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:5/678: sync 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:4/739: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/fce [0,4194304] 0 2024-04-26T11:46:40.599 INFO:tasks.workunit.client.0.smithi029.stdout:3/652: fdatasync d0/d1/d2b/d33/f66 0 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:1/844: dwrite d7/db/d10/d1e/d53/f6c [0,4194304] 0 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:5/679: unlink db/d12/f7c 0 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:3/653: chown d0/d1/d2f/fb3 64194130 1 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:8/673: mkdir dc/de/d26/d57/d86/dc0/df0 0 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:1/845: chown d7/db/d10/d20/fde 15337365 1 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:4/740: creat d3/d1d/db/d13/ff1 x:0 0 0 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:5/680: mkdir db/d40/dd6 0 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:3/654: symlink d0/d1/d41/d5f/d4d/d9d/lde 0 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:0/701: dwrite d9/d16/d25/d2a/d4b/dd9/ff3 [0,4194304] 0 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:1/846: symlink d7/db/dc5/dd5/l12b 0 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:4/741: chown d3/d1d/d11/d16/d1f/d3d 119399 1 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:1/847: sync 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:1/848: sync 2024-04-26T11:46:40.600 INFO:tasks.workunit.client.0.smithi029.stdout:5/681: mknod db/d40/d4d/d4f/cd7 1 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:2/798: dwrite d12/d6c/d73/da5/ff8 [0,4194304] 0 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:8/674: getdents dc/d12/d7c 0 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:3/655: rename d0/d1/d5c/f9b to d0/dc/d1f/fdf 0 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:7/792: dread d11/d18/d1a/f4a [0,4194304] 0 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:1/849: write d7/db/d8d/ff7 [694981,110167] 0 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:6/759: dwrite d7/d25/d4b/f6e [4194304,4194304] 0 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/742: creat d3/d1d/ff2 x:0 0 0 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/743: sync 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:5/682: getdents db/d40/d77 0 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:7/793: fdatasync d11/d18/d35/fdc 0 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:6/760: fdatasync d7/d25/d4b/d6d/f8e 0 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:3/656: rmdir d0/dc/d80 39 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:8/675: creat dc/de/d2e/d23/d27/d6f/ff1 x:0 0 0 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:5/683: rmdir db/d40/d4d/d4f/d73 39 2024-04-26T11:46:40.601 INFO:tasks.workunit.client.0.smithi029.stdout:5/684: readlink db/la5 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:7/794: unlink d11/d18/d35/d39/f6a 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:6/761: symlink d7/d25/d4b/d4d/l103 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:4/744: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/df3 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:8/676: symlink dc/de/d26/d57/lf2 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:3/657: rename d0/d1/d2f/d68 to d0/d1/d41/de0 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:5/685: symlink db/d12/d72/d39/d3b/ld8 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:6/762: creat d7/d20/d27/dc0/f104 x:0 0 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:9/684: dread d4/d5/d16/f1c [0,4194304] 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:4/745: rename d3/d1d/db/d13/d23/d2b/f7c to d3/d1d/db/da4/ff4 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:1/850: dread d7/db/d8d/f92 [0,4194304] 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:6/763: truncate d7/d25/d5c/f5e 1017120 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:9/685: chown d4/d49/d58/d67 17917085 1 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:4/746: write d3/d1d/db/d13/d23/f43 [627613,117902] 0 2024-04-26T11:46:40.602 INFO:tasks.workunit.client.0.smithi029.stdout:2/799: dwrite d12/d6c/d73/f108 [0,4194304] 0 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:7/795: dread d11/d18/d35/d7c/fa5 [0,4194304] 0 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:9/686: truncate d4/d46/f56 1613305 0 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:2/800: write d12/f26 [763925,105164] 0 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:1/851: rename d7/d25/d6d/d8c/lfb to d7/db/d10/l12c 0 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:7/796: mkdir d11/d18/d58/d8d/d108 0 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:8/677: dwrite dc/de/d2e/d23/fe2 [0,4194304] 0 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:4/747: read - d3/d1d/d11/d16/d1f/d3d/d39/ff0 zero size 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:2/801: chown d12/d6c/d73/d4f/d65/d99 31633156 1 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:9/687: getdents d4/d49 0 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:8/678: mknod dc/de/d26/d57/d86/d90/cf3 1 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:7/797: chown d11/d18/db8/dd7/le7 5 1 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:4/748: creat d3/d1d/db/ff5 x:0 0 0 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:2/802: fdatasync d12/de3/f103 0 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:7/798: write d11/d18/d1a/d33/fdf [395908,106927] 0 2024-04-26T11:46:40.603 INFO:tasks.workunit.client.0.smithi029.stdout:6/764: dwrite d7/f3e [0,4194304] 0 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:9/688: dread - d4/d5/d16/d80/f92 zero size 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:8/679: creat dc/de/d2e/d23/d27/dc5/ff4 x:0 0 0 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:2/803: creat d12/d24/d29/db2/f116 x:0 0 0 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:3/658: dwrite d0/dc/d1f/f6f [0,4194304] 0 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:4/749: creat d3/d1d/db/d13/d73/d97/ddb/ff6 x:0 0 0 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:9/689: write d4/d49/d7d/fb4 [27322,35448] 0 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:6/765: chown d7/d46/d69/da2/d4c/d98/fc9 88 1 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:9/690: readlink d4/d5/d78/l8b 0 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:4/750: chown d3/d1d/db/d13/l59 7361 1 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:2/804: symlink d12/d24/d29/d50/d6a/dd1/l117 0 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:6/766: dread - d7/d46/d69/da2/d4c/d98/d45/fe2 zero size 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:8/680: rename dc/de/d2e/d23/d27/d6f/d9b/d43/da1/l89 to dc/d3b/lf5 0 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:2/805: stat d12/d24/d29/d50/d6a/f9d 0 2024-04-26T11:46:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:9/691: rename d4/d5/d7a/l90 to d4/d5/d7/d74/ld6 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:6/767: write d7/d46/d69/da2/fdc [83773,50337] 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:8/681: link dc/de/d26/f32 dc/d12/d6a/daa/ff6 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:6/768: rename d7/d25/d4b/d4d/fd9 to d7/d46/d69/f105 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:2/806: truncate d12/d24/fe9 789101 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:2/807: sync 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:3/659: dwrite d0/dc/d1f/f8d [0,4194304] 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:4/751: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f5e [8388608,4194304] 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:9/692: dwrite d4/d49/d58/f9d [0,4194304] 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:6/769: readlink d7/d46/d69/db4/lfb 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:8/682: dwrite dc/de/d2e/d23/d27/d6f/d9b/f80 [0,4194304] 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:4/752: rmdir d3/d1d/db/d13/d23/de8 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:2/808: dread d12/d24/d29/d50/d6a/fab [0,4194304] 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:9/693: creat d4/d5/d16/d39/dc5/fd7 x:0 0 0 2024-04-26T11:46:40.605 INFO:tasks.workunit.client.0.smithi029.stdout:6/770: chown d7/d20/d27/f2b 50427 1 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:8/683: creat dc/de/d26/d57/ff7 x:0 0 0 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:9/694: write d4/d49/d58/f53 [1123477,130342] 0 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:8/684: write dc/de/d26/d57/ff7 [809856,62512] 0 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/852: dread d7/db/dc5/dd5/fe9 [0,4194304] 0 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:0/702: dread d9/d16/de7/f8b [0,4194304] 0 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/853: truncate d7/db/fa3 579760 0 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:8/685: dwrite dc/d12/f49 [0,4194304] 0 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/854: symlink d7/db/d10/d1e/d5e/d10f/d112/l12d 0 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/855: fdatasync d7/d25/d68/f79 0 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/856: chown d7 15440 1 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:5/686: dread db/d40/d4d/d4f/d73/f74 [0,4194304] 0 2024-04-26T11:46:40.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/857: fdatasync d7/db/d10/d1e/d5e/d10f/d112/f127 0 2024-04-26T11:46:40.610 INFO:tasks.workunit.client.0.smithi029.stdout:3/660: dwrite d0/d1/d2b/d33/dcb/fd7 [0,4194304] 0 2024-04-26T11:46:40.610 INFO:tasks.workunit.client.0.smithi029.stdout:5/687: mknod db/d40/d4d/d4f/d73/cd9 1 2024-04-26T11:46:40.610 INFO:tasks.workunit.client.0.smithi029.stdout:1/858: mknod d7/d25/d85/c12e 1 2024-04-26T11:46:40.610 INFO:tasks.workunit.client.0.smithi029.stdout:7/799: dread d11/dd3/de4/d84/fca [0,4194304] 0 2024-04-26T11:46:40.610 INFO:tasks.workunit.client.0.smithi029.stdout:5/688: symlink db/d40/d70/lda 0 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:3/661: rmdir d0/d1/d2b/d7e/da3 39 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:7/800: stat d11/d18/d1a/f31 0 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:0/703: dwrite d9/d16/d33/d2f/d32/d9f/de6/feb [0,4194304] 0 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:3/662: write d0/d1/d41/d5f/d1a/f3d [7267335,79495] 0 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:5/689: mknod db/d40/d4d/d4f/dc6/cdb 1 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:7/801: unlink d11/d18/d1a/dab/fee 0 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:0/704: chown d9/d16/d33/f38 0 1 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:7/802: stat d11/d18/l107 0 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:6/771: write d7/d97/fa5 [1861611,121987] 0 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:4/753: truncate d3/d1d/d11/d16/d1f/d3d/f60 3043218 0 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:8/686: truncate dc/d12/d6a/d78/dc3/fdc 204428 0 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:7/803: creat d11/d15/d79/f109 x:0 0 0 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:6/772: dread - d7/d25/d4b/d4d/d65/fe1 zero size 2024-04-26T11:46:40.611 INFO:tasks.workunit.client.0.smithi029.stdout:3/663: truncate d0/d1/d41/f42 5377005 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:0/705: write d9/d16/d25/d2a/d46/ffb [298920,114462] 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/690: link db/d12/d1a/l7b db/d12/d6b/da4/ldc 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:8/687: write dc/d12/f5d [789212,23292] 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:6/773: symlink d7/d25/d4b/d6d/dd6/l106 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:3/664: link d0/l9e d0/d1/d41/d5f/d1a/d3b/db5/le1 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:8/688: fsync dc/de/d2e/d23/d27/d6f/ff1 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/691: write db/d40/d4d/d4f/d73/fbb [457600,103045] 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:4/754: rename d3/d1d/db/d13/d23/d2b/ldf to d3/d1d/db/d13/d23/d2b/d9d/lf7 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/692: mknod db/d40/d77/cdd 1 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:1/859: dwrite d7/d25/d68/f79 [0,4194304] 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:0/706: read d9/d16/d25/f34 [197140,91818] 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:4/755: unlink d3/d1d/db/d13/d23/l49 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:3/665: write d0/d1/d2b/d7e/da3/fc1 [915799,109348] 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/693: write db/d12/d72/d92/f9c [456758,80926] 0 2024-04-26T11:46:40.612 INFO:tasks.workunit.client.0.smithi029.stdout:1/860: mknod d7/d25/d68/d4b/c12f 1 2024-04-26T11:46:40.613 INFO:tasks.workunit.client.0.smithi029.stdout:6/774: truncate d7/d46/d69/da2/d4c/d98/ff1 58709 0 2024-04-26T11:46:40.613 INFO:tasks.workunit.client.0.smithi029.stdout:1/861: write d7/d5b/fb4 [837925,122835] 0 2024-04-26T11:46:40.613 INFO:tasks.workunit.client.0.smithi029.stdout:0/707: write d9/d16/d33/d2f/d32/d90/fbe [4005441,66983] 0 2024-04-26T11:46:40.613 INFO:tasks.workunit.client.0.smithi029.stdout:4/756: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/cf8 1 2024-04-26T11:46:40.613 INFO:tasks.workunit.client.0.smithi029.stdout:7/804: dwrite d11/d15/d79/fcf [0,4194304] 0 2024-04-26T11:46:40.614 INFO:tasks.workunit.client.0.smithi029.stdout:6/775: dread - d7/d20/fea zero size 2024-04-26T11:46:40.614 INFO:tasks.workunit.client.0.smithi029.stdout:4/757: mknod d3/d1d/db/d13/d73/d97/ddb/cf9 1 2024-04-26T11:46:40.614 INFO:tasks.workunit.client.0.smithi029.stdout:3/666: creat d0/d1/d41/fe2 x:0 0 0 2024-04-26T11:46:40.616 INFO:tasks.workunit.client.0.smithi029.stdout:7/805: creat d11/d18/d35/d39/d7e/f10a x:0 0 0 2024-04-26T11:46:40.616 INFO:tasks.workunit.client.0.smithi029.stdout:4/758: symlink d3/d1d/d11/d16/d1f/lfa 0 2024-04-26T11:46:40.618 INFO:tasks.workunit.client.0.smithi029.stdout:3/667: truncate d0/d1/d2f/fb2 587630 0 2024-04-26T11:46:40.618 INFO:tasks.workunit.client.0.smithi029.stdout:1/862: creat d7/d25/d68/f130 x:0 0 0 2024-04-26T11:46:40.618 INFO:tasks.workunit.client.0.smithi029.stdout:9/695: dread d4/d5/f45 [0,4194304] 0 2024-04-26T11:46:40.619 INFO:tasks.workunit.client.0.smithi029.stdout:0/708: write d9/d78/f83 [564162,113254] 0 2024-04-26T11:46:40.621 INFO:tasks.workunit.client.0.smithi029.stdout:7/806: read d11/dd3/de4/d84/fca [2496520,365] 0 2024-04-26T11:46:40.621 INFO:tasks.workunit.client.0.smithi029.stdout:7/807: sync 2024-04-26T11:46:40.623 INFO:tasks.workunit.client.0.smithi029.stdout:5/694: dwrite db/d40/d4d/d4f/f8f [0,4194304] 0 2024-04-26T11:46:40.623 INFO:tasks.workunit.client.0.smithi029.stdout:3/668: mkdir d0/d1/d41/d5f/de3 0 2024-04-26T11:46:40.623 INFO:tasks.workunit.client.0.smithi029.stdout:4/759: write d3/d1d/da0/fad [923915,31696] 0 2024-04-26T11:46:40.623 INFO:tasks.workunit.client.0.smithi029.stdout:1/863: unlink d7/db/d10/d1e/d5e/fdb 0 2024-04-26T11:46:40.624 INFO:tasks.workunit.client.0.smithi029.stdout:0/709: mknod d9/d16/d33/d2f/d32/d90/df4/c101 1 2024-04-26T11:46:40.625 INFO:tasks.workunit.client.0.smithi029.stdout:8/689: dwrite dc/de/d2e/d23/d27/d6f/d9b/fb5 [0,4194304] 0 2024-04-26T11:46:40.625 INFO:tasks.workunit.client.0.smithi029.stdout:2/809: dread d12/f1b [0,4194304] 0 2024-04-26T11:46:40.625 INFO:tasks.workunit.client.0.smithi029.stdout:3/669: fdatasync d0/d1/d2f/fb2 0 2024-04-26T11:46:40.625 INFO:tasks.workunit.client.0.smithi029.stdout:7/808: symlink d11/d15/d104/l10b 0 2024-04-26T11:46:40.627 INFO:tasks.workunit.client.0.smithi029.stdout:4/760: symlink d3/d1d/db/d13/d73/d97/lfb 0 2024-04-26T11:46:40.628 INFO:tasks.workunit.client.0.smithi029.stdout:3/670: mknod d0/d1/d2b/da7/dad/d98/ce4 1 2024-04-26T11:46:40.628 INFO:tasks.workunit.client.0.smithi029.stdout:4/761: sync 2024-04-26T11:46:40.628 INFO:tasks.workunit.client.0.smithi029.stdout:9/696: write d4/d5/d16/d80/fc3 [802182,56616] 0 2024-04-26T11:46:40.628 INFO:tasks.workunit.client.0.smithi029.stdout:6/776: dwrite d7/d46/d69/da2/ff8 [0,4194304] 0 2024-04-26T11:46:40.628 INFO:tasks.workunit.client.0.smithi029.stdout:5/695: getdents db/d40/d70 0 2024-04-26T11:46:40.629 INFO:tasks.workunit.client.0.smithi029.stdout:1/864: link d7/db/d10/d1e/l95 d7/db/dc5/dd5/l131 0 2024-04-26T11:46:40.630 INFO:tasks.workunit.client.0.smithi029.stdout:5/696: truncate db/f1c 1633248 0 2024-04-26T11:46:40.630 INFO:tasks.workunit.client.0.smithi029.stdout:9/697: chown d4/d5/d7/f9f 215009 1 2024-04-26T11:46:40.631 INFO:tasks.workunit.client.0.smithi029.stdout:9/698: dread - d4/d49/d58/d67/f84 zero size 2024-04-26T11:46:40.632 INFO:tasks.workunit.client.0.smithi029.stdout:6/777: creat d7/d46/d69/da2/d4c/d98/d45/d83/f107 x:0 0 0 2024-04-26T11:46:40.634 INFO:tasks.workunit.client.0.smithi029.stdout:1/865: write d7/d25/dab/f7d [992256,64253] 0 2024-04-26T11:46:40.634 INFO:tasks.workunit.client.0.smithi029.stdout:3/671: creat d0/d1/d41/d5f/d1a/d3b/db5/fe5 x:0 0 0 2024-04-26T11:46:40.635 INFO:tasks.workunit.client.0.smithi029.stdout:2/810: link d12/d24/d2f/d8c/f8e d12/d24/d29/f118 0 2024-04-26T11:46:40.635 INFO:tasks.workunit.client.0.smithi029.stdout:9/699: creat d4/d5/d7a/fd8 x:0 0 0 2024-04-26T11:46:40.636 INFO:tasks.workunit.client.0.smithi029.stdout:6/778: read - d7/d25/d4b/d4d/fae zero size 2024-04-26T11:46:40.637 INFO:tasks.workunit.client.0.smithi029.stdout:0/710: dwrite d9/d16/d25/d2a/d4b/dd9/ff3 [4194304,4194304] 0 2024-04-26T11:46:40.638 INFO:tasks.workunit.client.0.smithi029.stdout:7/809: truncate d11/d18/d35/f76 3444184 0 2024-04-26T11:46:40.639 INFO:tasks.workunit.client.0.smithi029.stdout:6/779: fdatasync d7/d46/d69/da2/d4c/d98/f72 0 2024-04-26T11:46:40.639 INFO:tasks.workunit.client.0.smithi029.stdout:2/811: creat d12/d6c/d73/dbd/dec/f119 x:0 0 0 2024-04-26T11:46:40.639 INFO:tasks.workunit.client.0.smithi029.stdout:5/697: dread db/d40/d4d/d4f/d73/f74 [0,4194304] 0 2024-04-26T11:46:40.640 INFO:tasks.workunit.client.0.smithi029.stdout:9/700: link d4/d49/d58/f53 d4/d49/d7d/fd9 0 2024-04-26T11:46:40.640 INFO:tasks.workunit.client.0.smithi029.stdout:8/690: dwrite dc/de/d26/d57/f6d [0,4194304] 0 2024-04-26T11:46:40.641 INFO:tasks.workunit.client.0.smithi029.stdout:0/711: truncate d9/d16/d25/d2a/d4b/fe8 937009 0 2024-04-26T11:46:40.642 INFO:tasks.workunit.client.0.smithi029.stdout:9/701: truncate d4/d5/d16/f5b 520989 0 2024-04-26T11:46:40.643 INFO:tasks.workunit.client.0.smithi029.stdout:6/780: creat d7/d20/d27/d91/f108 x:0 0 0 2024-04-26T11:46:40.644 INFO:tasks.workunit.client.0.smithi029.stdout:0/712: rename d9/d16/fd8 to d9/d16/d25/da7/f102 0 2024-04-26T11:46:40.644 INFO:tasks.workunit.client.0.smithi029.stdout:9/702: write d4/d5/d7a/da1/fb6 [5142872,13668] 0 2024-04-26T11:46:40.644 INFO:tasks.workunit.client.0.smithi029.stdout:8/691: truncate dc/d12/d6a/d78/dc3/fdc 510552 0 2024-04-26T11:46:40.646 INFO:tasks.workunit.client.0.smithi029.stdout:9/703: rename d4/d49/d58/d67/dab/fbe to d4/d49/d7d/fda 0 2024-04-26T11:46:40.646 INFO:tasks.workunit.client.0.smithi029.stdout:8/692: creat dc/de/d2e/d23/d8d/de1/ff8 x:0 0 0 2024-04-26T11:46:40.646 INFO:tasks.workunit.client.0.smithi029.stdout:9/704: fdatasync d4/d5/d7/d74/fa2 0 2024-04-26T11:46:40.647 INFO:tasks.workunit.client.0.smithi029.stdout:3/672: dread d0/d1/d2b/d7e/da3/fc1 [0,4194304] 0 2024-04-26T11:46:40.647 INFO:tasks.workunit.client.0.smithi029.stdout:9/705: chown d4/d5/d7a/dbd 25581 1 2024-04-26T11:46:40.648 INFO:tasks.workunit.client.0.smithi029.stdout:3/673: stat d0/l48 0 2024-04-26T11:46:40.648 INFO:tasks.workunit.client.0.smithi029.stdout:8/693: getdents dc/d9f/db2 0 2024-04-26T11:46:40.648 INFO:tasks.workunit.client.0.smithi029.stdout:9/706: read - d4/d5/d7a/da1/fa9 zero size 2024-04-26T11:46:40.649 INFO:tasks.workunit.client.0.smithi029.stdout:3/674: readlink d0/d1/d2f/d82/lbc 0 2024-04-26T11:46:40.649 INFO:tasks.workunit.client.0.smithi029.stdout:9/707: fsync d4/d49/d7d/fb4 0 2024-04-26T11:46:40.650 INFO:tasks.workunit.client.0.smithi029.stdout:9/708: creat d4/d49/fdb x:0 0 0 2024-04-26T11:46:40.651 INFO:tasks.workunit.client.0.smithi029.stdout:9/709: creat d4/d5/d78/dd4/fdc x:0 0 0 2024-04-26T11:46:40.653 INFO:tasks.workunit.client.0.smithi029.stdout:3/675: read d0/d1/d2b/d33/f8c [4020526,89813] 0 2024-04-26T11:46:40.654 INFO:tasks.workunit.client.0.smithi029.stdout:0/713: dread d9/d16/f28 [0,4194304] 0 2024-04-26T11:46:40.655 INFO:tasks.workunit.client.0.smithi029.stdout:5/698: truncate db/d12/d1a/f96 1953774 0 2024-04-26T11:46:40.655 INFO:tasks.workunit.client.0.smithi029.stdout:6/781: truncate d7/d46/d69/da2/d4c/d98/f3d 1531861 0 2024-04-26T11:46:40.656 INFO:tasks.workunit.client.0.smithi029.stdout:2/812: dread d12/d24/d2f/d8c/f8e [0,4194304] 0 2024-04-26T11:46:40.657 INFO:tasks.workunit.client.0.smithi029.stdout:8/694: dwrite dc/d12/d6a/daa/fef [0,4194304] 0 2024-04-26T11:46:40.658 INFO:tasks.workunit.client.0.smithi029.stdout:0/714: creat d9/d43/f103 x:0 0 0 2024-04-26T11:46:40.659 INFO:tasks.workunit.client.0.smithi029.stdout:8/695: truncate dc/de/d2e/f68 1587915 0 2024-04-26T11:46:40.659 INFO:tasks.workunit.client.0.smithi029.stdout:9/710: stat d4/d49/d58/d67/dab 0 2024-04-26T11:46:40.660 INFO:tasks.workunit.client.0.smithi029.stdout:4/762: dread d3/d1d/d11/d16/d1f/d3d/f60 [0,4194304] 0 2024-04-26T11:46:40.660 INFO:tasks.workunit.client.0.smithi029.stdout:6/782: link d7/d20/f74 d7/d97/dc2/f109 0 2024-04-26T11:46:40.661 INFO:tasks.workunit.client.0.smithi029.stdout:5/699: mkdir db/d40/d4d/d4f/dde 0 2024-04-26T11:46:40.662 INFO:tasks.workunit.client.0.smithi029.stdout:8/696: mkdir dc/de/d2e/d23/df9 0 2024-04-26T11:46:40.662 INFO:tasks.workunit.client.0.smithi029.stdout:5/700: stat db/d40/d70/lda 0 2024-04-26T11:46:40.663 INFO:tasks.workunit.client.0.smithi029.stdout:4/763: readlink d3/d1d/db/d13/d23/la8 0 2024-04-26T11:46:40.663 INFO:tasks.workunit.client.0.smithi029.stdout:8/697: chown dc/d3b 0 1 2024-04-26T11:46:40.664 INFO:tasks.workunit.client.0.smithi029.stdout:2/813: truncate d12/d24/d29/d50/f56 443654 0 2024-04-26T11:46:40.666 INFO:tasks.workunit.client.0.smithi029.stdout:6/783: rename d7/d25/d4b/d4d/d65/fba to d7/d25/d4b/d4d/d65/f10a 0 2024-04-26T11:46:40.666 INFO:tasks.workunit.client.0.smithi029.stdout:3/676: dwrite d0/d1/d2f/d82/dce/fd2 [0,4194304] 0 2024-04-26T11:46:40.667 INFO:tasks.workunit.client.0.smithi029.stdout:5/701: chown db/d12/d1a/d4c/f91 636127512 1 2024-04-26T11:46:40.667 INFO:tasks.workunit.client.0.smithi029.stdout:8/698: dread - dc/de/d2e/d23/d27/d6f/d9b/da2/fd6 zero size 2024-04-26T11:46:40.667 INFO:tasks.workunit.client.0.smithi029.stdout:2/814: mknod d12/d24/d29/d36/d10f/c11a 1 2024-04-26T11:46:40.668 INFO:tasks.workunit.client.0.smithi029.stdout:5/702: stat db/d40/d77/lbc 0 2024-04-26T11:46:40.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/784: creat d7/d25/d4b/d4d/d65/db5/f10b x:0 0 0 2024-04-26T11:46:40.669 INFO:tasks.workunit.client.0.smithi029.stdout:8/699: chown dc/d12/d6a/d78/dc3/dcf 21 1 2024-04-26T11:46:40.672 INFO:tasks.workunit.client.0.smithi029.stdout:5/703: write db/d12/f1b [336278,55858] 0 2024-04-26T11:46:40.672 INFO:tasks.workunit.client.0.smithi029.stdout:2/815: creat d12/d24/f11b x:0 0 0 2024-04-26T11:46:40.672 INFO:tasks.workunit.client.0.smithi029.stdout:5/704: stat db/d12/d6b/da4 0 2024-04-26T11:46:40.672 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:40.669+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:40.672 INFO:tasks.workunit.client.0.smithi029.stdout:9/711: dwrite d4/d49/d58/f6d [4194304,4194304] 0 2024-04-26T11:46:40.673 INFO:tasks.workunit.client.0.smithi029.stdout:6/785: write d7/d25/d4b/d4d/d65/f10a [968859,51783] 0 2024-04-26T11:46:40.675 INFO:tasks.workunit.client.0.smithi029.stdout:9/712: write d4/d5/d7/f59 [3066580,126783] 0 2024-04-26T11:46:40.675 INFO:tasks.workunit.client.0.smithi029.stdout:5/705: symlink db/d40/d4d/d79/dc8/ldf 0 2024-04-26T11:46:40.676 INFO:tasks.workunit.client.0.smithi029.stdout:1/866: dread d7/d25/d68/d4b/f6f [0,4194304] 0 2024-04-26T11:46:40.677 INFO:tasks.workunit.client.0.smithi029.stdout:6/786: rmdir d7/d20/d27/d91/dee 39 2024-04-26T11:46:40.677 INFO:tasks.workunit.client.0.smithi029.stdout:7/810: dread d11/d18/d1a/d26/d91/f9c [0,4194304] 0 2024-04-26T11:46:40.677 INFO:tasks.workunit.client.0.smithi029.stdout:9/713: dread - d4/d5/d16/fca zero size 2024-04-26T11:46:40.677 INFO:tasks.workunit.client.0.smithi029.stdout:5/706: chown db/d40/f61 0 1 2024-04-26T11:46:40.678 INFO:tasks.workunit.client.0.smithi029.stdout:2/816: getdents d12/d24/d29/d50 0 2024-04-26T11:46:40.678 INFO:tasks.workunit.client.0.smithi029.stdout:4/764: dwrite d3/d1d/db/da4/ff4 [0,4194304] 0 2024-04-26T11:46:40.679 INFO:tasks.workunit.client.0.smithi029.stdout:1/867: mkdir d7/db/d10/d1e/d5e/d10f/d112/d132 0 2024-04-26T11:46:40.679 INFO:tasks.workunit.client.0.smithi029.stdout:2/817: stat d12/d24/d29/dc6 0 2024-04-26T11:46:40.680 INFO:tasks.workunit.client.0.smithi029.stdout:6/787: mknod d7/d46/d69/da2/d4c/d98/c10c 1 2024-04-26T11:46:40.680 INFO:tasks.workunit.client.0.smithi029.stdout:7/811: creat d11/d15/f10c x:0 0 0 2024-04-26T11:46:40.680 INFO:tasks.workunit.client.0.smithi029.stdout:9/714: chown d4/d49/d58/fa7 33012559 1 2024-04-26T11:46:40.681 INFO:tasks.workunit.client.0.smithi029.stdout:1/868: write d7/db/d10/d1e/d53/d9d/fbe [3803876,70169] 0 2024-04-26T11:46:40.682 INFO:tasks.workunit.client.0.smithi029.stdout:2/818: write d12/d6c/d73/d4f/d65/d81/fd3 [1290149,121712] 0 2024-04-26T11:46:40.683 INFO:tasks.workunit.client.0.smithi029.stdout:4/765: rename d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f7d to d3/d50/db4/ffc 0 2024-04-26T11:46:40.683 INFO:tasks.workunit.client.0.smithi029.stdout:1/869: mkdir d7/db/d10/d1e/d53/d133 0 2024-04-26T11:46:40.684 INFO:tasks.workunit.client.0.smithi029.stdout:9/715: truncate d4/d5/d16/f73 521159 0 2024-04-26T11:46:40.684 INFO:tasks.workunit.client.0.smithi029.stdout:1/870: fsync d7/db/d8d/fe2 0 2024-04-26T11:46:40.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/788: rename d7/d97/dc2/ld2 to d7/d46/d69/l10d 0 2024-04-26T11:46:40.685 INFO:tasks.workunit.client.0.smithi029.stdout:5/707: dread db/d12/d6b/f9e [0,4194304] 0 2024-04-26T11:46:40.685 INFO:tasks.workunit.client.0.smithi029.stdout:2/819: rename d12/d24/d29/d38/dea/fe2 to d12/d6c/d73/d40/ddd/dee/f11c 0 2024-04-26T11:46:40.686 INFO:tasks.workunit.client.0.smithi029.stdout:6/789: stat d7/d46/d69/da2/d4c/d98/f3d 0 2024-04-26T11:46:40.687 INFO:tasks.workunit.client.0.smithi029.stdout:1/871: symlink d7/db/d10/d1e/d5e/d10f/d112/d132/l134 0 2024-04-26T11:46:40.687 INFO:tasks.workunit.client.0.smithi029.stdout:6/790: fsync d7/f22 0 2024-04-26T11:46:40.687 INFO:tasks.workunit.client.0.smithi029.stdout:2/820: truncate d12/d6c/d73/d4f/faa 1041042 0 2024-04-26T11:46:40.687 INFO:tasks.workunit.client.0.smithi029.stdout:1/872: read - d7/db/d10/d1e/db2/dee/f116 zero size 2024-04-26T11:46:40.688 INFO:tasks.workunit.client.0.smithi029.stdout:2/821: unlink d12/d6c/d73/d40/lc2 0 2024-04-26T11:46:40.688 INFO:tasks.workunit.client.0.smithi029.stdout:6/791: creat d7/d20/d27/d91/dee/f10e x:0 0 0 2024-04-26T11:46:40.689 INFO:tasks.workunit.client.0.smithi029.stdout:2/822: symlink d12/d24/d29/d50/d55/d5f/l11d 0 2024-04-26T11:46:40.690 INFO:tasks.workunit.client.0.smithi029.stdout:2/823: creat d12/d24/d29/dda/f11e x:0 0 0 2024-04-26T11:46:40.691 INFO:tasks.workunit.client.0.smithi029.stdout:2/824: chown d12/d6c/d73/d40/ddd/dee/f11c 971 1 2024-04-26T11:46:40.692 INFO:tasks.workunit.client.0.smithi029.stdout:7/812: truncate d11/d18/d35/d39/d7e/ff9 334238 0 2024-04-26T11:46:40.693 INFO:tasks.workunit.client.0.smithi029.stdout:2/825: creat d12/d47/f11f x:0 0 0 2024-04-26T11:46:40.694 INFO:tasks.workunit.client.0.smithi029.stdout:7/813: mknod d11/d18/d58/d8d/d108/c10d 1 2024-04-26T11:46:40.695 INFO:tasks.workunit.client.0.smithi029.stdout:3/677: dread d0/d1/d2f/fba [0,4194304] 0 2024-04-26T11:46:40.696 INFO:tasks.workunit.client.0.smithi029.stdout:7/814: fsync d11/d15/f57 0 2024-04-26T11:46:40.697 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:40.697 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:40.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.697 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:2462 3.8 3:17051619:::200.0000000f:head [write 3849917~9768 [fadvise_dontneed] in=9768b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-26T11:46:40.697 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.696982+0000", 2024-04-26T11:46:40.697 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00064327999999999998, 2024-04-26T11:46:40.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000670205, 2024-04-26T11:46:40.697 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:40.697 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:40.697 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:40.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.696982+0000", 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.696982+0000", 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.696982+0000", 2024-04-26T11:46:40.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.696993+0000", 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1491000000000001e-05 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.697005+0000", 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.697012+0000", 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4289999999999998e-06 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.697059+0000", 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7141000000000001e-05 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.697120+0000", 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0776999999999998e-05 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:40.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.701 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14056 4.9 4.d3e97bc9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:40.701 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.697684+0000", 2024-04-26T11:46:40.701 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9999423, 2024-04-26T11:46:40.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2723000000000003e-05, 2024-04-26T11:46:40.701 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:40.701 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2024-04-26T11:46:40.701 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:40.701 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14056 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.697684+0000", 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.697684+0000", 2024-04-26T11:46:40.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.697682+0000", 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.697690+0000", 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7819999999999994e-06 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:40.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.697702+0000", 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2208000000000001e-05 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.697710+0000", 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.875e-06 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 2 2024-04-26T11:46:40.704 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:3/678: mknod d0/d1/ce6 1 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:1/873: dread d7/d25/f100 [0,4194304] 0 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:2/826: creat d12/d24/d2f/d8c/f120 x:0 0 0 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:0/715: dread d9/d16/d33/d2f/d32/d90/fbe [0,4194304] 0 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:6/792: dwrite d7/d46/d69/da2/f4a [4194304,4194304] 0 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:3/679: chown d0/dc/f6c 87082352 1 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:5/708: dwrite db/f1e [0,4194304] 0 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:0/716: chown d9/d16/d33/d2f/d32/d9d/f9e 1334980205 1 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:7/815: truncate d11/d15/d67/ff7 228774 0 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:2/827: creat d12/d6c/d73/d4f/d65/d99/f121 x:0 0 0 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:3/680: mkdir d0/d1/d41/d5f/de3/de7 0 2024-04-26T11:46:40.707 INFO:tasks.workunit.client.0.smithi029.stdout:1/874: getdents d7/d25/d68/d4b/d66/d12a 0 2024-04-26T11:46:40.708 INFO:tasks.workunit.client.0.smithi029.stdout:0/717: rename d9/d16/d25/da7/fec to d9/d16/d25/d2a/d4b/dde/f104 0 2024-04-26T11:46:40.708 INFO:tasks.workunit.client.0.smithi029.stdout:2/828: symlink d12/d6c/d6e/de4/l122 0 2024-04-26T11:46:40.708 INFO:tasks.workunit.client.0.smithi029.stdout:7/816: getdents d11/d18/d58/d8d 0 2024-04-26T11:46:40.708 INFO:tasks.workunit.client.0.smithi029.stdout:2/829: chown d12/d24/d29/d38/dea 1 1 2024-04-26T11:46:40.708 INFO:tasks.workunit.client.0.smithi029.stdout:0/718: write d9/d16/d25/f3e [1312764,29835] 0 2024-04-26T11:46:40.708 INFO:tasks.workunit.client.0.smithi029.stdout:7/817: creat d11/d37/f10e x:0 0 0 2024-04-26T11:46:40.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:40.710 INFO:tasks.workunit.client.0.smithi029.stdout:2/830: link d12/d6c/d73/dbd/dec/ffd d12/d47/f123 0 2024-04-26T11:46:40.710 INFO:tasks.workunit.client.0.smithi029.stdout:0/719: rename f3 to d9/d16/d33/d2f/d68/f105 0 2024-04-26T11:46:40.710 INFO:tasks.workunit.client.0.smithi029.stdout:8/700: sync 2024-04-26T11:46:40.711 INFO:tasks.workunit.client.0.smithi029.stdout:4/766: sync 2024-04-26T11:46:40.711 INFO:tasks.workunit.client.0.smithi029.stdout:2/831: chown d12/d24/d29/dc6 8 1 2024-04-26T11:46:40.711 INFO:tasks.workunit.client.0.smithi029.stdout:6/793: dread d7/d46/d69/da2/d4c/d98/fc5 [0,4194304] 0 2024-04-26T11:46:40.711 INFO:tasks.workunit.client.0.smithi029.stdout:1/875: dread d7/d25/d68/f79 [0,4194304] 0 2024-04-26T11:46:40.712 INFO:tasks.workunit.client.0.smithi029.stdout:5/709: dread db/d12/fa7 [0,4194304] 0 2024-04-26T11:46:40.712 INFO:tasks.workunit.client.0.smithi029.stdout:3/681: truncate d0/d1/d2b/da7/fb9 2818190 0 2024-04-26T11:46:40.712 INFO:tasks.workunit.client.0.smithi029.stdout:8/701: symlink dc/de/d2e/d23/d27/d6f/d9b/d43/da1/de0/lfa 0 2024-04-26T11:46:40.713 INFO:tasks.workunit.client.0.smithi029.stdout:3/682: mknod d0/d1/d2b/ddb/ce8 1 2024-04-26T11:46:40.714 INFO:tasks.workunit.client.0.smithi029.stdout:2/832: mkdir d12/d24/d29/d36/d10f/d124 0 2024-04-26T11:46:40.716 INFO:tasks.workunit.client.0.smithi029.stdout:4/767: rename d3/d1d/db/d13/d73/d97 to d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84/dfd 0 2024-04-26T11:46:40.717 INFO:tasks.workunit.client.0.smithi029.stdout:6/794: link d7/d46/d69/da2/d4c/d98/fc5 d7/d46/d69/db4/dfa/f10f 0 2024-04-26T11:46:40.717 INFO:tasks.workunit.client.0.smithi029.stdout:3/683: symlink d0/d1/d2b/ddb/le9 0 2024-04-26T11:46:40.717 INFO:tasks.workunit.client.0.smithi029.stdout:7/818: dwrite d11/d18/d35/f96 [0,4194304] 0 2024-04-26T11:46:40.718 INFO:tasks.workunit.client.0.smithi029.stdout:3/684: stat d0/d1/f7c 0 2024-04-26T11:46:40.721 INFO:tasks.workunit.client.0.smithi029.stdout:5/710: dread db/d12/d1a/f6f [0,4194304] 0 2024-04-26T11:46:40.721 INFO:tasks.workunit.client.0.smithi029.stdout:8/702: rename dc/d12/d6a/l38 to dc/de/d2e/d23/d27/d6f/dc8/lfb 0 2024-04-26T11:46:40.721 INFO:tasks.workunit.client.0.smithi029.stdout:0/720: dwrite d9/d16/d25/d2a/d74/d9a/faf [0,4194304] 0 2024-04-26T11:46:40.722 INFO:tasks.workunit.client.0.smithi029.stdout:6/795: fsync d7/d46/d69/db4/fe9 0 2024-04-26T11:46:40.722 INFO:tasks.workunit.client.0.smithi029.stdout:3/685: dread d0/d1/d2b/d7e/da3/fc1 [0,4194304] 0 2024-04-26T11:46:40.723 INFO:tasks.workunit.client.0.smithi029.stdout:9/716: dread d4/d5/d7/f94 [0,4194304] 0 2024-04-26T11:46:40.725 INFO:tasks.workunit.client.0.smithi029.stdout:5/711: mkdir db/d89/de0 0 2024-04-26T11:46:40.725 INFO:tasks.workunit.client.0.smithi029.stdout:3/686: truncate d0/d1/d41/d4c/f7b 4536551 0 2024-04-26T11:46:40.725 INFO:tasks.workunit.client.0.smithi029.stdout:8/703: truncate dc/de/d2e/d23/d27/dc5/fca 464004 0 2024-04-26T11:46:40.725 INFO:tasks.workunit.client.0.smithi029.stdout:0/721: getdents d9/d16/d25/d2a/d8e/dc7 0 2024-04-26T11:46:40.725 INFO:tasks.workunit.client.0.smithi029.stdout:3/687: truncate d0/d1/f16 5048217 0 2024-04-26T11:46:40.726 INFO:tasks.workunit.client.0.smithi029.stdout:5/712: creat db/d12/d72/d39/fe1 x:0 0 0 2024-04-26T11:46:40.731 INFO:tasks.workunit.client.0.smithi029.stdout:3/688: symlink d0/dc/d1f/d92/lea 0 2024-04-26T11:46:40.731 INFO:tasks.workunit.client.0.smithi029.stdout:0/722: truncate d9/d16/d52/fe2 636115 0 2024-04-26T11:46:40.731 INFO:tasks.workunit.client.0.smithi029.stdout:3/689: chown d0/faa 302 1 2024-04-26T11:46:40.731 INFO:tasks.workunit.client.0.smithi029.stdout:0/723: chown d9/d16/d33/d2f/d31 483317856 1 2024-04-26T11:46:40.731 INFO:tasks.workunit.client.0.smithi029.stdout:5/713: mkdir db/d89/de0/de2 0 2024-04-26T11:46:40.731 INFO:tasks.workunit.client.0.smithi029.stdout:0/724: dread - d9/d16/d25/db4/fb5 zero size 2024-04-26T11:46:40.731 INFO:tasks.workunit.client.0.smithi029.stdout:1/876: dread d7/d25/f2e [0,4194304] 0 2024-04-26T11:46:40.731 INFO:tasks.workunit.client.0.smithi029.stdout:5/714: write db/d12/d72/d92/f9c [1339826,89564] 0 2024-04-26T11:46:40.732 INFO:tasks.workunit.client.0.smithi029.stdout:3/690: truncate d0/d1/d41/d5f/d1a/d3b/db5/fe5 178241 0 2024-04-26T11:46:40.732 INFO:tasks.workunit.client.0.smithi029.stdout:1/877: rename d7/db/dcc/deb/f111 to d7/d25/d85/dfd/f135 0 2024-04-26T11:46:40.732 INFO:tasks.workunit.client.0.smithi029.stdout:3/691: unlink d0/d1/d2b/d33/f51 0 2024-04-26T11:46:40.732 INFO:tasks.workunit.client.0.smithi029.stdout:7/819: truncate f9 3401253 0 2024-04-26T11:46:40.732 INFO:tasks.workunit.client.0.smithi029.stdout:5/715: read db/d12/d1a/f19 [1222805,46425] 0 2024-04-26T11:46:40.732 INFO:tasks.workunit.client.0.smithi029.stdout:3/692: chown d0/dc/f71 627831773 1 2024-04-26T11:46:40.733 INFO:tasks.workunit.client.0.smithi029.stdout:5/716: write db/d12/d1a/d4c/f55 [4941728,48046] 0 2024-04-26T11:46:40.734 INFO:tasks.workunit.client.0.smithi029.stdout:1/878: rename d7/db/d8d/d11a/l9c to d7/db/d10/d1e/d53/d133/l136 0 2024-04-26T11:46:40.735 INFO:tasks.workunit.client.0.smithi029.stdout:3/693: write d0/d1/d41/d5f/d1a/d3b/f4f [209020,120223] 0 2024-04-26T11:46:40.735 INFO:tasks.workunit.client.0.smithi029.stdout:1/879: dread - d7/d5b/fb1 zero size 2024-04-26T11:46:40.736 INFO:tasks.workunit.client.0.smithi029.stdout:1/880: readlink d7/d25/dae/led 0 2024-04-26T11:46:40.737 INFO:tasks.workunit.client.0.smithi029.stdout:0/725: dwrite d9/d43/f6d [0,4194304] 0 2024-04-26T11:46:40.738 INFO:tasks.workunit.client.0.smithi029.stdout:7/820: dread d11/d18/f40 [0,4194304] 0 2024-04-26T11:46:40.739 INFO:tasks.workunit.client.0.smithi029.stdout:0/726: fsync d9/d16/d52/ffd 0 2024-04-26T11:46:40.739 INFO:tasks.workunit.client.0.smithi029.stdout:7/821: creat d11/d15/d79/d97/f10f x:0 0 0 2024-04-26T11:46:40.741 INFO:tasks.workunit.client.0.smithi029.stdout:3/694: rmdir d0/dc/d1f 39 2024-04-26T11:46:40.741 INFO:tasks.workunit.client.0.smithi029.stdout:7/822: truncate d11/d15/f2a 3581343 0 2024-04-26T11:46:40.742 INFO:tasks.workunit.client.0.smithi029.stdout:1/881: write d7/d25/f100 [1447266,31245] 0 2024-04-26T11:46:40.743 INFO:tasks.workunit.client.0.smithi029.stdout:3/695: chown d0/d1/d2f/f39 387918 1 2024-04-26T11:46:40.743 INFO:tasks.workunit.client.0.smithi029.stdout:5/717: dwrite db/d12/d72/f2c [0,4194304] 0 2024-04-26T11:46:40.745 INFO:tasks.workunit.client.0.smithi029.stdout:1/882: creat d7/d25/d6d/d8c/f137 x:0 0 0 2024-04-26T11:46:40.745 INFO:tasks.workunit.client.0.smithi029.stdout:5/718: mkdir db/de3 0 2024-04-26T11:46:40.746 INFO:tasks.workunit.client.0.smithi029.stdout:5/719: chown db/d12/d72/d92/lb7 7667 1 2024-04-26T11:46:40.746 INFO:tasks.workunit.client.0.smithi029.stdout:4/768: dread d3/f47 [0,4194304] 0 2024-04-26T11:46:40.746 INFO:tasks.workunit.client.0.smithi029.stdout:3/696: link d0/d1/d2b/f85 d0/d1/d2b/d33/dcb/feb 0 2024-04-26T11:46:40.747 INFO:tasks.workunit.client.0.smithi029.stdout:5/720: write db/d12/d72/f21 [4472044,90754] 0 2024-04-26T11:46:40.748 INFO:tasks.workunit.client.0.smithi029.stdout:4/769: unlink d3/d1d/d11/d16/d1f/d3d/le3 0 2024-04-26T11:46:40.748 INFO:tasks.workunit.client.0.smithi029.stdout:5/721: mknod db/d40/ce4 1 2024-04-26T11:46:40.752 INFO:tasks.workunit.client.0.smithi029.stdout:4/770: unlink d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f72 0 2024-04-26T11:46:40.752 INFO:tasks.workunit.client.0.smithi029.stdout:5/722: rename db/d12/d1a/l7b to db/d12/d72/d39/d3b/d86/le5 0 2024-04-26T11:46:40.754 INFO:tasks.workunit.client.0.smithi029.stdout:4/771: creat d3/d50/d7a/ded/ffe x:0 0 0 2024-04-26T11:46:40.754 INFO:tasks.workunit.client.0.smithi029.stdout:6/796: dread d7/d20/d27/d91/dee/ff0 [0,4194304] 0 2024-04-26T11:46:40.755 INFO:tasks.workunit.client.0.smithi029.stdout:1/883: dwrite d7/db/d10/d1e/fd1 [0,4194304] 0 2024-04-26T11:46:40.755 INFO:tasks.workunit.client.0.smithi029.stdout:2/833: dread d12/d6c/d73/d4f/d65/f75 [0,4194304] 0 2024-04-26T11:46:40.756 INFO:tasks.workunit.client.0.smithi029.stdout:4/772: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f5e [6569519,17125] 0 2024-04-26T11:46:40.757 INFO:tasks.workunit.client.0.smithi029.stdout:1/884: write d7/d5b/fb1 [602360,35281] 0 2024-04-26T11:46:40.758 INFO:tasks.workunit.client.0.smithi029.stdout:1/885: mknod d7/db/d10/d1e/d53/d9d/c138 1 2024-04-26T11:46:40.759 INFO:tasks.workunit.client.0.smithi029.stdout:1/886: stat d7/db 0 2024-04-26T11:46:40.759 INFO:tasks.workunit.client.0.smithi029.stdout:5/723: dread db/d40/d4d/f95 [0,4194304] 0 2024-04-26T11:46:40.760 INFO:tasks.workunit.client.0.smithi029.stdout:1/887: write d7/d25/d85/dfd/f125 [210939,59209] 0 2024-04-26T11:46:40.765 INFO:tasks.workunit.client.0.smithi029.stdout:5/724: dread db/d40/d4d/d4f/d73/f74 [0,4194304] 0 2024-04-26T11:46:40.765 INFO:tasks.workunit.client.0.smithi029.stdout:7/823: dread d11/d18/d1a/d33/fc8 [0,4194304] 0 2024-04-26T11:46:40.766 INFO:tasks.workunit.client.0.smithi029.stdout:5/725: rename db/d12/d72/fa2 to db/d12/d6b/fe6 0 2024-04-26T11:46:40.767 INFO:tasks.workunit.client.0.smithi029.stdout:5/726: mknod db/da6/ce7 1 2024-04-26T11:46:40.767 INFO:tasks.workunit.client.0.smithi029.stdout:6/797: truncate d7/d20/d27/d91/dee/ff0 700670 0 2024-04-26T11:46:40.767 INFO:tasks.workunit.client.0.smithi029.stdout:4/773: write d3/d1d/db/d13/d23/fd3 [2923669,73751] 0 2024-04-26T11:46:40.768 INFO:tasks.workunit.client.0.smithi029.stdout:4/774: stat d3/d1d/d11/d16/d1f/d3d/d46/fbf 0 2024-04-26T11:46:40.769 INFO:tasks.workunit.client.0.smithi029.stdout:5/727: rename db/d12/d1a/d4c to db/d40/d70/de8 0 2024-04-26T11:46:40.770 INFO:tasks.workunit.client.0.smithi029.stdout:4/775: rmdir d3/d1d/db/d13/d73/d7e 39 2024-04-26T11:46:40.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~106s 2024-04-26T11:46:40.775 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:40.772+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:40.776 INFO:tasks.workunit.client.0.smithi029.stdout:5/728: creat db/d40/d4d/d4f/d73/d93/fe9 x:0 0 0 2024-04-26T11:46:40.776 INFO:tasks.workunit.client.0.smithi029.stdout:1/888: dwrite d7/f1c [0,4194304] 0 2024-04-26T11:46:40.776 INFO:tasks.workunit.client.0.smithi029.stdout:7/824: dwrite d11/d18/d35/dbf/ff8 [0,4194304] 0 2024-04-26T11:46:40.776 INFO:tasks.workunit.client.0.smithi029.stdout:1/889: symlink d7/d25/d68/l139 0 2024-04-26T11:46:40.776 INFO:tasks.workunit.client.0.smithi029.stdout:6/798: write d7/d46/d69/da2/d4c/d98/fc5 [749140,70530] 0 2024-04-26T11:46:40.777 INFO:tasks.workunit.client.0.smithi029.stdout:7/825: stat d11/d18/dad/lc1 0 2024-04-26T11:46:40.778 INFO:tasks.workunit.client.0.smithi029.stdout:1/890: symlink d7/db/d10/d1e/d5e/l13a 0 2024-04-26T11:46:40.778 INFO:tasks.workunit.client.0.smithi029.stdout:6/799: link d7/d25/d4b/fbe d7/d46/f110 0 2024-04-26T11:46:40.779 INFO:tasks.workunit.client.0.smithi029.stdout:2/834: dread d12/d24/d29/d38/fac [0,4194304] 0 2024-04-26T11:46:40.780 INFO:tasks.workunit.client.0.smithi029.stdout:2/835: mknod d12/d6c/d70/c125 1 2024-04-26T11:46:40.782 INFO:tasks.workunit.client.0.smithi029.stdout:6/800: creat d7/d25/d4b/d4d/d65/db5/f111 x:0 0 0 2024-04-26T11:46:40.782 INFO:tasks.workunit.client.0.smithi029.stdout:9/717: sync 2024-04-26T11:46:40.782 INFO:tasks.workunit.client.0.smithi029.stdout:8/704: sync 2024-04-26T11:46:40.783 INFO:tasks.workunit.client.0.smithi029.stdout:8/705: mkdir dc/d12/d7c/dfc 0 2024-04-26T11:46:40.784 INFO:tasks.workunit.client.0.smithi029.stdout:6/801: creat d7/d46/d69/da2/d4c/d98/f112 x:0 0 0 2024-04-26T11:46:40.784 INFO:tasks.workunit.client.0.smithi029.stdout:7/826: dread d11/dd3/de4/d84/fca [0,4194304] 0 2024-04-26T11:46:40.786 INFO:tasks.workunit.client.0.smithi029.stdout:6/802: link d7/d46/f7f d7/d25/d4b/d6d/dd6/df7/f113 0 2024-04-26T11:46:40.786 INFO:tasks.workunit.client.0.smithi029.stdout:7/827: link d11/d18/d35/d39/d7e/da2/fda d11/d18/d35/d39/f110 0 2024-04-26T11:46:40.787 INFO:tasks.workunit.client.0.smithi029.stdout:6/803: symlink d7/d20/d27/dc0/l114 0 2024-04-26T11:46:40.787 INFO:tasks.workunit.client.0.smithi029.stdout:7/828: stat d11/d15/d79/da6/fa8 0 2024-04-26T11:46:40.788 INFO:tasks.workunit.client.0.smithi029.stdout:2/836: truncate d12/d6c/d73/d4f/d65/d6f/f77 305572 0 2024-04-26T11:46:40.789 INFO:tasks.workunit.client.0.smithi029.stdout:7/829: fdatasync d11/d18/d58/faf 0 2024-04-26T11:46:40.791 INFO:tasks.workunit.client.0.smithi029.stdout:7/830: mknod d11/d18/d1a/d92/c111 1 2024-04-26T11:46:40.791 INFO:tasks.workunit.client.0.smithi029.stdout:3/697: dread d0/d1/d2f/f39 [4194304,4194304] 0 2024-04-26T11:46:40.791 INFO:tasks.workunit.client.0.smithi029.stdout:7/831: rmdir d11/d18/d1a/d26 39 2024-04-26T11:46:40.792 INFO:tasks.workunit.client.0.smithi029.stdout:4/776: dread d3/d1d/d11/d16/f57 [0,4194304] 0 2024-04-26T11:46:40.792 INFO:tasks.workunit.client.0.smithi029.stdout:7/832: symlink d11/dd3/l112 0 2024-04-26T11:46:40.793 INFO:tasks.workunit.client.0.smithi029.stdout:7/833: stat d11/d18/d1a/d33/fa3 0 2024-04-26T11:46:40.794 INFO:tasks.workunit.client.0.smithi029.stdout:2/837: dread d12/f1c [0,4194304] 0 2024-04-26T11:46:40.795 INFO:tasks.workunit.client.0.smithi029.stdout:6/804: write d7/d20/d27/d91/dee/ff0 [1509494,46353] 0 2024-04-26T11:46:40.798 INFO:tasks.workunit.client.0.smithi029.stdout:3/698: truncate d0/d1/d41/d4c/f7b 363955 0 2024-04-26T11:46:40.801 INFO:tasks.workunit.client.0.smithi029.stdout:0/727: sync 2024-04-26T11:46:40.801 INFO:tasks.workunit.client.0.smithi029.stdout:3/699: sync 2024-04-26T11:46:40.801 INFO:tasks.workunit.client.0.smithi029.stdout:3/700: stat d0/lc9 0 2024-04-26T11:46:40.802 INFO:tasks.workunit.client.0.smithi029.stdout:7/834: dwrite d11/d18/d58/d8d/fbe [0,4194304] 0 2024-04-26T11:46:40.804 INFO:tasks.workunit.client.0.smithi029.stdout:3/701: rename d0/d1/d2b/d33/f8b to d0/d1/d41/d4c/fec 0 2024-04-26T11:46:40.804 INFO:tasks.workunit.client.0.smithi029.stdout:1/891: dread d7/d25/d68/fac [0,4194304] 0 2024-04-26T11:46:40.806 INFO:tasks.workunit.client.0.smithi029.stdout:1/892: write d7/d25/f2a [3308786,110495] 0 2024-04-26T11:46:40.807 INFO:tasks.workunit.client.0.smithi029.stdout:3/702: creat d0/d1/d2b/d33/fed x:0 0 0 2024-04-26T11:46:40.807 INFO:tasks.workunit.client.0.smithi029.stdout:9/718: dread d4/d49/d58/f91 [0,4194304] 0 2024-04-26T11:46:40.807 INFO:tasks.workunit.client.0.smithi029.stdout:5/729: dread db/f76 [0,4194304] 0 2024-04-26T11:46:40.807 INFO:tasks.workunit.client.0.smithi029.stdout:1/893: readlink d7/db/dc5/dd5/l117 0 2024-04-26T11:46:40.808 INFO:tasks.workunit.client.0.smithi029.stdout:0/728: truncate d9/f84 3697917 0 2024-04-26T11:46:40.809 INFO:tasks.workunit.client.0.smithi029.stdout:3/703: write d0/d1/d41/d5f/d1a/d3b/f4f [326580,124390] 0 2024-04-26T11:46:40.809 INFO:tasks.workunit.client.0.smithi029.stdout:9/719: mknod d4/d5/d16/cdd 1 2024-04-26T11:46:40.810 INFO:tasks.workunit.client.0.smithi029.stdout:9/720: read d4/d5/f45 [3028390,2408] 0 2024-04-26T11:46:40.810 INFO:tasks.workunit.client.0.smithi029.stdout:5/730: creat db/d40/d4d/d4f/d73/fea x:0 0 0 2024-04-26T11:46:40.810 INFO:tasks.workunit.client.0.smithi029.stdout:0/729: creat d9/d16/d25/ddc/f106 x:0 0 0 2024-04-26T11:46:40.811 INFO:tasks.workunit.client.0.smithi029.stdout:8/706: dread dc/de/d2e/d23/d27/f3e [0,4194304] 0 2024-04-26T11:46:40.811 INFO:tasks.workunit.client.0.smithi029.stdout:7/835: write d11/d18/d35/d39/d7e/dde/f5a [3151645,43689] 0 2024-04-26T11:46:40.812 INFO:tasks.workunit.client.0.smithi029.stdout:5/731: fdatasync db/d12/d6b/f83 0 2024-04-26T11:46:40.812 INFO:tasks.workunit.client.0.smithi029.stdout:9/721: getdents d4/d5/d7a/db0 0 2024-04-26T11:46:40.813 INFO:tasks.workunit.client.0.smithi029.stdout:0/730: rename d9/d16/d33/d2f/d31 to d9/d16/de7/d107 0 2024-04-26T11:46:40.813 INFO:tasks.workunit.client.0.smithi029.stdout:3/704: truncate d0/d1/d41/d5f/d54/fb8 3712420 0 2024-04-26T11:46:40.813 INFO:tasks.workunit.client.0.smithi029.stdout:7/836: write d11/d18/d1a/f80 [146447,89801] 0 2024-04-26T11:46:40.816 INFO:tasks.workunit.client.0.smithi029.stdout:7/837: link d11/d18/d58/d8d/fd0 d11/d18/db8/f113 0 2024-04-26T11:46:40.817 INFO:tasks.workunit.client.0.smithi029.stdout:7/838: dread - d11/d18/d35/d39/d7e/f10a zero size 2024-04-26T11:46:40.817 INFO:tasks.workunit.client.0.smithi029.stdout:3/705: dread d0/d1/d2b/d33/fa1 [0,4194304] 0 2024-04-26T11:46:40.818 INFO:tasks.workunit.client.0.smithi029.stdout:7/839: creat d11/d15/d67/f114 x:0 0 0 2024-04-26T11:46:40.819 INFO:tasks.workunit.client.0.smithi029.stdout:3/706: rename d0/d1/d41/d5f/d4d to d0/d1/d41/d4c/dee 0 2024-04-26T11:46:40.820 INFO:tasks.workunit.client.0.smithi029.stdout:7/840: rename d11/d15/d79 to d11/d115 0 2024-04-26T11:46:40.820 INFO:tasks.workunit.client.0.smithi029.stdout:3/707: mkdir d0/d1/d41/d5f/d54/def 0 2024-04-26T11:46:40.821 INFO:tasks.workunit.client.0.smithi029.stdout:7/841: symlink d11/d18/d35/d39/d7e/dde/l116 0 2024-04-26T11:46:40.821 INFO:tasks.workunit.client.0.smithi029.stdout:3/708: creat d0/d1/d41/d5f/de3/de7/ff0 x:0 0 0 2024-04-26T11:46:40.822 INFO:tasks.workunit.client.0.smithi029.stdout:7/842: chown d11/d18/d35/d39/d7e/f10a 817 1 2024-04-26T11:46:40.823 INFO:tasks.workunit.client.0.smithi029.stdout:7/843: chown d11/d18/db8/f113 111 1 2024-04-26T11:46:40.823 INFO:tasks.workunit.client.0.smithi029.stdout:3/709: rmdir d0/d1/d41/d5f/dd3 0 2024-04-26T11:46:40.824 INFO:tasks.workunit.client.0.smithi029.stdout:7/844: read - d11/d18/d1a/d33/f74 zero size 2024-04-26T11:46:40.824 INFO:tasks.workunit.client.0.smithi029.stdout:3/710: mknod d0/d1/d41/d5f/de3/cf1 1 2024-04-26T11:46:40.825 INFO:tasks.workunit.client.0.smithi029.stdout:8/707: write dc/de/d2e/d23/d27/d6f/d9b/d43/f82 [325306,51602] 0 2024-04-26T11:46:40.825 INFO:tasks.workunit.client.0.smithi029.stdout:6/805: dread d7/d25/f79 [0,4194304] 0 2024-04-26T11:46:40.825 INFO:tasks.workunit.client.0.smithi029.stdout:0/731: truncate d9/d16/d25/d2a/d4b/dd9/ff3 345060 0 2024-04-26T11:46:40.826 INFO:tasks.workunit.client.0.smithi029.stdout:8/708: chown dc/de/d26/f69 67 1 2024-04-26T11:46:40.827 INFO:tasks.workunit.client.0.smithi029.stdout:0/732: chown d9/d16/d33/ff9 418314423 1 2024-04-26T11:46:40.827 INFO:tasks.workunit.client.0.smithi029.stdout:6/806: unlink d7/d20/d27/f71 0 2024-04-26T11:46:40.828 INFO:tasks.workunit.client.0.smithi029.stdout:7/845: rename d11/d115/fd1 to d11/d18/db8/f117 0 2024-04-26T11:46:40.829 INFO:tasks.workunit.client.0.smithi029.stdout:6/807: stat d7/d46/d69/f9d 0 2024-04-26T11:46:40.829 INFO:tasks.workunit.client.0.smithi029.stdout:0/733: creat d9/d16/d33/d2f/d32/f108 x:0 0 0 2024-04-26T11:46:40.830 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:40.830 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:40.830 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:40.830 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:40.830 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:40.830 INFO:tasks.workunit.client.0.smithi029.stdout:8/709: write dc/de/d2e/d23/d27/d6f/d9b/d43/da1/de0/fe9 [664357,71710] 0 2024-04-26T11:46:40.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/808: symlink d7/d20/l115 0 2024-04-26T11:46:40.831 INFO:tasks.workunit.client.0.smithi029.stdout:0/734: symlink d9/d16/d52/l109 0 2024-04-26T11:46:40.832 INFO:tasks.workunit.client.0.smithi029.stdout:7/846: read d11/d18/f22 [432039,15209] 0 2024-04-26T11:46:40.832 INFO:tasks.workunit.client.0.smithi029.stdout:8/710: creat dc/de/d2e/d23/d27/d6f/ffd x:0 0 0 2024-04-26T11:46:40.833 INFO:tasks.workunit.client.0.smithi029.stdout:0/735: creat d9/d16/de7/dff/f10a x:0 0 0 2024-04-26T11:46:40.834 INFO:tasks.workunit.client.0.smithi029.stdout:7/847: write d11/d18/d35/ff2 [237414,68841] 0 2024-04-26T11:46:40.835 INFO:tasks.workunit.client.0.smithi029.stdout:6/809: dread d7/d46/d69/da2/d4c/d98/f52 [0,4194304] 0 2024-04-26T11:46:40.835 INFO:tasks.workunit.client.0.smithi029.stdout:0/736: chown d9/d16/d33/f72 37681421 1 2024-04-26T11:46:40.835 INFO:tasks.workunit.client.0.smithi029.stdout:8/711: creat dc/d12/d6a/d78/dc3/dcf/ffe x:0 0 0 2024-04-26T11:46:40.836 INFO:tasks.workunit.client.0.smithi029.stdout:2/838: dread d12/d24/d29/d50/d6a/fa2 [0,4194304] 0 2024-04-26T11:46:40.837 INFO:tasks.workunit.client.0.smithi029.stdout:1/894: dread d7/d25/d68/d4b/d66/f87 [0,4194304] 0 2024-04-26T11:46:40.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/839: chown d12/d24/d29/d36/l41 28 1 2024-04-26T11:46:40.838 INFO:tasks.workunit.client.0.smithi029.stdout:6/810: chown d7/d46/d69/da2/d4c/d98/ff1 4360904 1 2024-04-26T11:46:40.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/840: sync 2024-04-26T11:46:40.838 INFO:tasks.workunit.client.0.smithi029.stdout:4/777: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/fce [0,4194304] 0 2024-04-26T11:46:40.838 INFO:tasks.workunit.client.0.smithi029.stdout:0/737: unlink d9/d16/d33/d2f/l40 0 2024-04-26T11:46:40.839 INFO:tasks.workunit.client.0.smithi029.stdout:1/895: stat d7/db/dc5/fca 0 2024-04-26T11:46:40.839 INFO:tasks.workunit.client.0.smithi029.stdout:8/712: readlink dc/de/d2e/d23/d27/d6f/d9b/d43/da1/de0/lfa 0 2024-04-26T11:46:40.840 INFO:tasks.workunit.client.0.smithi029.stdout:6/811: chown d7/d46/d69/l10d 0 1 2024-04-26T11:46:40.840 INFO:tasks.workunit.client.0.smithi029.stdout:2/841: write d12/d24/d29/d36/d4b/fd7 [699369,41206] 0 2024-04-26T11:46:40.841 INFO:tasks.workunit.client.0.smithi029.stdout:1/896: chown d7/db/d10/d1e/db2/l10b 5815 1 2024-04-26T11:46:40.841 INFO:tasks.workunit.client.0.smithi029.stdout:8/713: stat dc/de/d26/d57/fb0 0 2024-04-26T11:46:40.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:40.842 INFO:tasks.workunit.client.0.smithi029.stdout:4/778: read - d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/fe9 zero size 2024-04-26T11:46:40.843 INFO:tasks.workunit.client.0.smithi029.stdout:2/842: unlink d12/d24/d29/d50/lb0 0 2024-04-26T11:46:40.843 INFO:tasks.workunit.client.0.smithi029.stdout:0/738: write d9/d16/d25/d2a/d8e/fb9 [874670,40138] 0 2024-04-26T11:46:40.843 INFO:tasks.workunit.client.0.smithi029.stdout:6/812: mknod d7/d46/d69/da2/d4c/d98/d45/c116 1 2024-04-26T11:46:40.845 INFO:tasks.workunit.client.0.smithi029.stdout:5/732: dread db/d12/d72/f3d [0,4194304] 0 2024-04-26T11:46:40.845 INFO:tasks.workunit.client.0.smithi029.stdout:8/714: creat dc/de/d26/d57/d86/dc0/fff x:0 0 0 2024-04-26T11:46:40.845 INFO:tasks.workunit.client.0.smithi029.stdout:1/897: rename d7/db/d8d/d11a/fcb to d7/d25/dae/f13b 0 2024-04-26T11:46:40.846 INFO:tasks.workunit.client.0.smithi029.stdout:9/722: dread d4/f7f [0,4194304] 0 2024-04-26T11:46:40.846 INFO:tasks.workunit.client.0.smithi029.stdout:6/813: mkdir d7/d46/d69/d117 0 2024-04-26T11:46:40.846 INFO:tasks.workunit.client.0.smithi029.stdout:2/843: creat d12/d24/d29/d38/dea/f126 x:0 0 0 2024-04-26T11:46:40.847 INFO:tasks.workunit.client.0.smithi029.stdout:7/848: dwrite d11/d18/d58/f64 [0,4194304] 0 2024-04-26T11:46:40.847 INFO:tasks.workunit.client.0.smithi029.stdout:4/779: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/dc8/fcb [813472,66541] 0 2024-04-26T11:46:40.848 INFO:tasks.workunit.client.0.smithi029.stdout:1/898: chown d7/d25/dab/f7d 1511 1 2024-04-26T11:46:40.849 INFO:tasks.workunit.client.0.smithi029.stdout:5/733: chown db/d40/d4d/d79/lbe 6223703 1 2024-04-26T11:46:40.849 INFO:tasks.workunit.client.0.smithi029.stdout:8/715: write dc/de/d26/d57/f6d [3959468,87573] 0 2024-04-26T11:46:40.849 INFO:tasks.workunit.client.0.smithi029.stdout:9/723: getdents d4/d49/d58 0 2024-04-26T11:46:40.849 INFO:tasks.workunit.client.0.smithi029.stdout:2/844: read d12/d24/d29/d50/f59 [17562,18062] 0 2024-04-26T11:46:40.850 INFO:tasks.workunit.client.0.smithi029.stdout:5/734: read - db/d40/d4d/d4f/d73/d93/fe9 zero size 2024-04-26T11:46:40.850 INFO:tasks.workunit.client.0.smithi029.stdout:6/814: fsync d7/d25/d4b/d6d/f78 0 2024-04-26T11:46:40.850 INFO:tasks.workunit.client.0.smithi029.stdout:4/780: symlink d3/d1d/db/da4/lff 0 2024-04-26T11:46:40.851 INFO:tasks.workunit.client.0.smithi029.stdout:1/899: creat d7/d25/dae/f13c x:0 0 0 2024-04-26T11:46:40.851 INFO:tasks.workunit.client.0.smithi029.stdout:2/845: dread - d12/d6c/d73/d4f/f8d zero size 2024-04-26T11:46:40.853 INFO:tasks.workunit.client.0.smithi029.stdout:2/846: unlink d12/d6c/d73/fe7 0 2024-04-26T11:46:40.853 INFO:tasks.workunit.client.0.smithi029.stdout:1/900: creat d7/db/dcc/f13d x:0 0 0 2024-04-26T11:46:40.854 INFO:tasks.workunit.client.0.smithi029.stdout:4/781: fdatasync d3/d1d/db/d13/d23/d2b/d9d/fc5 0 2024-04-26T11:46:40.854 INFO:tasks.workunit.client.0.smithi029.stdout:9/724: creat d4/d5/fde x:0 0 0 2024-04-26T11:46:40.855 INFO:tasks.workunit.client.0.smithi029.stdout:2/847: readlink d12/d24/d2f/l7f 0 2024-04-26T11:46:40.855 INFO:tasks.workunit.client.0.smithi029.stdout:6/815: read d7/d46/d69/da2/d4c/d98/d45/fff [4051223,33902] 0 2024-04-26T11:46:40.857 INFO:tasks.workunit.client.0.smithi029.stdout:1/901: symlink d7/d25/d6d/d119/l13e 0 2024-04-26T11:46:40.857 INFO:tasks.workunit.client.0.smithi029.stdout:7/849: dread d11/d18/d58/f64 [0,4194304] 0 2024-04-26T11:46:40.857 INFO:tasks.workunit.client.0.smithi029.stdout:8/716: truncate dc/de/d2e/d23/d27/d6f/d9b/d43/da1/de0/fe9 1473976 0 2024-04-26T11:46:40.859 INFO:tasks.workunit.client.0.smithi029.stdout:8/717: fdatasync dc/f66 0 2024-04-26T11:46:40.859 INFO:tasks.workunit.client.0.smithi029.stdout:9/725: creat d4/d5/d16/d80/fdf x:0 0 0 2024-04-26T11:46:40.859 INFO:tasks.workunit.client.0.smithi029.stdout:4/782: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/dc8/c100 1 2024-04-26T11:46:40.859 INFO:tasks.workunit.client.0.smithi029.stdout:9/726: sync 2024-04-26T11:46:40.859 INFO:tasks.workunit.client.0.smithi029.stdout:6/816: symlink d7/d20/d27/dc0/dd0/l118 0 2024-04-26T11:46:40.859 INFO:tasks.workunit.client.0.smithi029.stdout:3/711: dread d0/d1/d41/d5f/d1a/f3d [4194304,4194304] 0 2024-04-26T11:46:40.859 INFO:tasks.workunit.client.0.smithi029.stdout:2/848: getdents d12/d24/d29/d50/d55 0 2024-04-26T11:46:40.860 INFO:tasks.workunit.client.0.smithi029.stdout:7/850: write d11/d18/d1a/fef [1028511,63991] 0 2024-04-26T11:46:40.860 INFO:tasks.workunit.client.0.smithi029.stdout:0/739: dwrite d9/d43/f8a [0,4194304] 0 2024-04-26T11:46:40.861 INFO:tasks.workunit.client.0.smithi029.stdout:6/817: read - d7/d25/d4b/d4d/d65/f8c zero size 2024-04-26T11:46:40.861 INFO:tasks.workunit.client.0.smithi029.stdout:8/718: creat dc/de/d2e/d23/d8d/f100 x:0 0 0 2024-04-26T11:46:40.862 INFO:tasks.workunit.client.0.smithi029.stdout:4/783: unlink d3/d1d/db/d13/d23/f43 0 2024-04-26T11:46:40.863 INFO:tasks.workunit.client.0.smithi029.stdout:9/727: rename d4/d5/d7/d74/lce to d4/d5/d7a/dbd/le0 0 2024-04-26T11:46:40.863 INFO:tasks.workunit.client.0.smithi029.stdout:0/740: symlink d9/d16/d25/ddc/l10b 0 2024-04-26T11:46:40.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/728: truncate d4/fd2 445032 0 2024-04-26T11:46:40.864 INFO:tasks.workunit.client.0.smithi029.stdout:6/818: unlink d7/d46/d69/da2/d4c/d98/f3d 0 2024-04-26T11:46:40.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/784: unlink d3/d1d/db/d13/d23/fec 0 2024-04-26T11:46:40.865 INFO:tasks.workunit.client.0.smithi029.stdout:0/741: creat d9/d16/d33/f10c x:0 0 0 2024-04-26T11:46:40.865 INFO:tasks.workunit.client.0.smithi029.stdout:8/719: mkdir dc/de/d2e/d23/df9/d101 0 2024-04-26T11:46:40.865 INFO:tasks.workunit.client.0.smithi029.stdout:3/712: link d0/d1/d2b/ddb/le9 d0/d1/d41/d4c/lf2 0 2024-04-26T11:46:40.865 INFO:tasks.workunit.client.0.smithi029.stdout:9/729: chown d4/d49/d58/d67/l6c 557897498 1 2024-04-26T11:46:40.866 INFO:tasks.workunit.client.0.smithi029.stdout:3/713: mknod d0/d1/d2f/cf3 1 2024-04-26T11:46:40.867 INFO:tasks.workunit.client.0.smithi029.stdout:3/714: truncate d0/d1/d2b/f85 4905331 0 2024-04-26T11:46:40.868 INFO:tasks.workunit.client.0.smithi029.stdout:0/742: rename d9/d16/d33/d2f/d32/d90/fbe to d9/d16/d33/d2f/d32/d9d/f10d 0 2024-04-26T11:46:40.869 INFO:tasks.workunit.client.0.smithi029.stdout:3/715: creat d0/d1/d41/d4c/dee/d9d/ff4 x:0 0 0 2024-04-26T11:46:40.870 INFO:tasks.workunit.client.0.smithi029.stdout:0/743: symlink d9/d16/d8d/l10e 0 2024-04-26T11:46:40.871 INFO:tasks.workunit.client.0.smithi029.stdout:6/819: rename d7/d20/d27/dc0/dd0/l118 to d7/d46/l119 0 2024-04-26T11:46:40.871 INFO:tasks.workunit.client.0.smithi029.stdout:7/851: dwrite d11/d18/d35/d39/f8f [0,4194304] 0 2024-04-26T11:46:40.871 INFO:tasks.workunit.client.0.smithi029.stdout:9/730: dread d4/d5/f45 [0,4194304] 0 2024-04-26T11:46:40.876 INFO:tasks.workunit.client.0.smithi029.stdout:4/785: dwrite d3/f6e [0,4194304] 0 2024-04-26T11:46:40.876 INFO:tasks.workunit.client.0.smithi029.stdout:7/852: truncate d11/d15/d67/f114 774044 0 2024-04-26T11:46:40.876 INFO:tasks.workunit.client.0.smithi029.stdout:8/720: truncate dc/d3b/f5a 83400 0 2024-04-26T11:46:40.878 INFO:tasks.workunit.client.0.smithi029.stdout:5/735: dread db/d12/d72/f21 [0,4194304] 0 2024-04-26T11:46:40.878 INFO:tasks.workunit.client.0.smithi029.stdout:9/731: mkdir d4/d5/d7/d74/da8/de1 0 2024-04-26T11:46:40.878 INFO:tasks.workunit.client.0.smithi029.stdout:6/820: creat d7/d46/d69/da2/d4c/d98/d45/d83/da9/f11a x:0 0 0 2024-04-26T11:46:40.878 INFO:tasks.workunit.client.0.smithi029.stdout:8/721: mknod dc/d3b/dd2/c102 1 2024-04-26T11:46:40.880 INFO:tasks.workunit.client.0.smithi029.stdout:4/786: dread - d3/d1d/db/d13/d23/d2b/d9d/faa zero size 2024-04-26T11:46:40.883 INFO:tasks.workunit.client.0.smithi029.stdout:6/821: chown d7/d25/d4b/d4d/f82 2 1 2024-04-26T11:46:40.883 INFO:tasks.workunit.client.0.smithi029.stdout:1/902: dwrite d7/d25/f2e [0,4194304] 0 2024-04-26T11:46:40.885 INFO:tasks.workunit.client.0.smithi029.stdout:6/822: stat l6 0 2024-04-26T11:46:40.885 INFO:tasks.workunit.client.0.smithi029.stdout:2/849: dwrite d12/d24/d29/d38/fac [0,4194304] 0 2024-04-26T11:46:40.885 INFO:tasks.workunit.client.0.smithi029.stdout:9/732: link d4/d5/d16/l1b d4/d5/d7/dc7/le2 0 2024-04-26T11:46:40.886 INFO:tasks.workunit.client.0.smithi029.stdout:9/733: chown d4/d5/d7/d74/fa0 9 1 2024-04-26T11:46:40.887 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:40.884+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:40.888 INFO:tasks.workunit.client.0.smithi029.stdout:0/744: truncate d9/d16/d25/d2a/d8e/fb9 803145 0 2024-04-26T11:46:40.888 INFO:tasks.workunit.client.0.smithi029.stdout:1/903: rename d7/db/f91 to d7/db/d10/d1e/db2/dee/d98/f13f 0 2024-04-26T11:46:40.888 INFO:tasks.workunit.client.0.smithi029.stdout:1/904: sync 2024-04-26T11:46:40.889 INFO:tasks.workunit.client.0.smithi029.stdout:2/850: write d12/d24/d29/d50/d6a/dd1/fed [199073,121330] 0 2024-04-26T11:46:40.890 INFO:tasks.workunit.client.0.smithi029.stdout:9/734: getdents d4/d5/d7/d74/da8 0 2024-04-26T11:46:40.890 INFO:tasks.workunit.client.0.smithi029.stdout:4/787: dwrite d3/d1d/f5c [0,4194304] 0 2024-04-26T11:46:40.890 INFO:tasks.workunit.client.0.smithi029.stdout:6/823: link d7/lc d7/d25/d5c/l11b 0 2024-04-26T11:46:40.890 INFO:tasks.workunit.client.0.smithi029.stdout:2/851: unlink d12/l13 0 2024-04-26T11:46:40.891 INFO:tasks.workunit.client.0.smithi029.stdout:2/852: mknod d12/d6c/d73/dbd/dec/c127 1 2024-04-26T11:46:40.893 INFO:tasks.workunit.client.0.smithi029.stdout:5/736: truncate db/d89/fcf 843103 0 2024-04-26T11:46:40.893 INFO:tasks.workunit.client.0.smithi029.stdout:6/824: creat d7/d20/d27/d91/dee/f11c x:0 0 0 2024-04-26T11:46:40.893 INFO:tasks.workunit.client.0.smithi029.stdout:1/905: creat d7/d25/d68/d4b/f140 x:0 0 0 2024-04-26T11:46:40.894 INFO:tasks.workunit.client.0.smithi029.stdout:4/788: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f63 3705984 0 2024-04-26T11:46:40.894 INFO:tasks.workunit.client.0.smithi029.stdout:5/737: write db/d12/d1a/f33 [751380,104149] 0 2024-04-26T11:46:40.895 INFO:tasks.workunit.client.0.smithi029.stdout:5/738: dread - db/d40/d70/de8/f5f zero size 2024-04-26T11:46:40.896 INFO:tasks.workunit.client.0.smithi029.stdout:4/789: unlink d3/d1d/db/d13/d23/f69 0 2024-04-26T11:46:40.896 INFO:tasks.workunit.client.0.smithi029.stdout:6/825: truncate d7/d46/d69/f8a 2264820 0 2024-04-26T11:46:40.897 INFO:tasks.workunit.client.0.smithi029.stdout:5/739: rename db/l32 to db/d40/d70/leb 0 2024-04-26T11:46:40.897 INFO:tasks.workunit.client.0.smithi029.stdout:4/790: mkdir d3/d50/d101 0 2024-04-26T11:46:40.897 INFO:tasks.workunit.client.0.smithi029.stdout:6/826: fsync d7/d20/d27/f9c 0 2024-04-26T11:46:40.897 INFO:tasks.workunit.client.0.smithi029.stdout:5/740: truncate db/d12/fa7 699930 0 2024-04-26T11:46:40.898 INFO:tasks.workunit.client.0.smithi029.stdout:6/827: dread - d7/d97/fe7 zero size 2024-04-26T11:46:40.898 INFO:tasks.workunit.client.0.smithi029.stdout:4/791: write d3/d1d/d11/fa2 [4178148,74976] 0 2024-04-26T11:46:40.899 INFO:tasks.workunit.client.0.smithi029.stdout:5/741: mkdir db/d12/d6b/dec 0 2024-04-26T11:46:40.899 INFO:tasks.workunit.client.0.smithi029.stdout:6/828: unlink d7/d46/d69/da2/f38 0 2024-04-26T11:46:40.900 INFO:tasks.workunit.client.0.smithi029.stdout:4/792: mkdir d3/d1d/db/dc0/d102 0 2024-04-26T11:46:40.900 INFO:tasks.workunit.client.0.smithi029.stdout:6/829: fsync d7/d25/d4b/d6d/dd6/df7/f102 0 2024-04-26T11:46:40.900 INFO:tasks.workunit.client.0.smithi029.stdout:6/830: mknod d7/d97/dc2/c11d 1 2024-04-26T11:46:40.903 INFO:tasks.workunit.client.0.smithi029.stdout:4/793: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/fe7 958317 0 2024-04-26T11:46:40.903 INFO:tasks.workunit.client.0.smithi029.stdout:6/831: rename d7/d20/d27/da1/fcb to d7/d46/d69/f11e 0 2024-04-26T11:46:40.904 INFO:tasks.workunit.client.0.smithi029.stdout:2/853: write d12/d6c/d73/d4f/d65/d6f/f77 [1049322,93093] 0 2024-04-26T11:46:40.905 INFO:tasks.workunit.client.0.smithi029.stdout:7/853: dread d11/d18/d1a/f23 [0,4194304] 0 2024-04-26T11:46:40.906 INFO:tasks.workunit.client.0.smithi029.stdout:3/716: dread d0/d1/d2f/f3a [0,4194304] 0 2024-04-26T11:46:40.907 INFO:tasks.workunit.client.0.smithi029.stdout:4/794: getdents d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84 0 2024-04-26T11:46:40.907 INFO:tasks.workunit.client.0.smithi029.stdout:6/832: rename d7/d46/d69/f9d to d7/d25/d4b/d4d/d65/f11f 0 2024-04-26T11:46:40.908 INFO:tasks.workunit.client.0.smithi029.stdout:7/854: rename d11/d18/d1a/d33/l52 to d11/d15/l118 0 2024-04-26T11:46:40.908 INFO:tasks.workunit.client.0.smithi029.stdout:3/717: creat d0/d1/d2b/d7e/ff5 x:0 0 0 2024-04-26T11:46:40.909 INFO:tasks.workunit.client.0.smithi029.stdout:4/795: symlink d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/l103 0 2024-04-26T11:46:40.909 INFO:tasks.workunit.client.0.smithi029.stdout:7/855: mkdir d11/dd3/d119 0 2024-04-26T11:46:40.910 INFO:tasks.workunit.client.0.smithi029.stdout:2/854: read d12/d24/d2f/f33 [290702,70232] 0 2024-04-26T11:46:40.912 INFO:tasks.workunit.client.0.smithi029.stdout:3/718: creat d0/d1/d41/ff6 x:0 0 0 2024-04-26T11:46:40.912 INFO:tasks.workunit.client.0.smithi029.stdout:3/719: stat d0/d1/f43 0 2024-04-26T11:46:40.913 INFO:tasks.workunit.client.0.smithi029.stdout:4/796: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/fe7 [584370,114136] 0 2024-04-26T11:46:40.914 INFO:tasks.workunit.client.0.smithi029.stdout:6/833: getdents d7/d46/d69 0 2024-04-26T11:46:40.914 INFO:tasks.workunit.client.0.smithi029.stdout:7/856: link d11/d15/f57 d11/dd3/d119/f11a 0 2024-04-26T11:46:40.915 INFO:tasks.workunit.client.0.smithi029.stdout:7/857: stat d11/d115/d97 0 2024-04-26T11:46:40.915 INFO:tasks.workunit.client.0.smithi029.stdout:4/797: fsync d3/d1d/db/d13/f9e 0 2024-04-26T11:46:40.916 INFO:tasks.workunit.client.0.smithi029.stdout:7/858: write d11/d18/d35/f5e [3004626,49425] 0 2024-04-26T11:46:40.917 INFO:tasks.workunit.client.0.smithi029.stdout:3/720: rename d0/dc/d1f/f6f to d0/d1/d2b/d7e/ff7 0 2024-04-26T11:46:40.917 INFO:tasks.workunit.client.0.smithi029.stdout:3/721: sync 2024-04-26T11:46:40.917 INFO:tasks.workunit.client.0.smithi029.stdout:5/742: dwrite db/d12/d6b/f83 [0,4194304] 0 2024-04-26T11:46:40.917 INFO:tasks.workunit.client.0.smithi029.stdout:4/798: write d3/f47 [1726939,103330] 0 2024-04-26T11:46:40.918 INFO:tasks.workunit.client.0.smithi029.stdout:2/855: read d12/d6c/d73/dbd/fca [4181154,5218] 0 2024-04-26T11:46:40.918 INFO:tasks.workunit.client.0.smithi029.stdout:7/859: mknod d11/d18/d35/d39/d7e/c11b 1 2024-04-26T11:46:40.919 INFO:tasks.workunit.client.0.smithi029.stdout:2/856: chown d12/d24 8 1 2024-04-26T11:46:40.922 INFO:tasks.workunit.client.0.smithi029.stdout:7/860: creat d11/d18/dad/de5/f11c x:0 0 0 2024-04-26T11:46:40.922 INFO:tasks.workunit.client.0.smithi029.stdout:2/857: dread - d12/d6c/d73/da5/db1/fcd zero size 2024-04-26T11:46:40.922 INFO:tasks.workunit.client.0.smithi029.stdout:7/861: mknod d11/d18/d35/dfd/c11d 1 2024-04-26T11:46:40.924 INFO:tasks.workunit.client.0.smithi029.stdout:7/862: mkdir d11/d15/d104/d11e 0 2024-04-26T11:46:40.926 INFO:tasks.workunit.client.0.smithi029.stdout:9/735: dread d4/d5/d7/f47 [4194304,4194304] 0 2024-04-26T11:46:40.926 INFO:tasks.workunit.client.0.smithi029.stdout:2/858: fdatasync d12/d24/d29/d38/dea/fc3 0 2024-04-26T11:46:40.926 INFO:tasks.workunit.client.0.smithi029.stdout:3/722: getdents d0/d1/d41/d5f/d1a 0 2024-04-26T11:46:40.928 INFO:tasks.workunit.client.0.smithi029.stdout:6/834: dwrite d7/d46/d69/da2/d4c/d98/ff5 [0,4194304] 0 2024-04-26T11:46:40.928 INFO:tasks.workunit.client.0.smithi029.stdout:1/906: dread d7/db/f38 [0,4194304] 0 2024-04-26T11:46:40.928 INFO:tasks.workunit.client.0.smithi029.stdout:7/863: creat d11/d18/d58/d8d/dc3/f11f x:0 0 0 2024-04-26T11:46:40.929 INFO:tasks.workunit.client.0.smithi029.stdout:2/859: creat d12/d24/d29/d57/f128 x:0 0 0 2024-04-26T11:46:40.931 INFO:tasks.workunit.client.0.smithi029.stdout:1/907: readlink d7/db/d10/d1e/l49 0 2024-04-26T11:46:40.931 INFO:tasks.workunit.client.0.smithi029.stdout:8/722: dread dc/de/d26/f53 [0,4194304] 0 2024-04-26T11:46:40.931 INFO:tasks.workunit.client.0.smithi029.stdout:3/723: write d0/dc/d80/f8f [2402925,80163] 0 2024-04-26T11:46:40.931 INFO:tasks.workunit.client.0.smithi029.stdout:4/799: dwrite d3/f31 [4194304,4194304] 0 2024-04-26T11:46:40.931 INFO:tasks.workunit.client.0.smithi029.stdout:9/736: truncate d4/d5/f45 4306162 0 2024-04-26T11:46:40.932 INFO:tasks.workunit.client.0.smithi029.stdout:7/864: creat d11/d18/d35/dfd/f120 x:0 0 0 2024-04-26T11:46:40.932 INFO:tasks.workunit.client.0.smithi029.stdout:2/860: creat d12/d24/d29/dc6/f129 x:0 0 0 2024-04-26T11:46:40.933 INFO:tasks.workunit.client.0.smithi029.stdout:6/835: rename d7/d46/d69/da2/d4c/f94 to d7/d25/d4b/d6d/dd6/f120 0 2024-04-26T11:46:40.933 INFO:tasks.workunit.client.0.smithi029.stdout:9/737: chown d4/f7f 31442845 1 2024-04-26T11:46:40.935 INFO:tasks.workunit.client.0.smithi029.stdout:4/800: stat d3/d1d/d11/d16/d1f/d3d/d39/ff0 0 2024-04-26T11:46:40.935 INFO:tasks.workunit.client.0.smithi029.stdout:3/724: chown d0/d1/d41/d5f/d1a/d3b/fa5 104 1 2024-04-26T11:46:40.936 INFO:tasks.workunit.client.0.smithi029.stdout:0/745: dread d9/f10 [0,4194304] 0 2024-04-26T11:46:40.938 INFO:tasks.workunit.client.0.smithi029.stdout:4/801: read d3/d50/db4/ffc [1397964,38754] 0 2024-04-26T11:46:40.939 INFO:tasks.workunit.client.0.smithi029.stdout:8/723: rename dc/d12 to dc/de/d103 0 2024-04-26T11:46:40.939 INFO:tasks.workunit.client.0.smithi029.stdout:9/738: dread d4/d5/d7/f9f [0,4194304] 0 2024-04-26T11:46:40.939 INFO:tasks.workunit.client.0.smithi029.stdout:0/746: mknod d9/d78/c10f 1 2024-04-26T11:46:40.940 INFO:tasks.workunit.client.0.smithi029.stdout:1/908: rename d7/db/d8d/dc7/fe3 to d7/db/d10/d1e/db2/dee/f141 0 2024-04-26T11:46:40.942 INFO:tasks.workunit.client.0.smithi029.stdout:9/739: creat d4/d49/d58/d67/dab/dc6/fe3 x:0 0 0 2024-04-26T11:46:40.942 INFO:tasks.workunit.client.0.smithi029.stdout:8/724: link dc/de/d103/d7c/f8f dc/de/d2e/d23/d8d/de1/f104 0 2024-04-26T11:46:40.942 INFO:tasks.workunit.client.0.smithi029.stdout:1/909: symlink d7/db/d10/l142 0 2024-04-26T11:46:40.945 INFO:tasks.workunit.client.0.smithi029.stdout:8/725: write dc/d3b/f40 [3764447,50264] 0 2024-04-26T11:46:40.945 INFO:tasks.workunit.client.0.smithi029.stdout:9/740: symlink d4/d5/d7a/dbd/le4 0 2024-04-26T11:46:40.946 INFO:tasks.workunit.client.0.smithi029.stdout:3/725: dwrite d0/d1/f16 [0,4194304] 0 2024-04-26T11:46:40.950 INFO:tasks.workunit.client.0.smithi029.stdout:9/741: creat d4/d5/d7/d74/da8/fe5 x:0 0 0 2024-04-26T11:46:40.950 INFO:tasks.workunit.client.0.smithi029.stdout:8/726: write dc/de/d26/f99 [274143,117424] 0 2024-04-26T11:46:40.953 INFO:tasks.workunit.client.0.smithi029.stdout:4/802: dwrite d3/d1d/d11/f79 [0,4194304] 0 2024-04-26T11:46:40.953 INFO:tasks.workunit.client.0.smithi029.stdout:0/747: dwrite d9/d16/d25/ddc/f106 [0,4194304] 0 2024-04-26T11:46:40.954 INFO:tasks.workunit.client.0.smithi029.stdout:0/748: sync 2024-04-26T11:46:40.955 INFO:tasks.workunit.client.0.smithi029.stdout:5/743: dread db/d12/d72/d39/f41 [0,4194304] 0 2024-04-26T11:46:40.955 INFO:tasks.workunit.client.0.smithi029.stdout:4/803: rmdir d3 39 2024-04-26T11:46:40.955 INFO:tasks.workunit.client.0.smithi029.stdout:8/727: fdatasync dc/de/d26/d57/fb0 0 2024-04-26T11:46:40.956 INFO:tasks.workunit.client.0.smithi029.stdout:9/742: getdents d4/d5/d78/dd4 0 2024-04-26T11:46:40.957 INFO:tasks.workunit.client.0.smithi029.stdout:6/836: chown d7/d46/d69/da2/d4c/d98/d45/d83/f107 417921 1 2024-04-26T11:46:40.957 INFO:tasks.workunit.client.0.smithi029.stdout:0/749: creat d9/d16/de7/f110 x:0 0 0 2024-04-26T11:46:40.957 INFO:tasks.workunit.client.0.smithi029.stdout:0/750: sync 2024-04-26T11:46:40.958 INFO:tasks.workunit.client.0.smithi029.stdout:8/728: read dc/de/d2e/f94 [269963,65921] 0 2024-04-26T11:46:40.959 INFO:tasks.workunit.client.0.smithi029.stdout:5/744: read db/f20 [1248064,65125] 0 2024-04-26T11:46:40.959 INFO:tasks.workunit.client.0.smithi029.stdout:1/910: dwrite d7/db/d10/d20/fa2 [0,4194304] 0 2024-04-26T11:46:40.959 INFO:tasks.workunit.client.0.smithi029.stdout:2/861: truncate d12/d24/d29/d50/fbe 3217334 0 2024-04-26T11:46:40.961 INFO:tasks.workunit.client.0.smithi029.stdout:4/804: chown d3/d1d/d11/d16/d1f/d3d/d46/f5f 589730591 1 2024-04-26T11:46:40.962 INFO:tasks.workunit.client.0.smithi029.stdout:3/726: dwrite d0/f4b [0,4194304] 0 2024-04-26T11:46:40.962 INFO:tasks.workunit.client.0.smithi029.stdout:0/751: chown d9/d78/fd0 13 1 2024-04-26T11:46:40.962 INFO:tasks.workunit.client.0.smithi029.stdout:2/862: chown d12/d24/d29/d50/d55/d5f 708 1 2024-04-26T11:46:40.962 INFO:tasks.workunit.client.0.smithi029.stdout:9/743: symlink d4/d5/d7a/da1/le6 0 2024-04-26T11:46:40.962 INFO:tasks.workunit.client.0.smithi029.stdout:8/729: symlink dc/de/d26/d6b/dde/l105 0 2024-04-26T11:46:40.962 INFO:tasks.workunit.client.0.smithi029.stdout:6/837: symlink d7/d25/d4b/l121 0 2024-04-26T11:46:40.963 INFO:tasks.workunit.client.0.smithi029.stdout:4/805: chown d3/d1d/f3f 91322101 1 2024-04-26T11:46:40.964 INFO:tasks.workunit.client.0.smithi029.stdout:8/730: write dc/d3b/f9a [1210108,27698] 0 2024-04-26T11:46:40.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/744: write d4/d5/f95 [1478610,82118] 0 2024-04-26T11:46:40.964 INFO:tasks.workunit.client.0.smithi029.stdout:3/727: truncate d0/dc/d80/f8f 4658364 0 2024-04-26T11:46:40.964 INFO:tasks.workunit.client.0.smithi029.stdout:2/863: readlink d12/d24/d29/d50/d55/l66 0 2024-04-26T11:46:40.964 INFO:tasks.workunit.client.0.smithi029.stdout:8/731: mknod dc/de/d2e/d23/d8d/c106 1 2024-04-26T11:46:40.966 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:40.966 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:40.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:40.966 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:40.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.966 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 18.808235876000001, 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:40.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:40.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:40.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 18.808209148, 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:40.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:40.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:40.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:40.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:40.980 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 18.808178197, 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:40.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:40.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.8062161799999998, 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:40.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:40.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:40.991 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.8061905599999992, 2024-04-26T11:46:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:40.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:40.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:40.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:40.996 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.8061303659999997, 2024-04-26T11:46:40.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:40.997 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:40.997 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:40.997 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:40.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:40.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:40.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:40.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:40.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:40.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:40.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:40.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:40.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:40.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:40.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:40.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:40.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:40.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:40.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:40.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.8061035889999992, 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.002 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:41.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:41.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.8060475409999999, 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:41.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:41.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:41.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:41.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:41.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.8060075750000006, 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:41.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.8059769649999993, 2024-04-26T11:46:41.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:41.017 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.017 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.017 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:41.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:41.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:41.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:41.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.8059024570000002, 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.021 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.025 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.8058343919999995, 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.805734245, 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:41.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:332 3.2 3:4272d415:::200.0000000b:head [write 1522559~21066 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7962489519999991, 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042100678000000002, 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:41.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166240+0000", 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166237+0000", 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999971 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166309+0000", 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1858000000000002e-05 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166405+0000", 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6333000000000001e-05 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.166451+0000", 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6529999999999997e-05 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204736+0000", 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.038284158999999998 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204876+0000", 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014074700000000001 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208177+0000", 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003301179 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208220+0000", 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2098000000000002e-05 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208340+0000", 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120685 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:41.039 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7858851429999998, 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7858268440000007, 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.044 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:41.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.7837895849999992, 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.1884314849999997, 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:41.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:11559 4.22 4:454f8e6e:::100000030e5.00000001:head [write 0~4194304 [3@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:36.972822+0000", 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.9896667130000001, 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042020137999999999, 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 11559 2024-04-26T11:46:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.972822+0000", 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.972822+0000", 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.972819+0000", 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.976866+0000", 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040466410000000001 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.976887+0000", 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.105e-05 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.976898+0000", 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0763e-05 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.976985+0000", 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7088000000000004e-05 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.977111+0000", 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012639199999999999 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:41.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.977245+0000", 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133473 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:36.995855+0000", 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018610646000000002 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:37.014730+0000", 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018874526999999999 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:37.014772+0000", 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2033999999999998e-05 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:37.014842+0000", 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0010000000000002e-05 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:41.064 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62028374799999997, 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:46:41.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:41.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:41.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:46:41.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:46:41.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.070 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.070 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.070 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:41.074 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:41.074 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:41.068+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:41.090 INFO:tasks.workunit.client.0.smithi029.stdout:6/838: rmdir d7/d20/d27/d91/dca 0 2024-04-26T11:46:41.090 INFO:tasks.workunit.client.0.smithi029.stdout:4/806: fsync d3/d1d/db/d13/f9e 0 2024-04-26T11:46:41.090 INFO:tasks.workunit.client.0.smithi029.stdout:5/745: truncate db/d40/d77/d98/fd5 761128 0 2024-04-26T11:46:41.090 INFO:tasks.workunit.client.0.smithi029.stdout:9/745: dread - d4/d5/d16/fca zero size 2024-04-26T11:46:41.090 INFO:tasks.workunit.client.0.smithi029.stdout:3/728: chown d0/d1/d2b/d33 2401137 1 2024-04-26T11:46:41.090 INFO:tasks.workunit.client.0.smithi029.stdout:2/864: dread - d12/d24/fcc zero size 2024-04-26T11:46:41.090 INFO:tasks.workunit.client.0.smithi029.stdout:5/746: stat db/d12/d1a/f16 0 2024-04-26T11:46:41.090 INFO:tasks.workunit.client.0.smithi029.stdout:2/865: unlink d12/f16 0 2024-04-26T11:46:41.090 INFO:tasks.workunit.client.0.smithi029.stdout:4/807: creat d3/d1d/db/d13/d23/d2b/dbc/f104 x:0 0 0 2024-04-26T11:46:41.090 INFO:tasks.workunit.client.0.smithi029.stdout:3/729: mkdir d0/d1/d41/d5f/d1a/d3b/db5/df8 0 2024-04-26T11:46:41.090 INFO:tasks.workunit.client.0.smithi029.stdout:9/746: creat d4/d5/d16/d80/dc2/dc0/fe7 x:0 0 0 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:8/732: rename dc/de/d26/d6b/l88 to dc/de/d103/d6a/d78/dc3/dcf/l107 0 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:5/747: chown db/d12/d72/d39/fb4 483461900 1 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:2/866: write d12/d6c/d73/d4f/d65/d81/ffa [459974,77834] 0 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:3/730: chown d0/lc9 940443318 1 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:1/911: dwrite d7/db/d10/d1e/fb0 [0,4194304] 0 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:9/747: creat d4/d5/d7/d74/fe8 x:0 0 0 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:4/808: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/fce [821126,68094] 0 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:2/867: fsync d12/d6c/d73/d4f/d65/f84 0 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:5/748: write db/d40/d77/fd4 [867770,123240] 0 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:8/733: write dc/de/d103/d6a/daa/fef [2275078,112781] 0 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:3/731: write d0/d1/d2f/fb3 [418882,79858] 0 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:9/748: dread - d4/d5/d16/d80/fdf zero size 2024-04-26T11:46:41.091 INFO:tasks.workunit.client.0.smithi029.stdout:4/809: chown d3/d1d/db/d13/dbb 6 1 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:3/732: mknod d0/dc/d80/cf9 1 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:8/734: mkdir dc/de/dd0/d108 0 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:2/868: dread - d12/d6c/d73/d4f/d65/d81/fd8 zero size 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:8/735: creat dc/d3b/f109 x:0 0 0 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:3/733: write d0/d1/d2b/d33/f74 [3861807,92613] 0 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:2/869: dread - d12/d24/d29/d36/fdc zero size 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:4/810: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d105 0 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:3/734: write d0/d1/d41/d5f/d1a/f38 [987675,59296] 0 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:4/811: chown d3/d1d/f21 1356 1 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:2/870: truncate d12/d24/d29/d36/f3b 195339 0 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:1/912: dwrite d7/db/d10/d1e/fd1 [0,4194304] 0 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:4/812: getdents d3/d50/d101 0 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:3/735: getdents d0/d1/d2f/d82/dce 0 2024-04-26T11:46:41.092 INFO:tasks.workunit.client.0.smithi029.stdout:7/865: dread d11/d18/d58/faf [0,4194304] 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:4/813: write d3/d1d/f12 [9036423,25986] 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:1/913: rename d7/db/d10/d1e/d53/lef to d7/d25/d6d/d119/l143 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:1/914: readlink d7/d25/l10a 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:7/866: getdents d11/d18/d1a/d33 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:8/736: dwrite dc/d3b/f9a [0,4194304] 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:4/814: read d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/dbe/fe6 [294603,23912] 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:7/867: mknod d11/d115/d97/d9b/c121 1 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:3/736: rename d0/d1/d41/d5f/d1a/d3b/fa5 to d0/d1/d41/d5f/de3/de7/ffa 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:1/915: mkdir d7/db/d10/d1e/d5e/d144 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:3/737: chown d0/dc/d1f/l79 421019181 1 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:7/868: fsync d11/d115/f109 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:8/737: symlink dc/de/d103/d6a/d78/dc3/dcf/l10a 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:1/916: fdatasync d7/db/dc5/f101 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:9/749: write d4/d5/f45 [661016,5858] 0 2024-04-26T11:46:41.093 INFO:tasks.workunit.client.0.smithi029.stdout:5/749: truncate db/d12/d1a/f18 1990291 0 2024-04-26T11:46:41.094 INFO:tasks.workunit.client.0.smithi029.stdout:2/871: dwrite d12/d6c/d73/d4f/d65/d6f/f77 [0,4194304] 0 2024-04-26T11:46:41.094 INFO:tasks.workunit.client.0.smithi029.stdout:2/872: sync 2024-04-26T11:46:41.094 INFO:tasks.workunit.client.0.smithi029.stdout:3/738: chown d0/d1/d2b/da7/dad/f14 20793 1 2024-04-26T11:46:41.094 INFO:tasks.workunit.client.0.smithi029.stdout:9/750: chown d4/d46/l5f 1037001362 1 2024-04-26T11:46:41.094 INFO:tasks.workunit.client.0.smithi029.stdout:5/750: symlink db/de3/led 0 2024-04-26T11:46:41.094 INFO:tasks.workunit.client.0.smithi029.stdout:1/917: chown d7/d25/d68/ldf 14516083 1 2024-04-26T11:46:41.094 INFO:tasks.workunit.client.0.smithi029.stdout:1/918: mkdir d7/db/d8d/d145 0 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:1/919: creat d7/db/dcc/f146 x:0 0 0 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:9/751: write d4/d5/d7/d74/fa5 [1168003,90113] 0 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:1/920: chown d7/db/d10 3753994 1 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:9/752: mkdir d4/d5/de9 0 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:1/921: getdents d7/db/d10/d1e/d53/d9d/dfc 0 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:8/738: dwrite dc/fbd [4194304,4194304] 0 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:3/739: dwrite d0/d1/d2b/d33/f66 [0,4194304] 0 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:7/869: write d11/d18/db8/f113 [3632018,53477] 0 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:1/922: rename d7/db/d10/d1e/d53/d9d to d7/d25/d6d/d8c/df0/d147 0 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:8/739: symlink dc/de/d2e/d23/d27/d6f/d9b/d43/da1/de0/l10b 0 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:3/740: creat d0/d1/d41/d5f/d54/def/ffb x:0 0 0 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:8/740: chown dc/de/fb3 525240278 1 2024-04-26T11:46:41.095 INFO:tasks.workunit.client.0.smithi029.stdout:1/923: stat f2 0 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:2/873: truncate d12/d24/d2f/f4e 1757410 0 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:7/870: rename d11/d115/da6/fa8 to d11/d15/d104/f122 0 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:3/741: mknod d0/d1/d2f/d82/cfc 1 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:1/924: chown d7/db/d10/d1e/d5e 106650 1 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:2/874: write d12/d6c/d6e/f10a [632707,41418] 0 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:4/815: dread d3/d1d/f29 [0,4194304] 0 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:8/741: truncate dc/d3b/f84 88179 0 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:3/742: creat d0/d1/ffd x:0 0 0 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:1/925: creat d7/d25/d6d/d8c/f148 x:0 0 0 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:8/742: chown dc/f11 0 1 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:1/926: chown d7/db/d10 419919342 1 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:4/816: mknod d3/d1d/d11/d16/d1f/d3d/c106 1 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:2/875: creat d12/d24/d29/d50/d6a/f12a x:0 0 0 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:4/817: chown d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84 408529235 1 2024-04-26T11:46:41.096 INFO:tasks.workunit.client.0.smithi029.stdout:2/876: creat d12/d24/d2f/f12b x:0 0 0 2024-04-26T11:46:41.097 INFO:tasks.workunit.client.0.smithi029.stdout:4/818: write d3/d50/d7a/ded/ffe [554650,73536] 0 2024-04-26T11:46:41.097 INFO:tasks.workunit.client.0.smithi029.stdout:2/877: creat d12/d24/d29/d36/d10f/f12c x:0 0 0 2024-04-26T11:46:41.097 INFO:tasks.workunit.client.0.smithi029.stdout:4/819: symlink d3/d1d/d11/d16/d1f/l107 0 2024-04-26T11:46:41.097 INFO:tasks.workunit.client.0.smithi029.stdout:2/878: read - d12/d24/d29/f6b zero size 2024-04-26T11:46:41.097 INFO:tasks.workunit.client.0.smithi029.stdout:6/839: dread d7/d25/d4b/d4d/d65/faa [0,4194304] 0 2024-04-26T11:46:41.097 INFO:tasks.workunit.client.0.smithi029.stdout:6/840: chown d7/d25/d4b/d6d/dd6/f120 235210 1 2024-04-26T11:46:41.097 INFO:tasks.workunit.client.0.smithi029.stdout:0/752: dread d9/d16/f24 [0,4194304] 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:6/841: mkdir d7/d20/d27/dc0/d122 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:0/753: write d9/d16/d33/f5c [1483468,101815] 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:4/820: dread d3/d1d/f89 [0,4194304] 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:0/754: rename d9/d16/de7/lf5 to d9/d16/d33/d2f/d68/l111 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:1/927: truncate d7/d25/d68/f120 561504 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:2/879: write d12/f22 [1577741,117883] 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:1/928: mkdir d7/d25/dab/d149 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:1/929: creat d7/db/dcc/f14a x:0 0 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:2/880: link d12/d24/d2f/fd2 d12/d24/d29/d38/dea/f12d 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:1/930: fsync d7/db/dc5/dd5/fe9 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:2/881: mknod d12/d24/d29/d57/def/c12e 1 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:9/753: sync 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:0/755: dread d9/d16/d25/d2a/d8e/fb9 [0,4194304] 0 2024-04-26T11:46:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:9/754: stat d4/d5 0 2024-04-26T11:46:41.099 INFO:tasks.workunit.client.0.smithi029.stdout:2/882: getdents d12/d24/d29/dda 0 2024-04-26T11:46:41.099 INFO:tasks.workunit.client.0.smithi029.stdout:0/756: symlink d9/d16/d25/d2a/d8e/dc7/l112 0 2024-04-26T11:46:41.099 INFO:tasks.workunit.client.0.smithi029.stdout:5/751: dread db/d40/d4d/d4f/f8f [0,4194304] 0 2024-04-26T11:46:41.099 INFO:tasks.workunit.client.0.smithi029.stdout:0/757: mknod d9/d16/de7/d107/d100/c113 1 2024-04-26T11:46:41.099 INFO:tasks.workunit.client.0.smithi029.stdout:0/758: fdatasync d9/d78/dc4/fd3 0 2024-04-26T11:46:41.099 INFO:tasks.workunit.client.0.smithi029.stdout:5/752: creat db/d40/d4d/d79/fee x:0 0 0 2024-04-26T11:46:41.099 INFO:tasks.workunit.client.0.smithi029.stdout:3/743: dread d0/d1/d2b/d33/f8c [0,4194304] 0 2024-04-26T11:46:41.099 INFO:tasks.workunit.client.0.smithi029.stdout:0/759: stat d9/d16/d25/d2a/d4b/dde/fe1 0 2024-04-26T11:46:41.099 INFO:tasks.workunit.client.0.smithi029.stdout:5/753: mkdir db/d40/dd6/def 0 2024-04-26T11:46:41.099 INFO:tasks.workunit.client.0.smithi029.stdout:0/760: stat d9/d16/de7/d107 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:3/744: write d0/dc/d1f/f8d [4281748,19755] 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:6/842: dwrite d7/d97/dc2/f109 [0,4194304] 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:3/745: mknod d0/d1/d5c/cfe 1 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:5/754: creat db/d12/ff0 x:0 0 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:7/871: dread d11/dd3/de4/daa/fc0 [0,4194304] 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:3/746: fsync d0/d1/d41/d5f/d1a/d3b/f4f 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:6/843: fdatasync d7/d46/d69/da2/d4c/d98/d45/d83/da9/fce 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:1/931: dread d7/db/d10/d1e/db2/dee/f63 [0,4194304] 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:1/932: fdatasync d7/db/dc5/f101 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:7/872: creat d11/d18/d35/de0/f123 x:0 0 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:2/883: dwrite d12/d6c/d73/d4f/d65/d6f/fb7 [0,4194304] 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:7/873: chown d11/d15/f57 105674900 1 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:6/844: link d7/d46/d69/da2/d4c/d98/f72 d7/d46/d69/da2/deb/f123 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:1/933: write d7/f75 [1294387,39962] 0 2024-04-26T11:46:41.100 INFO:tasks.workunit.client.0.smithi029.stdout:3/747: truncate d0/f4b 717825 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/761: dwrite d9/d16/d25/ddc/f106 [0,4194304] 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:7/874: fsync d11/d15/d104/f122 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:6/845: write d7/d25/d4b/d4d/d65/fe1 [364036,3298] 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/762: mknod d9/c114 1 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:2/884: getdents d12/d24/d29/d50/d6a/dd1 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:1/934: dread d7/db/f1d [0,4194304] 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:7/875: mknod d11/d18/d1a/c124 1 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:5/755: dwrite db/d12/f1b [0,4194304] 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:2/885: fsync d12/d24/d29/d50/f59 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:6/846: creat d7/f124 x:0 0 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:8/743: sync 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:3/748: link d0/d1/d41/d5f/d1a/f38 d0/d1/d2f/dd8/fff 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/763: write d9/d16/d52/fe2 [1255034,42116] 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:5/756: rename db/d12/d6b/f83 to db/d12/d72/d92/ff1 0 2024-04-26T11:46:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/764: fsync d9/f18 0 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:6/847: getdents d7/d20/d27/dc0/dd0 0 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:6/848: rename d7/d46/d69/da2/d4c/d98/d45/fff to d7/d46/d69/da2/d4c/d98/d45/f125 0 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:9/755: dread d4/d5/d16/d80/faa [0,4194304] 0 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:4/821: sync 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:0/765: dwrite d9/d16/d33/d2f/d32/d9f/de6/feb [0,4194304] 0 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:8/744: dwrite dc/de/d2e/d23/d27/fd3 [0,4194304] 0 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:5/757: dwrite db/d12/d72/d92/ff1 [0,4194304] 0 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:8/745: mknod dc/de/d2e/d23/d27/d6f/c10c 1 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:5/758: getdents db/d40/d4d/d4f/dc6 0 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:1/935: sync 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:2/886: sync 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:5/759: stat db/d40/d4d/d4f/f8f 0 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:5/760: creat db/d89/de0/ff2 x:0 0 0 2024-04-26T11:46:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:9/756: dread d4/d49/f93 [0,4194304] 0 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:6/849: dwrite d7/d46/d69/da2/d4c/d98/d45/d83/da9/fce [0,4194304] 0 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:8/746: link dc/de/d2e/d23/d27/dc5/fd9 dc/de/f10d 0 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:1/936: getdents d7/d25/d6d 0 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:5/761: rmdir db/de3 39 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:9/757: chown d4/d5/d7/d74/fa2 125 1 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/766: dwrite d9/d16/d33/d2f/f50 [0,4194304] 0 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:3/749: write d0/d1/d2b/d7e/ff7 [5620437,76036] 0 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:2/887: link d12/d24/d29/d50/l91 d12/d6c/d73/da5/db1/l12f 0 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:5/762: dread - db/d89/de0/ff2 zero size 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/767: stat d9/d43/f75 0 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:9/758: mknod d4/d5/d7/cea 1 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:8/747: creat dc/f10e x:0 0 0 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:2/888: creat d12/d6c/d6e/de4/f130 x:0 0 0 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:9/759: read d4/d49/d7d/fda [6424787,1333] 0 2024-04-26T11:46:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:3/750: read d0/f1b [123047,62099] 0 2024-04-26T11:46:41.104 INFO:tasks.workunit.client.0.smithi029.stdout:0/768: unlink d9/d16/d33/d2f/d32/d90/l97 0 2024-04-26T11:46:41.104 INFO:tasks.workunit.client.0.smithi029.stdout:5/763: rmdir db/d12/d6b/dec 0 2024-04-26T11:46:41.104 INFO:tasks.workunit.client.0.smithi029.stdout:8/748: mknod dc/de/d103/d6a/d78/dc3/dcf/c10f 1 2024-04-26T11:46:41.104 INFO:tasks.workunit.client.0.smithi029.stdout:7/876: dwrite d11/dd3/de4/f7a [0,4194304] 0 2024-04-26T11:46:41.104 INFO:tasks.workunit.client.0.smithi029.stdout:2/889: creat d12/d24/f131 x:0 0 0 2024-04-26T11:46:41.104 INFO:tasks.workunit.client.0.smithi029.stdout:3/751: read - d0/d1/d2f/d82/dc3/dc7/fca zero size 2024-04-26T11:46:41.104 INFO:tasks.workunit.client.0.smithi029.stdout:9/760: readlink d4/d5/d7/lcf 0 2024-04-26T11:46:41.104 INFO:tasks.workunit.client.0.smithi029.stdout:3/752: creat d0/dc/d80/d9a/f100 x:0 0 0 2024-04-26T11:46:41.107 INFO:tasks.workunit.client.0.smithi029.stdout:2/890: chown d12/d24/d29/d36/d10f/f12c 3 1 2024-04-26T11:46:41.107 INFO:tasks.workunit.client.0.smithi029.stdout:8/749: getdents dc/de/d26/d57/d86 0 2024-04-26T11:46:41.107 INFO:tasks.workunit.client.0.smithi029.stdout:9/761: creat d4/d5/d16/d80/dc2/feb x:0 0 0 2024-04-26T11:46:41.107 INFO:tasks.workunit.client.0.smithi029.stdout:3/753: chown d0/d1/d2b/d33/fa1 47246 1 2024-04-26T11:46:41.107 INFO:tasks.workunit.client.0.smithi029.stdout:5/764: getdents db 0 2024-04-26T11:46:41.107 INFO:tasks.workunit.client.0.smithi029.stdout:1/937: dwrite d7/d25/d6d/d8c/f148 [0,4194304] 0 2024-04-26T11:46:41.107 INFO:tasks.workunit.client.0.smithi029.stdout:6/850: write d7/d46/d69/da2/d4c/d98/f72 [782719,83575] 0 2024-04-26T11:46:41.107 INFO:tasks.workunit.client.0.smithi029.stdout:8/750: read dc/de/d2e/d23/fe2 [2164344,91059] 0 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:5/765: chown db/d89/fcf 82487 1 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:5/766: sync 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:9/762: getdents d4/d5/d7a/dbd 0 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:5/767: write db/d12/d72/d39/d3b/f6d [361041,12397] 0 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:9/763: write d4/d46/f56 [1431483,24744] 0 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:7/877: dwrite d11/d18/d35/dbf/fdb [0,4194304] 0 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:5/768: mkdir db/de3/df3 0 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:9/764: write d4/d5/d7/f94 [1292762,52256] 0 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/938: rename d7/db/d10/d1e/db2/dee/d3e/l1b to d7/d25/d6d/d8c/df0/d147/dfc/l14b 0 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/939: sync 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:5/769: rmdir db/d40/d70 39 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:3/754: dwrite d0/d1/d2f/dd8/f7a [0,4194304] 0 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:5/770: chown db/d89/de0 57480 1 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:3/755: sync 2024-04-26T11:46:41.108 INFO:tasks.workunit.client.0.smithi029.stdout:0/769: truncate d9/d16/d52/fa2 2946770 0 2024-04-26T11:46:41.109 INFO:tasks.workunit.client.0.smithi029.stdout:1/940: mkdir d7/d25/dab/d149/d14c 0 2024-04-26T11:46:41.109 INFO:tasks.workunit.client.0.smithi029.stdout:8/751: rename dc/fbd to dc/de/d2e/d23/d27/d6f/d9b/d43/f110 0 2024-04-26T11:46:41.109 INFO:tasks.workunit.client.0.smithi029.stdout:5/771: symlink db/d12/d72/d39/d3b/lf4 0 2024-04-26T11:46:41.109 INFO:tasks.workunit.client.0.smithi029.stdout:0/770: rmdir d9/d16/d25/d2a/d4b/dd9 39 2024-04-26T11:46:41.110 INFO:tasks.workunit.client.0.smithi029.stdout:1/941: write d7/db/dc5/dd5/fe9 [9167708,123370] 0 2024-04-26T11:46:41.110 INFO:tasks.workunit.client.0.smithi029.stdout:9/765: rename d4/d5/fb to d4/d5/d7/fec 0 2024-04-26T11:46:41.110 INFO:tasks.workunit.client.0.smithi029.stdout:0/771: readlink d9/la5 0 2024-04-26T11:46:41.110 INFO:tasks.workunit.client.0.smithi029.stdout:5/772: rmdir db/d40/d4d/d4f/dde 0 2024-04-26T11:46:41.110 INFO:tasks.workunit.client.0.smithi029.stdout:7/878: dwrite d11/d18/f29 [4194304,4194304] 0 2024-04-26T11:46:41.110 INFO:tasks.workunit.client.0.smithi029.stdout:7/879: sync 2024-04-26T11:46:41.110 INFO:tasks.workunit.client.0.smithi029.stdout:9/766: rmdir d4/d49 39 2024-04-26T11:46:41.111 INFO:tasks.workunit.client.0.smithi029.stdout:8/752: creat dc/de/d26/d57/d86/d90/f111 x:0 0 0 2024-04-26T11:46:41.111 INFO:tasks.workunit.client.0.smithi029.stdout:0/772: unlink d9/f1d 0 2024-04-26T11:46:41.112 INFO:tasks.workunit.client.0.smithi029.stdout:1/942: creat d7/d25/d68/d4b/f14d x:0 0 0 2024-04-26T11:46:41.113 INFO:tasks.workunit.client.0.smithi029.stdout:7/880: creat d11/d18/d2d/f125 x:0 0 0 2024-04-26T11:46:41.113 INFO:tasks.workunit.client.0.smithi029.stdout:5/773: unlink db/d40/d70/lda 0 2024-04-26T11:46:41.114 INFO:tasks.workunit.client.0.smithi029.stdout:2/891: dwrite d12/d24/d29/d50/f56 [0,4194304] 0 2024-04-26T11:46:41.115 INFO:tasks.workunit.client.0.smithi029.stdout:7/881: chown d11/d18/d1a/f83 147504281 1 2024-04-26T11:46:41.115 INFO:tasks.workunit.client.0.smithi029.stdout:9/767: creat d4/d5/d16/d80/dc9/fed x:0 0 0 2024-04-26T11:46:41.115 INFO:tasks.workunit.client.0.smithi029.stdout:8/753: creat dc/de/dd0/d108/f112 x:0 0 0 2024-04-26T11:46:41.115 INFO:tasks.workunit.client.0.smithi029.stdout:0/773: rename d9/d16/d52/f45 to d9/d78/f115 0 2024-04-26T11:46:41.115 INFO:tasks.workunit.client.0.smithi029.stdout:0/774: sync 2024-04-26T11:46:41.117 INFO:tasks.workunit.client.0.smithi029.stdout:3/756: dwrite d0/dc/f6c [4194304,4194304] 0 2024-04-26T11:46:41.117 INFO:tasks.workunit.client.0.smithi029.stdout:9/768: fsync d4/d49/d58/d67/f84 0 2024-04-26T11:46:41.120 INFO:tasks.workunit.client.0.smithi029.stdout:1/943: rename d7/d25/dab/lbb to d7/db/d8d/dc7/l14e 0 2024-04-26T11:46:41.120 INFO:tasks.workunit.client.0.smithi029.stdout:7/882: unlink d11/d18/d1a/d26/f45 0 2024-04-26T11:46:41.121 INFO:tasks.workunit.client.0.smithi029.stdout:9/769: rename d4/d5/d7/d74/fa2 to d4/d49/d7d/fee 0 2024-04-26T11:46:41.122 INFO:tasks.workunit.client.0.smithi029.stdout:1/944: mknod d7/d25/c14f 1 2024-04-26T11:46:41.122 INFO:tasks.workunit.client.0.smithi029.stdout:7/883: creat d11/d18/d58/f126 x:0 0 0 2024-04-26T11:46:41.124 INFO:tasks.workunit.client.0.smithi029.stdout:6/851: truncate d7/d25/f73 2671140 0 2024-04-26T11:46:41.125 INFO:tasks.workunit.client.0.smithi029.stdout:3/757: rename d0/d1/d41/d4c/f94 to d0/dc/d1f/f101 0 2024-04-26T11:46:41.126 INFO:tasks.workunit.client.0.smithi029.stdout:4/822: dread d3/d1d/db/d13/d23/d2b/f9a [0,4194304] 0 2024-04-26T11:46:41.127 INFO:tasks.workunit.client.0.smithi029.stdout:0/775: link d9/d16/d25/d2a/d4b/dd9/ff3 d9/d16/f116 0 2024-04-26T11:46:41.128 INFO:tasks.workunit.client.0.smithi029.stdout:9/770: write d4/d5/d16/d80/faa [2611332,37904] 0 2024-04-26T11:46:41.129 INFO:tasks.workunit.client.0.smithi029.stdout:6/852: creat d7/d20/f126 x:0 0 0 2024-04-26T11:46:41.129 INFO:tasks.workunit.client.0.smithi029.stdout:1/945: truncate d7/db/d8d/ff7 1430296 0 2024-04-26T11:46:41.129 INFO:tasks.workunit.client.0.smithi029.stdout:8/754: dwrite dc/de/d26/d57/fb0 [0,4194304] 0 2024-04-26T11:46:41.129 INFO:tasks.workunit.client.0.smithi029.stdout:4/823: mknod d3/d50/d101/c108 1 2024-04-26T11:46:41.129 INFO:tasks.workunit.client.0.smithi029.stdout:2/892: dwrite d12/d6c/d70/f9a [0,4194304] 0 2024-04-26T11:46:41.130 INFO:tasks.workunit.client.0.smithi029.stdout:9/771: stat d4/d5/d7/f59 0 2024-04-26T11:46:41.131 INFO:tasks.workunit.client.0.smithi029.stdout:4/824: mknod d3/d1d/da0/c109 1 2024-04-26T11:46:41.131 INFO:tasks.workunit.client.0.smithi029.stdout:5/774: dwrite db/d12/d72/f3d [0,4194304] 0 2024-04-26T11:46:41.134 INFO:tasks.workunit.client.0.smithi029.stdout:1/946: chown d7/db/d10/d1e/db2/dee/d3e/ld4 12 1 2024-04-26T11:46:41.134 INFO:tasks.workunit.client.0.smithi029.stdout:0/776: truncate d9/d16/d25/da7/fa9 920986 0 2024-04-26T11:46:41.136 INFO:tasks.workunit.client.0.smithi029.stdout:0/777: readlink d9/d16/de7/lb2 0 2024-04-26T11:46:41.138 INFO:tasks.workunit.client.0.smithi029.stdout:6/853: unlink d7/d25/d4b/d4d/d65/faa 0 2024-04-26T11:46:41.139 INFO:tasks.workunit.client.0.smithi029.stdout:4/825: creat d3/d1d/d11/d16/d71/f10a x:0 0 0 2024-04-26T11:46:41.139 INFO:tasks.workunit.client.0.smithi029.stdout:3/758: symlink d0/d1/d2f/d82/dce/l102 0 2024-04-26T11:46:41.140 INFO:tasks.workunit.client.0.smithi029.stdout:3/759: chown d0/d1/d5c 1474669 1 2024-04-26T11:46:41.141 INFO:tasks.workunit.client.0.smithi029.stdout:9/772: rename d4/d49/d58/l60 to d4/d49/lef 0 2024-04-26T11:46:41.143 INFO:tasks.workunit.client.0.smithi029.stdout:5/775: dread db/d12/d6b/f9e [0,4194304] 0 2024-04-26T11:46:41.144 INFO:tasks.workunit.client.0.smithi029.stdout:1/947: dwrite d7/db/dcc/f13d [0,4194304] 0 2024-04-26T11:46:41.144 INFO:tasks.workunit.client.0.smithi029.stdout:7/884: truncate d11/d18/d35/d7c/fa5 4134714 0 2024-04-26T11:46:41.146 INFO:tasks.workunit.client.0.smithi029.stdout:3/760: write d0/d1/d5c/f9c [32645,26666] 0 2024-04-26T11:46:41.147 INFO:tasks.workunit.client.0.smithi029.stdout:2/893: dwrite d12/d24/d29/d50/f56 [4194304,4194304] 0 2024-04-26T11:46:41.149 INFO:tasks.workunit.client.0.smithi029.stdout:4/826: chown d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/l5b 30819592 1 2024-04-26T11:46:41.149 INFO:tasks.workunit.client.0.smithi029.stdout:9/773: write d4/d5/d7/d74/da8/fe5 [660369,48986] 0 2024-04-26T11:46:41.149 INFO:tasks.workunit.client.0.smithi029.stdout:8/755: dwrite dc/de/d103/faf [0,4194304] 0 2024-04-26T11:46:41.149 INFO:tasks.workunit.client.0.smithi029.stdout:7/885: readlink d11/d15/l54 0 2024-04-26T11:46:41.150 INFO:tasks.workunit.client.0.smithi029.stdout:9/774: mknod d4/d49/cf0 1 2024-04-26T11:46:41.151 INFO:tasks.workunit.client.0.smithi029.stdout:2/894: symlink d12/d24/d29/db2/l132 0 2024-04-26T11:46:41.151 INFO:tasks.workunit.client.0.smithi029.stdout:3/761: unlink d0/dc/f89 0 2024-04-26T11:46:41.152 INFO:tasks.workunit.client.0.smithi029.stdout:0/778: dwrite d9/d16/d33/d2f/d68/f79 [0,4194304] 0 2024-04-26T11:46:41.154 INFO:tasks.workunit.client.0.smithi029.stdout:6/854: dwrite d7/d25/d4b/f6e [0,4194304] 0 2024-04-26T11:46:41.155 INFO:tasks.workunit.client.0.smithi029.stdout:9/775: fsync d4/d5/d16/d80/dc2/fb5 0 2024-04-26T11:46:41.155 INFO:tasks.workunit.client.0.smithi029.stdout:7/886: link d11/d18/d1a/d26/d91/f9f d11/d18/d2d/f127 0 2024-04-26T11:46:41.157 INFO:tasks.workunit.client.0.smithi029.stdout:3/762: rename d0/d1/d41/d5f to d0/d1/d5c/d103 0 2024-04-26T11:46:41.160 INFO:tasks.workunit.client.0.smithi029.stdout:6/855: getdents d7/d46/d69 0 2024-04-26T11:46:41.160 INFO:tasks.workunit.client.0.smithi029.stdout:3/763: write d0/d1/d5c/d103/d54/fbf [3346513,128739] 0 2024-04-26T11:46:41.162 INFO:tasks.workunit.client.0.smithi029.stdout:3/764: truncate d0/faa 807373 0 2024-04-26T11:46:41.164 INFO:tasks.workunit.client.0.smithi029.stdout:3/765: mknod d0/d1/d2b/d33/c104 1 2024-04-26T11:46:41.164 INFO:tasks.workunit.client.0.smithi029.stdout:2/895: dwrite d12/f26 [0,4194304] 0 2024-04-26T11:46:41.165 INFO:tasks.workunit.client.0.smithi029.stdout:8/756: write dc/de/d2e/d23/d27/dc5/fd9 [681501,124168] 0 2024-04-26T11:46:41.165 INFO:tasks.workunit.client.0.smithi029.stdout:0/779: dwrite d9/f36 [0,4194304] 0 2024-04-26T11:46:41.166 INFO:tasks.workunit.client.0.smithi029.stdout:8/757: dread - dc/de/d103/d7c/f8f zero size 2024-04-26T11:46:41.167 INFO:tasks.workunit.client.0.smithi029.stdout:2/896: truncate d12/d6c/d73/d4f/d65/d81/ffa 778637 0 2024-04-26T11:46:41.168 INFO:tasks.workunit.client.0.smithi029.stdout:0/780: getdents d9/d16/d25/db4 0 2024-04-26T11:46:41.169 INFO:tasks.workunit.client.0.smithi029.stdout:2/897: rename d12/d6c/d73/da5/ff8 to d12/d24/d29/d50/d55/f133 0 2024-04-26T11:46:41.169 INFO:tasks.workunit.client.0.smithi029.stdout:6/856: dwrite d7/d25/d5c/f1e [0,4194304] 0 2024-04-26T11:46:41.170 INFO:tasks.workunit.client.0.smithi029.stdout:2/898: dread - d12/d24/fcc zero size 2024-04-26T11:46:41.171 INFO:tasks.workunit.client.0.smithi029.stdout:2/899: read - d12/d6c/d73/d40/ddd/dee/f11c zero size 2024-04-26T11:46:41.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/857: chown d7/d46/d69/da2/d4c/d98/f66 379807 1 2024-04-26T11:46:41.174 INFO:tasks.workunit.client.0.smithi029.stdout:6/858: mkdir d7/d25/d4b/d6d/dd6/df7/d127 0 2024-04-26T11:46:41.174 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:41.173+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:41.176 INFO:tasks.workunit.client.0.smithi029.stdout:8/758: dwrite dc/de/f97 [0,4194304] 0 2024-04-26T11:46:41.176 INFO:tasks.workunit.client.0.smithi029.stdout:6/859: mkdir d7/d97/dc2/d128 0 2024-04-26T11:46:41.177 INFO:tasks.workunit.client.0.smithi029.stdout:2/900: rename d12/d6c/d73/d4f/d65/d99/ff2 to d12/d24/d2f/d76/f134 0 2024-04-26T11:46:41.179 INFO:tasks.workunit.client.0.smithi029.stdout:0/781: dwrite d9/d16/d25/da7/fa9 [0,4194304] 0 2024-04-26T11:46:41.179 INFO:tasks.workunit.client.0.smithi029.stdout:2/901: mknod d12/d6c/d73/dbd/dec/c135 1 2024-04-26T11:46:41.179 INFO:tasks.workunit.client.0.smithi029.stdout:2/902: stat d12/d6c/d70/f9a 0 2024-04-26T11:46:41.180 INFO:tasks.workunit.client.0.smithi029.stdout:0/782: symlink d9/d16/d33/d2f/d32/d9f/l117 0 2024-04-26T11:46:41.187 INFO:tasks.workunit.client.0.smithi029.stdout:0/783: dread - d9/d16/d33/d2f/d32/d90/ffc zero size 2024-04-26T11:46:41.187 INFO:tasks.workunit.client.0.smithi029.stdout:9/776: dwrite d4/d5/d7a/f96 [0,4194304] 0 2024-04-26T11:46:41.188 INFO:tasks.workunit.client.0.smithi029.stdout:0/784: read - d9/d16/de7/f110 zero size 2024-04-26T11:46:41.188 INFO:tasks.workunit.client.0.smithi029.stdout:0/785: link d9/d16/d33/d2f/d68/l93 d9/d16/d33/d2f/de3/l118 0 2024-04-26T11:46:41.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:46:41.189 INFO:tasks.workunit.client.0.smithi029.stdout:2/903: mkdir d12/d24/d29/d50/d55/d136 0 2024-04-26T11:46:41.189 INFO:tasks.workunit.client.0.smithi029.stdout:0/786: creat d9/d16/de7/d107/d100/f119 x:0 0 0 2024-04-26T11:46:41.189 INFO:tasks.workunit.client.0.smithi029.stdout:2/904: symlink d12/d24/d29/dda/d102/l137 0 2024-04-26T11:46:41.189 INFO:tasks.workunit.client.0.smithi029.stdout:0/787: read d9/f10 [4322166,116205] 0 2024-04-26T11:46:41.191 INFO:tasks.workunit.client.0.smithi029.stdout:2/905: mkdir d12/d24/d2f/d76/d138 0 2024-04-26T11:46:41.192 INFO:tasks.workunit.client.0.smithi029.stdout:0/788: link d9/d16/d33/d2f/d32/d9f/de6/feb d9/d16/d33/d2f/d68/f11a 0 2024-04-26T11:46:41.193 INFO:tasks.workunit.client.0.smithi029.stdout:7/887: sync 2024-04-26T11:46:41.193 INFO:tasks.workunit.client.0.smithi029.stdout:3/766: sync 2024-04-26T11:46:41.194 INFO:tasks.workunit.client.0.smithi029.stdout:1/948: dread d7/db/d10/d1e/db2/f10c [0,4194304] 0 2024-04-26T11:46:41.195 INFO:tasks.workunit.client.0.smithi029.stdout:0/789: fsync d9/d16/d25/d2a/d46/f5a 0 2024-04-26T11:46:41.195 INFO:tasks.workunit.client.0.smithi029.stdout:7/888: mkdir d11/dd3/de4/d84/d128 0 2024-04-26T11:46:41.197 INFO:tasks.workunit.client.0.smithi029.stdout:2/906: dread d12/d6c/d73/d4f/faa [0,4194304] 0 2024-04-26T11:46:41.197 INFO:tasks.workunit.client.0.smithi029.stdout:0/790: symlink d9/d16/de7/d107/d100/l11b 0 2024-04-26T11:46:41.198 INFO:tasks.workunit.client.0.smithi029.stdout:7/889: write d11/d18/f22 [870395,73168] 0 2024-04-26T11:46:41.198 INFO:tasks.workunit.client.0.smithi029.stdout:5/776: dread db/d12/d1a/f27 [0,4194304] 0 2024-04-26T11:46:41.199 INFO:tasks.workunit.client.0.smithi029.stdout:1/949: truncate d7/f77 1571250 0 2024-04-26T11:46:41.199 INFO:tasks.workunit.client.0.smithi029.stdout:0/791: creat d9/d16/d33/f11c x:0 0 0 2024-04-26T11:46:41.199 INFO:tasks.workunit.client.0.smithi029.stdout:7/890: unlink d11/d18/d1a/d92/f9a 0 2024-04-26T11:46:41.200 INFO:tasks.workunit.client.0.smithi029.stdout:1/950: write d7/d25/d68/f130 [83507,36057] 0 2024-04-26T11:46:41.200 INFO:tasks.workunit.client.0.smithi029.stdout:5/777: creat db/d12/ff5 x:0 0 0 2024-04-26T11:46:41.200 INFO:tasks.workunit.client.0.smithi029.stdout:0/792: creat d9/d16/de7/d107/f11d x:0 0 0 2024-04-26T11:46:41.200 INFO:tasks.workunit.client.0.smithi029.stdout:8/759: read dc/de/d103/d6a/f77 [328682,129958] 0 2024-04-26T11:46:41.202 INFO:tasks.workunit.client.0.smithi029.stdout:5/778: unlink db/d12/d72/d39/faf 0 2024-04-26T11:46:41.202 INFO:tasks.workunit.client.0.smithi029.stdout:1/951: symlink d7/db/dcc/deb/l150 0 2024-04-26T11:46:41.202 INFO:tasks.workunit.client.0.smithi029.stdout:7/891: truncate d11/d18/d58/d8d/fbe 4641267 0 2024-04-26T11:46:41.202 INFO:tasks.workunit.client.0.smithi029.stdout:0/793: mknod d9/d16/d33/d2f/d32/d9f/dac/c11e 1 2024-04-26T11:46:41.203 INFO:tasks.workunit.client.0.smithi029.stdout:5/779: rmdir db/da6 39 2024-04-26T11:46:41.204 INFO:tasks.workunit.client.0.smithi029.stdout:8/760: creat dc/de/d26/f113 x:0 0 0 2024-04-26T11:46:41.204 INFO:tasks.workunit.client.0.smithi029.stdout:2/907: read d12/f19 [666850,128161] 0 2024-04-26T11:46:41.204 INFO:tasks.workunit.client.0.smithi029.stdout:0/794: rmdir d9/d16/d33/d2f/d32/d90 39 2024-04-26T11:46:41.205 INFO:tasks.workunit.client.0.smithi029.stdout:1/952: link d7/d25/d85/lbf d7/d25/d6d/d119/l151 0 2024-04-26T11:46:41.206 INFO:tasks.workunit.client.0.smithi029.stdout:2/908: mknod d12/d24/d29/d36/c139 1 2024-04-26T11:46:41.206 INFO:tasks.workunit.client.0.smithi029.stdout:1/953: mknod d7/db/d10/d1e/d5e/d144/c152 1 2024-04-26T11:46:41.207 INFO:tasks.workunit.client.0.smithi029.stdout:5/780: read db/d12/f8d [330833,89497] 0 2024-04-26T11:46:41.207 INFO:tasks.workunit.client.0.smithi029.stdout:4/827: dread d3/d1d/d11/d16/d1f/d3d/d39/f5a [0,4194304] 0 2024-04-26T11:46:41.208 INFO:tasks.workunit.client.0.smithi029.stdout:1/954: chown d7/db/d8d/d11a/l106 0 1 2024-04-26T11:46:41.212 INFO:tasks.workunit.client.0.smithi029.stdout:5/781: read - db/d40/d4d/fcc zero size 2024-04-26T11:46:41.212 INFO:tasks.workunit.client.0.smithi029.stdout:4/828: getdents d3/d1d/db/d13/d23/d2b/dbc 0 2024-04-26T11:46:41.214 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2661 4.2c 4:3633c3cf:::10000003340.00000000:head [trimtrunc 3@1571250] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-26T11:46:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:41.212487+0000", 2024-04-26T11:46:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.002110692, 2024-04-26T11:46:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021299560000000001, 2024-04-26T11:46:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.212487+0000", 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.212487+0000", 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.212486+0000", 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.212489+0000", 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9950000000000001e-06 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.212495+0000", 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9909999999999999e-06 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.212500+0000", 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7949999999999998e-06 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.212535+0000", 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4983e-05 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.212613+0000", 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7627999999999996e-05 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:14503 4.31 4:8f6bfef1:::1000000314b.00000000:head [read 1048576~1048576 [5@2065690]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:41.213299+0000", 2024-04-26T11:46:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00129827, 2024-04-26T11:46:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013634719999999999, 2024-04-26T11:46:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:46:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 14503 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.213299+0000", 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.213299+0000", 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.213299+0000", 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.213302+0000", 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.909e-06 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.213315+0000", 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2864000000000001e-05 2024-04-26T11:46:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.213319+0000", 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6369999999999998e-06 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.213347+0000", 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8092000000000001e-05 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.213395+0000", 2024-04-26T11:46:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7277000000000002e-05 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:14504 4.11 4.f5f8e651 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:41.214614+0000", 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9999833, 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102248, 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 14504 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.214614+0000", 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.214614+0000", 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.214613+0000", 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.214619+0000", 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3949999999999998e-06 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.214636+0000", 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6518999999999999e-05 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:41.214648+0000", 2024-04-26T11:46:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2277e-05 2024-04-26T11:46:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:46:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 3 2024-04-26T11:46:41.226 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:41.228 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:41.230 INFO:tasks.workunit.client.0.smithi029.stdout:5/782: dread - db/d12/f78 zero size 2024-04-26T11:46:41.230 INFO:tasks.workunit.client.0.smithi029.stdout:9/777: dread d4/d5/d16/d80/dc2/fb5 [0,4194304] 0 2024-04-26T11:46:41.230 INFO:tasks.workunit.client.0.smithi029.stdout:0/795: dwrite d9/d16/f4d [0,4194304] 0 2024-04-26T11:46:41.230 INFO:tasks.workunit.client.0.smithi029.stdout:9/778: chown d4/d5/d7/dc7 688 1 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:8/761: dwrite dc/de/d103/f5d [0,4194304] 0 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:7/892: truncate d11/d18/d35/d39/d7e/dde/f5a 3988491 0 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:0/796: fdatasync d9/d16/d25/da7/f102 0 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:4/829: symlink d3/d1d/d11/l10b 0 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:2/909: dwrite d12/f39 [0,4194304] 0 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:7/893: symlink d11/l129 0 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:5/783: creat db/d12/d72/d39/ff6 x:0 0 0 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:0/797: chown d9/f18 8 1 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:9/779: creat d4/ff1 x:0 0 0 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:4/830: write d3/d1d/ff2 [84598,4761] 0 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:8/762: unlink dc/de/d2e/f46 0 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:9/780: mknod d4/d5/d7/d74/da8/de1/cf2 1 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:8/763: chown dc/d3b/f40 744687642 1 2024-04-26T11:46:41.231 INFO:tasks.workunit.client.0.smithi029.stdout:0/798: chown d9/d16/d25/d2a/f39 0 1 2024-04-26T11:46:41.232 INFO:tasks.workunit.client.0.smithi029.stdout:9/781: mknod d4/d5/d7/cf3 1 2024-04-26T11:46:41.232 INFO:tasks.workunit.client.0.smithi029.stdout:5/784: symlink db/d12/d72/lf7 0 2024-04-26T11:46:41.232 INFO:tasks.workunit.client.0.smithi029.stdout:2/910: rename d12/d6c/d73/d40/fd4 to d12/d6c/d6e/de4/f13a 0 2024-04-26T11:46:41.232 INFO:tasks.workunit.client.0.smithi029.stdout:8/764: chown dc/de/d26/d57/d86/d90 5 1 2024-04-26T11:46:41.232 INFO:tasks.workunit.client.0.smithi029.stdout:6/860: dread d7/d46/d69/da2/d4c/d98/f66 [0,4194304] 0 2024-04-26T11:46:41.232 INFO:tasks.workunit.client.0.smithi029.stdout:1/955: dwrite d7/db/dcc/deb/f124 [0,4194304] 0 2024-04-26T11:46:41.233 INFO:tasks.workunit.client.0.smithi029.stdout:3/767: dread d0/d1/d5c/d103/f59 [0,4194304] 0 2024-04-26T11:46:41.233 INFO:tasks.workunit.client.0.smithi029.stdout:6/861: read d7/d25/d5c/f1e [1610345,106722] 0 2024-04-26T11:46:41.233 INFO:tasks.workunit.client.0.smithi029.stdout:4/831: chown d3/d1d/db/d13/d73/d7e/l91 51 1 2024-04-26T11:46:41.233 INFO:tasks.workunit.client.0.smithi029.stdout:5/785: mkdir db/da6/df8 0 2024-04-26T11:46:41.233 INFO:tasks.workunit.client.0.smithi029.stdout:1/956: chown d7/d25/d68/d4b/d66/d12a 93929 1 2024-04-26T11:46:41.234 INFO:tasks.workunit.client.0.smithi029.stdout:9/782: write d4/d49/d7d/fee [5216188,2262] 0 2024-04-26T11:46:41.234 INFO:tasks.workunit.client.0.smithi029.stdout:3/768: mknod d0/d1/d5c/d103/de3/de7/c105 1 2024-04-26T11:46:41.236 INFO:tasks.workunit.client.0.smithi029.stdout:3/769: unlink d0/f1b 0 2024-04-26T11:46:41.236 INFO:tasks.workunit.client.0.smithi029.stdout:4/832: readlink d3/d1d/d11/d16/d1f/d3d/d39/l6f 0 2024-04-26T11:46:41.236 INFO:tasks.workunit.client.0.smithi029.stdout:1/957: creat d7/d25/dab/df1/f153 x:0 0 0 2024-04-26T11:46:41.236 INFO:tasks.workunit.client.0.smithi029.stdout:0/799: read d9/d16/d25/d2a/d74/d9a/faf [2864228,40075] 0 2024-04-26T11:46:41.236 INFO:tasks.workunit.client.0.smithi029.stdout:5/786: creat db/d89/de0/ff9 x:0 0 0 2024-04-26T11:46:41.236 INFO:tasks.workunit.client.0.smithi029.stdout:7/894: dwrite d11/d18/d2d/fc2 [0,4194304] 0 2024-04-26T11:46:41.236 INFO:tasks.workunit.client.0.smithi029.stdout:6/862: write d7/d46/d69/da2/d4c/d98/fa4 [4396084,54767] 0 2024-04-26T11:46:41.237 INFO:tasks.workunit.client.0.smithi029.stdout:5/787: fsync db/d40/d4d/d4f/fb9 0 2024-04-26T11:46:41.238 INFO:tasks.workunit.client.0.smithi029.stdout:3/770: creat d0/dc/d80/d9a/f106 x:0 0 0 2024-04-26T11:46:41.238 INFO:tasks.workunit.client.0.smithi029.stdout:1/958: stat d7/d25/d6d/d8c/df0/d147/l9f 0 2024-04-26T11:46:41.238 INFO:tasks.workunit.client.0.smithi029.stdout:6/863: unlink d7/d46/d69/da2/f4a 0 2024-04-26T11:46:41.239 INFO:tasks.workunit.client.0.smithi029.stdout:0/800: mkdir d9/d16/d33/d2f/d32/d9f/de6/d11f 0 2024-04-26T11:46:41.239 INFO:tasks.workunit.client.0.smithi029.stdout:4/833: write d3/d1d/db/f51 [1814136,111056] 0 2024-04-26T11:46:41.239 INFO:tasks.workunit.client.0.smithi029.stdout:9/783: link d4/d46/l5f d4/d5/d7/d74/lf4 0 2024-04-26T11:46:41.240 INFO:tasks.workunit.client.0.smithi029.stdout:8/765: rmdir dc/de/d2e 39 2024-04-26T11:46:41.240 INFO:tasks.workunit.client.0.smithi029.stdout:7/895: rename d11/dd3/de4/l85 to d11/d18/d58/d8d/dc3/l12a 0 2024-04-26T11:46:41.240 INFO:tasks.workunit.client.0.smithi029.stdout:6/864: unlink l3 0 2024-04-26T11:46:41.240 INFO:tasks.workunit.client.0.smithi029.stdout:4/834: chown d3/d1d/d11/d16/d1f/d3d/d39 235231 1 2024-04-26T11:46:41.241 INFO:tasks.workunit.client.0.smithi029.stdout:1/959: rename d7/db/d10/l142 to d7/db/d8d/d145/l154 0 2024-04-26T11:46:41.241 INFO:tasks.workunit.client.0.smithi029.stdout:9/784: write d4/f7f [5835322,121927] 0 2024-04-26T11:46:41.241 INFO:tasks.workunit.client.0.smithi029.stdout:6/865: chown d7/d25/d4b/d4d/fc1 1 1 2024-04-26T11:46:41.241 INFO:tasks.workunit.client.0.smithi029.stdout:0/801: truncate d9/d16/d25/d2a/d46/ffb 714781 0 2024-04-26T11:46:41.242 INFO:tasks.workunit.client.0.smithi029.stdout:5/788: chown db/d12/d1a/f80 79395870 1 2024-04-26T11:46:41.243 INFO:tasks.workunit.client.0.smithi029.stdout:7/896: rename d11/d18/d35/d39/l3e to d11/d18/d35/d39/d7e/l12b 0 2024-04-26T11:46:41.243 INFO:tasks.workunit.client.0.smithi029.stdout:1/960: mkdir d7/d5b/d155 0 2024-04-26T11:46:41.243 INFO:tasks.workunit.client.0.smithi029.stdout:8/766: write dc/de/d26/d57/f85 [1084376,112367] 0 2024-04-26T11:46:41.248 INFO:tasks.workunit.client.0.smithi029.stdout:8/767: mkdir dc/de/d26/d57/d86/d90/de8/d114 0 2024-04-26T11:46:41.249 INFO:tasks.workunit.client.0.smithi029.stdout:5/789: creat db/d12/d72/d92/ffa x:0 0 0 2024-04-26T11:46:41.249 INFO:tasks.workunit.client.0.smithi029.stdout:3/771: dwrite d0/d1/d2f/f39 [0,4194304] 0 2024-04-26T11:46:41.251 INFO:tasks.workunit.client.0.smithi029.stdout:2/911: write d12/d6c/f72 [650628,47738] 0 2024-04-26T11:46:41.252 INFO:tasks.workunit.client.0.smithi029.stdout:7/897: truncate d11/d18/d35/d7c/fa5 4719246 0 2024-04-26T11:46:41.252 INFO:tasks.workunit.client.0.smithi029.stdout:5/790: chown db/d12/d72/f3d 0 1 2024-04-26T11:46:41.253 INFO:tasks.workunit.client.0.smithi029.stdout:9/785: dwrite d4/d46/f56 [0,4194304] 0 2024-04-26T11:46:41.254 INFO:tasks.workunit.client.0.smithi029.stdout:0/802: dwrite d9/d16/d25/da7/fa9 [0,4194304] 0 2024-04-26T11:46:41.255 INFO:tasks.workunit.client.0.smithi029.stdout:2/912: truncate d12/de3/f103 3674086 0 2024-04-26T11:46:41.255 INFO:tasks.workunit.client.0.smithi029.stdout:0/803: truncate d9/d16/de7/f110 784398 0 2024-04-26T11:46:41.258 INFO:tasks.workunit.client.0.smithi029.stdout:0/804: mkdir d9/d16/de7/dff/d120 0 2024-04-26T11:46:41.260 INFO:tasks.workunit.client.0.smithi029.stdout:2/913: getdents d12/d6c/d73/d40/ddd/dee 0 2024-04-26T11:46:41.261 INFO:tasks.workunit.client.0.smithi029.stdout:5/791: read db/d12/d1a/f80 [3911837,66537] 0 2024-04-26T11:46:41.262 INFO:tasks.workunit.client.0.smithi029.stdout:5/792: chown db/d40/d77/d98 18051 1 2024-04-26T11:46:41.263 INFO:tasks.workunit.client.0.smithi029.stdout:4/835: dwrite d3/d1d/d11/d16/d1f/d3d/d39/f32 [0,4194304] 0 2024-04-26T11:46:41.266 INFO:tasks.workunit.client.0.smithi029.stdout:2/914: creat d12/d24/d2f/f13b x:0 0 0 2024-04-26T11:46:41.267 INFO:tasks.workunit.client.0.smithi029.stdout:4/836: mkdir d3/d50/d10c 0 2024-04-26T11:46:41.267 INFO:tasks.workunit.client.0.smithi029.stdout:7/898: dwrite d11/dd3/de4/daa/fc0 [0,4194304] 0 2024-04-26T11:46:41.267 INFO:tasks.workunit.client.0.smithi029.stdout:0/805: dread d9/d16/d25/d2a/f66 [0,4194304] 0 2024-04-26T11:46:41.268 INFO:tasks.workunit.client.0.smithi029.stdout:0/806: write d9/d16/d25/da7/fbf [834225,54825] 0 2024-04-26T11:46:41.268 INFO:tasks.workunit.client.0.smithi029.stdout:2/915: creat d12/d24/d2f/d76/f13c x:0 0 0 2024-04-26T11:46:41.269 INFO:tasks.workunit.client.0.smithi029.stdout:7/899: creat d11/d18/d35/dfd/f12c x:0 0 0 2024-04-26T11:46:41.269 INFO:tasks.workunit.client.0.smithi029.stdout:5/793: getdents db/d40/d4d/d4f/d73/d93 0 2024-04-26T11:46:41.270 INFO:tasks.workunit.client.0.smithi029.stdout:0/807: creat d9/d16/d25/ddc/f121 x:0 0 0 2024-04-26T11:46:41.270 INFO:tasks.workunit.client.0.smithi029.stdout:7/900: truncate d11/dd3/de4/d84/fe2 1351845 0 2024-04-26T11:46:41.271 INFO:tasks.workunit.client.0.smithi029.stdout:7/901: chown d11/d15/l54 573427 1 2024-04-26T11:46:41.272 INFO:tasks.workunit.client.0.smithi029.stdout:7/902: mknod d11/d18/dad/c12d 1 2024-04-26T11:46:41.276 INFO:tasks.workunit.client.0.smithi029.stdout:5/794: dwrite db/d12/f78 [0,4194304] 0 2024-04-26T11:46:41.277 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:41.277+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:41.278 INFO:tasks.workunit.client.0.smithi029.stdout:7/903: dread d11/dd3/de4/daa/fc0 [0,4194304] 0 2024-04-26T11:46:41.278 INFO:tasks.workunit.client.0.smithi029.stdout:7/904: fsync d11/d115/f109 0 2024-04-26T11:46:41.278 INFO:tasks.workunit.client.0.smithi029.stdout:5/795: mkdir db/d12/d72/d39/dfb 0 2024-04-26T11:46:41.280 INFO:tasks.workunit.client.0.smithi029.stdout:5/796: write db/d12/f8d [668577,46231] 0 2024-04-26T11:46:41.280 INFO:tasks.workunit.client.0.smithi029.stdout:7/905: rename d11/d18/d1a/f3c to d11/dd3/de4/d84/d128/f12e 0 2024-04-26T11:46:41.282 INFO:tasks.workunit.client.0.smithi029.stdout:7/906: mkdir d11/d18/d35/d39/d7e/d12f 0 2024-04-26T11:46:41.282 INFO:tasks.workunit.client.0.smithi029.stdout:5/797: getdents db/d40/d4d/d79/dc8 0 2024-04-26T11:46:41.283 INFO:tasks.workunit.client.0.smithi029.stdout:5/798: rmdir db/d40/d70/de8 39 2024-04-26T11:46:41.284 INFO:tasks.workunit.client.0.smithi029.stdout:5/799: unlink db/d40/d4d/fcc 0 2024-04-26T11:46:41.288 INFO:tasks.workunit.client.0.smithi029.stdout:6/866: dread d7/d46/d69/da2/fb1 [0,4194304] 0 2024-04-26T11:46:41.289 INFO:tasks.workunit.client.0.smithi029.stdout:6/867: fdatasync d7/d20/fea 0 2024-04-26T11:46:41.290 INFO:tasks.workunit.client.0.smithi029.stdout:7/907: dread d11/d18/d35/d39/d7e/ff9 [0,4194304] 0 2024-04-26T11:46:41.291 INFO:tasks.workunit.client.0.smithi029.stdout:5/800: dwrite db/d40/f61 [0,4194304] 0 2024-04-26T11:46:41.292 INFO:tasks.workunit.client.0.smithi029.stdout:6/868: rename d7/d46/d69/da2/d4c/d98/fc5 to d7/d25/d4b/d6d/dd6/df7/f129 0 2024-04-26T11:46:41.294 INFO:tasks.workunit.client.0.smithi029.stdout:6/869: mkdir d7/d46/d69/da2/dc8/d12a 0 2024-04-26T11:46:41.295 INFO:tasks.workunit.client.0.smithi029.stdout:1/961: dread d7/d25/d68/f79 [0,4194304] 0 2024-04-26T11:46:41.296 INFO:tasks.workunit.client.0.smithi029.stdout:6/870: symlink d7/d46/d69/l12b 0 2024-04-26T11:46:41.298 INFO:tasks.workunit.client.0.smithi029.stdout:1/962: mkdir d7/d25/dab/d149/d14c/d156 0 2024-04-26T11:46:41.298 INFO:tasks.workunit.client.0.smithi029.stdout:1/963: chown d7/d5b 428 1 2024-04-26T11:46:41.301 INFO:tasks.workunit.client.0.smithi029.stdout:8/768: dread dc/d3b/f41 [0,4194304] 0 2024-04-26T11:46:41.301 INFO:tasks.workunit.client.0.smithi029.stdout:9/786: dread d4/d49/d58/f9d [0,4194304] 0 2024-04-26T11:46:41.301 INFO:tasks.workunit.client.0.smithi029.stdout:7/908: dwrite d11/dd3/de4/daa/fac [0,4194304] 0 2024-04-26T11:46:41.303 INFO:tasks.workunit.client.0.smithi029.stdout:5/801: dwrite db/d12/d72/d92/ffa [0,4194304] 0 2024-04-26T11:46:41.303 INFO:tasks.workunit.client.0.smithi029.stdout:9/787: fsync d4/d49/fdb 0 2024-04-26T11:46:41.303 INFO:tasks.workunit.client.0.smithi029.stdout:8/769: chown dc/d3b/f84 30 1 2024-04-26T11:46:41.303 INFO:tasks.workunit.client.0.smithi029.stdout:7/909: stat d11/d18/d1a/d33/l51 0 2024-04-26T11:46:41.304 INFO:tasks.workunit.client.0.smithi029.stdout:2/916: dread d12/f1d [8388608,4194304] 0 2024-04-26T11:46:41.305 INFO:tasks.workunit.client.0.smithi029.stdout:7/910: write d11/d18/d1a/f23 [196746,48367] 0 2024-04-26T11:46:41.305 INFO:tasks.workunit.client.0.smithi029.stdout:8/770: stat dc/de/d2e/d23/d27/la4 0 2024-04-26T11:46:41.305 INFO:tasks.workunit.client.0.smithi029.stdout:5/802: write db/d12/d1a/fa8 [2220799,105559] 0 2024-04-26T11:46:41.305 INFO:tasks.workunit.client.0.smithi029.stdout:2/917: chown d12/d24/d29/d50 11 1 2024-04-26T11:46:41.306 INFO:tasks.workunit.client.0.smithi029.stdout:6/871: truncate d7/d46/d69/da2/fb1 4075604 0 2024-04-26T11:46:41.306 INFO:tasks.workunit.client.0.smithi029.stdout:5/803: fdatasync db/f76 0 2024-04-26T11:46:41.307 INFO:tasks.workunit.client.0.smithi029.stdout:2/918: write d12/d6c/d73/d4f/d65/f75 [4228474,87867] 0 2024-04-26T11:46:41.307 INFO:tasks.workunit.client.0.smithi029.stdout:6/872: truncate d7/d25/d4b/d4d/f82 1412535 0 2024-04-26T11:46:41.308 INFO:tasks.workunit.client.0.smithi029.stdout:2/919: creat d12/d6c/d70/dff/f13d x:0 0 0 2024-04-26T11:46:41.309 INFO:tasks.workunit.client.0.smithi029.stdout:6/873: rmdir d7/d97 39 2024-04-26T11:46:41.309 INFO:tasks.workunit.client.0.smithi029.stdout:5/804: truncate db/d12/d1a/f51 4877615 0 2024-04-26T11:46:41.309 INFO:tasks.workunit.client.0.smithi029.stdout:2/920: stat d12/d6c/l62 0 2024-04-26T11:46:41.309 INFO:tasks.workunit.client.0.smithi029.stdout:5/805: mknod db/d40/d77/cfc 1 2024-04-26T11:46:41.310 INFO:tasks.workunit.client.0.smithi029.stdout:6/874: mkdir d7/d46/d69/da2/d12c 0 2024-04-26T11:46:41.310 INFO:tasks.workunit.client.0.smithi029.stdout:5/806: mknod db/d12/d72/d39/dfb/cfd 1 2024-04-26T11:46:41.311 INFO:tasks.workunit.client.0.smithi029.stdout:6/875: write d7/d97/dc2/f109 [4812383,32163] 0 2024-04-26T11:46:41.312 INFO:tasks.workunit.client.0.smithi029.stdout:5/807: creat db/ffe x:0 0 0 2024-04-26T11:46:41.313 INFO:tasks.workunit.client.0.smithi029.stdout:6/876: creat d7/d25/d4b/d4d/d65/f12d x:0 0 0 2024-04-26T11:46:41.313 INFO:tasks.workunit.client.0.smithi029.stdout:8/771: dwrite dc/de/d2e/d23/d27/d6f/d9b/f80 [0,4194304] 0 2024-04-26T11:46:41.313 INFO:tasks.workunit.client.0.smithi029.stdout:5/808: unlink db/d12/d72/d39/d3b/d86/le5 0 2024-04-26T11:46:41.314 INFO:tasks.workunit.client.0.smithi029.stdout:5/809: chown db/d12/f8d 7 1 2024-04-26T11:46:41.315 INFO:tasks.workunit.client.0.smithi029.stdout:8/772: symlink dc/de/d2e/d23/df9/d101/l115 0 2024-04-26T11:46:41.316 INFO:tasks.workunit.client.0.smithi029.stdout:6/877: getdents d7/d46 0 2024-04-26T11:46:41.316 INFO:tasks.workunit.client.0.smithi029.stdout:5/810: write db/d40/d77/f97 [860880,65210] 0 2024-04-26T11:46:41.316 INFO:tasks.workunit.client.0.smithi029.stdout:8/773: fdatasync dc/de/d26/f113 0 2024-04-26T11:46:41.316 INFO:tasks.workunit.client.0.smithi029.stdout:6/878: write d7/f1c [1884427,56788] 0 2024-04-26T11:46:41.317 INFO:tasks.workunit.client.0.smithi029.stdout:8/774: creat dc/de/d2e/d23/d27/d6f/dc8/f116 x:0 0 0 2024-04-26T11:46:41.318 INFO:tasks.workunit.client.0.smithi029.stdout:6/879: readlink d7/d25/d5c/l1f 0 2024-04-26T11:46:41.318 INFO:tasks.workunit.client.0.smithi029.stdout:8/775: write dc/de/d103/fb1 [3390284,6445] 0 2024-04-26T11:46:41.319 INFO:tasks.workunit.client.0.smithi029.stdout:5/811: link db/d12/d72/d39/l60 db/d12/lff 0 2024-04-26T11:46:41.319 INFO:tasks.workunit.client.0.smithi029.stdout:8/776: unlink dc/d3b/f50 0 2024-04-26T11:46:41.319 INFO:tasks.workunit.client.0.smithi029.stdout:6/880: symlink d7/d20/d27/d91/l12e 0 2024-04-26T11:46:41.320 INFO:tasks.workunit.client.0.smithi029.stdout:5/812: creat db/da6/f100 x:0 0 0 2024-04-26T11:46:41.320 INFO:tasks.workunit.client.0.smithi029.stdout:6/881: read - d7/d25/d4b/d4d/d65/f8c zero size 2024-04-26T11:46:41.320 INFO:tasks.workunit.client.0.smithi029.stdout:5/813: fsync db/d12/d72/d39/fe1 0 2024-04-26T11:46:41.321 INFO:tasks.workunit.client.0.smithi029.stdout:8/777: rename dc/de/d103/f5d to dc/de/d26/d57/d86/f117 0 2024-04-26T11:46:41.321 INFO:tasks.workunit.client.0.smithi029.stdout:5/814: stat db/d12/d72/f21 0 2024-04-26T11:46:41.322 INFO:tasks.workunit.client.0.smithi029.stdout:5/815: mkdir db/d40/dd6/d101 0 2024-04-26T11:46:41.322 INFO:tasks.workunit.client.0.smithi029.stdout:8/778: mkdir dc/de/d2e/d23/d27/d6f/d9b/d43/dad/d118 0 2024-04-26T11:46:41.323 INFO:tasks.workunit.client.0.smithi029.stdout:5/816: creat db/d40/f102 x:0 0 0 2024-04-26T11:46:41.324 INFO:tasks.workunit.client.0.smithi029.stdout:8/779: dread - dc/de/d2e/d23/d27/d6f/ff1 zero size 2024-04-26T11:46:41.324 INFO:tasks.workunit.client.0.smithi029.stdout:5/817: creat db/d89/f103 x:0 0 0 2024-04-26T11:46:41.325 INFO:tasks.workunit.client.0.smithi029.stdout:2/921: write d12/d24/d2f/f4e [1219106,64877] 0 2024-04-26T11:46:41.326 INFO:tasks.workunit.client.0.smithi029.stdout:5/818: symlink db/d40/d4d/d79/dc8/l104 0 2024-04-26T11:46:41.328 INFO:tasks.workunit.client.0.smithi029.stdout:5/819: read - db/d89/fd0 zero size 2024-04-26T11:46:41.328 INFO:tasks.workunit.client.0.smithi029.stdout:1/964: dread d7/db/d10/d1e/db2/dee/d3e/f56 [0,4194304] 0 2024-04-26T11:46:41.330 INFO:tasks.workunit.client.0.smithi029.stdout:5/820: dread - db/d40/d70/de8/f5f zero size 2024-04-26T11:46:41.331 INFO:tasks.workunit.client.0.smithi029.stdout:6/882: dwrite d7/d25/d4b/d4d/d65/db5/f111 [0,4194304] 0 2024-04-26T11:46:41.332 INFO:tasks.workunit.client.0.smithi029.stdout:5/821: symlink db/da6/l105 0 2024-04-26T11:46:41.332 INFO:tasks.workunit.client.0.smithi029.stdout:1/965: truncate d7/db/d10/d1e/d5e/d10f/d112/f127 1029117 0 2024-04-26T11:46:41.333 INFO:tasks.workunit.client.0.smithi029.stdout:5/822: mknod db/d12/d72/d39/dfb/c106 1 2024-04-26T11:46:41.333 INFO:tasks.workunit.client.0.smithi029.stdout:8/780: dwrite dc/d3b/f56 [4194304,4194304] 0 2024-04-26T11:46:41.333 INFO:tasks.workunit.client.0.smithi029.stdout:6/883: truncate d7/d97/fa5 2129581 0 2024-04-26T11:46:41.336 INFO:tasks.workunit.client.0.smithi029.stdout:5/823: mknod db/d12/c107 1 2024-04-26T11:46:41.337 INFO:tasks.workunit.client.0.smithi029.stdout:5/824: fdatasync db/d12/d72/f3d 0 2024-04-26T11:46:41.337 INFO:tasks.workunit.client.0.smithi029.stdout:8/781: chown dc/de/d2e/d23/d27/d6f/ffd 63696662 1 2024-04-26T11:46:41.338 INFO:tasks.workunit.client.0.smithi029.stdout:5/825: read db/d12/d72/f3d [2143870,53188] 0 2024-04-26T11:46:41.338 INFO:tasks.workunit.client.0.smithi029.stdout:6/884: mknod d7/d46/d69/da2/d4c/d98/d45/d83/da9/c12f 1 2024-04-26T11:46:41.339 INFO:tasks.workunit.client.0.smithi029.stdout:8/782: mkdir dc/de/d103/d6a/d119 0 2024-04-26T11:46:41.340 INFO:tasks.workunit.client.0.smithi029.stdout:8/783: write dc/d9f/db2/fc6 [158667,22993] 0 2024-04-26T11:46:41.340 INFO:tasks.workunit.client.0.smithi029.stdout:2/922: dwrite d12/d24/d29/dda/d102/f115 [0,4194304] 0 2024-04-26T11:46:41.340 INFO:tasks.workunit.client.0.smithi029.stdout:5/826: rename db/d89/de0/de2 to db/d40/d4d/d79/d108 0 2024-04-26T11:46:41.341 INFO:tasks.workunit.client.0.smithi029.stdout:6/885: mknod d7/d46/d69/da2/d4c/d98/d45/d76/df9/c130 1 2024-04-26T11:46:41.342 INFO:tasks.workunit.client.0.smithi029.stdout:5/827: write db/d40/d77/fd4 [432339,125223] 0 2024-04-26T11:46:41.343 INFO:tasks.workunit.client.0.smithi029.stdout:6/886: mkdir d7/d97/dc2/d131 0 2024-04-26T11:46:41.343 INFO:tasks.workunit.client.0.smithi029.stdout:2/923: write d12/d24/d29/d38/fac [2456868,63439] 0 2024-04-26T11:46:41.344 INFO:tasks.workunit.client.0.smithi029.stdout:6/887: chown d7/d97/dc2/d128 46350946 1 2024-04-26T11:46:41.344 INFO:tasks.workunit.client.0.smithi029.stdout:9/788: dread d4/d5/fd [4194304,4194304] 0 2024-04-26T11:46:41.344 INFO:tasks.workunit.client.0.smithi029.stdout:5/828: unlink db/d12/d1a/f96 0 2024-04-26T11:46:41.345 INFO:tasks.workunit.client.0.smithi029.stdout:2/924: mkdir d12/d6c/d73/d4f/d65/d81/d13e 0 2024-04-26T11:46:41.346 INFO:tasks.workunit.client.0.smithi029.stdout:9/789: fsync d4/f6f 0 2024-04-26T11:46:41.346 INFO:tasks.workunit.client.0.smithi029.stdout:6/888: rmdir d7/d25/d4b/d4d/d65/db9 0 2024-04-26T11:46:41.346 INFO:tasks.workunit.client.0.smithi029.stdout:2/925: rename l10 to d12/d6c/d73/l13f 0 2024-04-26T11:46:41.346 INFO:tasks.workunit.client.0.smithi029.stdout:6/889: chown d7/d46/d69/da2/d4c 9 1 2024-04-26T11:46:41.347 INFO:tasks.workunit.client.0.smithi029.stdout:9/790: rename d4/d49/d58/fa6 to d4/d5/d7/ff5 0 2024-04-26T11:46:41.349 INFO:tasks.workunit.client.0.smithi029.stdout:9/791: write d4/d5/d16/d80/f92 [954507,9463] 0 2024-04-26T11:46:41.349 INFO:tasks.workunit.client.0.smithi029.stdout:6/890: getdents d7/d97 0 2024-04-26T11:46:41.349 INFO:tasks.workunit.client.0.smithi029.stdout:2/926: link d12/d24/d2f/d76/f134 d12/d24/d29/d50/d55/f140 0 2024-04-26T11:46:41.349 INFO:tasks.workunit.client.0.smithi029.stdout:8/784: dread dc/d3b/f84 [0,4194304] 0 2024-04-26T11:46:41.349 INFO:tasks.workunit.client.0.smithi029.stdout:9/792: fdatasync d4/d49/fdb 0 2024-04-26T11:46:41.350 INFO:tasks.workunit.client.0.smithi029.stdout:2/927: mknod d12/d24/d29/dda/d102/c141 1 2024-04-26T11:46:41.351 INFO:tasks.workunit.client.0.smithi029.stdout:6/891: mkdir d7/d25/d4b/d4d/d132 0 2024-04-26T11:46:41.351 INFO:tasks.workunit.client.0.smithi029.stdout:8/785: creat dc/de/d2e/d23/d27/dc5/f11a x:0 0 0 2024-04-26T11:46:41.352 INFO:tasks.workunit.client.0.smithi029.stdout:2/928: dread - d12/d6c/d6e/fbf zero size 2024-04-26T11:46:41.352 INFO:tasks.workunit.client.0.smithi029.stdout:8/786: mknod dc/d9f/c11b 1 2024-04-26T11:46:41.352 INFO:tasks.workunit.client.0.smithi029.stdout:9/793: getdents d4 0 2024-04-26T11:46:41.352 INFO:tasks.workunit.client.0.smithi029.stdout:6/892: creat d7/d25/d4b/d6d/dd6/df7/f133 x:0 0 0 2024-04-26T11:46:41.353 INFO:tasks.workunit.client.0.smithi029.stdout:2/929: rmdir d12/d24/d29/d36/d4b 39 2024-04-26T11:46:41.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/893: mknod d7/d46/d69/da2/deb/c134 1 2024-04-26T11:46:41.354 INFO:tasks.workunit.client.0.smithi029.stdout:8/787: rename dc/de/d2e/d23/d27/fd3 to dc/de/d103/d7c/dfc/f11c 0 2024-04-26T11:46:41.354 INFO:tasks.workunit.client.0.smithi029.stdout:2/930: symlink d12/d24/d2f/d76/l142 0 2024-04-26T11:46:41.354 INFO:tasks.workunit.client.0.smithi029.stdout:8/788: fsync dc/de/d103/d6a/f4c 0 2024-04-26T11:46:41.354 INFO:tasks.workunit.client.0.smithi029.stdout:2/931: fdatasync d12/d24/d29/d50/d6a/fa1 0 2024-04-26T11:46:41.355 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:41.356 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:41.356 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:41.356 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:41.356 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:41.358 INFO:tasks.workunit.client.0.smithi029.stdout:5/829: dread db/d40/d77/f97 [0,4194304] 0 2024-04-26T11:46:41.358 INFO:tasks.workunit.client.0.smithi029.stdout:2/932: creat d12/d6c/d73/d40/ddd/dee/f143 x:0 0 0 2024-04-26T11:46:41.358 INFO:tasks.workunit.client.0.smithi029.stdout:5/830: chown db/d40/d4d/d4f/f8f 3235 1 2024-04-26T11:46:41.358 INFO:tasks.workunit.client.0.smithi029.stdout:8/789: dread dc/de/d2e/d23/f5f [0,4194304] 0 2024-04-26T11:46:41.358 INFO:tasks.workunit.client.0.smithi029.stdout:5/831: mknod db/d12/d6b/c109 1 2024-04-26T11:46:41.358 INFO:tasks.workunit.client.0.smithi029.stdout:2/933: creat d12/d24/d29/d50/d55/f144 x:0 0 0 2024-04-26T11:46:41.359 INFO:tasks.workunit.client.0.smithi029.stdout:5/832: chown db/d12/d72/l7d 28953 1 2024-04-26T11:46:41.360 INFO:tasks.workunit.client.0.smithi029.stdout:8/790: write dc/d3b/f41 [1117710,11539] 0 2024-04-26T11:46:41.360 INFO:tasks.workunit.client.0.smithi029.stdout:9/794: dread d4/d5/f95 [0,4194304] 0 2024-04-26T11:46:41.361 INFO:tasks.workunit.client.0.smithi029.stdout:2/934: dread - d12/d6c/d73/dbd/dec/f119 zero size 2024-04-26T11:46:41.361 INFO:tasks.workunit.client.0.smithi029.stdout:5/833: creat db/d12/d72/d39/d3b/d86/f10a x:0 0 0 2024-04-26T11:46:41.361 INFO:tasks.workunit.client.0.smithi029.stdout:9/795: mkdir d4/d5/d7a/db0/df6 0 2024-04-26T11:46:41.364 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:41.367 INFO:tasks.workunit.client.0.smithi029.stdout:9/796: truncate d4/d5/d16/d39/f3d 2090163 0 2024-04-26T11:46:41.367 INFO:tasks.workunit.client.0.smithi029.stdout:8/791: write dc/de/d103/d6a/d78/dc3/fdc [439589,118499] 0 2024-04-26T11:46:41.367 INFO:tasks.workunit.client.0.smithi029.stdout:9/797: creat d4/d5/de9/ff7 x:0 0 0 2024-04-26T11:46:41.367 INFO:tasks.workunit.client.0.smithi029.stdout:9/798: mkdir d4/d5/d7a/da1/df8 0 2024-04-26T11:46:41.367 INFO:tasks.workunit.client.0.smithi029.stdout:8/792: link dc/de/d2e/d23/l3d dc/de/d103/d6a/d119/l11d 0 2024-04-26T11:46:41.367 INFO:tasks.workunit.client.0.smithi029.stdout:2/935: dwrite d12/d6c/d73/d4f/d65/d81/fd8 [0,4194304] 0 2024-04-26T11:46:41.368 INFO:tasks.workunit.client.0.smithi029.stdout:9/799: symlink d4/d49/d7d/lf9 0 2024-04-26T11:46:41.368 INFO:tasks.workunit.client.0.smithi029.stdout:8/793: mknod dc/de/d103/d6a/d78/dc3/dcf/c11e 1 2024-04-26T11:46:41.371 INFO:tasks.workunit.client.0.smithi029.stdout:9/800: dread d4/d5/d16/f73 [0,4194304] 0 2024-04-26T11:46:41.372 INFO:tasks.workunit.client.0.smithi029.stdout:9/801: readlink d4/d5/d16/d80/lae 0 2024-04-26T11:46:41.373 INFO:tasks.workunit.client.0.smithi029.stdout:9/802: creat d4/d49/d58/d67/ffa x:0 0 0 2024-04-26T11:46:41.374 INFO:tasks.workunit.client.0.smithi029.stdout:9/803: rmdir d4/d5/d7a/d97 39 2024-04-26T11:46:41.375 INFO:tasks.workunit.client.0.smithi029.stdout:2/936: dwrite d12/d6c/d73/d40/ddd/dee/f143 [0,4194304] 0 2024-04-26T11:46:41.375 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:41.368+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:41.382 INFO:tasks.workunit.client.0.smithi029.stdout:2/937: write d12/d24/d2f/fd2 [908492,13638] 0 2024-04-26T11:46:41.387 INFO:tasks.workunit.client.0.smithi029.stdout:8/794: dread dc/f11 [8388608,4194304] 0 2024-04-26T11:46:41.388 INFO:tasks.workunit.client.0.smithi029.stdout:8/795: creat dc/de/dd0/d108/f11f x:0 0 0 2024-04-26T11:46:41.390 INFO:tasks.workunit.client.0.smithi029.stdout:2/938: dwrite d12/d24/d2f/f114 [0,4194304] 0 2024-04-26T11:46:41.401 INFO:tasks.workunit.client.0.smithi029.stdout:2/939: dwrite d12/d6c/d6e/fbf [0,4194304] 0 2024-04-26T11:46:41.403 INFO:tasks.workunit.client.0.smithi029.stdout:2/940: chown d12/d6c/d73/d4f/f80 20377 1 2024-04-26T11:46:41.406 INFO:tasks.workunit.client.0.smithi029.stdout:2/941: truncate d12/d24/d29/d50/d55/d5f/f111 1033310 0 2024-04-26T11:46:41.408 INFO:tasks.workunit.client.0.smithi029.stdout:2/942: rename d12/d6c/d73/d40/ddd/dee to d12/d6c/d70/d145 0 2024-04-26T11:46:41.409 INFO:tasks.workunit.client.0.smithi029.stdout:8/796: dread dc/de/d103/d7c/dfc/f11c [0,4194304] 0 2024-04-26T11:46:41.410 INFO:tasks.workunit.client.0.smithi029.stdout:2/943: rmdir d12/d24/d2f/d8c 39 2024-04-26T11:46:41.410 INFO:tasks.workunit.client.0.smithi029.stdout:2/944: mknod d12/d24/d29/d38/dea/c146 1 2024-04-26T11:46:41.411 INFO:tasks.workunit.client.0.smithi029.stdout:9/804: dread d4/d49/f6a [0,4194304] 0 2024-04-26T11:46:41.411 INFO:tasks.workunit.client.0.smithi029.stdout:8/797: rename dc/de/f10d to dc/d3b/f120 0 2024-04-26T11:46:41.412 INFO:tasks.workunit.client.0.smithi029.stdout:9/805: chown d4/d5/d16/d80/f9b 28557 1 2024-04-26T11:46:41.412 INFO:tasks.workunit.client.0.smithi029.stdout:2/945: creat d12/d6c/d73/dbd/dec/f147 x:0 0 0 2024-04-26T11:46:41.412 INFO:tasks.workunit.client.0.smithi029.stdout:8/798: write dc/de/d26/f53 [3928274,101389] 0 2024-04-26T11:46:41.413 INFO:tasks.workunit.client.0.smithi029.stdout:2/946: mknod d12/d24/d29/d36/d10f/d124/c148 1 2024-04-26T11:46:41.413 INFO:tasks.workunit.client.0.smithi029.stdout:9/806: unlink d4/d5/d16/d80/dc9/fed 0 2024-04-26T11:46:41.414 INFO:tasks.workunit.client.0.smithi029.stdout:9/807: chown d4/l9a 13654760 1 2024-04-26T11:46:41.415 INFO:tasks.workunit.client.0.smithi029.stdout:2/947: rename d12/d6c/d73/f108 to d12/d24/d2f/d76/f149 0 2024-04-26T11:46:41.416 INFO:tasks.workunit.client.0.smithi029.stdout:2/948: creat d12/d6c/d73/d40/f14a x:0 0 0 2024-04-26T11:46:41.416 INFO:tasks.workunit.client.0.smithi029.stdout:2/949: readlink d12/d24/d29/d38/l51 0 2024-04-26T11:46:41.418 INFO:tasks.workunit.client.0.smithi029.stdout:2/950: unlink d12/d6c/d73/d4f/d65/d6f/fb7 0 2024-04-26T11:46:41.420 INFO:tasks.workunit.client.0.smithi029.stdout:2/951: symlink d12/d24/d29/d50/l14b 0 2024-04-26T11:46:41.422 INFO:tasks.workunit.client.0.smithi029.stdout:2/952: truncate d12/d24/fcc 896654 0 2024-04-26T11:46:41.422 INFO:tasks.workunit.client.0.smithi029.stdout:8/799: dwrite dc/de/d2e/d23/d27/dc5/fca [0,4194304] 0 2024-04-26T11:46:41.423 INFO:tasks.workunit.client.0.smithi029.stdout:2/953: mkdir d12/d6c/d73/da5/d14c 0 2024-04-26T11:46:41.423 INFO:tasks.workunit.client.0.smithi029.stdout:9/808: dwrite d4/d5/d7/f85 [0,4194304] 0 2024-04-26T11:46:41.424 INFO:tasks.workunit.client.0.smithi029.stdout:8/800: unlink dc/de/d26/d6b/dde/l105 0 2024-04-26T11:46:41.424 INFO:tasks.workunit.client.0.smithi029.stdout:9/809: write d4/fd2 [731607,27934] 0 2024-04-26T11:46:41.425 INFO:tasks.workunit.client.0.smithi029.stdout:9/810: write d4/d5/d7/d74/da8/fe5 [858753,30765] 0 2024-04-26T11:46:41.426 INFO:tasks.workunit.client.0.smithi029.stdout:2/954: creat d12/d24/d29/d57/f14d x:0 0 0 2024-04-26T11:46:41.427 INFO:tasks.workunit.client.0.smithi029.stdout:9/811: link d4/d5/d7/f85 d4/d5/d7/d74/da8/de1/ffb 0 2024-04-26T11:46:41.428 INFO:tasks.workunit.client.0.smithi029.stdout:9/812: symlink d4/d5/d7a/d97/lfc 0 2024-04-26T11:46:41.433 INFO:tasks.workunit.client.0.smithi029.stdout:8/801: dwrite dc/de/d26/d57/d86/dc0/fff [0,4194304] 0 2024-04-26T11:46:41.433 INFO:tasks.workunit.client.0.smithi029.stdout:9/813: link d4/d5/f51 d4/d5/d16/ffd 0 2024-04-26T11:46:41.435 INFO:tasks.workunit.client.0.smithi029.stdout:3/772: sync 2024-04-26T11:46:41.435 INFO:tasks.workunit.client.0.smithi029.stdout:0/808: sync 2024-04-26T11:46:41.435 INFO:tasks.workunit.client.0.smithi029.stdout:7/911: sync 2024-04-26T11:46:41.435 INFO:tasks.workunit.client.0.smithi029.stdout:4/837: sync 2024-04-26T11:46:41.435 INFO:tasks.workunit.client.0.smithi029.stdout:2/955: dwrite d12/d6c/fb3 [8388608,4194304] 0 2024-04-26T11:46:41.436 INFO:tasks.workunit.client.0.smithi029.stdout:4/838: mknod d3/d1d/db/d13/d23/d2b/c10d 1 2024-04-26T11:46:41.436 INFO:tasks.workunit.client.0.smithi029.stdout:2/956: stat d12/d24/fe9 0 2024-04-26T11:46:41.437 INFO:tasks.workunit.client.0.smithi029.stdout:8/802: mkdir dc/de/d2e/d23/d27/d6f/d9b/d43/dad/d121 0 2024-04-26T11:46:41.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/912: unlink d11/d18/d35/f5e 0 2024-04-26T11:46:41.437 INFO:tasks.workunit.client.0.smithi029.stdout:0/809: rmdir d9/d16/d33/d2f 39 2024-04-26T11:46:41.438 INFO:tasks.workunit.client.0.smithi029.stdout:8/803: mknod dc/de/d103/d6a/d119/c122 1 2024-04-26T11:46:41.438 INFO:tasks.workunit.client.0.smithi029.stdout:9/814: link d4/d5/de9/ff7 d4/d5/d7/d74/da8/ffe 0 2024-04-26T11:46:41.438 INFO:tasks.workunit.client.0.smithi029.stdout:3/773: rename d0/dc/d80 to d0/d1/d2b/d7e/d107 0 2024-04-26T11:46:41.438 INFO:tasks.workunit.client.0.smithi029.stdout:2/957: chown d12/d24/d29/d50/f59 22764124 1 2024-04-26T11:46:41.439 INFO:tasks.workunit.client.0.smithi029.stdout:8/804: stat dc/de/d103/d6a/f4c 0 2024-04-26T11:46:41.439 INFO:tasks.workunit.client.0.smithi029.stdout:3/774: chown d0/l2e 14933416 1 2024-04-26T11:46:41.440 INFO:tasks.workunit.client.0.smithi029.stdout:2/958: mknod d12/d24/d29/d57/c14e 1 2024-04-26T11:46:41.440 INFO:tasks.workunit.client.0.smithi029.stdout:9/815: mkdir d4/dac/dff 0 2024-04-26T11:46:41.440 INFO:tasks.workunit.client.0.smithi029.stdout:2/959: creat d12/d24/d29/d57/f14f x:0 0 0 2024-04-26T11:46:41.444 INFO:tasks.workunit.client.0.smithi029.stdout:2/960: creat d12/d6c/d70/d145/f150 x:0 0 0 2024-04-26T11:46:41.444 INFO:tasks.workunit.client.0.smithi029.stdout:7/913: read d11/d18/d1a/d33/f75 [6177576,79332] 0 2024-04-26T11:46:41.445 INFO:tasks.workunit.client.0.smithi029.stdout:2/961: mknod d12/d6c/d73/d4f/d65/d6f/c151 1 2024-04-26T11:46:41.447 INFO:tasks.workunit.client.0.smithi029.stdout:8/805: dwrite dc/de/d2e/d23/d27/dc5/ff4 [0,4194304] 0 2024-04-26T11:46:41.448 INFO:tasks.workunit.client.0.smithi029.stdout:9/816: dwrite d4/d5/d7a/da1/fa9 [0,4194304] 0 2024-04-26T11:46:41.449 INFO:tasks.workunit.client.0.smithi029.stdout:2/962: creat d12/d6c/d73/dbd/f152 x:0 0 0 2024-04-26T11:46:41.449 INFO:tasks.workunit.client.0.smithi029.stdout:8/806: mkdir dc/de/d103/d6a/d78/d123 0 2024-04-26T11:46:41.451 INFO:tasks.workunit.client.0.smithi029.stdout:9/817: chown d4/d49/l89 7602 1 2024-04-26T11:46:41.451 INFO:tasks.workunit.client.0.smithi029.stdout:2/963: write d12/d6c/d73/da5/db1/fd0 [884280,31762] 0 2024-04-26T11:46:41.451 INFO:tasks.workunit.client.0.smithi029.stdout:8/807: write dc/de/f97 [3112962,40325] 0 2024-04-26T11:46:41.451 INFO:tasks.workunit.client.0.smithi029.stdout:9/818: chown d4/d49/d58/d67 257475147 1 2024-04-26T11:46:41.451 INFO:tasks.workunit.client.0.smithi029.stdout:9/819: dread - d4/d5/de9/ff7 zero size 2024-04-26T11:46:41.452 INFO:tasks.workunit.client.0.smithi029.stdout:2/964: symlink d12/d6c/d70/dff/l153 0 2024-04-26T11:46:41.452 INFO:tasks.workunit.client.0.smithi029.stdout:8/808: chown dc/l98 318824 1 2024-04-26T11:46:41.454 INFO:tasks.workunit.client.0.smithi029.stdout:2/965: write d12/d24/d29/d50/d6a/f9d [469050,96943] 0 2024-04-26T11:46:41.454 INFO:tasks.workunit.client.0.smithi029.stdout:8/809: creat dc/de/d26/d57/d86/dc0/df0/f124 x:0 0 0 2024-04-26T11:46:41.455 INFO:tasks.workunit.client.0.smithi029.stdout:8/810: creat dc/de/d103/d7c/dfc/f125 x:0 0 0 2024-04-26T11:46:41.456 INFO:tasks.workunit.client.0.smithi029.stdout:9/820: dread d4/d5/d7/f85 [0,4194304] 0 2024-04-26T11:46:41.458 INFO:tasks.workunit.client.0.smithi029.stdout:9/821: creat d4/d49/d58/d67/dab/dc6/f100 x:0 0 0 2024-04-26T11:46:41.460 INFO:tasks.workunit.client.0.smithi029.stdout:2/966: dwrite d12/d24/d29/f48 [0,4194304] 0 2024-04-26T11:46:41.461 INFO:tasks.workunit.client.0.smithi029.stdout:2/967: dread - d12/d24/f131 zero size 2024-04-26T11:46:41.465 INFO:tasks.workunit.client.0.smithi029.stdout:8/811: dwrite dc/de/d2e/d23/d27/f3e [0,4194304] 0 2024-04-26T11:46:41.469 INFO:tasks.workunit.client.0.smithi029.stdout:8/812: readlink dc/de/d26/d6b/dde/lee 0 2024-04-26T11:46:41.471 INFO:tasks.workunit.client.0.smithi029.stdout:2/968: dwrite d12/d6c/d73/fdf [0,4194304] 0 2024-04-26T11:46:41.471 INFO:tasks.workunit.client.0.smithi029.stdout:7/914: dwrite d11/d15/f57 [4194304,4194304] 0 2024-04-26T11:46:41.472 INFO:tasks.workunit.client.0.smithi029.stdout:3/775: dwrite d0/d1/d2f/dd8/fff [0,4194304] 0 2024-04-26T11:46:41.473 INFO:tasks.workunit.client.0.smithi029.stdout:8/813: creat dc/de/d2e/d23/d8d/de1/f126 x:0 0 0 2024-04-26T11:46:41.473 INFO:tasks.workunit.client.0.smithi029.stdout:2/969: chown d12/d6c/d73/d4f/d65/d99/fd5 38402 1 2024-04-26T11:46:41.474 INFO:tasks.workunit.client.0.smithi029.stdout:8/814: mknod dc/de/d103/d6a/d78/dc3/c127 1 2024-04-26T11:46:41.475 INFO:tasks.workunit.client.0.smithi029.stdout:3/776: creat d0/d1/f108 x:0 0 0 2024-04-26T11:46:41.475 INFO:tasks.workunit.client.0.smithi029.stdout:2/970: mkdir d12/d6c/d73/d4f/d65/d154 0 2024-04-26T11:46:41.475 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:41.473+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:41.476 INFO:tasks.workunit.client.0.smithi029.stdout:8/815: creat dc/de/d2e/d23/f128 x:0 0 0 2024-04-26T11:46:41.477 INFO:tasks.workunit.client.0.smithi029.stdout:2/971: rename d12/d6c/d73/f67 to d12/d24/d29/d57/f155 0 2024-04-26T11:46:41.478 INFO:tasks.workunit.client.0.smithi029.stdout:5/834: sync 2024-04-26T11:46:41.478 INFO:tasks.workunit.client.0.smithi029.stdout:6/894: sync 2024-04-26T11:46:41.478 INFO:tasks.workunit.client.0.smithi029.stdout:0/810: sync 2024-04-26T11:46:41.479 INFO:tasks.workunit.client.0.smithi029.stdout:1/966: sync 2024-04-26T11:46:41.480 INFO:tasks.workunit.client.0.smithi029.stdout:6/895: fsync d7/d25/d4b/d4d/d65/db5/f10b 0 2024-04-26T11:46:41.481 INFO:tasks.workunit.client.0.smithi029.stdout:0/811: write d9/d16/d33/f5c [2959053,29235] 0 2024-04-26T11:46:41.482 INFO:tasks.workunit.client.0.smithi029.stdout:6/896: mknod d7/d97/dc2/c135 1 2024-04-26T11:46:41.482 INFO:tasks.workunit.client.0.smithi029.stdout:5/835: link db/da6/lb2 db/d40/d4d/d4f/l10b 0 2024-04-26T11:46:41.483 INFO:tasks.workunit.client.0.smithi029.stdout:0/812: creat d9/d16/d8d/f122 x:0 0 0 2024-04-26T11:46:41.484 INFO:tasks.workunit.client.0.smithi029.stdout:7/915: dwrite d11/dd3/de4/daa/fc0 [0,4194304] 0 2024-04-26T11:46:41.484 INFO:tasks.workunit.client.0.smithi029.stdout:5/836: write db/d40/d77/fd4 [248107,127894] 0 2024-04-26T11:46:41.486 INFO:tasks.workunit.client.0.smithi029.stdout:7/916: readlink d11/d18/d1a/d33/l51 0 2024-04-26T11:46:41.486 INFO:tasks.workunit.client.0.smithi029.stdout:8/816: dwrite dc/de/d2e/d23/d27/d6f/f8a [0,4194304] 0 2024-04-26T11:46:41.486 INFO:tasks.workunit.client.0.smithi029.stdout:5/837: stat db/d40/d4d/d4f/d73/d93/fe9 0 2024-04-26T11:46:41.487 INFO:tasks.workunit.client.0.smithi029.stdout:6/897: link d7/d46/d69/f77 d7/d46/d69/da2/d12c/f136 0 2024-04-26T11:46:41.487 INFO:tasks.workunit.client.0.smithi029.stdout:6/898: chown d7/d97/fa5 20 1 2024-04-26T11:46:41.488 INFO:tasks.workunit.client.0.smithi029.stdout:5/838: rename db/d40/l4e to db/d12/d6b/l10c 0 2024-04-26T11:46:41.488 INFO:tasks.workunit.client.0.smithi029.stdout:8/817: creat dc/de/d2e/d23/d27/d6f/d9b/da2/f129 x:0 0 0 2024-04-26T11:46:41.489 INFO:tasks.workunit.client.0.smithi029.stdout:0/813: truncate d9/d16/d25/d2a/d46/fbb 1227432 0 2024-04-26T11:46:41.490 INFO:tasks.workunit.client.0.smithi029.stdout:5/839: unlink db/d12/ff0 0 2024-04-26T11:46:41.490 INFO:tasks.workunit.client.0.smithi029.stdout:6/899: symlink d7/d46/d69/db4/l137 0 2024-04-26T11:46:41.492 INFO:tasks.workunit.client.0.smithi029.stdout:6/900: rmdir d7/d97/dc2/d128 0 2024-04-26T11:46:41.493 INFO:tasks.workunit.client.0.smithi029.stdout:1/967: write d7/db/f1d [929030,25292] 0 2024-04-26T11:46:41.495 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:41.495 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:41.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:41.495 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:41.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.495 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.7718508870000003, 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:41.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:41.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:41.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:46:41.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:46:41.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:46:41.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:46:41.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:46:41.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3510821809999998, 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.503 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:46:41.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:41.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:46:41.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:46:41.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:46:41.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:46:41.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:46:41.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:46:41.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:46:41.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:46:41.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.509 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.509 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:41.509 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3510537029999998, 2024-04-26T11:46:41.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:46:41.509 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.509 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.509 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:46:41.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:46:41.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:46:41.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:46:41.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:46:41.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:46:41.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:46:41.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:46:41.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:46:41.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:46:41.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:46:41.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:46:41.514 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.514 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3510284859999997, 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:41.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:41.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:46:41.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:46:41.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:46:41.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:46:41.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:46:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:46:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:46:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:46:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:46:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:46:41.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:46:41.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:46:41.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:46:41.520 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.520 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.520 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.521 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.521 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:41.521 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3509924, 2024-04-26T11:46:41.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:46:41.521 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.521 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.521 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:41.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:41.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:46:41.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:46:41.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:46:41.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:46:41.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:46:41.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:46:41.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:46:41.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:46:41.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:46:41.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:46:41.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:46:41.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:46:41.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:46:41.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:46:41.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:46:41.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:46:41.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:46:41.526 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.527 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.527 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.527 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:41.527 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3509655780000003, 2024-04-26T11:46:41.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:46:41.527 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.527 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.527 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:41.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:41.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:46:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:46:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:46:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:46:41.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:46:41.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:46:41.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:46:41.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:46:41.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:46:41.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:46:41.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:46:41.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:46:41.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:46:41.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:46:41.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:46:41.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:46:41.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:46:41.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.533 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.533 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.533 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:41.534 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3483663400000001, 2024-04-26T11:46:41.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:46:41.534 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.534 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.534 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:41.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:41.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:46:41.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:46:41.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:46:41.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:46:41.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:46:41.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:46:41.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:46:41.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:46:41.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.540 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.540 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:41.540 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.347889082, 2024-04-26T11:46:41.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:46:41.540 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.540 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.540 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:41.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:41.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:46:41.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:46:41.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:46:41.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:46:41.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:46:41.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:46:41.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:46:41.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:46:41.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:46:41.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:46:41.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:46:41.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:46:41.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:46:41.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3438218800000001, 2024-04-26T11:46:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:46:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:46:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:46:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:46:41.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:46:41.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:46:41.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:46:41.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:46:41.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:46:41.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:46:41.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:46:41.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:46:41.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:46:41.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:46:41.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:46:41.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:46:41.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:46:41.552 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.552 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.552 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.552 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.553 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:41.553 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3436577600000001, 2024-04-26T11:46:41.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:46:41.553 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.553 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.553 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:41.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:41.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:41.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:46:41.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:46:41.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:46:41.558 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.558 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.558 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.558 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.558 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:41.558 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3407251000000002, 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:41.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:46:41.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:46:41.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:46:41.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:46:41.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:46:41.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:46:41.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3385425089999998, 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.564 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:41.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:46:41.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:46:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:46:41.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:46:41.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:46:41.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:46:41.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:46:41.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:46:41.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:46:41.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:46:41.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:46:41.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:46:41.571 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.571 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.571 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.571 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.571 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:41.571 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3360314740000003, 2024-04-26T11:46:41.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:46:41.571 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.571 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.572 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:41.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:41.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:46:41.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3336368329999999, 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:41.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:46:41.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:46:41.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:46:41.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:46:41.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:46:41.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:46:41.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:46:41.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:46:41.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:46:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:46:41.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:46:41.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.582 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.582 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.582 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3334517740000003, 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:46:41.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:46:41.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:41.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:46:41.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:46:41.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:46:41.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:46:41.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:46:41.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:46:41.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:46:41.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3334118879999997, 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.588 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:41.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:46:41.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:46:41.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:46:41.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:46:41.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:46:41.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:46:41.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:46:41.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:46:41.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:46:41.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:46:41.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:46:41.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:46:41.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:46:41.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:46:41.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:46:41.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:46:41.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.596 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.597 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.597 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.597 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:41.597 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3316726440000002, 2024-04-26T11:46:41.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:46:41.597 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.597 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.597 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:46:41.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:46:41.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:46:41.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:46:41.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:46:41.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:46:41.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:46:41.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:46:41.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:46:41.603 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.603 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.603 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.603 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.603 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:41.603 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3309709349999999, 2024-04-26T11:46:41.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:46:41.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:46:41.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:46:41.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:46:41.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:46:41.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:46:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:46:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:46:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:46:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3270915040000002, 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:41.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:41.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:46:41.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:46:41.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:46:41.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:46:41.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:46:41.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:46:41.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:46:41.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:46:41.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:46:41.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:46:41.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:46:41.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:46:41.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:46:41.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:46:41.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:46:41.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:46:41.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:46:41.614 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.614 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.614 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3270626649999997, 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:41.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:41.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:41.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:41.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:41.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:41.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:46:41.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:41.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:46:41.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:46:41.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:41.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:46:41.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:46:41.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:46:41.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:46:41.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:41.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:46:41.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:46:41.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:41.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:46:41.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:46:41.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:41.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:46:41.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:46:41.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:41.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:46:41.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:46:41.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:41.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:41.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:41.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:46:41.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:46:41.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.621 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.621 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.621 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:41.621 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:41.621 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:41.621 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:41.623 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:41.616+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:41.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:41.649 INFO:tasks.workunit.client.0.smithi029.stdout:8/818: chown dc/de/d2e/d23/d27/d6f/d9b/f80 5304 1 2024-04-26T11:46:41.650 INFO:tasks.workunit.client.0.smithi029.stdout:7/917: dwrite f8 [0,4194304] 0 2024-04-26T11:46:41.650 INFO:tasks.workunit.client.0.smithi029.stdout:6/901: getdents d7/d20/d27/dc0/dd0 0 2024-04-26T11:46:41.650 INFO:tasks.workunit.client.0.smithi029.stdout:1/968: chown d7/db/d10/d1e/ff9 69323437 1 2024-04-26T11:46:41.650 INFO:tasks.workunit.client.0.smithi029.stdout:7/918: creat d11/dd3/de4/f130 x:0 0 0 2024-04-26T11:46:41.650 INFO:tasks.workunit.client.0.smithi029.stdout:4/839: dread d3/d1d/d11/f79 [0,4194304] 0 2024-04-26T11:46:41.650 INFO:tasks.workunit.client.0.smithi029.stdout:8/819: write dc/de/d103/d6a/f4c [4300238,107884] 0 2024-04-26T11:46:41.650 INFO:tasks.workunit.client.0.smithi029.stdout:1/969: readlink d7/db/d10/d1e/l103 0 2024-04-26T11:46:41.650 INFO:tasks.workunit.client.0.smithi029.stdout:2/972: dwrite d12/d24/d29/d50/f59 [0,4194304] 0 2024-04-26T11:46:41.650 INFO:tasks.workunit.client.0.smithi029.stdout:7/919: mkdir d11/d18/d1a/d26/d131 0 2024-04-26T11:46:41.650 INFO:tasks.workunit.client.0.smithi029.stdout:5/840: dwrite db/d40/d77/d98/fd5 [0,4194304] 0 2024-04-26T11:46:41.651 INFO:tasks.workunit.client.0.smithi029.stdout:5/841: write db/d12/f5c [106369,6028] 0 2024-04-26T11:46:41.651 INFO:tasks.workunit.client.0.smithi029.stdout:7/920: truncate d11/d18/d35/dfd/f12c 957514 0 2024-04-26T11:46:41.651 INFO:tasks.workunit.client.0.smithi029.stdout:2/973: dread d12/d24/fe9 [0,4194304] 0 2024-04-26T11:46:41.651 INFO:tasks.workunit.client.0.smithi029.stdout:7/921: link d11/dd3/d119/f11a d11/d18/d1a/d26/f132 0 2024-04-26T11:46:41.651 INFO:tasks.workunit.client.0.smithi029.stdout:2/974: rename d12/d24/d29/f31 to d12/d24/d29/db2/f156 0 2024-04-26T11:46:41.651 INFO:tasks.workunit.client.0.smithi029.stdout:5/842: symlink db/de3/l10d 0 2024-04-26T11:46:41.651 INFO:tasks.workunit.client.0.smithi029.stdout:2/975: mknod d12/d24/d29/d50/d6a/dd1/c157 1 2024-04-26T11:46:41.651 INFO:tasks.workunit.client.0.smithi029.stdout:7/922: unlink d11/d15/d104/l10b 0 2024-04-26T11:46:41.651 INFO:tasks.workunit.client.0.smithi029.stdout:2/976: stat d12/d24/fcc 0 2024-04-26T11:46:41.651 INFO:tasks.workunit.client.0.smithi029.stdout:9/822: dread d4/f1d [0,4194304] 0 2024-04-26T11:46:41.652 INFO:tasks.workunit.client.0.smithi029.stdout:2/977: fdatasync d12/d24/d29/d50/d55/f133 0 2024-04-26T11:46:41.652 INFO:tasks.workunit.client.0.smithi029.stdout:8/820: dwrite dc/de/d2e/d23/d27/dc5/ff4 [0,4194304] 0 2024-04-26T11:46:41.652 INFO:tasks.workunit.client.0.smithi029.stdout:9/823: fdatasync d4/d5/d16/f19 0 2024-04-26T11:46:41.652 INFO:tasks.workunit.client.0.smithi029.stdout:2/978: getdents d12/d24/d29/dda 0 2024-04-26T11:46:41.652 INFO:tasks.workunit.client.0.smithi029.stdout:7/923: read d11/d18/f22 [838757,29788] 0 2024-04-26T11:46:41.652 INFO:tasks.workunit.client.0.smithi029.stdout:8/821: chown dc/de/d103/d6a/daa/fef 24 1 2024-04-26T11:46:41.652 INFO:tasks.workunit.client.0.smithi029.stdout:7/924: creat d11/dd3/de4/daa/f133 x:0 0 0 2024-04-26T11:46:41.652 INFO:tasks.workunit.client.0.smithi029.stdout:7/925: mknod d11/d18/d35/d103/c134 1 2024-04-26T11:46:41.652 INFO:tasks.workunit.client.0.smithi029.stdout:8/822: write dc/de/d26/d57/d86/dc0/fc1 [11509193,127857] 0 2024-04-26T11:46:41.652 INFO:tasks.workunit.client.0.smithi029.stdout:7/926: readlink d11/d18/d35/dfd/l101 0 2024-04-26T11:46:41.653 INFO:tasks.workunit.client.0.smithi029.stdout:8/823: write dc/d3b/f109 [32838,84820] 0 2024-04-26T11:46:41.653 INFO:tasks.workunit.client.0.smithi029.stdout:7/927: rmdir d11/dd3/de4/d84/d128 39 2024-04-26T11:46:41.653 INFO:tasks.workunit.client.0.smithi029.stdout:7/928: unlink d11/d18/d58/fd2 0 2024-04-26T11:46:41.653 INFO:tasks.workunit.client.0.smithi029.stdout:1/970: dwrite d7/db/dcc/fe1 [0,4194304] 0 2024-04-26T11:46:41.653 INFO:tasks.workunit.client.0.smithi029.stdout:8/824: rename dc/de/fb3 to dc/de/d26/d57/d86/d90/f12a 0 2024-04-26T11:46:41.653 INFO:tasks.workunit.client.0.smithi029.stdout:1/971: read - d7/db/d8d/faf zero size 2024-04-26T11:46:41.653 INFO:tasks.workunit.client.0.smithi029.stdout:7/929: chown d11/dd3/d119/f11a 201 1 2024-04-26T11:46:41.653 INFO:tasks.workunit.client.0.smithi029.stdout:7/930: mknod d11/d115/c135 1 2024-04-26T11:46:41.653 INFO:tasks.workunit.client.0.smithi029.stdout:1/972: write d7/db/fa3 [885460,60069] 0 2024-04-26T11:46:41.653 INFO:tasks.workunit.client.0.smithi029.stdout:7/931: chown d11/d115/fcf 559217362 1 2024-04-26T11:46:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:8/825: stat dc/de/d2e/d23/d27/d6f/d9b/da2/fbb 0 2024-04-26T11:46:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:1/973: mknod d7/d25/d6d/d8c/c157 1 2024-04-26T11:46:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:7/932: mknod d11/d18/d1a/c136 1 2024-04-26T11:46:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:7/933: write d11/fb0 [1178569,96914] 0 2024-04-26T11:46:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:1/974: fsync d7/d25/d68/d4b/d66/fff 0 2024-04-26T11:46:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:1/975: chown d7/d25/dae/lba 5 1 2024-04-26T11:46:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:7/934: symlink d11/d15/d104/d11e/l137 0 2024-04-26T11:46:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:1/976: rename d7/d25/d68/d4b/l5f to d7/d25/dae/l158 0 2024-04-26T11:46:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:7/935: dread - d11/d18/d58/d8d/f105 zero size 2024-04-26T11:46:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:9/824: dwrite d4/d5/d16/ffd [4194304,4194304] 0 2024-04-26T11:46:41.655 INFO:tasks.workunit.client.0.smithi029.stdout:1/977: fsync d7/db/d10/d1e/d53/f6c 0 2024-04-26T11:46:41.655 INFO:tasks.workunit.client.0.smithi029.stdout:7/936: dread - d11/d18/db8/f117 zero size 2024-04-26T11:46:41.655 INFO:tasks.workunit.client.0.smithi029.stdout:7/937: mknod d11/d115/d97/c138 1 2024-04-26T11:46:41.655 INFO:tasks.workunit.client.0.smithi029.stdout:3/777: dread d0/d1/f16 [0,4194304] 0 2024-04-26T11:46:41.655 INFO:tasks.workunit.client.0.smithi029.stdout:7/938: fdatasync d11/d18/d1a/d33/f74 0 2024-04-26T11:46:41.655 INFO:tasks.workunit.client.0.smithi029.stdout:1/978: creat d7/db/d10/d1e/db2/f159 x:0 0 0 2024-04-26T11:46:41.655 INFO:tasks.workunit.client.0.smithi029.stdout:7/939: creat d11/dd3/de4/f139 x:0 0 0 2024-04-26T11:46:41.655 INFO:tasks.workunit.client.0.smithi029.stdout:1/979: chown d7/db/d10/d20/l8b 16255963 1 2024-04-26T11:46:41.655 INFO:tasks.workunit.client.0.smithi029.stdout:7/940: chown d11/d115/d97/d9b/fc7 605 1 2024-04-26T11:46:41.655 INFO:tasks.workunit.client.0.smithi029.stdout:8/826: getdents dc/de/d26/d57/d86/d90 0 2024-04-26T11:46:41.656 INFO:tasks.workunit.client.0.smithi029.stdout:1/980: creat d7/db/f15a x:0 0 0 2024-04-26T11:46:41.656 INFO:tasks.workunit.client.0.smithi029.stdout:8/827: symlink dc/de/d2e/d23/d27/d6f/d9b/d43/dad/l12b 0 2024-04-26T11:46:41.656 INFO:tasks.workunit.client.0.smithi029.stdout:1/981: unlink d7/db/d10/d1e/db2/dee/lc6 0 2024-04-26T11:46:41.656 INFO:tasks.workunit.client.0.smithi029.stdout:6/902: dread d7/d20/d27/fab [0,4194304] 0 2024-04-26T11:46:41.656 INFO:tasks.workunit.client.0.smithi029.stdout:8/828: mkdir dc/de/d2e/d23/df9/d101/d12c 0 2024-04-26T11:46:41.656 INFO:tasks.workunit.client.0.smithi029.stdout:1/982: rename d7/db/d8d/f96 to d7/d25/d6d/d8c/f15b 0 2024-04-26T11:46:41.656 INFO:tasks.workunit.client.0.smithi029.stdout:9/825: dwrite d4/d5/d7/d74/fd5 [0,4194304] 0 2024-04-26T11:46:41.656 INFO:tasks.workunit.client.0.smithi029.stdout:7/941: dwrite d11/d18/d1a/f83 [0,4194304] 0 2024-04-26T11:46:41.656 INFO:tasks.workunit.client.0.smithi029.stdout:8/829: truncate dc/de/d2e/d23/d27/dc5/fd9 855791 0 2024-04-26T11:46:41.656 INFO:tasks.workunit.client.0.smithi029.stdout:9/826: dread d4/d5/d16/f73 [0,4194304] 0 2024-04-26T11:46:41.657 INFO:tasks.workunit.client.0.smithi029.stdout:2/979: dread d12/f1b [0,4194304] 0 2024-04-26T11:46:41.657 INFO:tasks.workunit.client.0.smithi029.stdout:4/840: dread d3/f31 [0,4194304] 0 2024-04-26T11:46:41.657 INFO:tasks.workunit.client.0.smithi029.stdout:7/942: mkdir d11/d18/d35/d13a 0 2024-04-26T11:46:41.657 INFO:tasks.workunit.client.0.smithi029.stdout:9/827: creat d4/f101 x:0 0 0 2024-04-26T11:46:41.657 INFO:tasks.workunit.client.0.smithi029.stdout:4/841: mknod d3/d1d/d11/c10e 1 2024-04-26T11:46:41.657 INFO:tasks.workunit.client.0.smithi029.stdout:7/943: dread - d11/d18/db8/f117 zero size 2024-04-26T11:46:41.657 INFO:tasks.workunit.client.0.smithi029.stdout:4/842: chown d3/d50/d7a 2 1 2024-04-26T11:46:41.657 INFO:tasks.workunit.client.0.smithi029.stdout:9/828: mkdir d4/d5/d78/d102 0 2024-04-26T11:46:41.657 INFO:tasks.workunit.client.0.smithi029.stdout:2/980: unlink d12/d24/d29/d57/f89 0 2024-04-26T11:46:41.657 INFO:tasks.workunit.client.0.smithi029.stdout:0/814: sync 2024-04-26T11:46:41.657 INFO:tasks.workunit.client.0.smithi029.stdout:3/778: sync 2024-04-26T11:46:41.658 INFO:tasks.workunit.client.0.smithi029.stdout:9/829: fsync d4/d5/d7/f94 0 2024-04-26T11:46:41.658 INFO:tasks.workunit.client.0.smithi029.stdout:3/779: mkdir d0/d1/d2b/da7/d109 0 2024-04-26T11:46:41.658 INFO:tasks.workunit.client.0.smithi029.stdout:0/815: creat d9/d16/d25/db4/f123 x:0 0 0 2024-04-26T11:46:41.658 INFO:tasks.workunit.client.0.smithi029.stdout:6/903: dwrite d7/d25/d4b/d4d/d65/f89 [0,4194304] 0 2024-04-26T11:46:41.658 INFO:tasks.workunit.client.0.smithi029.stdout:9/830: mkdir d4/dac/d103 0 2024-04-26T11:46:41.658 INFO:tasks.workunit.client.0.smithi029.stdout:5/843: dread db/d40/d4d/d4f/f8f [0,4194304] 0 2024-04-26T11:46:41.658 INFO:tasks.workunit.client.0.smithi029.stdout:8/830: dwrite dc/de/d2e/f6e [0,4194304] 0 2024-04-26T11:46:41.658 INFO:tasks.workunit.client.0.smithi029.stdout:5/844: chown db/d40/d70/de8/f58 253819 1 2024-04-26T11:46:41.658 INFO:tasks.workunit.client.0.smithi029.stdout:9/831: rename d4/d5/d7/f59 to d4/d5/d16/d80/dc9/f104 0 2024-04-26T11:46:41.659 INFO:tasks.workunit.client.0.smithi029.stdout:4/843: link d3/d1d/d11/d16/d1f/d3d/d46/f5f d3/d1d/db/d13/f10f 0 2024-04-26T11:46:41.659 INFO:tasks.workunit.client.0.smithi029.stdout:6/904: creat d7/d46/d69/da2/d4c/d98/d45/d83/f138 x:0 0 0 2024-04-26T11:46:41.659 INFO:tasks.workunit.client.0.smithi029.stdout:8/831: rename dc/de/d103/db7 to dc/de/d103/d9e/d12d 0 2024-04-26T11:46:41.659 INFO:tasks.workunit.client.0.smithi029.stdout:6/905: mknod d7/d25/d4b/c139 1 2024-04-26T11:46:41.659 INFO:tasks.workunit.client.0.smithi029.stdout:9/832: truncate d4/d5/d16/d80/dc2/fb2 963210 0 2024-04-26T11:46:41.659 INFO:tasks.workunit.client.0.smithi029.stdout:0/816: getdents d9/d16/d25/db4 0 2024-04-26T11:46:41.659 INFO:tasks.workunit.client.0.smithi029.stdout:1/983: dread d7/f77 [0,4194304] 0 2024-04-26T11:46:41.659 INFO:tasks.workunit.client.0.smithi029.stdout:3/780: dwrite d0/d1/d5c/d103/d54/fbf [0,4194304] 0 2024-04-26T11:46:41.659 INFO:tasks.workunit.client.0.smithi029.stdout:5/845: dread db/d12/d72/d92/ffa [0,4194304] 0 2024-04-26T11:46:41.659 INFO:tasks.workunit.client.0.smithi029.stdout:6/906: creat d7/d20/d27/d91/f13a x:0 0 0 2024-04-26T11:46:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:7/944: dwrite d11/d18/d35/d7c/fa5 [0,4194304] 0 2024-04-26T11:46:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:9/833: truncate d4/d5/d16/d80/fdf 97268 0 2024-04-26T11:46:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:6/907: mknod d7/d25/d4b/d4d/d65/db5/c13b 1 2024-04-26T11:46:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:8/832: getdents dc/de/d2e/d23/d27 0 2024-04-26T11:46:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:1/984: sync 2024-04-26T11:46:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:8/833: fdatasync dc/d9f/db2/fc6 0 2024-04-26T11:46:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:9/834: readlink d4/d49/l6b 0 2024-04-26T11:46:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:1/985: mknod d7/d25/d85/dfd/c15c 1 2024-04-26T11:46:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:5/846: symlink db/d40/dd6/d101/l10e 0 2024-04-26T11:46:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:6/908: write d7/d20/d27/f2b [1454937,114391] 0 2024-04-26T11:46:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:9/835: symlink d4/d5/d7a/da1/df8/l105 0 2024-04-26T11:46:41.661 INFO:tasks.workunit.client.0.smithi029.stdout:7/945: getdents d11/d115/da6 0 2024-04-26T11:46:41.661 INFO:tasks.workunit.client.0.smithi029.stdout:8/834: creat dc/de/d26/d57/d86/dc0/df0/f12e x:0 0 0 2024-04-26T11:46:41.661 INFO:tasks.workunit.client.0.smithi029.stdout:1/986: mkdir d7/d25/dab/df1/d15d 0 2024-04-26T11:46:41.661 INFO:tasks.workunit.client.0.smithi029.stdout:1/987: fdatasync d7/db/d10/f89 0 2024-04-26T11:46:41.661 INFO:tasks.workunit.client.0.smithi029.stdout:5/847: symlink db/d40/d4d/d4f/d73/l10f 0 2024-04-26T11:46:41.661 INFO:tasks.workunit.client.0.smithi029.stdout:6/909: dread - d7/d46/d69/da2/d4c/d98/d45/d83/f138 zero size 2024-04-26T11:46:41.661 INFO:tasks.workunit.client.0.smithi029.stdout:9/836: mkdir d4/d5/d16/d39/dc5/d106 0 2024-04-26T11:46:41.661 INFO:tasks.workunit.client.0.smithi029.stdout:0/817: dwrite d9/d16/d52/f7f [0,4194304] 0 2024-04-26T11:46:41.661 INFO:tasks.workunit.client.0.smithi029.stdout:7/946: read d11/dd3/de4/daa/fc0 [1525883,61255] 0 2024-04-26T11:46:41.661 INFO:tasks.workunit.client.0.smithi029.stdout:6/910: mknod d7/d20/d27/da1/c13c 1 2024-04-26T11:46:41.661 INFO:tasks.workunit.client.0.smithi029.stdout:0/818: chown d9/d16/d25/d2a/lba 10 1 2024-04-26T11:46:41.662 INFO:tasks.workunit.client.0.smithi029.stdout:1/988: write d7/d25/d85/dfd/f125 [850292,6875] 0 2024-04-26T11:46:41.662 INFO:tasks.workunit.client.0.smithi029.stdout:7/947: stat d11/d18/d1a/d92 0 2024-04-26T11:46:41.662 INFO:tasks.workunit.client.0.smithi029.stdout:6/911: write d7/fd3 [120440,98776] 0 2024-04-26T11:46:41.662 INFO:tasks.workunit.client.0.smithi029.stdout:1/989: dread - d7/db/dcc/f146 zero size 2024-04-26T11:46:41.662 INFO:tasks.workunit.client.0.smithi029.stdout:6/912: chown d7/d20/d27/d91/dee 197626 1 2024-04-26T11:46:41.662 INFO:tasks.workunit.client.0.smithi029.stdout:1/990: mknod d7/d25/d6d/d8c/c15e 1 2024-04-26T11:46:41.662 INFO:tasks.workunit.client.0.smithi029.stdout:9/837: link d4/d5/d7/d74/da8/ffe d4/d5/d16/d80/dc2/f107 0 2024-04-26T11:46:41.662 INFO:tasks.workunit.client.0.smithi029.stdout:6/913: write d7/d20/d27/d91/f13a [57190,91125] 0 2024-04-26T11:46:41.663 INFO:tasks.workunit.client.0.smithi029.stdout:4/844: truncate d3/d1d/db/d13/d23/fd3 1948404 0 2024-04-26T11:46:41.663 INFO:tasks.workunit.client.0.smithi029.stdout:5/848: link db/d40/d4d/d4f/d73/l10f db/d12/d72/d92/l110 0 2024-04-26T11:46:41.663 INFO:tasks.workunit.client.0.smithi029.stdout:4/845: symlink d3/d1d/db/d13/d73/d7e/l110 0 2024-04-26T11:46:41.663 INFO:tasks.workunit.client.0.smithi029.stdout:6/914: unlink d7/d46/d69/db4/dfa/f10f 0 2024-04-26T11:46:41.663 INFO:tasks.workunit.client.0.smithi029.stdout:5/849: creat db/d12/d72/d39/d3b/d86/f111 x:0 0 0 2024-04-26T11:46:41.663 INFO:tasks.workunit.client.0.smithi029.stdout:4/846: mknod d3/d50/d101/c111 1 2024-04-26T11:46:41.663 INFO:tasks.workunit.client.0.smithi029.stdout:5/850: mknod db/d12/d1a/c112 1 2024-04-26T11:46:41.663 INFO:tasks.workunit.client.0.smithi029.stdout:8/835: dwrite dc/de/d2e/d23/d27/d6f/d9b/fb5 [0,4194304] 0 2024-04-26T11:46:41.663 INFO:tasks.workunit.client.0.smithi029.stdout:6/915: write d7/f11 [7016708,51995] 0 2024-04-26T11:46:41.664 INFO:tasks.workunit.client.0.smithi029.stdout:5/851: mkdir db/d40/d4d/d79/d113 0 2024-04-26T11:46:41.664 INFO:tasks.workunit.client.0.smithi029.stdout:3/781: fdatasync d0/d1/d2b/f85 0 2024-04-26T11:46:41.664 INFO:tasks.workunit.client.0.smithi029.stdout:4/847: write d3/d1d/d11/d16/d1f/d3d/f62 [4208380,21950] 0 2024-04-26T11:46:41.664 INFO:tasks.workunit.client.0.smithi029.stdout:3/782: fsync d0/d1/d5c/d103/d1a/f1d 0 2024-04-26T11:46:41.664 INFO:tasks.workunit.client.0.smithi029.stdout:4/848: stat d3/d1d/db/f41 0 2024-04-26T11:46:41.664 INFO:tasks.workunit.client.0.smithi029.stdout:2/981: dread d12/d24/d29/db2/f156 [0,4194304] 0 2024-04-26T11:46:41.664 INFO:tasks.workunit.client.0.smithi029.stdout:6/916: write d7/d46/d69/da2/d4c/d98/d45/fe2 [113335,123979] 0 2024-04-26T11:46:41.664 INFO:tasks.workunit.client.0.smithi029.stdout:0/819: write d9/d16/f3d [1572149,48321] 0 2024-04-26T11:46:41.664 INFO:tasks.workunit.client.0.smithi029.stdout:5/852: dread - db/da6/fae zero size 2024-04-26T11:46:41.665 INFO:tasks.workunit.client.0.smithi029.stdout:6/917: rmdir d7/d46/d69/db4 39 2024-04-26T11:46:41.665 INFO:tasks.workunit.client.0.smithi029.stdout:4/849: read d3/d1d/d11/d16/d1f/d3d/f60 [2623381,6030] 0 2024-04-26T11:46:41.665 INFO:tasks.workunit.client.0.smithi029.stdout:5/853: mkdir db/da6/d114 0 2024-04-26T11:46:41.665 INFO:tasks.workunit.client.0.smithi029.stdout:6/918: fsync d7/d20/f9b 0 2024-04-26T11:46:41.665 INFO:tasks.workunit.client.0.smithi029.stdout:2/982: rename d12/d24/d29/d50/f7d to d12/d24/d2f/d76/d138/f158 0 2024-04-26T11:46:41.665 INFO:tasks.workunit.client.0.smithi029.stdout:5/854: dread - db/d89/fd0 zero size 2024-04-26T11:46:41.665 INFO:tasks.workunit.client.0.smithi029.stdout:4/850: read d3/d1d/f3f [2464002,17296] 0 2024-04-26T11:46:41.665 INFO:tasks.workunit.client.0.smithi029.stdout:0/820: truncate d9/d16/d25/d2a/f39 2794660 0 2024-04-26T11:46:41.665 INFO:tasks.workunit.client.0.smithi029.stdout:6/919: mknod d7/d20/d27/dc0/c13d 1 2024-04-26T11:46:41.666 INFO:tasks.workunit.client.0.smithi029.stdout:4/851: unlink d3/f47 0 2024-04-26T11:46:41.666 INFO:tasks.workunit.client.0.smithi029.stdout:8/836: dwrite dc/de/d26/f99 [0,4194304] 0 2024-04-26T11:46:41.666 INFO:tasks.workunit.client.0.smithi029.stdout:2/983: write d12/d24/d2f/fd2 [1740025,110310] 0 2024-04-26T11:46:41.666 INFO:tasks.workunit.client.0.smithi029.stdout:7/948: dwrite d11/d18/d2d/f77 [0,4194304] 0 2024-04-26T11:46:41.666 INFO:tasks.workunit.client.0.smithi029.stdout:4/852: dread - d3/d1d/d11/d16/d1f/fc1 zero size 2024-04-26T11:46:41.666 INFO:tasks.workunit.client.0.smithi029.stdout:0/821: rename d9/d16/d25/d2a/d46/ffb to d9/d16/de7/dff/f124 0 2024-04-26T11:46:41.666 INFO:tasks.workunit.client.0.smithi029.stdout:6/920: creat d7/d46/d69/da2/dc8/ded/f13e x:0 0 0 2024-04-26T11:46:41.666 INFO:tasks.workunit.client.0.smithi029.stdout:8/837: creat dc/de/d103/d6a/d78/dc3/f12f x:0 0 0 2024-04-26T11:46:41.666 INFO:tasks.workunit.client.0.smithi029.stdout:7/949: symlink d11/d18/d58/d8d/d108/l13b 0 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:4/853: symlink d3/l112 0 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:6/921: creat d7/d25/d4b/d6d/dd6/df7/f13f x:0 0 0 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:8/838: fsync dc/de/d2e/d23/d8d/de1/f104 0 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/950: chown d11/d18/d35/de0/f123 188 1 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:0/822: link d9/d16/f4d d9/d16/d33/d2f/d68/f125 0 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:4/854: write d3/f78 [1426191,14211] 0 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/951: readlink d11/d18/d1a/d92/le8 0 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:6/922: creat d7/d20/d27/da1/f140 x:0 0 0 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:8/839: chown dc/de/d2e/d23/d8d 9 1 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:6/923: unlink l5 0 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:0/823: creat d9/d16/d33/d2f/d32/d9f/de6/d11f/f126 x:0 0 0 2024-04-26T11:46:41.667 INFO:tasks.workunit.client.0.smithi029.stdout:4/855: dread d3/d1d/ff2 [0,4194304] 0 2024-04-26T11:46:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:8/840: rename dc/d3b/f9a to dc/d9f/db2/f130 0 2024-04-26T11:46:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:0/824: mknod d9/d16/d33/d2f/d32/d9f/dac/c127 1 2024-04-26T11:46:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/924: rename d7/d46/d69/db4/dfa to d7/d25/d4b/d6d/dd6/df7/d127/d141 0 2024-04-26T11:46:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:0/825: creat d9/d16/de7/f128 x:0 0 0 2024-04-26T11:46:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/925: dread - d7/d97/fe7 zero size 2024-04-26T11:46:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:5/855: dread db/d40/d4d/f9d [0,4194304] 0 2024-04-26T11:46:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:3/783: dread d0/d1/d5c/f87 [0,4194304] 0 2024-04-26T11:46:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:3/784: mkdir d0/d1/d5c/d103/d1a/d3b/db5/d10a 0 2024-04-26T11:46:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:1/991: dread d7/f36 [0,4194304] 0 2024-04-26T11:46:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:4/856: dwrite d3/d50/d7a/faf [0,4194304] 0 2024-04-26T11:46:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:3/785: symlink d0/d1/d5c/d103/d1a/d3b/db5/d10a/l10b 0 2024-04-26T11:46:41.669 INFO:tasks.workunit.client.0.smithi029.stdout:6/926: dwrite d7/d20/f63 [0,4194304] 0 2024-04-26T11:46:41.669 INFO:tasks.workunit.client.0.smithi029.stdout:3/786: rmdir d0/d1/d41/de0 39 2024-04-26T11:46:41.669 INFO:tasks.workunit.client.0.smithi029.stdout:6/927: mknod d7/d25/d4b/d6d/dd6/c142 1 2024-04-26T11:46:41.669 INFO:tasks.workunit.client.0.smithi029.stdout:4/857: getdents d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d105 0 2024-04-26T11:46:41.669 INFO:tasks.workunit.client.0.smithi029.stdout:3/787: mknod d0/d1/d41/d4c/c10c 1 2024-04-26T11:46:41.669 INFO:tasks.workunit.client.0.smithi029.stdout:3/788: readlink d0/l2e 0 2024-04-26T11:46:41.669 INFO:tasks.workunit.client.0.smithi029.stdout:0/826: truncate d9/d16/d33/f51 691702 0 2024-04-26T11:46:41.669 INFO:tasks.workunit.client.0.smithi029.stdout:9/838: dread d4/d5/f45 [0,4194304] 0 2024-04-26T11:46:41.669 INFO:tasks.workunit.client.0.smithi029.stdout:0/827: chown d9/d78 201 1 2024-04-26T11:46:41.669 INFO:tasks.workunit.client.0.smithi029.stdout:9/839: sync 2024-04-26T11:46:41.670 INFO:tasks.workunit.client.0.smithi029.stdout:9/840: mknod d4/c108 1 2024-04-26T11:46:41.670 INFO:tasks.workunit.client.0.smithi029.stdout:0/828: fsync d9/d16/d25/db4/fb5 0 2024-04-26T11:46:41.670 INFO:tasks.workunit.client.0.smithi029.stdout:4/858: rename d3/d1d/db/d13/l59 to d3/d1d/d11/l113 0 2024-04-26T11:46:41.670 INFO:tasks.workunit.client.0.smithi029.stdout:9/841: rmdir d4/d5/d7a/dbd 39 2024-04-26T11:46:41.670 INFO:tasks.workunit.client.0.smithi029.stdout:1/992: dwrite d7/db/f38 [4194304,4194304] 0 2024-04-26T11:46:41.670 INFO:tasks.workunit.client.0.smithi029.stdout:0/829: symlink d9/d16/d52/l129 0 2024-04-26T11:46:41.670 INFO:tasks.workunit.client.0.smithi029.stdout:6/928: truncate d7/d46/d69/da2/d4c/d98/d45/d83/f87 149683 0 2024-04-26T11:46:41.670 INFO:tasks.workunit.client.0.smithi029.stdout:9/842: fdatasync d4/f64 0 2024-04-26T11:46:41.670 INFO:tasks.workunit.client.0.smithi029.stdout:9/843: sync 2024-04-26T11:46:41.670 INFO:tasks.workunit.client.0.smithi029.stdout:4/859: write d3/d1d/d11/d16/d1f/d3d/d39/fe1 [415088,98047] 0 2024-04-26T11:46:41.670 INFO:tasks.workunit.client.0.smithi029.stdout:1/993: write d7/db/dcc/f146 [421571,99564] 0 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:6/929: mkdir d7/d25/d4b/d6d/dd6/d143 0 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:6/930: sync 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:3/789: dread d0/d1/d5c/d103/d1a/f1d [0,4194304] 0 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:6/931: rmdir d7/d25/d4b/d6d/dd6/df7/d127 39 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:1/994: creat d7/db/d8d/d11a/f15f x:0 0 0 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:4/860: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/fe9 [4708,122540] 0 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:4/861: chown d3/d1d/db/de2 238654 1 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:1/995: mkdir d7/d25/d6d/d160 0 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:6/932: write d7/d20/d27/f2b [2005752,67867] 0 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:1/996: stat d7/db/dcc/deb/l150 0 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:6/933: dread d7/d46/d69/da2/d4c/d98/ff1 [0,4194304] 0 2024-04-26T11:46:41.671 INFO:tasks.workunit.client.0.smithi029.stdout:9/844: dwrite d4/d5/d16/d39/f76 [0,4194304] 0 2024-04-26T11:46:41.672 INFO:tasks.workunit.client.0.smithi029.stdout:7/952: dread d11/d18/d35/fdc [0,4194304] 0 2024-04-26T11:46:41.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/997: mkdir d7/d25/d68/d4b/d161 0 2024-04-26T11:46:41.677 INFO:tasks.workunit.client.0.smithi029.stdout:7/953: fdatasync d11/d18/d1a/fd8 0 2024-04-26T11:46:41.677 INFO:tasks.workunit.client.0.smithi029.stdout:2/984: dread d12/d6c/d73/d4f/d65/d6f/f77 [0,4194304] 0 2024-04-26T11:46:41.677 INFO:tasks.workunit.client.0.smithi029.stdout:7/954: dread - d11/d18/db8/f117 zero size 2024-04-26T11:46:41.677 INFO:tasks.workunit.client.0.smithi029.stdout:9/845: chown d4/d49/d58/d67/dab/ld1 620056 1 2024-04-26T11:46:41.677 INFO:tasks.workunit.client.0.smithi029.stdout:6/934: mkdir d7/d25/d5c/d144 0 2024-04-26T11:46:41.677 INFO:tasks.workunit.client.0.smithi029.stdout:9/846: write d4/d46/f56 [2246450,92342] 0 2024-04-26T11:46:41.678 INFO:tasks.workunit.client.0.smithi029.stdout:2/985: creat d12/d24/d29/d36/d10f/f159 x:0 0 0 2024-04-26T11:46:41.678 INFO:tasks.workunit.client.0.smithi029.stdout:7/955: rmdir d11/d18/d35/d39/d7e/dde 39 2024-04-26T11:46:41.678 INFO:tasks.workunit.client.0.smithi029.stdout:6/935: creat d7/d97/dc2/f145 x:0 0 0 2024-04-26T11:46:41.678 INFO:tasks.workunit.client.0.smithi029.stdout:5/856: dread db/d12/d1a/f16 [0,4194304] 0 2024-04-26T11:46:41.678 INFO:tasks.workunit.client.0.smithi029.stdout:2/986: rename d12/d24/f92 to d12/d24/d29/d50/d6a/f15a 0 2024-04-26T11:46:41.678 INFO:tasks.workunit.client.0.smithi029.stdout:6/936: read d7/d46/d69/da2/d4c/d98/ff5 [2943179,39666] 0 2024-04-26T11:46:41.678 INFO:tasks.workunit.client.0.smithi029.stdout:2/987: write d12/d6c/d70/dff/f13d [527039,32962] 0 2024-04-26T11:46:41.678 INFO:tasks.workunit.client.0.smithi029.stdout:7/956: dread d11/fcd [0,4194304] 0 2024-04-26T11:46:41.678 INFO:tasks.workunit.client.0.smithi029.stdout:8/841: dread dc/f93 [0,4194304] 0 2024-04-26T11:46:41.678 INFO:tasks.workunit.client.0.smithi029.stdout:5/857: write db/d40/d70/de8/f91 [928633,42753] 0 2024-04-26T11:46:41.678 INFO:tasks.workunit.client.0.smithi029.stdout:3/790: dwrite d0/d1/d41/d4c/f7b [0,4194304] 0 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:6/937: mknod d7/d46/d69/da2/c146 1 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:5/858: write db/d89/de0/ff2 [55565,77830] 0 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:5/859: write db/d89/f103 [440412,60466] 0 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:7/957: rename d11/d18/f29 to d11/d115/da6/f13c 0 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:8/842: creat dc/de/d2e/d23/d27/d6f/dc8/f131 x:0 0 0 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:6/938: creat d7/d25/d4b/d6d/dd6/d143/f147 x:0 0 0 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:4/862: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f63 [0,4194304] 0 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:5/860: symlink db/l115 0 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:9/847: write d4/d49/d58/f91 [1019085,70003] 0 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:9/848: rmdir d4/d49 39 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:8/843: creat dc/de/d26/d57/d86/d90/de8/f132 x:0 0 0 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:4/863: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/c114 1 2024-04-26T11:46:41.679 INFO:tasks.workunit.client.0.smithi029.stdout:9/849: creat d4/d5/de9/f109 x:0 0 0 2024-04-26T11:46:41.680 INFO:tasks.workunit.client.0.smithi029.stdout:6/939: dread d7/d46/d69/da2/d4c/d98/d45/fe2 [0,4194304] 0 2024-04-26T11:46:41.680 INFO:tasks.workunit.client.0.smithi029.stdout:5/861: dread db/d40/d4d/d4f/f8f [0,4194304] 0 2024-04-26T11:46:41.680 INFO:tasks.workunit.client.0.smithi029.stdout:3/791: dwrite d0/d1/d5c/d103/d1a/f3d [0,4194304] 0 2024-04-26T11:46:41.680 INFO:tasks.workunit.client.0.smithi029.stdout:7/958: dwrite d11/d18/d1a/f23 [0,4194304] 0 2024-04-26T11:46:41.680 INFO:tasks.workunit.client.0.smithi029.stdout:9/850: chown d4/d5/d7/f9f 57922965 1 2024-04-26T11:46:41.680 INFO:tasks.workunit.client.0.smithi029.stdout:0/830: dread d9/d16/d33/d2f/f50 [0,4194304] 0 2024-04-26T11:46:41.680 INFO:tasks.workunit.client.0.smithi029.stdout:3/792: stat d0 0 2024-04-26T11:46:41.680 INFO:tasks.workunit.client.0.smithi029.stdout:6/940: chown d7/d46/d69/da2/d4c/d98/ff1 1318 1 2024-04-26T11:46:41.680 INFO:tasks.workunit.client.0.smithi029.stdout:9/851: mknod d4/d5/d7a/c10a 1 2024-04-26T11:46:41.681 INFO:tasks.workunit.client.0.smithi029.stdout:7/959: chown d11/d15/l118 16109 1 2024-04-26T11:46:41.681 INFO:tasks.workunit.client.0.smithi029.stdout:3/793: creat d0/d1/d41/f10d x:0 0 0 2024-04-26T11:46:41.681 INFO:tasks.workunit.client.0.smithi029.stdout:0/831: creat d9/d16/d25/d2a/d46/f12a x:0 0 0 2024-04-26T11:46:41.682 INFO:tasks.workunit.client.0.smithi029.stdout:9/852: chown d4/d49/d58/d67/l6c 1892954772 1 2024-04-26T11:46:41.682 INFO:tasks.workunit.client.0.smithi029.stdout:0/832: write d9/d78/f83 [915197,96757] 0 2024-04-26T11:46:41.682 INFO:tasks.workunit.client.0.smithi029.stdout:3/794: readlink d0/d1/d2b/d7e/da3/la9 0 2024-04-26T11:46:41.682 INFO:tasks.workunit.client.0.smithi029.stdout:9/853: chown d4/d49/d58/d67/f69 69 1 2024-04-26T11:46:41.682 INFO:tasks.workunit.client.0.smithi029.stdout:7/960: rename d11/d18/d35/dfd/f12c to d11/d18/d35/d13a/f13d 0 2024-04-26T11:46:41.683 INFO:tasks.workunit.client.0.smithi029.stdout:8/844: dwrite dc/de/d2e/d23/fe2 [0,4194304] 0 2024-04-26T11:46:41.684 INFO:tasks.workunit.client.0.smithi029.stdout:8/845: readlink dc/de/d2e/l39 0 2024-04-26T11:46:41.686 INFO:tasks.workunit.client.0.smithi029.stdout:7/961: write d11/d18/d35/d39/d7e/f87 [1028220,21466] 0 2024-04-26T11:46:41.686 INFO:tasks.workunit.client.0.smithi029.stdout:1/998: dread d7/db/f6b [0,4194304] 0 2024-04-26T11:46:41.686 INFO:tasks.workunit.client.0.smithi029.stdout:8/846: mknod dc/de/d103/d6a/d78/dc3/c133 1 2024-04-26T11:46:41.686 INFO:tasks.workunit.client.0.smithi029.stdout:3/795: symlink d0/d1/d5c/d103/de3/de7/l10e 0 2024-04-26T11:46:41.687 INFO:tasks.workunit.client.0.smithi029.stdout:9/854: symlink d4/dac/d103/l10b 0 2024-04-26T11:46:41.687 INFO:tasks.workunit.client.0.smithi029.stdout:0/833: write d9/d16/f24 [2930002,91475] 0 2024-04-26T11:46:41.687 INFO:tasks.workunit.client.0.smithi029.stdout:6/941: read d7/d46/d69/da2/d4c/d98/fc9 [7144940,19607] 0 2024-04-26T11:46:41.688 INFO:tasks.workunit.client.0.smithi029.stdout:9/855: stat d4/l82 0 2024-04-26T11:46:41.688 INFO:tasks.workunit.client.0.smithi029.stdout:1/999: creat d7/d25/f162 x:0 0 0 2024-04-26T11:46:41.688 INFO:tasks.workunit.client.0.smithi029.stdout:5/862: dwrite db/d12/d72/d39/d3b/f5e [0,4194304] 0 2024-04-26T11:46:41.689 INFO:tasks.workunit.client.0.smithi029.stdout:8/847: unlink dc/de/d103/d6a/daa/lc9 0 2024-04-26T11:46:41.690 INFO:tasks.workunit.client.0.smithi029.stdout:0/834: creat d9/d16/d33/d2f/d68/f12b x:0 0 0 2024-04-26T11:46:41.691 INFO:tasks.workunit.client.0.smithi029.stdout:6/942: creat d7/d25/d4b/d6d/dd6/df7/d127/d141/f148 x:0 0 0 2024-04-26T11:46:41.691 INFO:tasks.workunit.client.0.smithi029.stdout:8/848: dread - dc/de/d26/d57/d86/d90/de8/f132 zero size 2024-04-26T11:46:41.691 INFO:tasks.workunit.client.0.smithi029.stdout:5/863: fdatasync db/f20 0 2024-04-26T11:46:41.691 INFO:tasks.workunit.client.0.smithi029.stdout:3/796: rename d0/d1/d5c/d103/d1a/l73 to d0/d1/l10f 0 2024-04-26T11:46:41.692 INFO:tasks.workunit.client.0.smithi029.stdout:0/835: symlink d9/d16/d25/d2a/d46/l12c 0 2024-04-26T11:46:41.693 INFO:tasks.workunit.client.0.smithi029.stdout:6/943: write d7/d25/d4b/d4d/d65/f12d [704514,31217] 0 2024-04-26T11:46:41.693 INFO:tasks.workunit.client.0.smithi029.stdout:8/849: fdatasync dc/de/d2e/d23/d27/d6f/d9b/f45 0 2024-04-26T11:46:41.694 INFO:tasks.workunit.client.0.smithi029.stdout:8/850: write dc/f10e [456170,23681] 0 2024-04-26T11:46:41.695 INFO:tasks.workunit.client.0.smithi029.stdout:5/864: write db/d12/d1a/f6f [1632112,1819] 0 2024-04-26T11:46:41.695 INFO:tasks.workunit.client.0.smithi029.stdout:6/944: fsync d7/d46/d69/da2/d4c/d98/d45/d83/f87 0 2024-04-26T11:46:41.696 INFO:tasks.workunit.client.0.smithi029.stdout:5/865: creat db/d40/dd6/d101/f116 x:0 0 0 2024-04-26T11:46:41.696 INFO:tasks.workunit.client.0.smithi029.stdout:6/945: symlink d7/d20/d27/d91/dee/l149 0 2024-04-26T11:46:41.696 INFO:tasks.workunit.client.0.smithi029.stdout:8/851: getdents dc/de/d2e/d23/d27/d6f/d9b 0 2024-04-26T11:46:41.697 INFO:tasks.workunit.client.0.smithi029.stdout:6/946: chown d7/d97/fa5 54543741 1 2024-04-26T11:46:41.698 INFO:tasks.workunit.client.0.smithi029.stdout:5/866: symlink db/d40/d4d/d4f/d73/d93/l117 0 2024-04-26T11:46:41.698 INFO:tasks.workunit.client.0.smithi029.stdout:8/852: chown dc/de/d2e/d23/d27/l5e 30328330 1 2024-04-26T11:46:41.698 INFO:tasks.workunit.client.0.smithi029.stdout:6/947: mknod d7/d46/d69/da2/d4c/d98/d45/d83/dbf/c14a 1 2024-04-26T11:46:41.699 INFO:tasks.workunit.client.0.smithi029.stdout:5/867: unlink db/f76 0 2024-04-26T11:46:41.699 INFO:tasks.workunit.client.0.smithi029.stdout:6/948: unlink d7/d20/d27/fab 0 2024-04-26T11:46:41.700 INFO:tasks.workunit.client.0.smithi029.stdout:5/868: creat db/d40/d4d/d79/dc8/f118 x:0 0 0 2024-04-26T11:46:41.700 INFO:tasks.workunit.client.0.smithi029.stdout:6/949: fdatasync d7/d20/d27/d91/f108 0 2024-04-26T11:46:41.701 INFO:tasks.workunit.client.0.smithi029.stdout:3/797: write d0/d1/d5c/d103/d1a/d3b/db5/fc6 [1600785,10286] 0 2024-04-26T11:46:41.703 INFO:tasks.workunit.client.0.smithi029.stdout:6/950: symlink d7/d20/l14b 0 2024-04-26T11:46:41.704 INFO:tasks.workunit.client.0.smithi029.stdout:3/798: symlink d0/d1/d2b/l110 0 2024-04-26T11:46:41.704 INFO:tasks.workunit.client.0.smithi029.stdout:4/864: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/fce [0,4194304] 0 2024-04-26T11:46:41.704 INFO:tasks.workunit.client.0.smithi029.stdout:9/856: dread d4/d49/d58/f9d [0,4194304] 0 2024-04-26T11:46:41.705 INFO:tasks.workunit.client.0.smithi029.stdout:3/799: readlink d0/d1/d2f/l97 0 2024-04-26T11:46:41.707 INFO:tasks.workunit.client.0.smithi029.stdout:4/865: rename d3/d1d/db/d13/d23/d2b/d9d/lc7 to d3/d50/d10c/l115 0 2024-04-26T11:46:41.707 INFO:tasks.workunit.client.0.smithi029.stdout:8/853: dwrite dc/de/d26/d57/f85 [0,4194304] 0 2024-04-26T11:46:41.708 INFO:tasks.workunit.client.0.smithi029.stdout:4/866: chown d3/fac 263769769 1 2024-04-26T11:46:41.710 INFO:tasks.workunit.client.0.smithi029.stdout:8/854: symlink dc/de/d26/d57/d86/d90/de8/d114/l134 0 2024-04-26T11:46:41.711 INFO:tasks.workunit.client.0.smithi029.stdout:8/855: mkdir dc/de/d2e/d23/d135 0 2024-04-26T11:46:41.712 INFO:tasks.workunit.client.0.smithi029.stdout:5/869: truncate db/d12/d72/f21 4483022 0 2024-04-26T11:46:41.714 INFO:tasks.workunit.client.0.smithi029.stdout:8/856: chown dc/de/d2e/d23/d27/d6f/d9b/da2 1590 1 2024-04-26T11:46:41.714 INFO:tasks.workunit.client.0.smithi029.stdout:5/870: write db/da6/f100 [259512,54840] 0 2024-04-26T11:46:41.714 INFO:tasks.workunit.client.0.smithi029.stdout:9/857: dwrite d4/d46/f79 [0,4194304] 0 2024-04-26T11:46:41.715 INFO:tasks.workunit.client.0.smithi029.stdout:5/871: mknod db/d12/d72/d39/c119 1 2024-04-26T11:46:41.715 INFO:tasks.workunit.client.0.smithi029.stdout:9/858: mkdir d4/d5/d7a/d10c 0 2024-04-26T11:46:41.716 INFO:tasks.workunit.client.0.smithi029.stdout:2/988: dread d12/d24/d29/dda/d102/f115 [0,4194304] 0 2024-04-26T11:46:41.716 INFO:tasks.workunit.client.0.smithi029.stdout:5/872: read - db/d40/d4d/d4f/d73/fea zero size 2024-04-26T11:46:41.717 INFO:tasks.workunit.client.0.smithi029.stdout:6/951: dread d7/d25/d5c/f5e [0,4194304] 0 2024-04-26T11:46:41.719 INFO:tasks.workunit.client.0.smithi029.stdout:8/857: write dc/de/d103/d7c/f8f [873943,41855] 0 2024-04-26T11:46:41.720 INFO:tasks.workunit.client.0.smithi029.stdout:5/873: write db/d40/dd6/d101/f116 [805987,32317] 0 2024-04-26T11:46:41.720 INFO:tasks.workunit.client.0.smithi029.stdout:6/952: rmdir d7/d20 39 2024-04-26T11:46:41.723 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:41.720+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:41.724 INFO:tasks.workunit.client.0.smithi029.stdout:4/867: dread d3/d50/d7a/f96 [0,4194304] 0 2024-04-26T11:46:41.728 INFO:tasks.workunit.client.0.smithi029.stdout:6/953: write d7/d97/fe7 [812312,78764] 0 2024-04-26T11:46:41.728 INFO:tasks.workunit.client.0.smithi029.stdout:7/962: dread d11/d15/f8e [0,4194304] 0 2024-04-26T11:46:41.729 INFO:tasks.workunit.client.0.smithi029.stdout:5/874: write db/d12/d6b/f85 [651877,616] 0 2024-04-26T11:46:41.731 INFO:tasks.workunit.client.0.smithi029.stdout:5/875: mknod db/de3/df3/c11a 1 2024-04-26T11:46:41.731 INFO:tasks.workunit.client.0.smithi029.stdout:4/868: write d3/d1d/d11/d16/d1f/d3d/d39/ff0 [758107,13253] 0 2024-04-26T11:46:41.731 INFO:tasks.workunit.client.0.smithi029.stdout:9/859: dwrite d4/d49/d7d/fda [4194304,4194304] 0 2024-04-26T11:46:41.732 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:46:41.732 INFO:tasks.workunit.client.0.smithi029.stdout:2/989: dwrite d12/d6c/d73/fdf [0,4194304] 0 2024-04-26T11:46:41.733 INFO:tasks.workunit.client.0.smithi029.stdout:2/990: fsync d12/d6c/d73/d4f/d65/d81/f109 0 2024-04-26T11:46:41.734 INFO:tasks.workunit.client.0.smithi029.stdout:2/991: mknod d12/d6c/d73/d40/ddd/c15b 1 2024-04-26T11:46:41.734 INFO:tasks.workunit.client.0.smithi029.stdout:2/992: fdatasync d12/d24/fcc 0 2024-04-26T11:46:41.736 INFO:tasks.workunit.client.0.smithi029.stdout:8/858: truncate dc/de/d2e/d23/f5f 1072834 0 2024-04-26T11:46:41.738 INFO:tasks.workunit.client.0.smithi029.stdout:5/876: mkdir db/d12/d72/d11b 0 2024-04-26T11:46:41.740 INFO:tasks.workunit.client.0.smithi029.stdout:5/877: fdatasync db/d40/d70/de8/fb5 0 2024-04-26T11:46:41.742 INFO:tasks.workunit.client.0.smithi029.stdout:2/993: dread d12/d24/d29/d50/d6a/fab [0,4194304] 0 2024-04-26T11:46:41.742 INFO:tasks.workunit.client.0.smithi029.stdout:5/878: chown db/d12/lff 56660 1 2024-04-26T11:46:41.743 INFO:tasks.workunit.client.0.smithi029.stdout:6/954: dwrite d7/d46/d69/db4/fcd [0,4194304] 0 2024-04-26T11:46:41.746 INFO:tasks.workunit.client.0.smithi029.stdout:8/859: dwrite dc/de/d2e/d23/d8d/de1/ff8 [0,4194304] 0 2024-04-26T11:46:41.747 INFO:tasks.workunit.client.0.smithi029.stdout:5/879: symlink db/d40/d77/l11c 0 2024-04-26T11:46:41.749 INFO:tasks.workunit.client.0.smithi029.stdout:9/860: dwrite d4/d5/d7a/da1/fa9 [0,4194304] 0 2024-04-26T11:46:41.749 INFO:tasks.workunit.client.0.smithi029.stdout:8/860: chown dc/de/f9d 0 1 2024-04-26T11:46:41.749 INFO:tasks.workunit.client.0.smithi029.stdout:5/880: read - db/d89/de0/ff9 zero size 2024-04-26T11:46:41.750 INFO:tasks.workunit.client.0.smithi029.stdout:3/800: dread d0/d1/d5c/d103/d1a/d3b/db5/fc6 [0,4194304] 0 2024-04-26T11:46:41.750 INFO:tasks.workunit.client.0.smithi029.stdout:6/955: truncate d7/d25/d4b/d6d/dd6/df7/f129 1626291 0 2024-04-26T11:46:41.751 INFO:tasks.workunit.client.0.smithi029.stdout:8/861: chown dc/de/d103 426587724 1 2024-04-26T11:46:41.752 INFO:tasks.workunit.client.0.smithi029.stdout:3/801: mkdir d0/d1/d2b/da7/d109/d111 0 2024-04-26T11:46:41.753 INFO:tasks.workunit.client.0.smithi029.stdout:8/862: rename dc/de/d2e/d23/d27/dc5 to dc/de/d2e/d23/df9/d101/d136 0 2024-04-26T11:46:41.753 INFO:tasks.workunit.client.0.smithi029.stdout:3/802: mkdir d0/d112 0 2024-04-26T11:46:41.754 INFO:tasks.workunit.client.0.smithi029.stdout:6/956: link d7/fd4 d7/d46/d69/da2/dc8/ded/f14c 0 2024-04-26T11:46:41.754 INFO:tasks.workunit.client.0.smithi029.stdout:8/863: unlink dc/f4f 0 2024-04-26T11:46:41.754 INFO:tasks.workunit.client.0.smithi029.stdout:9/861: write d4/d5/d78/dd4/fdc [84060,6668] 0 2024-04-26T11:46:41.754 INFO:tasks.workunit.client.0.smithi029.stdout:3/803: rmdir d0/d1/d2f/d82/dc3 39 2024-04-26T11:46:41.758 INFO:tasks.workunit.client.0.smithi029.stdout:3/804: chown d0/d1/d2b/da7/dad/f14 477294 1 2024-04-26T11:46:41.758 INFO:tasks.workunit.client.0.smithi029.stdout:9/862: symlink d4/d49/d58/d67/dab/l10d 0 2024-04-26T11:46:41.758 INFO:tasks.workunit.client.0.smithi029.stdout:2/994: dwrite d12/d24/d2f/feb [4194304,4194304] 0 2024-04-26T11:46:41.759 INFO:tasks.workunit.client.0.smithi029.stdout:3/805: dread - d0/d1/d41/d4c/dee/d9d/fc0 zero size 2024-04-26T11:46:41.760 INFO:tasks.workunit.client.0.smithi029.stdout:5/881: dwrite db/d40/dd6/d101/f116 [0,4194304] 0 2024-04-26T11:46:41.761 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4541.0:14898 4.5 e61/17 4:a3d7899a:::10000003203.00000001:head v 61'228, mlcod=60'226)", 2024-04-26T11:46:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.740312+0000", 2024-04-26T11:46:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021487264999999998, 2024-04-26T11:46:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021520403, 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.740312+0000", 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.740312+0000", 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.740311+0000", 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.744353+0000", 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040415349999999997 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.744370+0000", 2024-04-26T11:46:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7475000000000001e-05 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.744380+0000", 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7249999999999992e-06 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.744468+0000", 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8325000000000006e-05 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.744492+0000", 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3557000000000002e-05 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:2826 3.d e61/16 3:b02ffd62:::200.00000010:head v 61'243, mlcod=61'241)", 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.758268+0000", 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.003530839, 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036251590000000002, 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.758268+0000", 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.758268+0000", 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.758267+0000", 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.758276+0000", 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5569999999999996e-06 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.758286+0000", 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8349999999999999e-06 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.758291+0000", 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5369999999999997e-06 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.758324+0000", 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2574999999999999e-05 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.758334+0000", 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0732e-05 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:2827 3.d e61/16 3:b02ffd62:::200.00000010:head v 61'244, mlcod=61'241)", 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.759169+0000", 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0026294339999999999, 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027750510000000002, 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.759169+0000", 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.759169+0000", 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.759169+0000", 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.759183+0000", 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4447000000000001e-05 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.759192+0000", 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0299999999999999e-06 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.759196+0000", 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0509999999999998e-06 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.759226+0000", 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0117e-05 2024-04-26T11:46:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.759237+0000", 2024-04-26T11:46:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0535e-05 2024-04-26T11:46:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:46:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 3 2024-04-26T11:46:41.772 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:41.774 INFO:tasks.workunit.client.0.smithi029.stdout:3/806: write d0/d1/d2b/d7e/d107/f8f [1265320,33361] 0 2024-04-26T11:46:41.774 INFO:tasks.workunit.client.0.smithi029.stdout:2/995: rename d12/d24/d2f/fd2 to d12/d24/d29/d50/d55/f15c 0 2024-04-26T11:46:41.774 INFO:tasks.workunit.client.0.smithi029.stdout:3/807: chown d0/d1/d5c/d103/d1a/f38 28513 1 2024-04-26T11:46:41.774 INFO:tasks.workunit.client.0.smithi029.stdout:6/957: dwrite d7/d25/d4b/d6d/f8e [0,4194304] 0 2024-04-26T11:46:41.774 INFO:tasks.workunit.client.0.smithi029.stdout:5/882: mknod db/d40/c11d 1 2024-04-26T11:46:41.774 INFO:tasks.workunit.client.0.smithi029.stdout:2/996: rename d12/d24/d2f/d76/l106 to d12/d6c/d70/l15d 0 2024-04-26T11:46:41.774 INFO:tasks.workunit.client.0.smithi029.stdout:5/883: write db/d12/d1a/f16 [350404,10964] 0 2024-04-26T11:46:41.774 INFO:tasks.workunit.client.0.smithi029.stdout:6/958: symlink d7/d20/d27/da1/l14d 0 2024-04-26T11:46:41.774 INFO:tasks.workunit.client.0.smithi029.stdout:2/997: mkdir d12/d6c/d73/da5/db1/d15e 0 2024-04-26T11:46:41.774 INFO:tasks.workunit.client.0.smithi029.stdout:9/863: dwrite d4/f101 [0,4194304] 0 2024-04-26T11:46:41.774 INFO:tasks.workunit.client.0.smithi029.stdout:5/884: truncate db/d40/d4d/d4f/d73/d93/fe9 743094 0 2024-04-26T11:46:41.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:41.777 INFO:tasks.workunit.client.0.smithi029.stdout:3/808: write d0/d1/d5c/d103/d54/fb8 [803708,99444] 0 2024-04-26T11:46:41.778 INFO:tasks.workunit.client.0.smithi029.stdout:3/809: creat d0/d112/f113 x:0 0 0 2024-04-26T11:46:41.778 INFO:tasks.workunit.client.0.smithi029.stdout:2/998: write d12/de3/f103 [4153181,117526] 0 2024-04-26T11:46:41.779 INFO:tasks.workunit.client.0.smithi029.stdout:6/959: dread d7/d25/d5c/f58 [4194304,4194304] 0 2024-04-26T11:46:41.780 INFO:tasks.workunit.client.0.smithi029.stdout:2/999: mkdir d12/d24/d2f/d76/d15f 0 2024-04-26T11:46:41.780 INFO:tasks.workunit.client.0.smithi029.stdout:9/864: dwrite d4/d5/f51 [4194304,4194304] 0 2024-04-26T11:46:41.780 INFO:tasks.workunit.client.0.smithi029.stdout:3/810: creat d0/d1/d5c/d103/de3/f114 x:0 0 0 2024-04-26T11:46:41.781 INFO:tasks.workunit.client.0.smithi029.stdout:6/960: stat d7/lc 0 2024-04-26T11:46:41.782 INFO:tasks.workunit.client.0.smithi029.stdout:9/865: dread - d4/d49/d58/d67/f84 zero size 2024-04-26T11:46:41.782 INFO:tasks.workunit.client.0.smithi029.stdout:6/961: symlink d7/d20/d27/da1/l14e 0 2024-04-26T11:46:41.783 INFO:tasks.workunit.client.0.smithi029.stdout:6/962: readlink d7/d46/l92 0 2024-04-26T11:46:41.784 INFO:tasks.workunit.client.0.smithi029.stdout:9/866: creat d4/d5/d7a/f10e x:0 0 0 2024-04-26T11:46:41.784 INFO:tasks.workunit.client.0.smithi029.stdout:9/867: mknod d4/d5/d7/c10f 1 2024-04-26T11:46:41.785 INFO:tasks.workunit.client.0.smithi029.stdout:6/963: creat d7/d46/d69/da2/d4c/d98/d45/d76/f14f x:0 0 0 2024-04-26T11:46:41.785 INFO:tasks.workunit.client.0.smithi029.stdout:8/864: dwrite dc/de/d2e/d23/d27/d6f/dc8/f116 [0,4194304] 0 2024-04-26T11:46:41.786 INFO:tasks.workunit.client.0.smithi029.stdout:6/964: mknod d7/d25/d4b/d6d/dd6/d143/c150 1 2024-04-26T11:46:41.786 INFO:tasks.workunit.client.0.smithi029.stdout:9/868: rename d4/d49/d58/d67/fb7 to d4/d49/d58/d67/dab/f110 0 2024-04-26T11:46:41.787 INFO:tasks.workunit.client.0.smithi029.stdout:8/865: read - dc/de/dd0/d108/f112 zero size 2024-04-26T11:46:41.787 INFO:tasks.workunit.client.0.smithi029.stdout:6/965: mknod d7/d25/d4b/d4d/d65/c151 1 2024-04-26T11:46:41.788 INFO:tasks.workunit.client.0.smithi029.stdout:9/869: symlink d4/dac/d103/l111 0 2024-04-26T11:46:41.788 INFO:tasks.workunit.client.0.smithi029.stdout:8/866: read dc/de/d2e/d23/d8d/de1/ff8 [2735047,13030] 0 2024-04-26T11:46:41.791 INFO:tasks.workunit.client.0.smithi029.stdout:9/870: readlink d4/d46/l5f 0 2024-04-26T11:46:41.791 INFO:tasks.workunit.client.0.smithi029.stdout:6/966: link d7/d25/d5c/f58 d7/d25/d4b/d4d/d132/f152 0 2024-04-26T11:46:41.791 INFO:tasks.workunit.client.0.smithi029.stdout:8/867: symlink dc/de/d2e/d23/d27/d6f/d9b/d43/dad/d118/l137 0 2024-04-26T11:46:41.792 INFO:tasks.workunit.client.0.smithi029.stdout:3/811: write d0/d1/d2b/da7/fb9 [2824423,95015] 0 2024-04-26T11:46:41.794 INFO:tasks.workunit.client.0.smithi029.stdout:6/967: creat d7/d97/f153 x:0 0 0 2024-04-26T11:46:41.796 INFO:tasks.workunit.client.0.smithi029.stdout:6/968: rmdir d7/d20/d27/dc0/d122 0 2024-04-26T11:46:41.796 INFO:tasks.workunit.client.0.smithi029.stdout:9/871: dread d4/d49/f6a [0,4194304] 0 2024-04-26T11:46:41.798 INFO:tasks.workunit.client.0.smithi029.stdout:6/969: truncate d7/d20/d27/da1/f140 18369 0 2024-04-26T11:46:41.803 INFO:tasks.workunit.client.0.smithi029.stdout:9/872: write d4/f6f [1304235,27911] 0 2024-04-26T11:46:41.803 INFO:tasks.workunit.client.0.smithi029.stdout:6/970: write d7/d25/d5c/f36 [1096875,8279] 0 2024-04-26T11:46:41.803 INFO:tasks.workunit.client.0.smithi029.stdout:8/868: dwrite dc/de/d2e/d23/d27/d6f/d9b/d43/f82 [0,4194304] 0 2024-04-26T11:46:41.803 INFO:tasks.workunit.client.0.smithi029.stdout:5/885: dread db/d40/d70/de8/f88 [0,4194304] 0 2024-04-26T11:46:41.804 INFO:tasks.workunit.client.0.smithi029.stdout:6/971: symlink d7/d25/d4b/d6d/dd6/d143/l154 0 2024-04-26T11:46:41.804 INFO:tasks.workunit.client.0.smithi029.stdout:5/886: creat db/d40/d77/d98/f11e x:0 0 0 2024-04-26T11:46:41.804 INFO:tasks.workunit.client.0.smithi029.stdout:8/869: symlink dc/de/d2e/d23/d27/d6f/d9b/da2/l138 0 2024-04-26T11:46:41.804 INFO:tasks.workunit.client.0.smithi029.stdout:6/972: unlink d7/d25/d4b/fac 0 2024-04-26T11:46:41.805 INFO:tasks.workunit.client.0.smithi029.stdout:8/870: readlink dc/de/d26/d6b/dde/lee 0 2024-04-26T11:46:41.806 INFO:tasks.workunit.client.0.smithi029.stdout:5/887: chown db/d40/d4d/d79/l7f 325 1 2024-04-26T11:46:41.808 INFO:tasks.workunit.client.0.smithi029.stdout:6/973: write d7/d20/d27/d91/dee/f11c [464012,122144] 0 2024-04-26T11:46:41.810 INFO:tasks.workunit.client.0.smithi029.stdout:8/871: write dc/de/d2e/d23/d27/d6f/dc8/f131 [701219,55464] 0 2024-04-26T11:46:41.810 INFO:tasks.workunit.client.0.smithi029.stdout:6/974: fsync d7/d25/d4b/d6d/dd6/df7/d127/d141/f148 0 2024-04-26T11:46:41.811 INFO:tasks.workunit.client.0.smithi029.stdout:8/872: mkdir dc/de/dd0/d108/d139 0 2024-04-26T11:46:41.812 INFO:tasks.workunit.client.0.smithi029.stdout:9/873: dwrite d4/d5/d16/d80/dc2/fb2 [0,4194304] 0 2024-04-26T11:46:41.812 INFO:tasks.workunit.client.0.smithi029.stdout:6/975: fsync d7/d46/d69/db4/fe9 0 2024-04-26T11:46:41.813 INFO:tasks.workunit.client.0.smithi029.stdout:8/873: symlink dc/d9f/db2/l13a 0 2024-04-26T11:46:41.814 INFO:tasks.workunit.client.0.smithi029.stdout:9/874: fdatasync d4/d5/f51 0 2024-04-26T11:46:41.814 INFO:tasks.workunit.client.0.smithi029.stdout:8/874: read - dc/de/d2e/d23/d8d/f100 zero size 2024-04-26T11:46:41.815 INFO:tasks.workunit.client.0.smithi029.stdout:6/976: getdents d7/d25/d4b/d4d/d132 0 2024-04-26T11:46:41.816 INFO:tasks.workunit.client.0.smithi029.stdout:9/875: rename d4/d5/d7/d74/da8 to d4/d5/d16/d80/dc9/d112 0 2024-04-26T11:46:41.816 INFO:tasks.workunit.client.0.smithi029.stdout:8/875: symlink dc/de/d103/d6a/d119/l13b 0 2024-04-26T11:46:41.816 INFO:tasks.workunit.client.0.smithi029.stdout:5/888: truncate db/d12/f5c 205810 0 2024-04-26T11:46:41.817 INFO:tasks.workunit.client.0.smithi029.stdout:5/889: dread - db/ffe zero size 2024-04-26T11:46:41.817 INFO:tasks.workunit.client.0.smithi029.stdout:9/876: write d4/d46/fd0 [905975,127487] 0 2024-04-26T11:46:41.817 INFO:tasks.workunit.client.0.smithi029.stdout:6/977: rename d7/d20/d27/f7b to d7/d20/f155 0 2024-04-26T11:46:41.818 INFO:tasks.workunit.client.0.smithi029.stdout:3/812: dread d0/d1/d2f/f9f [0,4194304] 0 2024-04-26T11:46:41.818 INFO:tasks.workunit.client.0.smithi029.stdout:3/813: mknod d0/d1/d2b/d7e/dc2/c115 1 2024-04-26T11:46:41.819 INFO:tasks.workunit.client.0.smithi029.stdout:3/814: write d0/d1/d2b/d33/f66 [2326325,65592] 0 2024-04-26T11:46:41.820 INFO:tasks.workunit.client.0.smithi029.stdout:5/890: truncate db/d89/fcf 564821 0 2024-04-26T11:46:41.821 INFO:tasks.workunit.client.0.smithi029.stdout:3/815: mkdir d0/d1/d5c/d103/d1a/d116 0 2024-04-26T11:46:41.821 INFO:tasks.workunit.client.0.smithi029.stdout:6/978: unlink d7/d46/d69/da2/fb1 0 2024-04-26T11:46:41.822 INFO:tasks.workunit.client.0.smithi029.stdout:6/979: mknod d7/d97/dc2/c156 1 2024-04-26T11:46:41.823 INFO:tasks.workunit.client.0.smithi029.stdout:6/980: chown d7/d97/dc2/d131 21625162 1 2024-04-26T11:46:41.823 INFO:tasks.workunit.client.0.smithi029.stdout:3/816: truncate d0/d1/d5c/f9c 345366 0 2024-04-26T11:46:41.824 INFO:tasks.workunit.client.0.smithi029.stdout:6/981: mknod d7/d25/c157 1 2024-04-26T11:46:41.824 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:41.821+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:41.825 INFO:tasks.workunit.client.0.smithi029.stdout:3/817: stat d0/d1/d2b/d7e/ff5 0 2024-04-26T11:46:41.826 INFO:tasks.workunit.client.0.smithi029.stdout:8/876: dwrite dc/de/d26/d57/d86/dc0/fff [0,4194304] 0 2024-04-26T11:46:41.827 INFO:tasks.workunit.client.0.smithi029.stdout:3/818: unlink d0/d1/f108 0 2024-04-26T11:46:41.828 INFO:tasks.workunit.client.0.smithi029.stdout:8/877: fsync dc/de/d2e/d23/f21 0 2024-04-26T11:46:41.830 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:41.830 INFO:tasks.workunit.client.0.smithi029.stdout:8/878: fsync dc/de/d26/f69 0 2024-04-26T11:46:41.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/982: chown d7/d25/d4b/d6d/dd6/df7/d127/d141/f148 1 1 2024-04-26T11:46:41.831 INFO:tasks.workunit.client.0.smithi029.stdout:9/877: dwrite d4/d5/d7/f35 [4194304,4194304] 0 2024-04-26T11:46:41.831 INFO:tasks.workunit.client.0.smithi029.stdout:5/891: dwrite db/d12/d1a/f80 [0,4194304] 0 2024-04-26T11:46:41.831 INFO:tasks.workunit.client.0.smithi029.stdout:8/879: dread - dc/de/d26/d57/d86/d90/f12a zero size 2024-04-26T11:46:41.832 INFO:tasks.workunit.client.0.smithi029.stdout:6/983: chown d7/d46/d69/da2/d4c/d98/d45/d83/da9/fe0 6941356 1 2024-04-26T11:46:41.833 INFO:tasks.workunit.client.0.smithi029.stdout:5/892: rename db/d40/d77/d98 to db/d40/dd6/d11f 0 2024-04-26T11:46:41.833 INFO:tasks.workunit.client.0.smithi029.stdout:9/878: link d4/d49/d58/f9d d4/d5/d16/d39/dc5/f113 0 2024-04-26T11:46:41.835 INFO:tasks.workunit.client.0.smithi029.stdout:5/893: mkdir db/de3/df3/d120 0 2024-04-26T11:46:41.835 INFO:tasks.workunit.client.0.smithi029.stdout:6/984: getdents d7/d25/d4b/d4d/d132 0 2024-04-26T11:46:41.835 INFO:tasks.workunit.client.0.smithi029.stdout:9/879: symlink d4/dac/dff/l114 0 2024-04-26T11:46:41.836 INFO:tasks.workunit.client.0.smithi029.stdout:9/880: rmdir d4/d5/d7 39 2024-04-26T11:46:41.836 INFO:tasks.workunit.client.0.smithi029.stdout:6/985: fsync d7/d46/d69/da2/f80 0 2024-04-26T11:46:41.836 INFO:tasks.workunit.client.0.smithi029.stdout:5/894: fdatasync db/d40/d4d/f95 0 2024-04-26T11:46:41.837 INFO:tasks.workunit.client.0.smithi029.stdout:5/895: creat db/d40/d4d/d4f/f121 x:0 0 0 2024-04-26T11:46:41.837 INFO:tasks.workunit.client.0.smithi029.stdout:6/986: getdents d7/d46/d69/d117 0 2024-04-26T11:46:41.838 INFO:tasks.workunit.client.0.smithi029.stdout:5/896: symlink db/d40/d70/l122 0 2024-04-26T11:46:41.838 INFO:tasks.workunit.client.0.smithi029.stdout:6/987: creat d7/d20/d27/d91/dee/f158 x:0 0 0 2024-04-26T11:46:41.839 INFO:tasks.workunit.client.0.smithi029.stdout:5/897: mknod db/d12/d6b/da4/c123 1 2024-04-26T11:46:41.840 INFO:tasks.workunit.client.0.smithi029.stdout:8/880: read dc/de/d103/d6a/d78/dc3/fdc [407117,117940] 0 2024-04-26T11:46:41.840 INFO:tasks.workunit.client.0.smithi029.stdout:5/898: rename db/d12/d72/d39/l6a to db/d40/dd6/def/l124 0 2024-04-26T11:46:41.841 INFO:tasks.workunit.client.0.smithi029.stdout:6/988: truncate d7/d46/d69/da2/d4c/d98/d45/d83/f87 1092679 0 2024-04-26T11:46:41.843 INFO:tasks.workunit.client.0.smithi029.stdout:8/881: getdents dc/de/d26/d57/d86/dc0/df0 0 2024-04-26T11:46:41.843 INFO:tasks.workunit.client.0.smithi029.stdout:5/899: truncate db/d12/d1a/f18 2780130 0 2024-04-26T11:46:41.843 INFO:tasks.workunit.client.0.smithi029.stdout:6/989: creat d7/d20/d27/d91/f159 x:0 0 0 2024-04-26T11:46:41.843 INFO:tasks.workunit.client.0.smithi029.stdout:5/900: mknod db/d89/c125 1 2024-04-26T11:46:41.843 INFO:tasks.workunit.client.0.smithi029.stdout:5/901: chown db/d40/d4d/d4f/d73 14319104 1 2024-04-26T11:46:41.844 INFO:tasks.workunit.client.0.smithi029.stdout:5/902: stat db/d12/d72/f8c 0 2024-04-26T11:46:41.844 INFO:tasks.workunit.client.0.smithi029.stdout:6/990: truncate d7/d25/d4b/d4d/d65/fb8 1022458 0 2024-04-26T11:46:41.845 INFO:tasks.workunit.client.0.smithi029.stdout:5/903: chown db/d40/d4d/d4f/d73 38355 1 2024-04-26T11:46:41.845 INFO:tasks.workunit.client.0.smithi029.stdout:6/991: readlink d7/d46/d69/l12b 0 2024-04-26T11:46:41.847 INFO:tasks.workunit.client.0.smithi029.stdout:9/881: truncate d4/d49/d58/d67/dab/f110 1470012 0 2024-04-26T11:46:41.847 INFO:tasks.workunit.client.0.smithi029.stdout:3/819: dwrite d0/d1/d41/f42 [4194304,4194304] 0 2024-04-26T11:46:41.847 INFO:tasks.workunit.client.0.smithi029.stdout:5/904: creat db/d40/d4d/d4f/d73/d93/f126 x:0 0 0 2024-04-26T11:46:41.848 INFO:tasks.workunit.client.0.smithi029.stdout:3/820: creat d0/d112/f117 x:0 0 0 2024-04-26T11:46:41.848 INFO:tasks.workunit.client.0.smithi029.stdout:5/905: chown db/d40/d4d/f9d 96725 1 2024-04-26T11:46:41.850 INFO:tasks.workunit.client.0.smithi029.stdout:5/906: symlink db/d40/dd6/d11f/l127 0 2024-04-26T11:46:41.851 INFO:tasks.workunit.client.0.smithi029.stdout:9/882: dread d4/d5/d16/f73 [0,4194304] 0 2024-04-26T11:46:41.852 INFO:tasks.workunit.client.0.smithi029.stdout:9/883: mkdir d4/d5/d16/d39/d115 0 2024-04-26T11:46:41.852 INFO:tasks.workunit.client.0.smithi029.stdout:3/821: truncate d0/d1/d2b/d33/dcb/feb 5011686 0 2024-04-26T11:46:41.853 INFO:tasks.workunit.client.0.smithi029.stdout:9/884: mknod d4/d5/d16/d80/c116 1 2024-04-26T11:46:41.854 INFO:tasks.workunit.client.0.smithi029.stdout:3/822: creat d0/d1/d2f/d82/dce/f118 x:0 0 0 2024-04-26T11:46:41.862 INFO:tasks.workunit.client.0.smithi029.stdout:9/885: write d4/d5/d16/d80/dc9/d112/ffe [84552,54070] 0 2024-04-26T11:46:41.862 INFO:tasks.workunit.client.0.smithi029.stdout:3/823: write d0/dc/d1f/fd9 [675970,68381] 0 2024-04-26T11:46:41.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/886: write d4/d5/d7/f36 [4541429,108778] 0 2024-04-26T11:46:41.864 INFO:tasks.workunit.client.0.smithi029.stdout:3/824: read - d0/d1/d2b/d7e/d107/d9a/f106 zero size 2024-04-26T11:46:41.865 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:41.865 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:41.865 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:41.865 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:41.866 INFO:tasks.workunit.client.0.smithi029.stdout:9/887: symlink d4/d49/d58/d67/l117 0 2024-04-26T11:46:41.866 INFO:tasks.workunit.client.0.smithi029.stdout:3/825: write d0/d1/d2f/f9f [137502,50046] 0 2024-04-26T11:46:41.866 INFO:tasks.workunit.client.0.smithi029.stdout:9/888: mknod d4/d5/d16/d80/dc9/c118 1 2024-04-26T11:46:41.867 INFO:tasks.workunit.client.0.smithi029.stdout:6/992: dread d7/d25/f73 [0,4194304] 0 2024-04-26T11:46:41.869 INFO:tasks.workunit.client.0.smithi029.stdout:6/993: readlink d7/d25/d5c/l8f 0 2024-04-26T11:46:41.869 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:41.870 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:41.870 INFO:tasks.workunit.client.0.smithi029.stdout:6/994: link d7/d46/d69/da2/d4c/d98/fc9 d7/d20/d27/dc0/dd0/f15a 0 2024-04-26T11:46:41.870 INFO:tasks.workunit.client.0.smithi029.stdout:9/889: write d4/d49/d58/f53 [616252,20710] 0 2024-04-26T11:46:41.871 INFO:tasks.workunit.client.0.smithi029.stdout:6/995: dread - d7/d46/d69/da2/dc8/ded/f13e zero size 2024-04-26T11:46:41.872 INFO:tasks.workunit.client.0.smithi029.stdout:9/890: truncate d4/d46/f56 4790036 0 2024-04-26T11:46:41.873 INFO:tasks.workunit.client.0.smithi029.stdout:6/996: write d7/d25/d5c/f36 [1582605,98514] 0 2024-04-26T11:46:41.873 INFO:tasks.workunit.client.0.smithi029.stdout:9/891: unlink d4/d5/d16/l8e 0 2024-04-26T11:46:41.874 INFO:tasks.workunit.client.0.smithi029.stdout:5/907: dread db/d12/d1a/fc9 [0,4194304] 0 2024-04-26T11:46:41.874 INFO:tasks.workunit.client.0.smithi029.stdout:9/892: readlink d4/d5/d7/d74/lf4 0 2024-04-26T11:46:41.874 INFO:tasks.workunit.client.0.smithi029.stdout:6/997: mknod d7/d46/d69/da2/d4c/d98/d45/d83/c15b 1 2024-04-26T11:46:41.875 INFO:tasks.workunit.client.0.smithi029.stdout:9/893: chown d4/d5/d7a/db0 226 1 2024-04-26T11:46:41.875 INFO:tasks.workunit.client.0.smithi029.stdout:5/908: rmdir db/d40/dd6 39 2024-04-26T11:46:41.875 INFO:tasks.workunit.client.0.smithi029.stdout:3/826: dwrite d0/d1/d41/d4c/dee/d9d/ff4 [0,4194304] 0 2024-04-26T11:46:41.876 INFO:tasks.workunit.client.0.smithi029.stdout:9/894: chown d4/d49/d58/fa7 73683 1 2024-04-26T11:46:41.876 INFO:tasks.workunit.client.0.smithi029.stdout:3/827: chown d0/d1/d5c/d103 3323 1 2024-04-26T11:46:41.877 INFO:tasks.workunit.client.0.smithi029.stdout:9/895: read - d4/d5/d16/d80/dc2/fc4 zero size 2024-04-26T11:46:41.878 INFO:tasks.workunit.client.0.smithi029.stdout:5/909: creat db/d40/d4d/d4f/f128 x:0 0 0 2024-04-26T11:46:41.878 INFO:tasks.workunit.client.0.smithi029.stdout:5/910: mknod db/d12/d72/c129 1 2024-04-26T11:46:41.880 INFO:tasks.workunit.client.0.smithi029.stdout:9/896: creat d4/d5/d7a/f119 x:0 0 0 2024-04-26T11:46:41.881 INFO:tasks.workunit.client.0.smithi029.stdout:9/897: chown d4/d5/d16/d80/f9b 85375349 1 2024-04-26T11:46:41.883 INFO:tasks.workunit.client.0.smithi029.stdout:5/911: link db/d40/d4d/lb8 db/d12/d72/d92/l12a 0 2024-04-26T11:46:41.883 INFO:tasks.workunit.client.0.smithi029.stdout:6/998: read d7/d20/d27/da1/f140 [9640,89127] 0 2024-04-26T11:46:41.884 INFO:tasks.workunit.client.0.smithi029.stdout:9/898: creat d4/d5/f11a x:0 0 0 2024-04-26T11:46:41.889 INFO:tasks.workunit.client.0.smithi029.stdout:3/828: dread d0/d1/f5d [0,4194304] 0 2024-04-26T11:46:41.890 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:41.890 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:41.891 INFO:tasks.workunit.client.0.smithi029.stdout:6/999: dwrite d7/d25/d5c/f36 [0,4194304] 0 2024-04-26T11:46:41.891 INFO:tasks.workunit.client.0.smithi029.stdout:9/899: dwrite d4/d5/d7/f85 [4194304,4194304] 0 2024-04-26T11:46:41.892 INFO:tasks.workunit.client.0.smithi029.stdout:9/900: mknod d4/d46/c11b 1 2024-04-26T11:46:41.895 INFO:tasks.workunit.client.0.smithi029.stdout:3/829: read d0/d1/d5c/d103/d54/fbf [3180515,77146] 0 2024-04-26T11:46:41.895 INFO:tasks.workunit.client.0.smithi029.stdout:9/901: link d4/d5/d16/d80/f92 d4/f11c 0 2024-04-26T11:46:41.895 INFO:tasks.workunit.client.0.smithi029.stdout:9/902: mknod d4/d5/d7a/da1/c11d 1 2024-04-26T11:46:41.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/903: truncate d4/d5/d16/d80/f9b 168242 0 2024-04-26T11:46:41.896 INFO:tasks.workunit.client.0.smithi029.stdout:3/830: creat d0/d1/d2b/da7/dad/d98/f119 x:0 0 0 2024-04-26T11:46:41.897 INFO:tasks.workunit.client.0.smithi029.stdout:9/904: write d4/d5/d7a/d97/f98 [780295,32761] 0 2024-04-26T11:46:41.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:41.899 INFO:tasks.workunit.client.0.smithi029.stdout:9/905: creat d4/d5/d78/d102/f11e x:0 0 0 2024-04-26T11:46:41.904 INFO:tasks.workunit.client.0.smithi029.stdout:3/831: dwrite d0/d1/d5c/d103/fa2 [0,4194304] 0 2024-04-26T11:46:41.905 INFO:tasks.workunit.client.0.smithi029.stdout:3/832: unlink d0/l20 0 2024-04-26T11:46:41.906 INFO:tasks.workunit.client.0.smithi029.stdout:3/833: creat d0/d1/d5c/d103/f11a x:0 0 0 2024-04-26T11:46:41.908 INFO:tasks.workunit.client.0.smithi029.stdout:3/834: truncate d0/d112/f113 537274 0 2024-04-26T11:46:41.910 INFO:tasks.workunit.client.0.smithi029.stdout:3/835: rename d0/d1/d2b/d33/dcb to d0/d1/d5c/d103/d54/d11b 0 2024-04-26T11:46:41.921 INFO:tasks.workunit.client.0.smithi029.stdout:0/836: sync 2024-04-26T11:46:41.924 INFO:tasks.workunit.client.0.smithi029.stdout:0/837: symlink d9/d16/d33/d2f/d32/d90/df4/l12d 0 2024-04-26T11:46:41.925 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:41.921+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:41.926 INFO:tasks.workunit.client.0.smithi029.stdout:0/838: creat d9/d16/d33/d2f/d32/f12e x:0 0 0 2024-04-26T11:46:41.934 INFO:tasks.workunit.client.0.smithi029.stdout:9/906: dread d4/d5/d7/f35 [0,4194304] 0 2024-04-26T11:46:41.938 INFO:tasks.workunit.client.0.smithi029.stdout:0/839: dwrite d9/d16/d33/d2f/d68/f12b [0,4194304] 0 2024-04-26T11:46:41.940 INFO:tasks.workunit.client.0.smithi029.stdout:3/836: dread d0/d1/d5c/d103/d54/d11b/fd7 [0,4194304] 0 2024-04-26T11:46:41.940 INFO:tasks.workunit.client.0.smithi029.stdout:9/907: write d4/d49/f87 [636474,82743] 0 2024-04-26T11:46:41.941 INFO:tasks.workunit.client.0.smithi029.stdout:9/908: mknod d4/d46/c11f 1 2024-04-26T11:46:41.942 INFO:tasks.workunit.client.0.smithi029.stdout:9/909: readlink d4/d5/l70 0 2024-04-26T11:46:41.942 INFO:tasks.workunit.client.0.smithi029.stdout:3/837: creat d0/d1/d5c/d103/de3/de7/f11c x:0 0 0 2024-04-26T11:46:41.943 INFO:tasks.workunit.client.0.smithi029.stdout:9/910: readlink d4/d5/l70 0 2024-04-26T11:46:41.943 INFO:tasks.workunit.client.0.smithi029.stdout:3/838: fsync d0/d1/d5c/d103/de3/de7/ffa 0 2024-04-26T11:46:41.944 INFO:tasks.workunit.client.0.smithi029.stdout:3/839: fsync d0/d1/d2f/fb2 0 2024-04-26T11:46:41.945 INFO:tasks.workunit.client.0.smithi029.stdout:9/911: link d4/d5/d16/f73 d4/d5/d16/d39/f120 0 2024-04-26T11:46:41.947 INFO:tasks.workunit.client.0.smithi029.stdout:3/840: creat d0/d1/d5c/d103/d1a/d3b/f11d x:0 0 0 2024-04-26T11:46:41.947 INFO:tasks.workunit.client.0.smithi029.stdout:9/912: creat d4/dac/f121 x:0 0 0 2024-04-26T11:46:41.948 INFO:tasks.workunit.client.0.smithi029.stdout:9/913: rmdir d4/d5/d78 39 2024-04-26T11:46:41.948 INFO:tasks.workunit.client.0.smithi029.stdout:3/841: symlink d0/d1/d5c/d103/d54/l11e 0 2024-04-26T11:46:41.949 INFO:tasks.workunit.client.0.smithi029.stdout:0/840: dwrite d9/d16/d33/d2f/f50 [4194304,4194304] 0 2024-04-26T11:46:41.950 INFO:tasks.workunit.client.0.smithi029.stdout:3/842: creat d0/d1/d2f/d82/dc3/f11f x:0 0 0 2024-04-26T11:46:41.951 INFO:tasks.workunit.client.0.smithi029.stdout:0/841: fsync d9/d43/f65 0 2024-04-26T11:46:41.959 INFO:tasks.workunit.client.0.smithi029.stdout:3/843: write d0/d1/d5c/d103/d54/fbf [4783164,24094] 0 2024-04-26T11:46:41.961 INFO:tasks.workunit.client.0.smithi029.stdout:3/844: write d0/d1/d2b/d7e/da3/fc1 [451524,62899] 0 2024-04-26T11:46:41.963 INFO:tasks.workunit.client.0.smithi029.stdout:3/845: truncate d0/d1/d2b/d7e/ff5 925569 0 2024-04-26T11:46:41.964 INFO:tasks.workunit.client.0.smithi029.stdout:0/842: dwrite d9/d16/d33/d2f/d68/f105 [0,4194304] 0 2024-04-26T11:46:41.967 INFO:tasks.workunit.client.0.smithi029.stdout:3/846: rmdir d0/d1/d2b/da7/d109/d111 0 2024-04-26T11:46:41.967 INFO:tasks.workunit.client.0.smithi029.stdout:0/843: getdents d9/d43 0 2024-04-26T11:46:41.970 INFO:tasks.workunit.client.0.smithi029.stdout:3/847: rename d0/d1/d5c/d103/d54/fbf to d0/d1/f120 0 2024-04-26T11:46:41.977 INFO:tasks.workunit.client.0.smithi029.stdout:0/844: write d9/d16/d25/f6c [4505820,69307] 0 2024-04-26T11:46:41.979 INFO:tasks.workunit.client.0.smithi029.stdout:3/848: dwrite d0/d1/d5c/d103/de3/de7/ffa [0,4194304] 0 2024-04-26T11:46:41.979 INFO:tasks.workunit.client.0.smithi029.stdout:0/845: creat d9/d16/d25/d2a/f12f x:0 0 0 2024-04-26T11:46:41.983 INFO:tasks.workunit.client.0.smithi029.stdout:0/846: rename d9/d16/d33/d2f/d68/f125 to d9/d16/d25/d2a/d8e/f130 0 2024-04-26T11:46:41.984 INFO:tasks.workunit.client.0.smithi029.stdout:0/847: mknod d9/d16/de7/dff/c131 1 2024-04-26T11:46:41.986 INFO:tasks.workunit.client.0.smithi029.stdout:0/848: truncate d9/d16/d25/d2a/f12f 34714 0 2024-04-26T11:46:41.987 INFO:tasks.workunit.client.0.smithi029.stdout:0/849: dread - d9/d16/de7/ff0 zero size 2024-04-26T11:46:41.989 INFO:tasks.workunit.client.0.smithi029.stdout:0/850: rename d9/d16/de7/d107/l58 to d9/d16/d25/ddc/l132 0 2024-04-26T11:46:41.991 INFO:tasks.workunit.client.0.smithi029.stdout:3/849: dwrite d0/d1/d2b/d7e/d107/d9a/f100 [0,4194304] 0 2024-04-26T11:46:41.991 INFO:tasks.workunit.client.0.smithi029.stdout:0/851: creat d9/d16/d25/db4/f133 x:0 0 0 2024-04-26T11:46:41.993 INFO:tasks.workunit.client.0.smithi029.stdout:0/852: dread - d9/d16/de7/d107/f6f zero size 2024-04-26T11:46:42.000 INFO:tasks.workunit.client.0.smithi029.stdout:3/850: dwrite d0/d1/d41/f10d [0,4194304] 0 2024-04-26T11:46:42.008 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:42.008 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:42.008 INFO:tasks.workunit.client.0.smithi029.stdout:0/853: dread d9/d43/f54 [0,4194304] 0 2024-04-26T11:46:42.009 INFO:tasks.workunit.client.0.smithi029.stdout:0/854: symlink d9/d78/l134 0 2024-04-26T11:46:42.009 INFO:tasks.workunit.client.0.smithi029.stdout:0/855: creat d9/d16/d52/f135 x:0 0 0 2024-04-26T11:46:42.009 INFO:tasks.workunit.client.0.smithi029.stdout:0/856: creat d9/d16/d25/ddc/f136 x:0 0 0 2024-04-26T11:46:42.009 INFO:tasks.workunit.client.0.smithi029.stdout:0/857: link d9/d43/f75 d9/d16/d33/d2f/d32/d9f/dac/f137 0 2024-04-26T11:46:42.013 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:42.025 INFO:tasks.workunit.client.0.smithi029.stdout:0/858: dwrite d9/f84 [0,4194304] 0 2024-04-26T11:46:42.027 INFO:tasks.workunit.client.0.smithi029.stdout:0/859: creat d9/d16/d33/d2f/d32/d9d/f138 x:0 0 0 2024-04-26T11:46:42.029 INFO:tasks.workunit.client.0.smithi029.stdout:3/851: dread d0/d1/d5c/d103/d1a/f38 [0,4194304] 0 2024-04-26T11:46:42.030 INFO:tasks.workunit.client.0.smithi029.stdout:0/860: rmdir d9/d16/d33/d2f/d32/d90/df4 39 2024-04-26T11:46:42.032 INFO:tasks.workunit.client.0.smithi029.stdout:3/852: symlink d0/d1/d5c/d103/de3/l121 0 2024-04-26T11:46:42.043 INFO:tasks.workunit.client.0.smithi029.stdout:0/861: dwrite d9/d78/fcb [0,4194304] 0 2024-04-26T11:46:42.044 INFO:tasks.workunit.client.0.smithi029.stdout:3/853: dwrite d0/d1/d2f/f39 [4194304,4194304] 0 2024-04-26T11:46:42.046 INFO:tasks.workunit.client.0.smithi029.stdout:3/854: symlink d0/d1/d5c/d103/d1a/d3b/l122 0 2024-04-26T11:46:42.048 INFO:tasks.workunit.client.0.smithi029.stdout:3/855: creat d0/d1/d2b/f123 x:0 0 0 2024-04-26T11:46:42.058 INFO:tasks.workunit.client.0.smithi029.stdout:0/862: dwrite d9/d16/d25/db4/ff2 [0,4194304] 0 2024-04-26T11:46:42.060 INFO:tasks.workunit.client.0.smithi029.stdout:3/856: dwrite d0/d1/d2b/d7e/ff5 [0,4194304] 0 2024-04-26T11:46:42.061 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:42.061+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:42.063 INFO:tasks.workunit.client.0.smithi029.stdout:3/857: getdents d0/d1/d5c/d103/d1a/d3b/db5/d10a 0 2024-04-26T11:46:42.065 INFO:tasks.workunit.client.0.smithi029.stdout:3/858: mkdir d0/d1/d2f/d82/d124 0 2024-04-26T11:46:42.066 INFO:tasks.workunit.client.0.smithi029.stdout:3/859: symlink d0/d1/d41/d4c/dee/l125 0 2024-04-26T11:46:42.068 INFO:tasks.workunit.client.0.smithi029.stdout:3/860: fsync d0/d1/d5c/d103/d54/d11b/feb 0 2024-04-26T11:46:42.068 INFO:tasks.workunit.client.0.smithi029.stdout:3/861: chown d0/d1/d41 150898113 1 2024-04-26T11:46:42.071 INFO:tasks.workunit.client.0.smithi029.stdout:3/862: mkdir d0/d1/d2f/d82/d126 0 2024-04-26T11:46:42.071 INFO:tasks.workunit.client.0.smithi029.stdout:3/863: creat d0/d1/d2f/dd8/f127 x:0 0 0 2024-04-26T11:46:42.083 INFO:tasks.workunit.client.0.smithi029.stdout:0/863: truncate d9/d16/d25/d2a/d4b/dde/fe1 2850587 0 2024-04-26T11:46:42.098 INFO:tasks.workunit.client.0.smithi029.stdout:0/864: dwrite d9/d43/fc6 [0,4194304] 0 2024-04-26T11:46:42.106 INFO:tasks.workunit.client.0.smithi029.stdout:0/865: dread d9/d43/fc6 [0,4194304] 0 2024-04-26T11:46:42.108 INFO:tasks.workunit.client.0.smithi029.stdout:0/866: write d9/d78/ff7 [695654,81231] 0 2024-04-26T11:46:42.108 INFO:tasks.workunit.client.0.smithi029.stdout:0/867: fsync d9/d16/f89 0 2024-04-26T11:46:42.120 INFO:tasks.workunit.client.0.smithi029.stdout:7/963: sync 2024-04-26T11:46:42.122 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:42.122 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:42.125 INFO:tasks.workunit.client.0.smithi029.stdout:7/964: write d11/fcd [1515983,24077] 0 2024-04-26T11:46:42.126 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:42.125+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:42.128 INFO:tasks.workunit.client.0.smithi029.stdout:7/965: creat d11/d18/d1a/d26/d131/f13e x:0 0 0 2024-04-26T11:46:42.129 INFO:tasks.workunit.client.0.smithi029.stdout:7/966: mknod d11/d18/d35/c13f 1 2024-04-26T11:46:42.132 INFO:tasks.workunit.client.0.smithi029.stdout:7/967: fsync d11/d18/d35/d39/d7e/dde/f5a 0 2024-04-26T11:46:42.133 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:42.133 INFO:tasks.workunit.client.0.smithi029.stdout:7/968: rmdir d11/d115 39 2024-04-26T11:46:42.135 INFO:tasks.workunit.client.0.smithi029.stdout:7/969: creat d11/dd3/de4/d84/f140 x:0 0 0 2024-04-26T11:46:42.136 INFO:tasks.workunit.client.0.smithi029.stdout:7/970: mknod d11/d18/d35/d39/d7e/dde/c141 1 2024-04-26T11:46:42.140 INFO:tasks.workunit.client.0.smithi029.stdout:7/971: read d11/d15/d67/ff7 [1152362,48376] 0 2024-04-26T11:46:42.147 INFO:tasks.workunit.client.0.smithi029.stdout:7/972: rename d11/d18/d58/f126 to d11/d115/f142 0 2024-04-26T11:46:42.149 INFO:tasks.workunit.client.0.smithi029.stdout:7/973: dread - d11/d18/d58/d8d/dc3/f11f zero size 2024-04-26T11:46:42.149 INFO:tasks.workunit.client.0.smithi029.stdout:7/974: chown d11/d18/l8b 16537660 1 2024-04-26T11:46:42.164 INFO:tasks.workunit.client.0.smithi029.stdout:7/975: dread d11/d18/d58/faf [0,4194304] 0 2024-04-26T11:46:42.166 INFO:tasks.workunit.client.0.smithi029.stdout:7/976: creat d11/dd3/de4/daa/f143 x:0 0 0 2024-04-26T11:46:42.168 INFO:tasks.workunit.client.0.smithi029.stdout:7/977: creat d11/d18/d35/d103/f144 x:0 0 0 2024-04-26T11:46:42.171 INFO:tasks.workunit.client.0.smithi029.stdout:7/978: dread d11/d18/d35/d13a/f13d [0,4194304] 0 2024-04-26T11:46:42.172 INFO:tasks.workunit.client.0.smithi029.stdout:7/979: mknod d11/d18/d58/d8d/c145 1 2024-04-26T11:46:42.173 INFO:tasks.workunit.client.0.smithi029.stdout:7/980: creat d11/d115/d97/d9b/f146 x:0 0 0 2024-04-26T11:46:42.174 INFO:tasks.workunit.client.0.smithi029.stdout:7/981: mknod d11/dd3/de4/d84/d128/c147 1 2024-04-26T11:46:42.198 INFO:tasks.workunit.client.0.smithi029.stdout:9/914: sync 2024-04-26T11:46:42.198 INFO:tasks.workunit.client.0.smithi029.stdout:3/864: sync 2024-04-26T11:46:42.198 INFO:tasks.workunit.client.0.smithi029.stdout:5/912: sync 2024-04-26T11:46:42.198 INFO:tasks.workunit.client.0.smithi029.stdout:4/869: sync 2024-04-26T11:46:42.198 INFO:tasks.workunit.client.0.smithi029.stdout:0/868: sync 2024-04-26T11:46:42.198 INFO:tasks.workunit.client.0.smithi029.stdout:8/882: sync 2024-04-26T11:46:42.201 INFO:tasks.workunit.client.0.smithi029.stdout:4/870: write d3/d1d/db/d13/f9e [607432,116925] 0 2024-04-26T11:46:42.201 INFO:tasks.workunit.client.0.smithi029.stdout:0/869: stat d9/d16/d33/d2f/d32/l3a 0 2024-04-26T11:46:42.201 INFO:tasks.workunit.client.0.smithi029.stdout:5/913: creat db/d12/d72/d11b/f12b x:0 0 0 2024-04-26T11:46:42.202 INFO:tasks.workunit.client.0.smithi029.stdout:8/883: dread dc/d3b/f109 [0,4194304] 0 2024-04-26T11:46:42.204 INFO:tasks.workunit.client.0.smithi029.stdout:8/884: mknod dc/c13c 1 2024-04-26T11:46:42.204 INFO:tasks.workunit.client.0.smithi029.stdout:0/870: dread - d9/d16/d33/d2f/d32/d9f/de6/d11f/f126 zero size 2024-04-26T11:46:42.204 INFO:tasks.workunit.client.0.smithi029.stdout:5/914: creat db/d40/d4d/f12c x:0 0 0 2024-04-26T11:46:42.206 INFO:tasks.workunit.client.0.smithi029.stdout:5/915: dread - db/d40/d4d/d4f/f121 zero size 2024-04-26T11:46:42.207 INFO:tasks.workunit.client.0.smithi029.stdout:0/871: dread - d9/d16/d25/d2a/fb0 zero size 2024-04-26T11:46:42.209 INFO:tasks.workunit.client.0.smithi029.stdout:5/916: dread - db/d12/d72/d39/d3b/d86/f99 zero size 2024-04-26T11:46:42.209 INFO:tasks.workunit.client.0.smithi029.stdout:0/872: mkdir d9/d43/d139 0 2024-04-26T11:46:42.213 INFO:tasks.workunit.client.0.smithi029.stdout:9/915: dwrite d4/d46/f57 [4194304,4194304] 0 2024-04-26T11:46:42.214 INFO:tasks.workunit.client.0.smithi029.stdout:9/916: stat d4/d5/d7a/dbd/le0 0 2024-04-26T11:46:42.216 INFO:tasks.workunit.client.0.smithi029.stdout:9/917: rename d4/d5/d16/d80/fc3 to d4/d49/d58/d67/dab/f122 0 2024-04-26T11:46:42.217 INFO:tasks.workunit.client.0.smithi029.stdout:9/918: dread - d4/d5/d7a/d97/fb9 zero size 2024-04-26T11:46:42.218 INFO:tasks.workunit.client.0.smithi029.stdout:9/919: dread - d4/d5/d7a/fd8 zero size 2024-04-26T11:46:42.219 INFO:tasks.workunit.client.0.smithi029.stdout:9/920: mkdir d4/d49/d58/d67/dab/d123 0 2024-04-26T11:46:42.221 INFO:tasks.workunit.client.0.smithi029.stdout:0/873: unlink d9/d16/d25/d2a/fb0 0 2024-04-26T11:46:42.222 INFO:tasks.workunit.client.0.smithi029.stdout:0/874: chown d9/d43/f103 243 1 2024-04-26T11:46:42.223 INFO:tasks.workunit.client.0.smithi029.stdout:0/875: write d9/d16/d33/d2f/ffe [395269,58796] 0 2024-04-26T11:46:42.224 INFO:tasks.workunit.client.0.smithi029.stdout:0/876: mknod d9/d16/d25/ddc/c13a 1 2024-04-26T11:46:42.226 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:42.225+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:42.229 INFO:tasks.workunit.client.0.smithi029.stdout:7/982: rmdir d11/d18/d1a/d92 39 2024-04-26T11:46:42.229 INFO:tasks.workunit.client.0.smithi029.stdout:7/983: dread - d11/dd3/de4/f130 zero size 2024-04-26T11:46:42.230 INFO:tasks.workunit.client.0.smithi029.stdout:0/877: dread d9/d16/f89 [0,4194304] 0 2024-04-26T11:46:42.232 INFO:tasks.workunit.client.0.smithi029.stdout:0/878: chown d9/d16/d25/d2a/d8e/dc7/l112 3 1 2024-04-26T11:46:42.232 INFO:tasks.workunit.client.0.smithi029.stdout:0/879: stat d9/d16/d25/d2a/d46/ld7 0 2024-04-26T11:46:42.239 INFO:tasks.workunit.client.0.smithi029.stdout:8/885: dread dc/de/d2e/d23/d27/fb6 [4194304,4194304] 0 2024-04-26T11:46:42.241 INFO:tasks.workunit.client.0.smithi029.stdout:7/984: dwrite d11/d18/d35/d39/d7e/f10a [0,4194304] 0 2024-04-26T11:46:42.241 INFO:tasks.workunit.client.0.smithi029.stdout:8/886: creat dc/de/d2e/d23/d27/d6f/f13d x:0 0 0 2024-04-26T11:46:42.244 INFO:tasks.workunit.client.0.smithi029.stdout:8/887: unlink dc/de/d2e/d23/d27/d6f/dc8/f131 0 2024-04-26T11:46:42.245 INFO:tasks.workunit.client.0.smithi029.stdout:8/888: fdatasync dc/de/d26/d57/d86/d90/f111 0 2024-04-26T11:46:42.247 INFO:tasks.workunit.client.0.smithi029.stdout:8/889: readlink dc/de/d103/d6a/d78/dc3/dcf/l10a 0 2024-04-26T11:46:42.247 INFO:tasks.workunit.client.0.smithi029.stdout:7/985: read d11/d18/d1a/d26/f132 [2465150,91699] 0 2024-04-26T11:46:42.248 INFO:tasks.workunit.client.0.smithi029.stdout:7/986: mknod d11/d18/d35/d39/d7e/da2/c148 1 2024-04-26T11:46:42.249 INFO:tasks.workunit.client.0.smithi029.stdout:8/890: chown dc/de/d103/d6a/d78/dc3/dcf/l107 159 1 2024-04-26T11:46:42.249 INFO:tasks.workunit.client.0.smithi029.stdout:7/987: read - d11/d115/d97/d9b/fc7 zero size 2024-04-26T11:46:42.250 INFO:tasks.workunit.client.0.smithi029.stdout:8/891: rmdir dc/de/dd0/d108 39 2024-04-26T11:46:42.250 INFO:tasks.workunit.client.0.smithi029.stdout:9/921: rmdir d4/d5 39 2024-04-26T11:46:42.250 INFO:tasks.workunit.client.0.smithi029.stdout:7/988: mknod d11/d18/d35/d39/d7e/d12f/c149 1 2024-04-26T11:46:42.251 INFO:tasks.workunit.client.0.smithi029.stdout:9/922: mknod d4/d5/d7a/dbd/c124 1 2024-04-26T11:46:42.251 INFO:tasks.workunit.client.0.smithi029.stdout:8/892: dread - dc/de/d103/d6a/d78/dc3/dcf/ffe zero size 2024-04-26T11:46:42.252 INFO:tasks.workunit.client.0.smithi029.stdout:8/893: mkdir dc/d9f/d13e 0 2024-04-26T11:46:42.254 INFO:tasks.workunit.client.0.smithi029.stdout:9/923: rename d4/d5/d16/d80/dc2/feb to d4/d5/d16/d80/dc9/d112/de1/f125 0 2024-04-26T11:46:42.255 INFO:tasks.workunit.client.0.smithi029.stdout:9/924: rmdir d4/dac 39 2024-04-26T11:46:42.255 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:42.255 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:42.257 INFO:tasks.workunit.client.0.smithi029.stdout:9/925: truncate d4/d5/d16/ffd 632014 0 2024-04-26T11:46:42.258 INFO:tasks.workunit.client.0.smithi029.stdout:9/926: creat d4/d5/d78/f126 x:0 0 0 2024-04-26T11:46:42.258 INFO:tasks.workunit.client.0.smithi029.stdout:9/927: mknod d4/d49/d58/d67/dab/c127 1 2024-04-26T11:46:42.260 INFO:tasks.workunit.client.0.smithi029.stdout:9/928: mkdir d4/d49/d58/d67/dab/d123/d128 0 2024-04-26T11:46:42.261 INFO:tasks.workunit.client.0.smithi029.stdout:9/929: stat d4/d49/d58/d67/dab/f122 0 2024-04-26T11:46:42.266 INFO:tasks.workunit.client.0.smithi029.stdout:9/930: read d4/d5/d7a/d97/f98 [138183,59408] 0 2024-04-26T11:46:42.267 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:42.268 INFO:tasks.workunit.client.0.smithi029.stdout:9/931: getdents d4/d5/d7a/da1 0 2024-04-26T11:46:42.277 INFO:tasks.workunit.client.0.smithi029.stdout:4/871: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/fce 3864824 0 2024-04-26T11:46:42.281 INFO:tasks.workunit.client.0.smithi029.stdout:4/872: rename d3/d1d/d11/d16/d71/l99 to d3/d1d/d11/d16/d1f/d3d/d39/l116 0 2024-04-26T11:46:42.284 INFO:tasks.workunit.client.0.smithi029.stdout:3/865: sync 2024-04-26T11:46:42.284 INFO:tasks.workunit.client.0.smithi029.stdout:5/917: sync 2024-04-26T11:46:42.284 INFO:tasks.workunit.client.0.smithi029.stdout:5/918: stat db/d89/de0 0 2024-04-26T11:46:42.286 INFO:tasks.workunit.client.0.smithi029.stdout:3/866: symlink d0/d1/d2b/d7e/dc2/l128 0 2024-04-26T11:46:42.288 INFO:tasks.workunit.client.0.smithi029.stdout:5/919: truncate db/d40/d4d/d4f/d73/fea 501440 0 2024-04-26T11:46:42.289 INFO:tasks.workunit.client.0.smithi029.stdout:9/932: getdents d4/d5/d16/d80/dc9/d112/de1 0 2024-04-26T11:46:42.294 INFO:tasks.workunit.client.0.smithi029.stdout:3/867: unlink d0/d1/d5c/d103/d1a/d3b/db5/fc6 0 2024-04-26T11:46:42.294 INFO:tasks.workunit.client.0.smithi029.stdout:9/933: write d4/d49/d58/d67/f84 [476145,12552] 0 2024-04-26T11:46:42.297 INFO:tasks.workunit.client.0.smithi029.stdout:7/989: dwrite d11/d18/d35/f76 [4194304,4194304] 0 2024-04-26T11:46:42.301 INFO:tasks.workunit.client.0.smithi029.stdout:8/894: dwrite dc/de/d2e/d23/d27/d6f/d9b/d43/da1/f61 [0,4194304] 0 2024-04-26T11:46:42.304 INFO:tasks.workunit.client.0.smithi029.stdout:3/868: write d0/d1/d2b/da7/dad/fd6 [881705,114335] 0 2024-04-26T11:46:42.306 INFO:tasks.workunit.client.0.smithi029.stdout:4/873: dwrite d3/d1d/d11/d16/d1f/d3d/fb3 [0,4194304] 0 2024-04-26T11:46:42.308 INFO:tasks.workunit.client.0.smithi029.stdout:5/920: dwrite db/d40/d77/fd4 [0,4194304] 0 2024-04-26T11:46:42.308 INFO:tasks.workunit.client.0.smithi029.stdout:8/895: symlink dc/de/d2e/d23/d27/d6f/d9b/d43/da1/l13f 0 2024-04-26T11:46:42.311 INFO:tasks.workunit.client.0.smithi029.stdout:3/869: creat d0/d1/d5c/d103/d1a/d3b/db5/df8/f129 x:0 0 0 2024-04-26T11:46:42.313 INFO:tasks.workunit.client.0.smithi029.stdout:4/874: symlink d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84/dfd/ddb/l117 0 2024-04-26T11:46:42.315 INFO:tasks.workunit.client.0.smithi029.stdout:3/870: chown d0/d1/d41/de0/lae 1436096023 1 2024-04-26T11:46:42.315 INFO:tasks.workunit.client.0.smithi029.stdout:7/990: dwrite d11/d115/da6/fe6 [4194304,4194304] 0 2024-04-26T11:46:42.316 INFO:tasks.workunit.client.0.smithi029.stdout:9/934: dwrite d4/d5/d7a/da1/fb6 [4194304,4194304] 0 2024-04-26T11:46:42.316 INFO:tasks.workunit.client.0.smithi029.stdout:8/896: rename dc/de/d26/d57/d86/dda/lbe to dc/de/d2e/d23/df9/d101/d136/ddd/l140 0 2024-04-26T11:46:42.317 INFO:tasks.workunit.client.0.smithi029.stdout:9/935: fsync d4/d49/d58/d67/ffa 0 2024-04-26T11:46:42.317 INFO:tasks.workunit.client.0.smithi029.stdout:7/991: rmdir d11/d18/d35/d39/d7e/da2 39 2024-04-26T11:46:42.319 INFO:tasks.workunit.client.0.smithi029.stdout:8/897: rename dc/de/d103/d6a/d78/dc3/fdc to dc/de/d103/d7c/f141 0 2024-04-26T11:46:42.319 INFO:tasks.workunit.client.0.smithi029.stdout:9/936: rename d4/d5/d16/d80/dc9/d112 to d4/d5/d7a/d10c/d129 0 2024-04-26T11:46:42.320 INFO:tasks.workunit.client.0.smithi029.stdout:7/992: mkdir d11/d18/d35/d39/d7e/da2/d14a 0 2024-04-26T11:46:42.321 INFO:tasks.workunit.client.0.smithi029.stdout:9/937: write d4/d5/d16/d80/f83 [850009,105612] 0 2024-04-26T11:46:42.322 INFO:tasks.workunit.client.0.smithi029.stdout:7/993: symlink d11/d18/d1a/l14b 0 2024-04-26T11:46:42.322 INFO:tasks.workunit.client.0.smithi029.stdout:9/938: chown d4/d5/d16/d80/dc9 3190 1 2024-04-26T11:46:42.324 INFO:tasks.workunit.client.0.smithi029.stdout:7/994: creat d11/d18/d35/d39/d7e/da2/f14c x:0 0 0 2024-04-26T11:46:42.328 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:42.324+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:42.328 INFO:tasks.workunit.client.0.smithi029.stdout:7/995: getdents d11/d18/d35/d39/d7e 0 2024-04-26T11:46:42.329 INFO:tasks.workunit.client.0.smithi029.stdout:3/871: dwrite d0/dc/d1f/fdf [0,4194304] 0 2024-04-26T11:46:42.330 INFO:tasks.workunit.client.0.smithi029.stdout:0/880: sync 2024-04-26T11:46:42.330 INFO:tasks.workunit.client.0.smithi029.stdout:5/921: sync 2024-04-26T11:46:42.330 INFO:tasks.workunit.client.0.smithi029.stdout:7/996: fsync d11/d18/d2d/f86 0 2024-04-26T11:46:42.331 INFO:tasks.workunit.client.0.smithi029.stdout:8/898: dwrite dc/de/d2e/d23/d27/d6f/f13d [0,4194304] 0 2024-04-26T11:46:42.334 INFO:tasks.workunit.client.0.smithi029.stdout:0/881: fsync d9/d16/d33/d2f/d32/d90/fc8 0 2024-04-26T11:46:42.335 INFO:tasks.workunit.client.0.smithi029.stdout:8/899: readlink dc/de/d2e/d23/ld4 0 2024-04-26T11:46:42.335 INFO:tasks.workunit.client.0.smithi029.stdout:3/872: write d0/d1/d5c/d103/d1a/d3b/f4f [710938,42085] 0 2024-04-26T11:46:42.336 INFO:tasks.workunit.client.0.smithi029.stdout:9/939: dwrite d4/d46/f79 [0,4194304] 0 2024-04-26T11:46:42.336 INFO:tasks.workunit.client.0.smithi029.stdout:0/882: chown d9/d16/d25/db4/fb5 10598581 1 2024-04-26T11:46:42.337 INFO:tasks.workunit.client.0.smithi029.stdout:5/922: fsync db/d40/d70/de8/fb5 0 2024-04-26T11:46:42.338 INFO:tasks.workunit.client.0.smithi029.stdout:3/873: unlink d0/d1/d2f/d82/dc3/f11f 0 2024-04-26T11:46:42.338 INFO:tasks.workunit.client.0.smithi029.stdout:9/940: read - d4/d5/d7/d74/fa0 zero size 2024-04-26T11:46:42.339 INFO:tasks.workunit.client.0.smithi029.stdout:5/923: mkdir db/d40/d4d/d4f/d73/d12d 0 2024-04-26T11:46:42.339 INFO:tasks.workunit.client.0.smithi029.stdout:3/874: creat d0/d1/d2f/d82/dce/f12a x:0 0 0 2024-04-26T11:46:42.339 INFO:tasks.workunit.client.0.smithi029.stdout:0/883: write d9/d16/d25/d2a/d74/d9a/faf [1826550,31073] 0 2024-04-26T11:46:42.341 INFO:tasks.workunit.client.0.smithi029.stdout:9/941: link d4/d5/d16/l4c d4/d5/d16/d80/dc2/l12a 0 2024-04-26T11:46:42.342 INFO:tasks.workunit.client.0.smithi029.stdout:7/997: dwrite d11/d18/d1a/f83 [0,4194304] 0 2024-04-26T11:46:42.343 INFO:tasks.workunit.client.0.smithi029.stdout:7/998: mkdir d11/d15/d104/d11e/d14d 0 2024-04-26T11:46:42.345 INFO:tasks.workunit.client.0.smithi029.stdout:7/999: write d11/d115/f109 [519062,55830] 0 2024-04-26T11:46:42.345 INFO:tasks.workunit.client.0.smithi029.stdout:9/942: rename d4/d5/d16/d80/dc2/l12a to d4/d5/d16/d39/l12b 0 2024-04-26T11:46:42.347 INFO:tasks.workunit.client.0.smithi029.stdout:4/875: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f6a [4194304,4194304] 0 2024-04-26T11:46:42.348 INFO:tasks.workunit.client.0.smithi029.stdout:5/924: dwrite db/d12/fa7 [0,4194304] 0 2024-04-26T11:46:42.349 INFO:tasks.workunit.client.0.smithi029.stdout:4/876: dread - d3/d1d/db/ff5 zero size 2024-04-26T11:46:42.350 INFO:tasks.workunit.client.0.smithi029.stdout:5/925: creat db/d89/f12e x:0 0 0 2024-04-26T11:46:42.350 INFO:tasks.workunit.client.0.smithi029.stdout:3/875: dwrite d0/d1/d2b/d7e/d107/d9a/f106 [0,4194304] 0 2024-04-26T11:46:42.351 INFO:tasks.workunit.client.0.smithi029.stdout:5/926: mkdir db/d40/dd6/d101/d12f 0 2024-04-26T11:46:42.352 INFO:tasks.workunit.client.0.smithi029.stdout:9/943: dread d4/d5/d16/d80/dc2/fb2 [0,4194304] 0 2024-04-26T11:46:42.352 INFO:tasks.workunit.client.0.smithi029.stdout:3/876: write d0/d1/d5c/d103/d54/f58 [4888952,96232] 0 2024-04-26T11:46:42.352 INFO:tasks.workunit.client.0.smithi029.stdout:5/927: fdatasync db/d12/f78 0 2024-04-26T11:46:42.353 INFO:tasks.workunit.client.0.smithi029.stdout:5/928: stat db/d12/d72/d92/lb7 0 2024-04-26T11:46:42.353 INFO:tasks.workunit.client.0.smithi029.stdout:3/877: dread - d0/d1/d41/ff6 zero size 2024-04-26T11:46:42.354 INFO:tasks.workunit.client.0.smithi029.stdout:9/944: rename d4/d49/d58/d67/dab to d4/d49/d7d/d12c 0 2024-04-26T11:46:42.354 INFO:tasks.workunit.client.0.smithi029.stdout:3/878: write d0/d1/d2f/d82/fc5 [858858,66555] 0 2024-04-26T11:46:42.356 INFO:tasks.workunit.client.0.smithi029.stdout:9/945: truncate d4/d49/d58/d67/ffa 40756 0 2024-04-26T11:46:42.356 INFO:tasks.workunit.client.0.smithi029.stdout:3/879: write d0/d1/d5c/d103/d54/fb8 [4395997,35119] 0 2024-04-26T11:46:42.356 INFO:tasks.workunit.client.0.smithi029.stdout:9/946: symlink d4/d5/d16/d39/dc5/d106/l12d 0 2024-04-26T11:46:42.357 INFO:tasks.workunit.client.0.smithi029.stdout:9/947: write d4/d49/d7d/fb4 [767210,106871] 0 2024-04-26T11:46:42.371 INFO:tasks.workunit.client.0.smithi029.stdout:9/948: dread d4/d5/d7a/d10c/d129/fe5 [0,4194304] 0 2024-04-26T11:46:42.371 INFO:tasks.workunit.client.0.smithi029.stdout:4/877: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f6a 5123630 0 2024-04-26T11:46:42.373 INFO:tasks.workunit.client.0.smithi029.stdout:4/878: link d3/d1d/db/d13/d73/f8e d3/d1d/db/dc0/d102/f118 0 2024-04-26T11:46:42.374 INFO:tasks.workunit.client.0.smithi029.stdout:4/879: write d3/d1d/d11/d16/d1f/d3d/d46/fbf [2422192,554] 0 2024-04-26T11:46:42.375 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:42.375 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:42.380 INFO:tasks.workunit.client.0.smithi029.stdout:9/949: dwrite d4/d5/d16/d39/f63 [0,4194304] 0 2024-04-26T11:46:42.381 INFO:tasks.workunit.client.0.smithi029.stdout:8/900: sync 2024-04-26T11:46:42.382 INFO:tasks.workunit.client.0.smithi029.stdout:0/884: sync 2024-04-26T11:46:42.382 INFO:tasks.workunit.client.0.smithi029.stdout:3/880: sync 2024-04-26T11:46:42.382 INFO:tasks.workunit.client.0.smithi029.stdout:5/929: sync 2024-04-26T11:46:42.383 INFO:tasks.workunit.client.0.smithi029.stdout:3/881: rmdir d0/d1/d5c/d103/d54 39 2024-04-26T11:46:42.384 INFO:tasks.workunit.client.0.smithi029.stdout:8/901: read - dc/de/d2e/d23/d8d/f100 zero size 2024-04-26T11:46:42.384 INFO:tasks.workunit.client.0.smithi029.stdout:5/930: dread - db/d12/d72/d11b/f12b zero size 2024-04-26T11:46:42.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:42.386 INFO:tasks.workunit.client.0.smithi029.stdout:0/885: link d9/d43/f54 d9/d16/d25/d2a/d4b/f13b 0 2024-04-26T11:46:42.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/882: readlink d0/d1/d41/d4c/l84 0 2024-04-26T11:46:42.387 INFO:tasks.workunit.client.0.smithi029.stdout:4/880: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/fb2 [0,4194304] 0 2024-04-26T11:46:42.387 INFO:tasks.workunit.client.0.smithi029.stdout:0/886: chown d9/d16/d33 1621320788 1 2024-04-26T11:46:42.388 INFO:tasks.workunit.client.0.smithi029.stdout:8/902: write dc/de/d103/d7c/dfc/f11c [1210955,74752] 0 2024-04-26T11:46:42.388 INFO:tasks.workunit.client.0.smithi029.stdout:4/881: dread - d3/d50/db4/fb9 zero size 2024-04-26T11:46:42.390 INFO:tasks.workunit.client.0.smithi029.stdout:5/931: getdents db/d12/d72/d39 0 2024-04-26T11:46:42.390 INFO:tasks.workunit.client.0.smithi029.stdout:3/883: mkdir d0/d1/d5c/d103/d1a/d3b/db5/d10a/d12b 0 2024-04-26T11:46:42.390 INFO:tasks.workunit.client.0.smithi029.stdout:0/887: mkdir d9/d16/d25/d2a/d4b/d13c 0 2024-04-26T11:46:42.390 INFO:tasks.workunit.client.0.smithi029.stdout:4/882: mkdir d3/d119 0 2024-04-26T11:46:42.391 INFO:tasks.workunit.client.0.smithi029.stdout:5/932: creat db/d12/d6b/da4/f130 x:0 0 0 2024-04-26T11:46:42.391 INFO:tasks.workunit.client.0.smithi029.stdout:4/883: rmdir d3/d1d/d11 39 2024-04-26T11:46:42.393 INFO:tasks.workunit.client.0.smithi029.stdout:4/884: rename d3/d1d/l2e to d3/d1d/d11/d16/d1f/l11a 0 2024-04-26T11:46:42.394 INFO:tasks.workunit.client.0.smithi029.stdout:4/885: getdents d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d105 0 2024-04-26T11:46:42.394 INFO:tasks.workunit.client.0.smithi029.stdout:3/884: dread d0/d1/d41/d4c/dee/d9d/fcc [0,4194304] 0 2024-04-26T11:46:42.397 INFO:tasks.workunit.client.0.smithi029.stdout:9/950: dread d4/d49/d58/f53 [0,4194304] 0 2024-04-26T11:46:42.397 INFO:tasks.workunit.client.0.smithi029.stdout:3/885: rename d0/d1/d2f/d82/d126 to d0/d1/d41/d4c/dee/d12c 0 2024-04-26T11:46:42.397 INFO:tasks.workunit.client.0.smithi029.stdout:9/951: mkdir d4/d49/d58/d67/d12e 0 2024-04-26T11:46:42.398 INFO:tasks.workunit.client.0.smithi029.stdout:3/886: fdatasync d0/d1/d2b/f85 0 2024-04-26T11:46:42.398 INFO:tasks.workunit.client.0.smithi029.stdout:9/952: dread - d4/d5/fde zero size 2024-04-26T11:46:42.399 INFO:tasks.workunit.client.0.smithi029.stdout:3/887: creat d0/d1/d5c/d103/d1a/d3b/f12d x:0 0 0 2024-04-26T11:46:42.399 INFO:tasks.workunit.client.0.smithi029.stdout:9/953: mkdir d4/d49/d7d/d12c/d123/d12f 0 2024-04-26T11:46:42.400 INFO:tasks.workunit.client.0.smithi029.stdout:9/954: truncate d4/d5/d7/f9f 846257 0 2024-04-26T11:46:42.405 INFO:tasks.workunit.client.0.smithi029.stdout:0/888: dread d9/d16/f28 [0,4194304] 0 2024-04-26T11:46:42.405 INFO:tasks.workunit.client.0.smithi029.stdout:5/933: sync 2024-04-26T11:46:42.406 INFO:tasks.workunit.client.0.smithi029.stdout:0/889: rmdir d9/d16/d25/ddc 39 2024-04-26T11:46:42.407 INFO:tasks.workunit.client.0.smithi029.stdout:3/888: dwrite d0/d1/d41/ff6 [0,4194304] 0 2024-04-26T11:46:42.408 INFO:tasks.workunit.client.0.smithi029.stdout:5/934: symlink db/de3/df3/d120/l131 0 2024-04-26T11:46:42.408 INFO:tasks.workunit.client.0.smithi029.stdout:8/903: write dc/de/d26/f69 [1605508,90756] 0 2024-04-26T11:46:42.409 INFO:tasks.workunit.client.0.smithi029.stdout:4/886: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/f82 3393068 0 2024-04-26T11:46:42.409 INFO:tasks.workunit.client.0.smithi029.stdout:9/955: dwrite d4/d49/d58/d67/f69 [0,4194304] 0 2024-04-26T11:46:42.410 INFO:tasks.workunit.client.0.smithi029.stdout:0/890: write d9/d78/dc4/fd3 [4217522,51076] 0 2024-04-26T11:46:42.411 INFO:tasks.workunit.client.0.smithi029.stdout:5/935: unlink db/d40/d70/de8/f5f 0 2024-04-26T11:46:42.413 INFO:tasks.workunit.client.0.smithi029.stdout:9/956: creat d4/d49/d7d/d12c/dc6/f130 x:0 0 0 2024-04-26T11:46:42.413 INFO:tasks.workunit.client.0.smithi029.stdout:4/887: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/dc8/d11b 0 2024-04-26T11:46:42.414 INFO:tasks.workunit.client.0.smithi029.stdout:8/904: rename dc/de/d2e/d23/d27/d6f/d9b/d43/da1/f61 to dc/de/d2e/d23/df9/f142 0 2024-04-26T11:46:42.414 INFO:tasks.workunit.client.0.smithi029.stdout:3/889: write d0/d1/d2b/d33/f74 [1675811,108877] 0 2024-04-26T11:46:42.414 INFO:tasks.workunit.client.0.smithi029.stdout:4/888: chown d3/d1d/f89 1097 1 2024-04-26T11:46:42.418 INFO:tasks.workunit.client.0.smithi029.stdout:5/936: rename db/d40/d4d/d79/dc8/l104 to db/de3/df3/l132 0 2024-04-26T11:46:42.420 INFO:tasks.workunit.client.0.smithi029.stdout:5/937: stat db/d40/d77/fd4 0 2024-04-26T11:46:42.420 INFO:tasks.workunit.client.0.smithi029.stdout:3/890: unlink d0/d1/d5c/d103/de3/de7/f11c 0 2024-04-26T11:46:42.420 INFO:tasks.workunit.client.0.smithi029.stdout:9/957: rmdir d4/d49/d7d/d12c/d123/d12f 0 2024-04-26T11:46:42.420 INFO:tasks.workunit.client.0.smithi029.stdout:3/891: sync 2024-04-26T11:46:42.420 INFO:tasks.workunit.client.0.smithi029.stdout:8/905: rename dc/de/d26/d57/d86 to dc/de/d2e/d23/d8d/de1/d143 0 2024-04-26T11:46:42.420 INFO:tasks.workunit.client.0.smithi029.stdout:3/892: mknod d0/d112/c12e 1 2024-04-26T11:46:42.421 INFO:tasks.workunit.client.0.smithi029.stdout:5/938: symlink db/de3/l133 0 2024-04-26T11:46:42.421 INFO:tasks.workunit.client.0.smithi029.stdout:8/906: mknod dc/de/d103/d7c/dfc/c144 1 2024-04-26T11:46:42.421 INFO:tasks.workunit.client.0.smithi029.stdout:4/889: rename d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f6d to d3/d50/f11c 0 2024-04-26T11:46:42.421 INFO:tasks.workunit.client.0.smithi029.stdout:9/958: dread d4/d5/d16/f5b [0,4194304] 0 2024-04-26T11:46:42.421 INFO:tasks.workunit.client.0.smithi029.stdout:3/893: creat d0/d1/d41/d4c/dee/d12c/f12f x:0 0 0 2024-04-26T11:46:42.421 INFO:tasks.workunit.client.0.smithi029.stdout:9/959: write d4/d5/d16/f19 [2144564,113573] 0 2024-04-26T11:46:42.421 INFO:tasks.workunit.client.0.smithi029.stdout:4/890: truncate d3/d1d/d11/d16/d1f/d3d/fcf 1902024 0 2024-04-26T11:46:42.421 INFO:tasks.workunit.client.0.smithi029.stdout:9/960: write d4/d5/d78/f7c [2926409,72187] 0 2024-04-26T11:46:42.422 INFO:tasks.workunit.client.0.smithi029.stdout:9/961: symlink d4/l131 0 2024-04-26T11:46:42.422 INFO:tasks.workunit.client.0.smithi029.stdout:4/891: mkdir d3/d1d/d11/d16/d1f/d3d/d11d 0 2024-04-26T11:46:42.422 INFO:tasks.workunit.client.0.smithi029.stdout:4/892: mknod d3/d1d/db/d13/d23/c11e 1 2024-04-26T11:46:42.423 INFO:tasks.workunit.client.0.smithi029.stdout:0/891: truncate d9/d16/de7/f110 761192 0 2024-04-26T11:46:42.423 INFO:tasks.workunit.client.0.smithi029.stdout:3/894: rename d0/d1/d5c/d103/de3 to d0/d1/d2b/d7e/d130 0 2024-04-26T11:46:42.424 INFO:tasks.workunit.client.0.smithi029.stdout:4/893: chown d3/d1d/db/d13/d23/d2b/d9d/lf7 127594 1 2024-04-26T11:46:42.425 INFO:tasks.workunit.client.0.smithi029.stdout:4/894: stat d3/d1d/d11/d16/d1f/d3d/d46 0 2024-04-26T11:46:42.426 INFO:tasks.workunit.client.0.smithi029.stdout:3/895: symlink d0/d1/d5c/d103/d1a/d3b/db5/d10a/d12b/l131 0 2024-04-26T11:46:42.426 INFO:tasks.workunit.client.0.smithi029.stdout:0/892: rename d9/d16/d25/d2a/lba to d9/d16/d25/d2a/d46/l13d 0 2024-04-26T11:46:42.427 INFO:tasks.workunit.client.0.smithi029.stdout:3/896: creat d0/d112/f132 x:0 0 0 2024-04-26T11:46:42.428 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:42.425+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:42.428 INFO:tasks.workunit.client.0.smithi029.stdout:4/895: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/f11f x:0 0 0 2024-04-26T11:46:42.428 INFO:tasks.workunit.client.0.smithi029.stdout:8/907: write f0 [11324152,118733] 0 2024-04-26T11:46:42.430 INFO:tasks.workunit.client.0.smithi029.stdout:9/962: dwrite d4/d5/f11a [0,4194304] 0 2024-04-26T11:46:42.431 INFO:tasks.workunit.client.0.smithi029.stdout:8/908: write dc/de/d2e/d23/d8d/de1/d143/d90/de8/f132 [151274,63059] 0 2024-04-26T11:46:42.434 INFO:tasks.workunit.client.0.smithi029.stdout:5/939: truncate db/d40/d70/de8/f88 1173952 0 2024-04-26T11:46:42.434 INFO:tasks.workunit.client.0.smithi029.stdout:9/963: creat d4/d5/d78/d102/f132 x:0 0 0 2024-04-26T11:46:42.434 INFO:tasks.workunit.client.0.smithi029.stdout:5/940: rename db to db/d40/dd6/d134 22 2024-04-26T11:46:42.435 INFO:tasks.workunit.client.0.smithi029.stdout:8/909: write dc/de/d26/d57/fb0 [2288935,124506] 0 2024-04-26T11:46:42.436 INFO:tasks.workunit.client.0.smithi029.stdout:8/910: sync 2024-04-26T11:46:42.436 INFO:tasks.workunit.client.0.smithi029.stdout:5/941: mknod db/d40/d4d/d79/d113/c135 1 2024-04-26T11:46:42.436 INFO:tasks.workunit.client.0.smithi029.stdout:5/942: sync 2024-04-26T11:46:42.436 INFO:tasks.workunit.client.0.smithi029.stdout:0/893: dwrite d9/d16/f89 [0,4194304] 0 2024-04-26T11:46:42.437 INFO:tasks.workunit.client.0.smithi029.stdout:9/964: mkdir d4/d5/d7a/d10c/d133 0 2024-04-26T11:46:42.438 INFO:tasks.workunit.client.0.smithi029.stdout:8/911: rmdir dc/de/d2e/d23/d8d/de1/d143/d90/de8 39 2024-04-26T11:46:42.438 INFO:tasks.workunit.client.0.smithi029.stdout:9/965: dread - d4/d5/d7a/d10c/d129/de1/f125 zero size 2024-04-26T11:46:42.439 INFO:tasks.workunit.client.0.smithi029.stdout:0/894: mknod d9/d16/d33/d2f/d32/d9f/de6/d11f/c13e 1 2024-04-26T11:46:42.440 INFO:tasks.workunit.client.0.smithi029.stdout:9/966: rmdir d4/d5/d7/d74 39 2024-04-26T11:46:42.440 INFO:tasks.workunit.client.0.smithi029.stdout:8/912: write dc/d9f/db2/fc6 [1819515,109382] 0 2024-04-26T11:46:42.441 INFO:tasks.workunit.client.0.smithi029.stdout:0/895: rename d9/l17 to d9/d16/d33/d2f/d32/l13f 0 2024-04-26T11:46:42.441 INFO:tasks.workunit.client.0.smithi029.stdout:9/967: mkdir d4/d5/d7a/d10c/d129/de1/d134 0 2024-04-26T11:46:42.442 INFO:tasks.workunit.client.0.smithi029.stdout:0/896: dread - d9/d16/d25/d2a/d74/d9a/fd5 zero size 2024-04-26T11:46:42.443 INFO:tasks.workunit.client.0.smithi029.stdout:0/897: mknod d9/d16/d33/d2f/d32/d9f/db7/c140 1 2024-04-26T11:46:42.444 INFO:tasks.workunit.client.0.smithi029.stdout:0/898: symlink d9/d16/d33/d2f/d68/l141 0 2024-04-26T11:46:42.446 INFO:tasks.workunit.client.0.smithi029.stdout:0/899: creat d9/d16/d25/d2a/d4b/d13c/f142 x:0 0 0 2024-04-26T11:46:42.449 INFO:tasks.workunit.client.0.smithi029.stdout:8/913: dwrite dc/de/d2e/d23/d27/d6f/f13d [0,4194304] 0 2024-04-26T11:46:42.451 INFO:tasks.workunit.client.0.smithi029.stdout:3/897: truncate d0/d1/d41/d4c/fec 3091811 0 2024-04-26T11:46:42.452 INFO:tasks.workunit.client.0.smithi029.stdout:8/914: link dc/de/d2e/l8b dc/de/d2e/l145 0 2024-04-26T11:46:42.452 INFO:tasks.workunit.client.0.smithi029.stdout:3/898: readlink d0/d1/d2f/l97 0 2024-04-26T11:46:42.453 INFO:tasks.workunit.client.0.smithi029.stdout:8/915: mknod dc/de/d2e/d23/d27/d6f/dc8/c146 1 2024-04-26T11:46:42.456 INFO:tasks.workunit.client.0.smithi029.stdout:8/916: truncate dc/de/dd0/d108/f11f 839668 0 2024-04-26T11:46:42.456 INFO:tasks.workunit.client.0.smithi029.stdout:9/968: write d4/d49/f93 [577323,57247] 0 2024-04-26T11:46:42.457 INFO:tasks.workunit.client.0.smithi029.stdout:0/900: dwrite d9/d16/d25/db4/f133 [0,4194304] 0 2024-04-26T11:46:42.457 INFO:tasks.workunit.client.0.smithi029.stdout:8/917: stat dc/de/d2e/d23/d27/d6f/fed 0 2024-04-26T11:46:42.458 INFO:tasks.workunit.client.0.smithi029.stdout:8/918: sync 2024-04-26T11:46:42.458 INFO:tasks.workunit.client.0.smithi029.stdout:9/969: chown d4/d5/d16/d80/f92 6978 1 2024-04-26T11:46:42.460 INFO:tasks.workunit.client.0.smithi029.stdout:5/943: dread db/d12/d1a/f19 [0,4194304] 0 2024-04-26T11:46:42.461 INFO:tasks.workunit.client.0.smithi029.stdout:3/899: truncate d0/d1/d2b/d33/f8c 2505453 0 2024-04-26T11:46:42.463 INFO:tasks.workunit.client.0.smithi029.stdout:9/970: mkdir d4/d5/d16/d39/dc5/d106/d135 0 2024-04-26T11:46:42.463 INFO:tasks.workunit.client.0.smithi029.stdout:8/919: write dc/de/d2e/d23/d8d/de1/d143/f117 [3022561,9812] 0 2024-04-26T11:46:42.463 INFO:tasks.workunit.client.0.smithi029.stdout:5/944: creat db/d40/d4d/d79/d108/f136 x:0 0 0 2024-04-26T11:46:42.464 INFO:tasks.workunit.client.0.smithi029.stdout:9/971: write d4/d49/f6a [3401660,39147] 0 2024-04-26T11:46:42.465 INFO:tasks.workunit.client.0.smithi029.stdout:8/920: readlink dc/de/d26/d57/lf2 0 2024-04-26T11:46:42.467 INFO:tasks.workunit.client.0.smithi029.stdout:8/921: rmdir dc/de/d2e 39 2024-04-26T11:46:42.468 INFO:tasks.workunit.client.0.smithi029.stdout:9/972: rename d4/d49/d7d/d12c/f122 to d4/d5/d7a/f136 0 2024-04-26T11:46:42.469 INFO:tasks.workunit.client.0.smithi029.stdout:0/901: dwrite d9/d16/d33/d2f/d68/f105 [0,4194304] 0 2024-04-26T11:46:42.469 INFO:tasks.workunit.client.0.smithi029.stdout:0/902: readlink l8 0 2024-04-26T11:46:42.469 INFO:tasks.workunit.client.0.smithi029.stdout:3/900: dread d0/d1/f5d [0,4194304] 0 2024-04-26T11:46:42.470 INFO:tasks.workunit.client.0.smithi029.stdout:9/973: mknod d4/d5/d7a/db0/df6/c137 1 2024-04-26T11:46:42.471 INFO:tasks.workunit.client.0.smithi029.stdout:9/974: stat d4/d5/d7a/dbd 0 2024-04-26T11:46:42.471 INFO:tasks.workunit.client.0.smithi029.stdout:8/922: rename dc/de/dd0/d108/d139 to dc/de/d2e/d23/df9/d147 0 2024-04-26T11:46:42.472 INFO:tasks.workunit.client.0.smithi029.stdout:8/923: dread dc/d3b/f109 [0,4194304] 0 2024-04-26T11:46:42.473 INFO:tasks.workunit.client.0.smithi029.stdout:9/975: creat d4/d49/d7d/d12c/d123/d128/f138 x:0 0 0 2024-04-26T11:46:42.474 INFO:tasks.workunit.client.0.smithi029.stdout:5/945: dwrite db/d12/d72/d39/d3b/f5e [0,4194304] 0 2024-04-26T11:46:42.475 INFO:tasks.workunit.client.0.smithi029.stdout:8/924: getdents dc/de/d2e/d23/df9/d101/d12c 0 2024-04-26T11:46:42.475 INFO:tasks.workunit.client.0.smithi029.stdout:9/976: mknod d4/d5/d16/d39/dc5/d106/d135/c139 1 2024-04-26T11:46:42.476 INFO:tasks.workunit.client.0.smithi029.stdout:5/946: mkdir db/d40/d4d/d4f/d73/d12d/d137 0 2024-04-26T11:46:42.477 INFO:tasks.workunit.client.0.smithi029.stdout:8/925: chown dc/de/l25 0 1 2024-04-26T11:46:42.477 INFO:tasks.workunit.client.0.smithi029.stdout:4/896: dread d3/f8d [0,4194304] 0 2024-04-26T11:46:42.478 INFO:tasks.workunit.client.0.smithi029.stdout:9/977: creat d4/d49/f13a x:0 0 0 2024-04-26T11:46:42.479 INFO:tasks.workunit.client.0.smithi029.stdout:5/947: mkdir db/da6/d114/d138 0 2024-04-26T11:46:42.479 INFO:tasks.workunit.client.0.smithi029.stdout:8/926: creat dc/de/d2e/d23/d27/d6f/d9b/d43/dad/f148 x:0 0 0 2024-04-26T11:46:42.479 INFO:tasks.workunit.client.0.smithi029.stdout:5/948: chown db/ffe 7 1 2024-04-26T11:46:42.479 INFO:tasks.workunit.client.0.smithi029.stdout:0/903: dwrite d9/d16/d25/db4/ff2 [0,4194304] 0 2024-04-26T11:46:42.480 INFO:tasks.workunit.client.0.smithi029.stdout:9/978: write d4/d5/d7/d74/fe8 [261024,118616] 0 2024-04-26T11:46:42.481 INFO:tasks.workunit.client.0.smithi029.stdout:8/927: creat dc/de/d26/f149 x:0 0 0 2024-04-26T11:46:42.481 INFO:tasks.workunit.client.0.smithi029.stdout:5/949: truncate db/da6/fae 983204 0 2024-04-26T11:46:42.482 INFO:tasks.workunit.client.0.smithi029.stdout:0/904: write d9/d16/d25/d2a/d46/f64 [736892,117074] 0 2024-04-26T11:46:42.482 INFO:tasks.workunit.client.0.smithi029.stdout:5/950: chown db/d40/dd6/d101 13933 1 2024-04-26T11:46:42.483 INFO:tasks.workunit.client.0.smithi029.stdout:8/928: rename dc/de/f9d to dc/de/d26/d57/f14a 0 2024-04-26T11:46:42.483 INFO:tasks.workunit.client.0.smithi029.stdout:9/979: rmdir d4/d5/d7a/db0/df6 0 2024-04-26T11:46:42.483 INFO:tasks.workunit.client.0.smithi029.stdout:5/951: chown db/d40/f61 17413 1 2024-04-26T11:46:42.483 INFO:tasks.workunit.client.0.smithi029.stdout:0/905: write d9/d16/d52/f2c [33759,11671] 0 2024-04-26T11:46:42.484 INFO:tasks.workunit.client.0.smithi029.stdout:5/952: creat db/d12/d72/d92/f139 x:0 0 0 2024-04-26T11:46:42.484 INFO:tasks.workunit.client.0.smithi029.stdout:8/929: chown dc/de/d2e/d23/d8d/de1/d143/dc0/fc1 21 1 2024-04-26T11:46:42.485 INFO:tasks.workunit.client.0.smithi029.stdout:0/906: read d9/f36 [3062573,14506] 0 2024-04-26T11:46:42.485 INFO:tasks.workunit.client.0.smithi029.stdout:5/953: mknod db/d12/d72/c13a 1 2024-04-26T11:46:42.485 INFO:tasks.workunit.client.0.smithi029.stdout:5/954: write db/d40/d4d/d4f/d73/d93/fe9 [1385041,63816] 0 2024-04-26T11:46:42.490 INFO:tasks.workunit.client.0.smithi029.stdout:8/930: dwrite dc/de/d103/d6a/d78/dc3/f12f [0,4194304] 0 2024-04-26T11:46:42.492 INFO:tasks.workunit.client.0.smithi029.stdout:8/931: unlink dc/de/l7b 0 2024-04-26T11:46:42.493 INFO:tasks.workunit.client.0.smithi029.stdout:8/932: stat dc/de/d2e/d23/d27/d6f/d9b/l72 0 2024-04-26T11:46:42.494 INFO:tasks.workunit.client.0.smithi029.stdout:4/897: dwrite d3/d1d/d11/fa2 [4194304,4194304] 0 2024-04-26T11:46:42.494 INFO:tasks.workunit.client.0.smithi029.stdout:8/933: stat dc/de/d2e/d23/d27/d6f/d9b/da2/fd6 0 2024-04-26T11:46:42.495 INFO:tasks.workunit.client.0.smithi029.stdout:4/898: symlink d3/d1d/d11/d16/d71/l120 0 2024-04-26T11:46:42.495 INFO:tasks.workunit.client.0.smithi029.stdout:8/934: truncate dc/f66 3665559 0 2024-04-26T11:46:42.497 INFO:tasks.workunit.client.0.smithi029.stdout:4/899: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/fab [966762,47365] 0 2024-04-26T11:46:42.498 INFO:tasks.workunit.client.0.smithi029.stdout:4/900: fsync d3/d1d/db/d13/d23/d2b/f9a 0 2024-04-26T11:46:42.501 INFO:tasks.workunit.client.0.smithi029.stdout:4/901: dread - d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/fd6 zero size 2024-04-26T11:46:42.505 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:42.505 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:42.507 INFO:tasks.workunit.client.0.smithi029.stdout:4/902: dwrite d3/d1d/d11/d16/f57 [0,4194304] 0 2024-04-26T11:46:42.509 INFO:tasks.workunit.client.0.smithi029.stdout:0/907: truncate d9/f84 830017 0 2024-04-26T11:46:42.509 INFO:tasks.workunit.client.0.smithi029.stdout:5/955: truncate db/d12/d72/d92/ff1 1627303 0 2024-04-26T11:46:42.511 INFO:tasks.workunit.client.0.smithi029.stdout:5/956: creat db/d40/dd6/def/f13b x:0 0 0 2024-04-26T11:46:42.512 INFO:tasks.workunit.client.0.smithi029.stdout:0/908: rename d9/d43/l92 to d9/d16/d25/d2a/l143 0 2024-04-26T11:46:42.512 INFO:tasks.workunit.client.0.smithi029.stdout:8/935: write dc/d3b/f5a [260321,23895] 0 2024-04-26T11:46:42.513 INFO:tasks.workunit.client.0.smithi029.stdout:5/957: mkdir db/d40/dd6/d13c 0 2024-04-26T11:46:42.514 INFO:tasks.workunit.client.0.smithi029.stdout:4/903: truncate d3/f31 4822064 0 2024-04-26T11:46:42.515 INFO:tasks.workunit.client.0.smithi029.stdout:9/980: dwrite d4/d5/d16/f1c [0,4194304] 0 2024-04-26T11:46:42.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:42.518 INFO:tasks.workunit.client.0.smithi029.stdout:4/904: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/c121 1 2024-04-26T11:46:42.518 INFO:tasks.workunit.client.0.smithi029.stdout:3/901: dread d0/d1/d2b/d33/f66 [0,4194304] 0 2024-04-26T11:46:42.518 INFO:tasks.workunit.client.0.smithi029.stdout:5/958: symlink db/d40/d4d/d79/d113/l13d 0 2024-04-26T11:46:42.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/981: write d4/d49/d58/f53 [2574602,25667] 0 2024-04-26T11:46:42.519 INFO:tasks.workunit.client.0.smithi029.stdout:3/902: creat d0/d1/d2f/dd8/f133 x:0 0 0 2024-04-26T11:46:42.519 INFO:tasks.workunit.client.0.smithi029.stdout:3/903: sync 2024-04-26T11:46:42.519 INFO:tasks.workunit.client.0.smithi029.stdout:5/959: unlink db/d40/d70/de8/f58 0 2024-04-26T11:46:42.520 INFO:tasks.workunit.client.0.smithi029.stdout:5/960: stat db/d12/d6b/lc7 0 2024-04-26T11:46:42.520 INFO:tasks.workunit.client.0.smithi029.stdout:9/982: unlink d4/f64 0 2024-04-26T11:46:42.521 INFO:tasks.workunit.client.0.smithi029.stdout:9/983: sync 2024-04-26T11:46:42.521 INFO:tasks.workunit.client.0.smithi029.stdout:9/984: dread - d4/d49/fdb zero size 2024-04-26T11:46:42.522 INFO:tasks.workunit.client.0.smithi029.stdout:3/904: link d0/d1/d2b/d7e/d130/l121 d0/d1/d41/d4c/l134 0 2024-04-26T11:46:42.524 INFO:tasks.workunit.client.0.smithi029.stdout:3/905: creat d0/d1/d41/d4c/dee/d12c/f135 x:0 0 0 2024-04-26T11:46:42.524 INFO:tasks.workunit.client.0.smithi029.stdout:4/905: dread d3/f8d [0,4194304] 0 2024-04-26T11:46:42.524 INFO:tasks.workunit.client.0.smithi029.stdout:5/961: link db/d40/d4d/d79/l7f db/d40/d4d/d4f/d73/d12d/d137/l13e 0 2024-04-26T11:46:42.524 INFO:tasks.workunit.client.0.smithi029.stdout:8/936: dread dc/de/d2e/d23/d8d/de1/f104 [0,4194304] 0 2024-04-26T11:46:42.526 INFO:tasks.workunit.client.0.smithi029.stdout:3/906: getdents d0/d1/d2b/d7e/d130/de7 0 2024-04-26T11:46:42.526 INFO:tasks.workunit.client.0.smithi029.stdout:8/937: readlink dc/de/d2e/d23/d27/d6f/d9b/d43/lc7 0 2024-04-26T11:46:42.527 INFO:tasks.workunit.client.0.smithi029.stdout:8/938: readlink dc/de/d2e/d23/df9/d101/d136/ddd/l140 0 2024-04-26T11:46:42.528 INFO:tasks.workunit.client.0.smithi029.stdout:8/939: chown dc/de/d2e/d23/fe2 2 1 2024-04-26T11:46:42.528 INFO:tasks.workunit.client.0.smithi029.stdout:3/907: link d0/d1/d2b/d7e/d107/d9a/lb1 d0/d1/d5c/d103/d1a/d3b/db5/d10a/d12b/l136 0 2024-04-26T11:46:42.529 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:42.524+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:42.529 INFO:tasks.workunit.client.0.smithi029.stdout:8/940: creat dc/d9f/db2/f14b x:0 0 0 2024-04-26T11:46:42.529 INFO:tasks.workunit.client.0.smithi029.stdout:3/908: mkdir d0/d1/d2b/d7e/d130/de7/d137 0 2024-04-26T11:46:42.530 INFO:tasks.workunit.client.0.smithi029.stdout:9/985: write d4/d5/d16/d39/f3d [1688851,84266] 0 2024-04-26T11:46:42.530 INFO:tasks.workunit.client.0.smithi029.stdout:3/909: mknod d0/d1/d5c/d103/d1a/c138 1 2024-04-26T11:46:42.533 INFO:tasks.workunit.client.0.smithi029.stdout:9/986: rmdir d4/d5/d16/d39/dc5/d106 39 2024-04-26T11:46:42.537 INFO:tasks.workunit.client.0.smithi029.stdout:8/941: dwrite dc/d3b/f41 [0,4194304] 0 2024-04-26T11:46:42.539 INFO:tasks.workunit.client.0.smithi029.stdout:8/942: mkdir dc/d3b/d14c 0 2024-04-26T11:46:42.539 INFO:tasks.workunit.client.0.smithi029.stdout:3/910: dwrite d0/d1/d5c/f9c [0,4194304] 0 2024-04-26T11:46:42.541 INFO:tasks.workunit.client.0.smithi029.stdout:0/909: dread d9/d16/d25/d2a/d4b/dde/fe1 [0,4194304] 0 2024-04-26T11:46:42.543 INFO:tasks.workunit.client.0.smithi029.stdout:3/911: symlink d0/d1/d2f/d82/dc3/dc7/l139 0 2024-04-26T11:46:42.544 INFO:tasks.workunit.client.0.smithi029.stdout:0/910: mknod d9/d16/d25/d2a/d4b/dd9/c144 1 2024-04-26T11:46:42.545 INFO:tasks.workunit.client.0.smithi029.stdout:8/943: link dc/d3b/lf5 dc/de/d2e/d23/d27/d6f/d9b/d43/dad/d121/l14d 0 2024-04-26T11:46:42.546 INFO:tasks.workunit.client.0.smithi029.stdout:9/987: dwrite d4/d5/d16/d80/dc2/f107 [0,4194304] 0 2024-04-26T11:46:42.547 INFO:tasks.workunit.client.0.smithi029.stdout:8/944: mkdir dc/de/d14e 0 2024-04-26T11:46:42.547 INFO:tasks.workunit.client.0.smithi029.stdout:3/912: rename d0/d1/d2b/d7e/d107/d9a to d0/d1/d41/d4c/dee/d13a 0 2024-04-26T11:46:42.549 INFO:tasks.workunit.client.0.smithi029.stdout:3/913: creat d0/d1/d2f/d82/dc3/dc7/f13b x:0 0 0 2024-04-26T11:46:42.550 INFO:tasks.workunit.client.0.smithi029.stdout:9/988: truncate d4/fb1 889275 0 2024-04-26T11:46:42.552 INFO:tasks.workunit.client.0.smithi029.stdout:9/989: rename d4/d5/d16/d39/f63 to d4/d5/d16/d80/dc2/f13b 0 2024-04-26T11:46:42.554 INFO:tasks.workunit.client.0.smithi029.stdout:0/911: dwrite d9/d16/d33/d2f/d68/f79 [4194304,4194304] 0 2024-04-26T11:46:42.555 INFO:tasks.workunit.client.0.smithi029.stdout:5/962: dread db/d40/f61 [0,4194304] 0 2024-04-26T11:46:42.556 INFO:tasks.workunit.client.0.smithi029.stdout:0/912: getdents d9/d78/dc4 0 2024-04-26T11:46:42.557 INFO:tasks.workunit.client.0.smithi029.stdout:5/963: creat db/d12/d72/d39/dfb/f13f x:0 0 0 2024-04-26T11:46:42.557 INFO:tasks.workunit.client.0.smithi029.stdout:4/906: dread d3/d50/db4/ffc [0,4194304] 0 2024-04-26T11:46:42.558 INFO:tasks.workunit.client.0.smithi029.stdout:5/964: mknod db/d40/d70/c140 1 2024-04-26T11:46:42.558 INFO:tasks.workunit.client.0.smithi029.stdout:4/907: creat d3/dba/f122 x:0 0 0 2024-04-26T11:46:42.562 INFO:tasks.workunit.client.0.smithi029.stdout:4/908: sync 2024-04-26T11:46:42.562 INFO:tasks.workunit.client.0.smithi029.stdout:0/913: creat d9/d16/d25/d2a/d74/d9a/f145 x:0 0 0 2024-04-26T11:46:42.563 INFO:tasks.workunit.client.0.smithi029.stdout:8/945: truncate dc/de/d2e/d23/d27/d6f/dc8/f116 2099088 0 2024-04-26T11:46:42.563 INFO:tasks.workunit.client.0.smithi029.stdout:9/990: write d4/d5/d16/f5b [745995,11354] 0 2024-04-26T11:46:42.563 INFO:tasks.workunit.client.0.smithi029.stdout:8/946: chown dc/de/d2e/d23/d27/d6f/d9b 1961718761 1 2024-04-26T11:46:42.563 INFO:tasks.workunit.client.0.smithi029.stdout:4/909: dread - d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/f11f zero size 2024-04-26T11:46:42.564 INFO:tasks.workunit.client.0.smithi029.stdout:5/965: truncate db/d12/d72/f21 2738857 0 2024-04-26T11:46:42.564 INFO:tasks.workunit.client.0.smithi029.stdout:9/991: creat d4/d49/d7d/d12c/dc6/f13c x:0 0 0 2024-04-26T11:46:42.564 INFO:tasks.workunit.client.0.smithi029.stdout:4/910: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d105/c123 1 2024-04-26T11:46:42.564 INFO:tasks.workunit.client.0.smithi029.stdout:5/966: symlink db/d89/l141 0 2024-04-26T11:46:42.564 INFO:tasks.workunit.client.0.smithi029.stdout:9/992: creat d4/d5/d16/d80/dc2/f13d x:0 0 0 2024-04-26T11:46:42.564 INFO:tasks.workunit.client.0.smithi029.stdout:8/947: rename dc/de/dd0/d108/f112 to dc/de/d26/f14f 0 2024-04-26T11:46:42.566 INFO:tasks.workunit.client.0.smithi029.stdout:4/911: truncate d3/d1d/ff2 450024 0 2024-04-26T11:46:42.566 INFO:tasks.workunit.client.0.smithi029.stdout:9/993: rmdir d4/d5/d7a/d10c/d133 0 2024-04-26T11:46:42.566 INFO:tasks.workunit.client.0.smithi029.stdout:8/948: write dc/f10e [1086417,129360] 0 2024-04-26T11:46:42.566 INFO:tasks.workunit.client.0.smithi029.stdout:3/914: dread d0/d1/d5c/d103/d1a/f3d [4194304,4194304] 0 2024-04-26T11:46:42.566 INFO:tasks.workunit.client.0.smithi029.stdout:8/949: chown dc/de/d26/d57 123 1 2024-04-26T11:46:42.567 INFO:tasks.workunit.client.0.smithi029.stdout:4/912: fdatasync d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/fb2 0 2024-04-26T11:46:42.567 INFO:tasks.workunit.client.0.smithi029.stdout:9/994: creat d4/d5/d16/d80/dc9/f13e x:0 0 0 2024-04-26T11:46:42.568 INFO:tasks.workunit.client.0.smithi029.stdout:4/913: mkdir d3/d50/d101/d124 0 2024-04-26T11:46:42.569 INFO:tasks.workunit.client.0.smithi029.stdout:0/914: dwrite d9/d16/d33/ff9 [0,4194304] 0 2024-04-26T11:46:42.570 INFO:tasks.workunit.client.0.smithi029.stdout:3/915: write d0/d1/d5c/d103/d54/fb6 [171935,58270] 0 2024-04-26T11:46:42.571 INFO:tasks.workunit.client.0.smithi029.stdout:9/995: truncate d4/d5/d16/d39/f3d 2324226 0 2024-04-26T11:46:42.571 INFO:tasks.workunit.client.0.smithi029.stdout:9/996: sync 2024-04-26T11:46:42.571 INFO:tasks.workunit.client.0.smithi029.stdout:8/950: symlink dc/de/d2e/d23/d27/d6f/d9b/d43/dad/l150 0 2024-04-26T11:46:42.572 INFO:tasks.workunit.client.0.smithi029.stdout:4/914: write d3/d1d/db/d13/d23/d2b/f9a [1950222,43412] 0 2024-04-26T11:46:42.572 INFO:tasks.workunit.client.0.smithi029.stdout:3/916: creat d0/d1/d5c/f13c x:0 0 0 2024-04-26T11:46:42.572 INFO:tasks.workunit.client.0.smithi029.stdout:5/967: dwrite f4 [4194304,4194304] 0 2024-04-26T11:46:42.572 INFO:tasks.workunit.client.0.smithi029.stdout:8/951: fdatasync dc/de/d26/f113 0 2024-04-26T11:46:42.573 INFO:tasks.workunit.client.0.smithi029.stdout:0/915: mkdir d9/d16/d33/d2f/d32/d9f/d146 0 2024-04-26T11:46:42.573 INFO:tasks.workunit.client.0.smithi029.stdout:9/997: write d4/d49/d7d/fda [9402369,101484] 0 2024-04-26T11:46:42.574 INFO:tasks.workunit.client.0.smithi029.stdout:5/968: getdents db/d40/dd6/d101/d12f 0 2024-04-26T11:46:42.574 INFO:tasks.workunit.client.0.smithi029.stdout:0/916: stat d9/d16/d25/d2a/d46/l96 0 2024-04-26T11:46:42.575 INFO:tasks.workunit.client.0.smithi029.stdout:9/998: symlink d4/d5/de9/l13f 0 2024-04-26T11:46:42.576 INFO:tasks.workunit.client.0.smithi029.stdout:0/917: write d9/d16/d8d/f122 [710297,92160] 0 2024-04-26T11:46:42.577 INFO:tasks.workunit.client.0.smithi029.stdout:5/969: readlink db/d40/d4d/d4f/d73/d12d/d137/l13e 0 2024-04-26T11:46:42.577 INFO:tasks.workunit.client.0.smithi029.stdout:9/999: write d4/d49/d58/d67/ffa [1061914,103004] 0 2024-04-26T11:46:42.577 INFO:tasks.workunit.client.0.smithi029.stdout:4/915: truncate d3/d1d/d11/d16/d1f/d3d/d39/fb5 276175 0 2024-04-26T11:46:42.578 INFO:tasks.workunit.client.0.smithi029.stdout:5/970: link db/d40/d70/leb db/da6/d114/l142 0 2024-04-26T11:46:42.578 INFO:tasks.workunit.client.0.smithi029.stdout:0/918: mkdir d9/d16/d33/d2f/d32/d9f/dac/d147 0 2024-04-26T11:46:42.578 INFO:tasks.workunit.client.0.smithi029.stdout:4/916: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/d125 0 2024-04-26T11:46:42.579 INFO:tasks.workunit.client.0.smithi029.stdout:5/971: rename db/d12/d1a/f19 to db/d40/dd6/def/f143 0 2024-04-26T11:46:42.581 INFO:tasks.workunit.client.0.smithi029.stdout:5/972: truncate db/d12/d72/d39/d3b/d86/fc0 700594 0 2024-04-26T11:46:42.581 INFO:tasks.workunit.client.0.smithi029.stdout:8/952: read dc/de/d26/d6b/f7d [2521083,127799] 0 2024-04-26T11:46:42.582 INFO:tasks.workunit.client.0.smithi029.stdout:5/973: mknod db/d12/d72/d39/d3b/d86/c144 1 2024-04-26T11:46:42.583 INFO:tasks.workunit.client.0.smithi029.stdout:5/974: rmdir db/de3/df3/d120 39 2024-04-26T11:46:42.586 INFO:tasks.workunit.client.0.smithi029.stdout:8/953: getdents dc/de/d2e/d23/d8d/de1/d143/d90/de8/d114 0 2024-04-26T11:46:42.586 INFO:tasks.workunit.client.0.smithi029.stdout:5/975: link db/de3/led db/d40/dd6/d101/l145 0 2024-04-26T11:46:42.586 INFO:tasks.workunit.client.0.smithi029.stdout:0/919: dwrite d9/d16/de7/dff/f124 [0,4194304] 0 2024-04-26T11:46:42.586 INFO:tasks.workunit.client.0.smithi029.stdout:5/976: stat db/de3/l133 0 2024-04-26T11:46:42.588 INFO:tasks.workunit.client.0.smithi029.stdout:4/917: dread d3/d1d/db/d13/f9e [0,4194304] 0 2024-04-26T11:46:42.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/977: unlink db/d40/d4d/d4f/f128 0 2024-04-26T11:46:42.589 INFO:tasks.workunit.client.0.smithi029.stdout:0/920: link d9/d16/d33/f38 d9/d16/d25/d2a/d8e/dc7/f148 0 2024-04-26T11:46:42.589 INFO:tasks.workunit.client.0.smithi029.stdout:0/921: sync 2024-04-26T11:46:42.592 INFO:tasks.workunit.client.0.smithi029.stdout:0/922: truncate d9/d16/de7/d107/f4e 955342 0 2024-04-26T11:46:42.594 INFO:tasks.workunit.client.0.smithi029.stdout:0/923: symlink d9/d16/d33/d2f/l149 0 2024-04-26T11:46:42.594 INFO:tasks.workunit.client.0.smithi029.stdout:8/954: read dc/de/d2e/d23/d8d/de1/d143/dc0/fff [115154,125431] 0 2024-04-26T11:46:42.594 INFO:tasks.workunit.client.0.smithi029.stdout:3/917: dread d0/d1/d5c/d103/d1a/d3b/f4f [0,4194304] 0 2024-04-26T11:46:42.595 INFO:tasks.workunit.client.0.smithi029.stdout:0/924: rmdir d9/d16/d25/d2a/d4b/d13c 39 2024-04-26T11:46:42.596 INFO:tasks.workunit.client.0.smithi029.stdout:3/918: write d0/d1/f43 [4254163,74458] 0 2024-04-26T11:46:42.597 INFO:tasks.workunit.client.0.smithi029.stdout:8/955: chown dc/de/d2e/d23/df9/d101/d136/ddd/l140 2 1 2024-04-26T11:46:42.597 INFO:tasks.workunit.client.0.smithi029.stdout:5/978: dwrite db/d12/d1a/f6f [0,4194304] 0 2024-04-26T11:46:42.598 INFO:tasks.workunit.client.0.smithi029.stdout:5/979: stat db/d89/de0/ff2 0 2024-04-26T11:46:42.598 INFO:tasks.workunit.client.0.smithi029.stdout:5/980: sync 2024-04-26T11:46:42.598 INFO:tasks.workunit.client.0.smithi029.stdout:5/981: sync 2024-04-26T11:46:42.603 INFO:tasks.workunit.client.0.smithi029.stdout:0/925: rename d9/d16/d52/ffd to d9/d16/d33/d2f/d32/d9f/dac/f14a 0 2024-04-26T11:46:42.603 INFO:tasks.workunit.client.0.smithi029.stdout:5/982: rmdir db/d12/d72/d39/d3b 39 2024-04-26T11:46:42.603 INFO:tasks.workunit.client.0.smithi029.stdout:8/956: creat dc/d3b/dd2/f151 x:0 0 0 2024-04-26T11:46:42.603 INFO:tasks.workunit.client.0.smithi029.stdout:3/919: symlink d0/d1/d5c/d103/l13d 0 2024-04-26T11:46:42.603 INFO:tasks.workunit.client.0.smithi029.stdout:5/983: readlink db/d12/d6b/lc7 0 2024-04-26T11:46:42.603 INFO:tasks.workunit.client.0.smithi029.stdout:0/926: creat d9/d43/f14b x:0 0 0 2024-04-26T11:46:42.603 INFO:tasks.workunit.client.0.smithi029.stdout:3/920: write d0/d1/d2f/d82/dce/fd2 [728361,21583] 0 2024-04-26T11:46:42.603 INFO:tasks.workunit.client.0.smithi029.stdout:8/957: creat dc/de/d26/d57/dd1/f152 x:0 0 0 2024-04-26T11:46:42.604 INFO:tasks.workunit.client.0.smithi029.stdout:3/921: rmdir d0/d1/d5c/d103 39 2024-04-26T11:46:42.604 INFO:tasks.workunit.client.0.smithi029.stdout:8/958: unlink dc/de/d103/d6a/d119/l11d 0 2024-04-26T11:46:42.604 INFO:tasks.workunit.client.0.smithi029.stdout:4/918: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/fb6 [0,4194304] 0 2024-04-26T11:46:42.606 INFO:tasks.workunit.client.0.smithi029.stdout:3/922: rename d0/d1/d41/de0/lae to d0/d1/d2b/ddb/l13e 0 2024-04-26T11:46:42.607 INFO:tasks.workunit.client.0.smithi029.stdout:0/927: truncate d9/d16/d25/d2a/d8e/f130 1722857 0 2024-04-26T11:46:42.608 INFO:tasks.workunit.client.0.smithi029.stdout:8/959: rename dc/de/d103/d6a/d78/dc3/dcf to dc/de/d2e/d23/d27/d6f/d9b/d43/dad/d153 0 2024-04-26T11:46:42.608 INFO:tasks.workunit.client.0.smithi029.stdout:5/984: dread db/d40/d4d/d4f/d73/d93/fe9 [0,4194304] 0 2024-04-26T11:46:42.608 INFO:tasks.workunit.client.0.smithi029.stdout:3/923: fdatasync d0/d1/d41/d4c/dee/d9d/fcc 0 2024-04-26T11:46:42.609 INFO:tasks.workunit.client.0.smithi029.stdout:8/960: chown dc/de/d2e/d23/df9/d101/d136/fd9 8 1 2024-04-26T11:46:42.610 INFO:tasks.workunit.client.0.smithi029.stdout:5/985: symlink db/da6/df8/l146 0 2024-04-26T11:46:42.611 INFO:tasks.workunit.client.0.smithi029.stdout:5/986: readlink db/d12/d6b/da4/ldc 0 2024-04-26T11:46:42.612 INFO:tasks.workunit.client.0.smithi029.stdout:8/961: link dc/de/d2e/d23/d27/d6f/d9b/d43/f82 dc/de/d2e/f154 0 2024-04-26T11:46:42.613 INFO:tasks.workunit.client.0.smithi029.stdout:5/987: fdatasync db/d12/f5c 0 2024-04-26T11:46:42.614 INFO:tasks.workunit.client.0.smithi029.stdout:8/962: chown dc/d3b/f56 469 1 2024-04-26T11:46:42.616 INFO:tasks.workunit.client.0.smithi029.stdout:5/988: creat db/d12/f147 x:0 0 0 2024-04-26T11:46:42.618 INFO:tasks.workunit.client.0.smithi029.stdout:5/989: chown db/d40/dd6/d11f 75862743 1 2024-04-26T11:46:42.619 INFO:tasks.workunit.client.0.smithi029.stdout:0/928: dwrite d9/d16/d33/d2f/d68/f79 [4194304,4194304] 0 2024-04-26T11:46:42.619 INFO:tasks.workunit.client.0.smithi029.stdout:4/919: dwrite d3/d1d/d11/d16/d1f/d3d/fb3 [0,4194304] 0 2024-04-26T11:46:42.619 INFO:tasks.workunit.client.0.smithi029.stdout:8/963: write dc/de/d2e/d23/d27/d6f/fed [1495369,108497] 0 2024-04-26T11:46:42.620 INFO:tasks.workunit.client.0.smithi029.stdout:5/990: creat db/da6/df8/f148 x:0 0 0 2024-04-26T11:46:42.620 INFO:tasks.workunit.client.0.smithi029.stdout:3/924: dwrite d0/d1/d41/f10d [0,4194304] 0 2024-04-26T11:46:42.621 INFO:tasks.workunit.client.0.smithi029.stdout:8/964: stat dc/de/d2e/d23/d27/d6f/d9b/da2/fbb 0 2024-04-26T11:46:42.622 INFO:tasks.workunit.client.0.smithi029.stdout:3/925: chown d0/d1/d2b/d33/f74 411301892 1 2024-04-26T11:46:42.622 INFO:tasks.workunit.client.0.smithi029.stdout:0/929: truncate d9/d16/d25/d2a/d74/d9a/f145 497161 0 2024-04-26T11:46:42.623 INFO:tasks.workunit.client.0.smithi029.stdout:8/965: write dc/d9f/db2/f130 [961729,76084] 0 2024-04-26T11:46:42.628 INFO:tasks.workunit.client.0.smithi029.stdout:3/926: rename d0/d1/d5c/d103/d54/f58 to d0/d1/d5c/d103/d1a/d3b/db5/d10a/d12b/f13f 0 2024-04-26T11:46:42.629 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:42.624+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:42.630 INFO:tasks.workunit.client.0.smithi029.stdout:3/927: truncate d0/d1/ffd 89750 0 2024-04-26T11:46:42.630 INFO:tasks.workunit.client.0.smithi029.stdout:4/920: read d3/f78 [478377,128960] 0 2024-04-26T11:46:42.632 INFO:tasks.workunit.client.0.smithi029.stdout:3/928: creat d0/dc/d1f/d92/f140 x:0 0 0 2024-04-26T11:46:42.633 INFO:tasks.workunit.client.0.smithi029.stdout:5/991: dread db/d89/f103 [0,4194304] 0 2024-04-26T11:46:42.633 INFO:tasks.workunit.client.0.smithi029.stdout:4/921: getdents d3/d1d/db/dc0 0 2024-04-26T11:46:42.634 INFO:tasks.workunit.client.0.smithi029.stdout:8/966: dwrite dc/de/d26/d57/ff7 [0,4194304] 0 2024-04-26T11:46:42.635 INFO:tasks.workunit.client.0.smithi029.stdout:3/929: mkdir d0/d1/d41/d4c/dee/d12c/d141 0 2024-04-26T11:46:42.635 INFO:tasks.workunit.client.0.smithi029.stdout:5/992: creat db/d40/d4d/d79/f149 x:0 0 0 2024-04-26T11:46:42.637 INFO:tasks.workunit.client.0.smithi029.stdout:4/922: write d3/d1d/d11/d16/d1f/d3d/fb3 [389989,12218] 0 2024-04-26T11:46:42.637 INFO:tasks.workunit.client.0.smithi029.stdout:0/930: dwrite d9/d16/d33/d2f/d32/d9f/dac/f137 [0,4194304] 0 2024-04-26T11:46:42.637 INFO:tasks.workunit.client.0.smithi029.stdout:5/993: mknod db/d40/dd6/d13c/c14a 1 2024-04-26T11:46:42.637 INFO:tasks.workunit.client.0.smithi029.stdout:8/967: chown dc/de/d2e/d23/df9/f142 990 1 2024-04-26T11:46:42.637 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:42.637 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:42.638 INFO:tasks.workunit.client.0.smithi029.stdout:4/923: write d3/d1d/d11/fa2 [3495614,102028] 0 2024-04-26T11:46:42.641 INFO:tasks.workunit.client.0.smithi029.stdout:3/930: rename d0/d1/d2b/da7/dad/lac to d0/d1/d41/d4c/dee/l142 0 2024-04-26T11:46:42.641 INFO:tasks.workunit.client.0.smithi029.stdout:8/968: unlink dc/d3b/f40 0 2024-04-26T11:46:42.642 INFO:tasks.workunit.client.0.smithi029.stdout:5/994: rmdir db/d40/d4d/d4f/d73/d12d 39 2024-04-26T11:46:42.642 INFO:tasks.workunit.client.0.smithi029.stdout:0/931: mkdir d9/d16/d33/d2f/d32/d9f/d14c 0 2024-04-26T11:46:42.644 INFO:tasks.workunit.client.0.smithi029.stdout:4/924: symlink d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/dc8/l126 0 2024-04-26T11:46:42.644 INFO:tasks.workunit.client.0.smithi029.stdout:5/995: dread - db/d40/d4d/f12c zero size 2024-04-26T11:46:42.644 INFO:tasks.workunit.client.0.smithi029.stdout:3/931: truncate d0/d1/ffd 810585 0 2024-04-26T11:46:42.644 INFO:tasks.workunit.client.0.smithi029.stdout:8/969: write dc/d9f/db2/f130 [2426952,130189] 0 2024-04-26T11:46:42.645 INFO:tasks.workunit.client.0.smithi029.stdout:0/932: dread - d9/d16/d25/db4/f123 zero size 2024-04-26T11:46:42.645 INFO:tasks.workunit.client.0.smithi029.stdout:5/996: fdatasync db/d12/f147 0 2024-04-26T11:46:42.645 INFO:tasks.workunit.client.0.smithi029.stdout:3/932: creat d0/d1/d2b/da7/f143 x:0 0 0 2024-04-26T11:46:42.645 INFO:tasks.workunit.client.0.smithi029.stdout:8/970: fdatasync dc/de/d103/d7c/f141 0 2024-04-26T11:46:42.645 INFO:tasks.workunit.client.0.smithi029.stdout:5/997: chown db/d12/d1a/fc9 676832 1 2024-04-26T11:46:42.645 INFO:tasks.workunit.client.0.smithi029.stdout:0/933: symlink d9/d16/d25/d2a/d74/l14d 0 2024-04-26T11:46:42.647 INFO:tasks.workunit.client.0.smithi029.stdout:0/934: dread - d9/d16/d33/f10c zero size 2024-04-26T11:46:42.647 INFO:tasks.workunit.client.0.smithi029.stdout:3/933: readlink d0/d1/d2b/d7e/d130/l121 0 2024-04-26T11:46:42.647 INFO:tasks.workunit.client.0.smithi029.stdout:5/998: mkdir db/d40/d4d/d4f/d73/d12d/d137/d14b 0 2024-04-26T11:46:42.647 INFO:tasks.workunit.client.0.smithi029.stdout:8/971: rename dc/de/d26/f113 to dc/de/d2e/d23/d27/d6f/d9b/da2/f155 0 2024-04-26T11:46:42.649 INFO:tasks.workunit.client.0.smithi029.stdout:3/934: creat d0/d1/d41/d4c/dee/d13a/f144 x:0 0 0 2024-04-26T11:46:42.649 INFO:tasks.workunit.client.0.smithi029.stdout:8/972: symlink dc/de/d14e/l156 0 2024-04-26T11:46:42.649 INFO:tasks.workunit.client.0.smithi029.stdout:5/999: write db/d40/d4d/d4f/f8f [1855146,109590] 0 2024-04-26T11:46:42.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:42.652 INFO:tasks.workunit.client.0.smithi029.stdout:8/973: mkdir dc/d9f/db2/d157 0 2024-04-26T11:46:42.652 INFO:tasks.workunit.client.0.smithi029.stdout:8/974: chown dc/de/d2e/f154 12241349 1 2024-04-26T11:46:42.653 INFO:tasks.workunit.client.0.smithi029.stdout:8/975: fdatasync dc/de/d2e/f6e 0 2024-04-26T11:46:42.653 INFO:tasks.workunit.client.0.smithi029.stdout:4/925: dwrite d3/d1d/db/d13/d23/d2b/f9a [0,4194304] 0 2024-04-26T11:46:42.653 INFO:tasks.workunit.client.0.smithi029.stdout:8/976: chown dc/de/d2e/d23/d8d/de1/f104 31765 1 2024-04-26T11:46:42.655 INFO:tasks.workunit.client.0.smithi029.stdout:4/926: rename d3/d1d/db/d13/l4e to d3/d1d/db/d13/dbb/l127 0 2024-04-26T11:46:42.655 INFO:tasks.workunit.client.0.smithi029.stdout:8/977: creat dc/de/d103/d6a/f158 x:0 0 0 2024-04-26T11:46:42.655 INFO:tasks.workunit.client.0.smithi029.stdout:8/978: unlink dc/de/d26/d57/fb0 0 2024-04-26T11:46:42.656 INFO:tasks.workunit.client.0.smithi029.stdout:4/927: fsync d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/dc8/fcb 0 2024-04-26T11:46:42.657 INFO:tasks.workunit.client.0.smithi029.stdout:4/928: creat d3/d1d/d11/d16/d1f/d3d/d46/f128 x:0 0 0 2024-04-26T11:46:42.658 INFO:tasks.workunit.client.0.smithi029.stdout:0/935: truncate d9/d16/d33/d2f/f50 7997724 0 2024-04-26T11:46:42.658 INFO:tasks.workunit.client.0.smithi029.stdout:3/935: write d0/d1/d2f/f9f [1286322,5088] 0 2024-04-26T11:46:42.658 INFO:tasks.workunit.client.0.smithi029.stdout:8/979: mkdir dc/de/d2e/d23/d27/d6f/d9b/d43/da1/de0/d159 0 2024-04-26T11:46:42.659 INFO:tasks.workunit.client.0.smithi029.stdout:4/929: truncate d3/d1d/d11/d16/d1f/d3d/d39/f32 4688881 0 2024-04-26T11:46:42.659 INFO:tasks.workunit.client.0.smithi029.stdout:3/936: chown d0/d1/d5c/d103/d1a/d3b/db5 170292462 1 2024-04-26T11:46:42.659 INFO:tasks.workunit.client.0.smithi029.stdout:0/936: chown d9/d16/d25/l26 55 1 2024-04-26T11:46:42.659 INFO:tasks.workunit.client.0.smithi029.stdout:8/980: mkdir dc/de/d26/d6b/dde/d15a 0 2024-04-26T11:46:42.660 INFO:tasks.workunit.client.0.smithi029.stdout:3/937: write d0/d1/d2f/d82/dce/fcf [787692,3905] 0 2024-04-26T11:46:42.661 INFO:tasks.workunit.client.0.smithi029.stdout:8/981: symlink dc/de/d26/d6b/dde/d15a/l15b 0 2024-04-26T11:46:42.663 INFO:tasks.workunit.client.0.smithi029.stdout:0/937: dread d9/d16/d25/d2a/d4b/fe8 [0,4194304] 0 2024-04-26T11:46:42.663 INFO:tasks.workunit.client.0.smithi029.stdout:3/938: dread d0/d112/f113 [0,4194304] 0 2024-04-26T11:46:42.664 INFO:tasks.workunit.client.0.smithi029.stdout:3/939: dread - d0/d1/d5c/d103/f11a zero size 2024-04-26T11:46:42.665 INFO:tasks.workunit.client.0.smithi029.stdout:0/938: rmdir d9/d16/d33/d2f/d32/d90/ddb 0 2024-04-26T11:46:42.666 INFO:tasks.workunit.client.0.smithi029.stdout:0/939: readlink l8 0 2024-04-26T11:46:42.666 INFO:tasks.workunit.client.0.smithi029.stdout:3/940: write d0/d1/d5c/d103/d1a/d3b/f4f [1441868,119370] 0 2024-04-26T11:46:42.669 INFO:tasks.workunit.client.0.smithi029.stdout:4/930: dwrite d3/d1d/f89 [0,4194304] 0 2024-04-26T11:46:42.669 INFO:tasks.workunit.client.0.smithi029.stdout:8/982: truncate dc/de/d26/d57/ff7 1771334 0 2024-04-26T11:46:42.674 INFO:tasks.workunit.client.0.smithi029.stdout:8/983: read dc/de/d2e/d23/d27/d6f/d9b/d43/f82 [1634630,39080] 0 2024-04-26T11:46:42.675 INFO:tasks.workunit.client.0.smithi029.stdout:8/984: stat dc/de/d26/d57/f6d 0 2024-04-26T11:46:42.676 INFO:tasks.workunit.client.0.smithi029.stdout:0/940: write d9/d16/d33/f51 [610288,107669] 0 2024-04-26T11:46:42.676 INFO:tasks.workunit.client.0.smithi029.stdout:8/985: sync 2024-04-26T11:46:42.676 INFO:tasks.workunit.client.0.smithi029.stdout:0/941: stat d9/d16/d33/d2f/d32/f12e 0 2024-04-26T11:46:42.678 INFO:tasks.workunit.client.0.smithi029.stdout:4/931: dwrite d3/d50/d7a/f96 [0,4194304] 0 2024-04-26T11:46:42.678 INFO:tasks.workunit.client.0.smithi029.stdout:4/932: sync 2024-04-26T11:46:42.679 INFO:tasks.workunit.client.0.smithi029.stdout:8/986: rename dc/d9f/db2/l13a to dc/de/d2e/d23/d27/d6f/d9b/d43/dad/d153/l15c 0 2024-04-26T11:46:42.679 INFO:tasks.workunit.client.0.smithi029.stdout:0/942: getdents d9/d16/d25/d2a 0 2024-04-26T11:46:42.680 INFO:tasks.workunit.client.0.smithi029.stdout:4/933: rmdir d3/d1d/d11/d16/d1f/d3d 39 2024-04-26T11:46:42.681 INFO:tasks.workunit.client.0.smithi029.stdout:8/987: getdents dc/d9f/db2/d157 0 2024-04-26T11:46:42.681 INFO:tasks.workunit.client.0.smithi029.stdout:0/943: truncate d9/d16/de7/dff/f10a 1045230 0 2024-04-26T11:46:42.682 INFO:tasks.workunit.client.0.smithi029.stdout:4/934: dread - d3/d1d/d11/d16/d71/f10a zero size 2024-04-26T11:46:42.683 INFO:tasks.workunit.client.0.smithi029.stdout:8/988: unlink dc/de/d2e/d23/d8d/f100 0 2024-04-26T11:46:42.683 INFO:tasks.workunit.client.0.smithi029.stdout:4/935: creat d3/d50/d7a/f129 x:0 0 0 2024-04-26T11:46:42.684 INFO:tasks.workunit.client.0.smithi029.stdout:0/944: symlink d9/d16/d33/d2f/d32/d9f/db7/l14e 0 2024-04-26T11:46:42.684 INFO:tasks.workunit.client.0.smithi029.stdout:8/989: creat dc/de/d2e/d23/df9/f15d x:0 0 0 2024-04-26T11:46:42.685 INFO:tasks.workunit.client.0.smithi029.stdout:4/936: write d3/d1d/d11/d16/d1f/d3d/d46/f128 [177623,36866] 0 2024-04-26T11:46:42.686 INFO:tasks.workunit.client.0.smithi029.stdout:8/990: write dc/de/d103/d6a/f77 [587887,53796] 0 2024-04-26T11:46:42.687 INFO:tasks.workunit.client.0.smithi029.stdout:0/945: mkdir d9/d16/d33/d2f/d32/d90/d14f 0 2024-04-26T11:46:42.688 INFO:tasks.workunit.client.0.smithi029.stdout:4/937: getdents d3/d50/d10c 0 2024-04-26T11:46:42.688 INFO:tasks.workunit.client.0.smithi029.stdout:0/946: creat d9/d16/d25/ddc/f150 x:0 0 0 2024-04-26T11:46:42.689 INFO:tasks.workunit.client.0.smithi029.stdout:4/938: unlink d3/d1d/da0/fd5 0 2024-04-26T11:46:42.689 INFO:tasks.workunit.client.0.smithi029.stdout:4/939: chown d3/d1d/db/da4/lff 109118453 1 2024-04-26T11:46:42.690 INFO:tasks.workunit.client.0.smithi029.stdout:0/947: mkdir d9/d16/d25/d2a/d74/de9/d151 0 2024-04-26T11:46:42.696 INFO:tasks.workunit.client.0.smithi029.stdout:4/940: truncate d3/d1d/db/d13/d23/d2b/d9d/fc5 760833 0 2024-04-26T11:46:42.697 INFO:tasks.workunit.client.0.smithi029.stdout:8/991: dwrite dc/de/d2e/d23/d27/d6f/ffd [0,4194304] 0 2024-04-26T11:46:42.697 INFO:tasks.workunit.client.0.smithi029.stdout:3/941: dread d0/d1/d2b/f85 [0,4194304] 0 2024-04-26T11:46:42.698 INFO:tasks.workunit.client.0.smithi029.stdout:8/992: mknod dc/de/d2e/d23/d27/d6f/c15e 1 2024-04-26T11:46:42.699 INFO:tasks.workunit.client.0.smithi029.stdout:3/942: mknod d0/d1/d2f/d82/dc3/dc7/c145 1 2024-04-26T11:46:42.701 INFO:tasks.workunit.client.0.smithi029.stdout:0/948: dwrite d9/d16/d33/d2f/d32/d9f/dac/f137 [0,4194304] 0 2024-04-26T11:46:42.702 INFO:tasks.workunit.client.0.smithi029.stdout:3/943: truncate d0/d1/d41/d4c/dee/d13a/fb4 1240653 0 2024-04-26T11:46:42.702 INFO:tasks.workunit.client.0.smithi029.stdout:0/949: chown d9/f20 2 1 2024-04-26T11:46:42.702 INFO:tasks.workunit.client.0.smithi029.stdout:8/993: chown dc/de/d2e/d23/d27/d6f/d9b/d43/dad/d153/ffe 3 1 2024-04-26T11:46:42.704 INFO:tasks.workunit.client.0.smithi029.stdout:8/994: write dc/de/fcb [845559,76193] 0 2024-04-26T11:46:42.704 INFO:tasks.workunit.client.0.smithi029.stdout:0/950: creat d9/d16/d25/d2a/d46/f152 x:0 0 0 2024-04-26T11:46:42.708 INFO:tasks.workunit.client.0.smithi029.stdout:4/941: dwrite d3/d1d/d11/d16/d1f/fea [0,4194304] 0 2024-04-26T11:46:42.710 INFO:tasks.workunit.client.0.smithi029.stdout:8/995: dread dc/de/d2e/d23/f5f [0,4194304] 0 2024-04-26T11:46:42.711 INFO:tasks.workunit.client.0.smithi029.stdout:8/996: stat dc/de/d2e/d23/d27/d6f/d9b/da2/fb4 0 2024-04-26T11:46:42.712 INFO:tasks.workunit.client.0.smithi029.stdout:4/942: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84/dfd/ddb/d12a 0 2024-04-26T11:46:42.713 INFO:tasks.workunit.client.0.smithi029.stdout:4/943: creat d3/d50/d101/f12b x:0 0 0 2024-04-26T11:46:42.713 INFO:tasks.workunit.client.0.smithi029.stdout:8/997: chown dc/de/d2e/d23/d8d/de1/d143/dc0/df0/f124 868 1 2024-04-26T11:46:42.715 INFO:tasks.workunit.client.0.smithi029.stdout:8/998: write dc/de/d2e/d23/fe2 [1224540,114864] 0 2024-04-26T11:46:42.716 INFO:tasks.workunit.client.0.smithi029.stdout:0/951: dwrite d9/d16/d52/fe2 [0,4194304] 0 2024-04-26T11:46:42.717 INFO:tasks.workunit.client.0.smithi029.stdout:4/944: rename d3/d1d/d11/d16/d1f/d3d/d11d to d3/d1d/d11/d16/d1f/d3d/d12c 0 2024-04-26T11:46:42.717 INFO:tasks.workunit.client.0.smithi029.stdout:0/952: mknod d9/d16/d25/d2a/d74/d9a/c153 1 2024-04-26T11:46:42.717 INFO:tasks.workunit.client.0.smithi029.stdout:8/999: mknod dc/de/d2e/d23/d27/d6f/d9b/d43/dad/d118/c15f 1 2024-04-26T11:46:42.718 INFO:tasks.workunit.client.0.smithi029.stdout:0/953: chown d9/d16/d25/d2a/d46/f5a 76088 1 2024-04-26T11:46:42.718 INFO:tasks.workunit.client.0.smithi029.stdout:4/945: symlink d3/d1d/d11/d16/d1f/d3d/d46/l12d 0 2024-04-26T11:46:42.719 INFO:tasks.workunit.client.0.smithi029.stdout:0/954: getdents d9/d16/d25/d2a/d4b 0 2024-04-26T11:46:42.725 INFO:tasks.workunit.client.0.smithi029.stdout:4/946: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/fe9 [0,4194304] 0 2024-04-26T11:46:42.727 INFO:tasks.workunit.client.0.smithi029.stdout:0/955: dread d9/d78/ff7 [0,4194304] 0 2024-04-26T11:46:42.728 INFO:tasks.workunit.client.0.smithi029.stdout:3/944: dread d0/d1/d41/f42 [0,4194304] 0 2024-04-26T11:46:42.729 INFO:tasks.workunit.client.0.smithi029.stdout:4/947: write d3/d1d/d11/d16/d1f/d3d/d46/f5f [2559155,111780] 0 2024-04-26T11:46:42.729 INFO:tasks.workunit.client.0.smithi029.stdout:0/956: chown d9/d16/de7/dff/f10a 200519762 1 2024-04-26T11:46:42.730 INFO:tasks.workunit.client.0.smithi029.stdout:3/945: chown d0/d1/d41/d4c/l60 472573092 1 2024-04-26T11:46:42.730 INFO:tasks.workunit.client.0.smithi029.stdout:4/948: write d3/d50/db4/fb9 [209759,121792] 0 2024-04-26T11:46:42.730 INFO:tasks.workunit.client.0.smithi029.stdout:0/957: creat d9/d16/d25/d2a/d74/f154 x:0 0 0 2024-04-26T11:46:42.730 INFO:tasks.workunit.client.0.smithi029.stdout:3/946: creat d0/d1/d5c/d103/d1a/d3b/f146 x:0 0 0 2024-04-26T11:46:42.730 INFO:tasks.workunit.client.0.smithi029.stdout:0/958: stat d9/d78/ff7 0 2024-04-26T11:46:42.731 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:42.729+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:42.731 INFO:tasks.workunit.client.0.smithi029.stdout:0/959: mknod d9/d16/d25/d2a/d4b/dd9/c155 1 2024-04-26T11:46:42.731 INFO:tasks.workunit.client.0.smithi029.stdout:3/947: mkdir d0/d1/d5c/d103/d54/d11b/d147 0 2024-04-26T11:46:42.733 INFO:tasks.workunit.client.0.smithi029.stdout:0/960: write d9/d16/d52/fe2 [3258330,127317] 0 2024-04-26T11:46:42.733 INFO:tasks.workunit.client.0.smithi029.stdout:3/948: creat d0/d1/d2f/f148 x:0 0 0 2024-04-26T11:46:42.738 INFO:tasks.workunit.client.0.smithi029.stdout:3/949: truncate d0/d1/f49 605460 0 2024-04-26T11:46:42.739 INFO:tasks.workunit.client.0.smithi029.stdout:3/950: rmdir d0/d1/d2b/ddb 39 2024-04-26T11:46:42.739 INFO:tasks.workunit.client.0.smithi029.stdout:3/951: unlink d0/d112/f132 0 2024-04-26T11:46:42.742 INFO:tasks.workunit.client.0.smithi029.stdout:3/952: creat d0/d1/d41/f149 x:0 0 0 2024-04-26T11:46:42.742 INFO:tasks.workunit.client.0.smithi029.stdout:3/953: mknod d0/d112/c14a 1 2024-04-26T11:46:42.743 INFO:tasks.workunit.client.0.smithi029.stdout:0/961: dwrite d9/d16/d52/f135 [0,4194304] 0 2024-04-26T11:46:42.746 INFO:tasks.workunit.client.0.smithi029.stdout:3/954: write d0/d1/d2b/d7e/ff7 [2572807,91246] 0 2024-04-26T11:46:42.746 INFO:tasks.workunit.client.0.smithi029.stdout:4/949: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/fb2 [0,4194304] 0 2024-04-26T11:46:42.749 INFO:tasks.workunit.client.0.smithi029.stdout:0/962: creat d9/d16/d25/db4/f156 x:0 0 0 2024-04-26T11:46:42.750 INFO:tasks.workunit.client.0.smithi029.stdout:0/963: fdatasync d9/d16/d25/d2a/d8e/dc7/f148 0 2024-04-26T11:46:42.751 INFO:tasks.workunit.client.0.smithi029.stdout:0/964: rmdir d9/d16/d25/d2a/d4b/d13c 39 2024-04-26T11:46:42.753 INFO:tasks.workunit.client.0.smithi029.stdout:0/965: creat d9/d16/d33/d2f/d32/d9d/f157 x:0 0 0 2024-04-26T11:46:42.754 INFO:tasks.workunit.client.0.smithi029.stdout:3/955: dwrite d0/d1/d2f/d82/dce/f118 [0,4194304] 0 2024-04-26T11:46:42.754 INFO:tasks.workunit.client.0.smithi029.stdout:0/966: rename d9/d16/l60 to d9/d16/d33/l158 0 2024-04-26T11:46:42.755 INFO:tasks.workunit.client.0.smithi029.stdout:3/956: mknod d0/d1/d5c/d103/d1a/d3b/db5/d10a/c14b 1 2024-04-26T11:46:42.757 INFO:tasks.workunit.client.0.smithi029.stdout:0/967: rename d9/d16/d33/f38 to d9/d16/de7/dff/d120/f159 0 2024-04-26T11:46:42.757 INFO:tasks.workunit.client.0.smithi029.stdout:3/957: read - d0/d1/d2b/da7/f143 zero size 2024-04-26T11:46:42.758 INFO:tasks.workunit.client.0.smithi029.stdout:3/958: write d0/d1/d2b/d7e/d130/f114 [142688,115779] 0 2024-04-26T11:46:42.759 INFO:tasks.workunit.client.0.smithi029.stdout:3/959: write d0/d1/d5c/d103/d1a/d3b/f11d [229366,7611] 0 2024-04-26T11:46:42.761 INFO:tasks.workunit.client.0.smithi029.stdout:4/950: dwrite d3/d1d/db/d13/d23/fd3 [0,4194304] 0 2024-04-26T11:46:42.762 INFO:tasks.workunit.client.0.smithi029.stdout:3/960: link d0/d1/d5c/d103/d1a/d3b/db5/df8/f129 d0/d1/d5c/d103/d54/f14c 0 2024-04-26T11:46:42.764 INFO:tasks.workunit.client.0.smithi029.stdout:0/968: truncate d9/d16/d33/d2f/d32/d9d/f10d 3968318 0 2024-04-26T11:46:42.765 INFO:tasks.workunit.client.0.smithi029.stdout:4/951: rename d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/fab to d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/d125/f12e 0 2024-04-26T11:46:42.766 INFO:tasks.workunit.client.0.smithi029.stdout:0/969: truncate d9/d16/d33/f10c 698709 0 2024-04-26T11:46:42.767 INFO:tasks.workunit.client.0.smithi029.stdout:4/952: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84/dfd/ddb/f12f x:0 0 0 2024-04-26T11:46:42.768 INFO:tasks.workunit.client.0.smithi029.stdout:0/970: creat d9/d78/dc4/f15a x:0 0 0 2024-04-26T11:46:42.772 INFO:tasks.workunit.client.0.smithi029.stdout:3/961: dwrite d0/dc/f71 [4194304,4194304] 0 2024-04-26T11:46:42.773 INFO:tasks.workunit.client.0.smithi029.stdout:3/962: chown d0/dc/f6c 100 1 2024-04-26T11:46:42.773 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:42.774 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:42.776 INFO:tasks.workunit.client.0.smithi029.stdout:3/963: write d0/d1/d5c/d103/d1a/d3b/db5/d10a/d12b/f13f [8243334,43989] 0 2024-04-26T11:46:42.778 INFO:tasks.workunit.client.0.smithi029.stdout:4/953: dwrite d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/fd6 [0,4194304] 0 2024-04-26T11:46:42.779 INFO:tasks.workunit.client.0.smithi029.stdout:3/964: symlink d0/d1/d41/d4c/dee/d13a/l14d 0 2024-04-26T11:46:42.779 INFO:tasks.workunit.client.0.smithi029.stdout:4/954: stat d3/d1d/d11/l2c 0 2024-04-26T11:46:42.780 INFO:tasks.workunit.client.0.smithi029.stdout:4/955: chown d3/d1d/db/d13/f9e 174066 1 2024-04-26T11:46:42.780 INFO:tasks.workunit.client.0.smithi029.stdout:0/971: dwrite d9/d16/d33/d2f/d32/d9f/de6/feb [0,4194304] 0 2024-04-26T11:46:42.781 INFO:tasks.workunit.client.0.smithi029.stdout:3/965: write d0/d1/d5c/d103/d1a/f61 [2346374,54996] 0 2024-04-26T11:46:42.783 INFO:tasks.workunit.client.0.smithi029.stdout:0/972: rename d9/d16/d33/d2f/d32/d9f/de6/feb to d9/d78/dc4/f15b 0 2024-04-26T11:46:42.784 INFO:tasks.workunit.client.0.smithi029.stdout:0/973: readlink d9/d16/l62 0 2024-04-26T11:46:42.785 INFO:tasks.workunit.client.0.smithi029.stdout:0/974: truncate d9/d78/fcb 4830889 0 2024-04-26T11:46:42.786 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:42.787 INFO:tasks.workunit.client.0.smithi029.stdout:0/975: creat d9/d78/dc4/f15c x:0 0 0 2024-04-26T11:46:42.787 INFO:tasks.workunit.client.0.smithi029.stdout:4/956: dread d3/d1d/db/d13/d73/f8e [0,4194304] 0 2024-04-26T11:46:42.787 INFO:tasks.workunit.client.0.smithi029.stdout:4/957: fsync d3/d1d/f89 0 2024-04-26T11:46:42.788 INFO:tasks.workunit.client.0.smithi029.stdout:0/976: readlink d9/d16/d33/d2f/d32/d90/lad 0 2024-04-26T11:46:42.788 INFO:tasks.workunit.client.0.smithi029.stdout:0/977: stat d9/d16/d33 0 2024-04-26T11:46:42.790 INFO:tasks.workunit.client.0.smithi029.stdout:0/978: rename d9/d16/d25/d2a/d4b/dde to d9/d16/d33/d2f/d32/d9d/d15d 0 2024-04-26T11:46:42.796 INFO:tasks.workunit.client.0.smithi029.stdout:4/958: dwrite d3/d50/d7a/ded/ffe [0,4194304] 0 2024-04-26T11:46:42.796 INFO:tasks.workunit.client.0.smithi029.stdout:3/966: dread d0/f4b [0,4194304] 0 2024-04-26T11:46:42.798 INFO:tasks.workunit.client.0.smithi029.stdout:4/959: creat d3/d1d/db/d13/dbb/f130 x:0 0 0 2024-04-26T11:46:42.798 INFO:tasks.workunit.client.0.smithi029.stdout:3/967: write d0/d1/d41/d4c/dee/d9d/fc0 [626886,109347] 0 2024-04-26T11:46:42.809 INFO:tasks.workunit.client.0.smithi029.stdout:3/968: dwrite d0/d1/d5c/d103/d54/d11b/fd7 [0,4194304] 0 2024-04-26T11:46:42.826 INFO:tasks.workunit.client.0.smithi029.stdout:4/960: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/f42 [0,4194304] 0 2024-04-26T11:46:42.827 INFO:tasks.workunit.client.0.smithi029.stdout:4/961: rmdir d3/d50/db4 39 2024-04-26T11:46:42.830 INFO:tasks.workunit.client.0.smithi029.stdout:4/962: chown d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/d125/f12e 49 1 2024-04-26T11:46:42.833 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:42.824+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:42.853 INFO:tasks.workunit.client.0.smithi029.stdout:4/963: dread d3/d1d/f12 [0,4194304] 0 2024-04-26T11:46:42.855 INFO:tasks.workunit.client.0.smithi029.stdout:4/964: fdatasync d3/d1d/d11/d16/d1f/f55 0 2024-04-26T11:46:42.857 INFO:tasks.workunit.client.0.smithi029.stdout:0/979: sync 2024-04-26T11:46:42.858 INFO:tasks.workunit.client.0.smithi029.stdout:4/965: write d3/d1d/db/d13/d23/fd3 [3835945,59321] 0 2024-04-26T11:46:42.858 INFO:tasks.workunit.client.0.smithi029.stdout:3/969: sync 2024-04-26T11:46:42.858 INFO:tasks.workunit.client.0.smithi029.stdout:4/966: stat d3/d1d/d11/d16/d1f/f61 0 2024-04-26T11:46:42.860 INFO:tasks.workunit.client.0.smithi029.stdout:0/980: rename d9/d16/d33/d2f/d32/d9f/dac to d9/d16/d33/d2f/d32/d9f/dac/d147/d15e 22 2024-04-26T11:46:42.864 INFO:tasks.workunit.client.0.smithi029.stdout:0/981: dread d9/d16/de7/dff/f10a [0,4194304] 0 2024-04-26T11:46:42.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/967: rename d3/d1d/db/da4/lff to d3/d1d/db/l131 0 2024-04-26T11:46:42.866 INFO:tasks.workunit.client.0.smithi029.stdout:0/982: chown d9/d43/f6d 0 1 2024-04-26T11:46:42.867 INFO:tasks.workunit.client.0.smithi029.stdout:0/983: mknod d9/d16/d25/d2a/c15f 1 2024-04-26T11:46:42.868 INFO:tasks.workunit.client.0.smithi029.stdout:0/984: symlink d9/d16/d33/d2f/d32/d90/d14f/l160 0 2024-04-26T11:46:42.870 INFO:tasks.workunit.client.0.smithi029.stdout:4/968: write d3/d1d/db/d13/d23/d2b/d9d/fc5 [920338,11326] 0 2024-04-26T11:46:42.873 INFO:tasks.workunit.client.0.smithi029.stdout:4/969: mkdir d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84/dfd/ddb/d132 0 2024-04-26T11:46:42.880 INFO:tasks.workunit.client.0.smithi029.stdout:3/970: sync 2024-04-26T11:46:42.881 INFO:tasks.workunit.client.0.smithi029.stdout:4/970: dread d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/dc8/fcb [0,4194304] 0 2024-04-26T11:46:42.881 INFO:tasks.workunit.client.0.smithi029.stdout:3/971: chown d0/d1/d2b 555153 1 2024-04-26T11:46:42.882 INFO:tasks.workunit.client.0.smithi029.stdout:4/971: chown d3/d1d/f3f 1777 1 2024-04-26T11:46:42.883 INFO:tasks.workunit.client.0.smithi029.stdout:4/972: creat d3/d1d/db/d13/dbb/f133 x:0 0 0 2024-04-26T11:46:42.884 INFO:tasks.workunit.client.0.smithi029.stdout:3/972: link d0/l9e d0/d1/d2b/d7e/l14e 0 2024-04-26T11:46:42.884 INFO:tasks.workunit.client.0.smithi029.stdout:4/973: mknod d3/d1d/db/d13/dbb/c134 1 2024-04-26T11:46:42.885 INFO:tasks.workunit.client.0.smithi029.stdout:3/973: fdatasync d0/d1/d5c/d103/d54/fb6 0 2024-04-26T11:46:42.886 INFO:tasks.workunit.client.0.smithi029.stdout:3/974: chown d0/d1/d5c/d103/d54/fb6 69 1 2024-04-26T11:46:42.887 INFO:tasks.workunit.client.0.smithi029.stdout:4/974: rename d3/d1d/d11/d16/d1f/d3d/d46/fbf to d3/d50/d7a/ded/f135 0 2024-04-26T11:46:42.890 INFO:tasks.workunit.client.0.smithi029.stdout:4/975: getdents d3/d1d/db/d13/d23/d2b/d9d 0 2024-04-26T11:46:42.892 INFO:tasks.workunit.client.0.smithi029.stdout:4/976: write d3/d50/d7a/f96 [356347,113004] 0 2024-04-26T11:46:42.893 INFO:tasks.workunit.client.0.smithi029.stdout:3/975: dread d0/d1/d2b/d33/f66 [0,4194304] 0 2024-04-26T11:46:42.893 INFO:tasks.workunit.client.0.smithi029.stdout:4/977: fsync d3/d1d/db/d13/d23/d2b/d9d/fc5 0 2024-04-26T11:46:42.895 INFO:tasks.workunit.client.0.smithi029.stdout:3/976: rename d0/d1/f7c to d0/d1/d2b/d7e/dc2/f14f 0 2024-04-26T11:46:42.896 INFO:tasks.workunit.client.0.smithi029.stdout:4/978: creat d3/d1d/d11/d16/d1f/d3d/d39/f136 x:0 0 0 2024-04-26T11:46:42.897 INFO:tasks.workunit.client.0.smithi029.stdout:3/977: truncate d0/d1/d2f/f148 517259 0 2024-04-26T11:46:42.898 INFO:tasks.workunit.client.0.smithi029.stdout:3/978: read - d0/d1/d2f/d82/dc3/dc7/fca zero size 2024-04-26T11:46:42.900 INFO:tasks.workunit.client.0.smithi029.stdout:3/979: mkdir d0/d1/d41/d4c/dee/d150 0 2024-04-26T11:46:42.901 INFO:tasks.workunit.client.0.smithi029.stdout:3/980: mkdir d0/d1/d5c/d151 0 2024-04-26T11:46:42.901 INFO:tasks.workunit.client.0.smithi029.stdout:4/979: write d3/d1d/d11/d16/d1f/d3d/d39/d30/fa3 [680782,2150] 0 2024-04-26T11:46:42.902 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:42.902 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:42.903 INFO:tasks.workunit.client.0.smithi029.stdout:4/980: write d3/d1d/d11/d16/d1f/d3d/d39/d30/d5d/d6c/fe7 [1860828,21673] 0 2024-04-26T11:46:42.907 INFO:tasks.workunit.client.0.smithi029.stdout:4/981: rename d3/d50/d7a/ded/ffe to d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84/dfd/ddb/f137 0 2024-04-26T11:46:42.908 INFO:tasks.workunit.client.0.smithi029.stdout:4/982: mkdir d3/d1d/d138 0 2024-04-26T11:46:42.911 INFO:tasks.workunit.client.0.smithi029.stdout:4/983: getdents d3/d1d/db/d13 0 2024-04-26T11:46:42.913 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:42.913 INFO:tasks.workunit.client.0.smithi029.stdout:3/981: dwrite d0/d1/d2f/d82/dce/fd2 [0,4194304] 0 2024-04-26T11:46:42.914 INFO:tasks.workunit.client.0.smithi029.stdout:3/982: symlink d0/d1/d5c/d151/l152 0 2024-04-26T11:46:42.916 INFO:tasks.workunit.client.0.smithi029.stdout:4/984: link d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/l5b d3/d1d/db/d13/d73/l139 0 2024-04-26T11:46:42.916 INFO:tasks.workunit.client.0.smithi029.stdout:3/983: creat d0/d1/d5c/d151/f153 x:0 0 0 2024-04-26T11:46:42.917 INFO:tasks.workunit.client.0.smithi029.stdout:4/985: write d3/d50/d7a/faf [4347874,11459] 0 2024-04-26T11:46:42.920 INFO:tasks.workunit.client.0.smithi029.stdout:4/986: creat d3/d1d/d11/d16/d1f/f13a x:0 0 0 2024-04-26T11:46:42.923 INFO:tasks.workunit.client.0.smithi029.stdout:3/984: dread d0/d1/d5c/d103/d54/d11b/fd7 [0,4194304] 0 2024-04-26T11:46:42.924 INFO:tasks.workunit.client.0.smithi029.stdout:4/987: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d56/f5e 1222275 0 2024-04-26T11:46:42.925 INFO:tasks.workunit.client.0.smithi029.stdout:3/985: rename d0/d1/d5c/f87 to d0/d1/d2f/d82/dc3/f154 0 2024-04-26T11:46:42.930 INFO:tasks.workunit.client.0.smithi029.stdout:4/988: dread d3/d1d/db/d13/d73/f8e [0,4194304] 0 2024-04-26T11:46:42.931 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:42.929+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:42.932 INFO:tasks.workunit.client.0.smithi029.stdout:4/989: chown d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/f77 280 1 2024-04-26T11:46:42.935 INFO:tasks.workunit.client.0.smithi029.stdout:4/990: creat d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84/dfd/ddb/f13b x:0 0 0 2024-04-26T11:46:42.936 INFO:tasks.workunit.client.0.smithi029.stdout:3/986: dwrite d0/d1/d2f/fb3 [0,4194304] 0 2024-04-26T11:46:42.937 INFO:tasks.workunit.client.0.smithi029.stdout:3/987: write d0/d1/d2b/d7e/ff7 [309136,99928] 0 2024-04-26T11:46:42.938 INFO:tasks.workunit.client.0.smithi029.stdout:3/988: mknod d0/d1/d41/c155 1 2024-04-26T11:46:42.939 INFO:tasks.workunit.client.0.smithi029.stdout:0/985: sync 2024-04-26T11:46:42.940 INFO:tasks.workunit.client.0.smithi029.stdout:3/989: creat d0/d1/d2f/d82/dc3/dc7/f156 x:0 0 0 2024-04-26T11:46:42.942 INFO:tasks.workunit.client.0.smithi029.stdout:0/986: symlink d9/d16/d33/d2f/d32/d90/df4/l161 0 2024-04-26T11:46:42.943 INFO:tasks.workunit.client.0.smithi029.stdout:3/990: rename d0/d1/d2b/d7e/d130/de7/ff0 to d0/d1/d2f/d82/f157 0 2024-04-26T11:46:42.944 INFO:tasks.workunit.client.0.smithi029.stdout:0/987: creat d9/d16/f162 x:0 0 0 2024-04-26T11:46:42.945 INFO:tasks.workunit.client.0.smithi029.stdout:3/991: chown d0/d1/d41/d4c/f7b 465319 1 2024-04-26T11:46:42.946 INFO:tasks.workunit.client.0.smithi029.stdout:0/988: write d9/d16/d25/db4/f123 [78900,60113] 0 2024-04-26T11:46:42.946 INFO:tasks.workunit.client.0.smithi029.stdout:4/991: dwrite d3/d50/d7a/faf [0,4194304] 0 2024-04-26T11:46:42.948 INFO:tasks.workunit.client.0.smithi029.stdout:0/989: rmdir d9/d16/de7/d107/d100 39 2024-04-26T11:46:42.950 INFO:tasks.workunit.client.0.smithi029.stdout:3/992: rename d0/d1/d41/d4c/dee/d9d/ff4 to d0/d1/d5c/d103/f158 0 2024-04-26T11:46:42.950 INFO:tasks.workunit.client.0.smithi029.stdout:4/992: mknod d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d9f/c13c 1 2024-04-26T11:46:42.950 INFO:tasks.workunit.client.0.smithi029.stdout:3/993: stat d0/d1/d41/d4c/dee/d13a/f106 0 2024-04-26T11:46:42.951 INFO:tasks.workunit.client.0.smithi029.stdout:0/990: creat d9/d16/de7/d107/f163 x:0 0 0 2024-04-26T11:46:42.952 INFO:tasks.workunit.client.0.smithi029.stdout:4/993: creat d3/d50/db4/f13d x:0 0 0 2024-04-26T11:46:42.953 INFO:tasks.workunit.client.0.smithi029.stdout:0/991: unlink d9/d16/d25/l77 0 2024-04-26T11:46:42.954 INFO:tasks.workunit.client.0.smithi029.stdout:0/992: chown d9/d16/d25/d2a/d74/f8f 1717 1 2024-04-26T11:46:42.954 INFO:tasks.workunit.client.0.smithi029.stdout:4/994: symlink d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/d84/dfd/ddb/l13e 0 2024-04-26T11:46:42.956 INFO:tasks.workunit.client.0.smithi029.stdout:4/995: unlink d3/d1d/d11/d16/d1f/d3d/d46/f128 0 2024-04-26T11:46:42.956 INFO:tasks.workunit.client.0.smithi029.stdout:0/993: truncate d9/d16/d25/d2a/d8e/fb9 1618857 0 2024-04-26T11:46:42.957 INFO:tasks.workunit.client.0.smithi029.stdout:4/996: dread - d3/d1d/d11/d16/d1f/d3d/d39/f136 zero size 2024-04-26T11:46:42.959 INFO:tasks.workunit.client.0.smithi029.stdout:0/994: rename d9/d16/d33/d2f/d32/d9f/dac/f14a to d9/d16/de7/d107/d100/f164 0 2024-04-26T11:46:42.960 INFO:tasks.workunit.client.0.smithi029.stdout:0/995: chown d9/d16/d25/d2a/d4b/fe8 123 1 2024-04-26T11:46:42.960 INFO:tasks.workunit.client.0.smithi029.stdout:4/997: truncate d3/d1d/d11/d16/d1f/d3d/d39/d30/d3c/dbe/fe6 591217 0 2024-04-26T11:46:42.961 INFO:tasks.workunit.client.0.smithi029.stdout:3/994: write d0/d112/f113 [382302,17493] 0 2024-04-26T11:46:42.962 INFO:tasks.workunit.client.0.smithi029.stdout:0/996: creat d9/d16/d25/d2a/d8e/f165 x:0 0 0 2024-04-26T11:46:42.962 INFO:tasks.workunit.client.0.smithi029.stdout:3/995: chown d0/d1/d41/d4c/dee/d9d/fcc 49197 1 2024-04-26T11:46:42.963 INFO:tasks.workunit.client.0.smithi029.stdout:4/998: link d3/dba/f122 d3/d1d/d11/d16/d1f/f13f 0 2024-04-26T11:46:42.963 INFO:tasks.workunit.client.0.smithi029.stdout:0/997: symlink d9/d16/d33/d2f/d68/l166 0 2024-04-26T11:46:42.965 INFO:tasks.workunit.client.0.smithi029.stdout:3/996: link d0/d1/d2b/d7e/d130/de7/ffa d0/d1/d5c/d151/f159 0 2024-04-26T11:46:42.966 INFO:tasks.workunit.client.0.smithi029.stdout:0/998: rename d9/d16/d33/d2f/d32/l13f to d9/d16/d33/d2f/d68/l167 0 2024-04-26T11:46:42.966 INFO:tasks.workunit.client.0.smithi029.stdout:0/999: read - d9/d16/f162 zero size 2024-04-26T11:46:42.967 INFO:tasks.workunit.client.0.smithi029.stdout:3/997: link d0/d1/d5c/d103/f158 d0/d1/d2f/d82/dce/f15a 0 2024-04-26T11:46:42.968 INFO:tasks.workunit.client.0.smithi029.stdout:4/999: write d3/f31 [4277588,67530] 0 2024-04-26T11:46:42.969 INFO:tasks.workunit.client.0.smithi029.stdout:3/998: symlink d0/d1/d41/d4c/dee/d12c/l15b 0 2024-04-26T11:46:42.979 INFO:tasks.workunit.client.0.smithi029.stdout:3/999: dwrite d0/dc/d1f/fd0 [0,4194304] 0 2024-04-26T11:46:42.983 INFO:tasks.workunit.client.0.smithi029.stderr:+ rm -rf -- ./tmp.FxRW8rlRQc 2024-04-26T11:46:43.026 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:43.026 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:43.032 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:43.028+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:43.039 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:43.134 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:43.128+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:43.141 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:43.141 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:43.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:43.235 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:43.228+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:43.270 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:43.270 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:43.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:43.335 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:43.333+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:43.383 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:43.384 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:43.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:43.436 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:43.433+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:43.499 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:43.500 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:43.509 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:43.554 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:43.553+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:43.628 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:43.629 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:43.638 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:43.637+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:43.639 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:43.738 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:43.732+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:43.742 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:43.742 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:43.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:46:43.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:43.840 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:43.837+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:43.860 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:43.860 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:43.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:43.870 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:43.941 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:43.937+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:43.994 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:43.994 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:44.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:44.024 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:44.042 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:44.036+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:44.055 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:44.055 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:44.055 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:44.055 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:44.060 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:44.061 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:44.115 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:44.115 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:44.116 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:44.116 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:44.116 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:44.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:44.143 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:44.141+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:44.242 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.084862368, 2024-04-26T11:46:44.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:44.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:44.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.084835640000001, 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:44.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.084804688999998, 2024-04-26T11:46:44.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:44.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:44.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:44.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.259 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.082842672, 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:44.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:44.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.082817051999999, 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:44.264 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:44.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.082756858, 2024-04-26T11:46:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:44.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.082730080999999, 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:44.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.278 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.082674033, 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:44.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:44.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:44.283 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.082634067000001, 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.082603456999999, 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:44.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.082528949, 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.297 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.082460884, 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:44.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:44.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.082360737, 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:44.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:44.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:44.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.062511635, 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:44.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.311 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.062453336000001, 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:44.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.060416076999999, 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.321 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.4650579770000007, 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:44.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:44.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:44.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:44.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:44.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:44.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:44.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:44.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:44.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:44.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.89691024, 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:46:44.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:46:44.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:46:44.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:44.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:44.334 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.1855550830000001, 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:46:44.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.339 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.1807928759999999, 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:46:44.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:46:44.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:44.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:46:44.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:46:44.345 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.345 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.345 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.345 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:44.345 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:44.345 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:44.347 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:44.348 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:44.345+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:44.447 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:44.444+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:44.463 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:44.464 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:44.474 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:44.548 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:44.544+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:44.582 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:44.582 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:44.582 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:44.582 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:44.582 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:44.595 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:44.649 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:44.644+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:44.697 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.9739225860000005, 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:46:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:46:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:46:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:46:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.55315388, 2024-04-26T11:46:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:46:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.553125402, 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:46:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5531001849999999, 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:46:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:46:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5530640990000002, 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:46:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5530372769999996, 2024-04-26T11:46:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:46:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5504380390000003, 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.728 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:46:44.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:46:44.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:46:44.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:46:44.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:46:44.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5499607810000002, 2024-04-26T11:46:44.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5458935790000004, 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:46:44.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:46:44.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:46:44.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5457294590000004, 2024-04-26T11:46:44.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:46:44.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:46:44.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5427967989999996, 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:46:44.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.540614208, 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:46:44.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:46:44.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:46:44.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5381031729999997, 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:46:44.757 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:46:44.761 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5357085320000001, 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:46:44.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:46:44.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:46:44.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5355234729999996, 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:46:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:46:44.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5354835869999999, 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:46:44.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5337443430000004, 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:46:44.777 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.778 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.779 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:44.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:44.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:46:44.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:46:44.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:46:44.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:46:44.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:46:44.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.785 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.786 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.786 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:44.786 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5330426340000001, 2024-04-26T11:46:44.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:46:44.786 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.786 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.786 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:44.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:44.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:46:44.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:44.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:46:44.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:46:44.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:46:44.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:46:44.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:46:44.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:46:44.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:46:44.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:46:44.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:46:44.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:46:44.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:46:44.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:46:44.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:46:44.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:46:44.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:46:44.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:46:44.794 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.794 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.794 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.794 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.794 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:44.794 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5291632029999995, 2024-04-26T11:46:44.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:46:44.795 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.795 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.795 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:44.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:44.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:46:44.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:46:44.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:46:44.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5291343639999999, 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:46:44.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:44.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:44.807 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:44.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:44.809 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:44.804+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:44.909 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:44.904+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:44.928 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:44.929 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:44.929 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:44.929 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:44.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:45.010 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:45.009+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:45.048 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:45.048 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:45.048 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:45.048 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:45.048 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:45.059 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:45.086 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:46:45.111 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:45.108+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:45.167 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:45.167 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:45.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:45.167 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:45.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.167 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:45.167 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.009849108000001, 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.009822379999999, 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.009791429, 2024-04-26T11:46:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.007829412, 2024-04-26T11:46:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.007803792000001, 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.007743597999999, 2024-04-26T11:46:45.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:45.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:45.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.007716821000001, 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.204 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.007660773, 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.007620807, 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.209 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.007590197000001, 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:45.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.218 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.007515689, 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:45.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:45.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.007447623999999, 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.007347477, 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:45.229 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:45.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:45.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.987498374999999, 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:45.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.987440076, 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.239 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:45.243 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.985402817000001, 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:45.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.3900447170000003, 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.249 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:45.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:45.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.82189698, 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:46:45.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:46:45.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:46:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1105418230000002, 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:46:45.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:46:45.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.1057796160000004, 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:45.266 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:46:45.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:46:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:46:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.271 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.271 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:45.273 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:45.274 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:45.268+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:45.373 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:45.372+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:45.389 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:45.389 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:45.389 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:45.389 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:45.400 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:45.474 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:45.468+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:45.506 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:45.507 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:45.516 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:45.575 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:45.568+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:45.646 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:45.646 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:45.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.9225521870000009, 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.647 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:45.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:46:45.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:46:45.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:46:45.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:46:45.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:46:45.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:46:45.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:45.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:46:45.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:46:45.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:46:45.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:46:45.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:45.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:46:45.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:46:45.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.653 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.5017834810000004, 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:45.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:46:45.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:45.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:46:45.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:46:45.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:46:45.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.5017550029999995, 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.5017297860000003, 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.667 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.5016937000000006, 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:46:45.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:46:45.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:46:45.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.501666878, 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:45.676 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4990676399999998, 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.680 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4985903819999997, 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:46:45.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:46:45.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4945231799999998, 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:46:45.685 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.689 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4943590600000007, 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:45.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:46:45.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:46:45.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:46:45.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4914263999999999, 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:46:45.694 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:46:45.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4892438089999995, 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:45.701 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:46:45.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:46:45.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:46:45.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.486732774, 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4843381329999996, 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:46:45.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:46:45.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.715 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.484153074, 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4841131880000002, 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.720 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.724 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4823739440000008, 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:46:45.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:46:45.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:45.729 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4816722349999996, 2024-04-26T11:46:45.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:46:45.730 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.730 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.730 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:45.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:46:45.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:46:45.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4777928039999999, 2024-04-26T11:46:45.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:46:45.738 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4777639649999994, 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:45.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:45.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:45.743 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:45.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:45.745 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:45.740+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:45.845 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:45.840+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:45.867 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:45.867 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:45.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.867 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4408 3.18 3:1cc859d9:::200.00000012:head [write 2051307~3797 [fadvise_dontneed] in=3797b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:46:45.867 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:45.865431+0000", 2024-04-26T11:46:45.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0019633839999999999, 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020250530000000002, 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.865431+0000", 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.865431+0000", 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.865429+0000", 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.865447+0000", 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7453e-05 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.865473+0000", 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5972000000000001e-05 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.865486+0000", 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3227000000000001e-05 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.865589+0000", 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000103065 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.865719+0000", 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012988299999999999 2024-04-26T11:46:45.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4409 3.18 3:1cc859d9:::200.00000012:head [write 2055104~7951 [fadvise_dontneed] in=7951b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:45.867167+0000", 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00022765400000000001, 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00043285300000000002, 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.867167+0000", 2024-04-26T11:46:45.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.867167+0000", 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.867165+0000", 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:45.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.867189+0000", 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3759000000000001e-05 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.867214+0000", 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4973e-05 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.867237+0000", 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3093000000000001e-05 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:45.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.867313+0000", 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6259000000000003e-05 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:45.867417+0000", 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010365399999999999 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 2 2024-04-26T11:46:45.874 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:45.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:45.946 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:45.940+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:45.990 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:45.990 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:46.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:46.047 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:46.044+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:46.062 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:46.149 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:46.144+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:46.167 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:46.167 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:46.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:46.167 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:46.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.167 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:46.167 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:46.167 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 24.009921856999998, 2024-04-26T11:46:46.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:46.167 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:46.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:46.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 24.009895129, 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:46.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:46.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 24.009864178000001, 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:46.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:46.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.183 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.007902161000001, 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:46.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:46.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:46.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.007876541, 2024-04-26T11:46:46.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:46.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:46.192 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.007816347, 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:46.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.197 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.00778957, 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:46.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:46.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:46.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.007733522000001, 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:46.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:46.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:46.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:46.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.007693556, 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.207 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.007662946, 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:46.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:46.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:46.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.007588438000001, 2024-04-26T11:46:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:46.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.007520373, 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.221 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.222 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:46.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:46.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:46.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:46.226 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.007420226000001, 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:46.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:46.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.987571124, 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:46.231 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:46.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.987512825, 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:46.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:46.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.985475566, 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 10.390117466, 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:46.245 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:46.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:46.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.8219697290000001, 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.1106145720000002, 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:46.256 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:46:46.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:46:46.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:46:46.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.1058523649999996, 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:46.261 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.265 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:46.266 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:46.266 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:46.268 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:46.269 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:46.264+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:46.269 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:46.269 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:46.269 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:46.269 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:46.269 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:46.368 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:46.365+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:46.384 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:46.384 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:46.394 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:46.469 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:46.468+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:46.544 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:46.544 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:46.554 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:46.571 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:46.569+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:46.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~112s 2024-04-26T11:46:46.671 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:46.672+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:46.681 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:46.681 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:46.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:46.773 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:46.772+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:46.810 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:46.810 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:46.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:46.873 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:46.873+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:46.930 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:46.930 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:46.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:46.974 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:46.972+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:47.039 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:47.039 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:47.050 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:47.098 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:47.097+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:47.100 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:46:47.171 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:47.171 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:47.176 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:47.176+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:47.182 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:47.277 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:47.277+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:47.294 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:47.295 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:47.305 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:47.378 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:47.376+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:47.412 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:47.412 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:47.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:47.478 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:47.476+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:47.544 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:47.544 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:47.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:47.579 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:47.580+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:47.679 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:47.680 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:47.680 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:47.680+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:47.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:47.781 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:47.781+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:47.841 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:47.841 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:47.850 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:47.882 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:47.880+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:47.968 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:47.968 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:47.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:47.983 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:47.981+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:48.082 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:48.082 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:48.084 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:48.081+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:48.092 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:48.111 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:46:48.185 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:48.181+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:48.248 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:48.248 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:48.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:48.270 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:48.286 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:48.285+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:48.375 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:48.376 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:48.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:48.387 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:48.385+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:48.424 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:48.448 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:48.449 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:48.449 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:48.449 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:48.452 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:48.453 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:48.488 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:48.488+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:48.494 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:48.495 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:48.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:48.506 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T11:46:48.506 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T11:46:48.589 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:48.588+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:48.625 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.469229329000001, 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.469202600999999, 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.46917165, 2024-04-26T11:46:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.467209633, 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.467184013000001, 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.467123819000001, 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:48.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:48.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:48.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.467097041999999, 2024-04-26T11:46:48.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:48.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:48.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:48.660 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.467040994000001, 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.467001027999999, 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:48.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.466970417999999, 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:48.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:48.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:48.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.466895910000002, 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.466827845000001, 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.679 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:48.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.466727698, 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.446878596000001, 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.688 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:48.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:48.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.446820296999999, 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:48.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:48.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.444783038000001, 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:48.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.849424938, 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:48.702 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:48.707 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.281277201, 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:46:48.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:46:48.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:48.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:48.713 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.5699220440000001, 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:46:48.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.5651598370000004, 2024-04-26T11:46:48.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:48.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:48.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:48.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:46:48.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:46:48.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.723 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:48.723 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:48.723 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:48.725 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:48.726 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:48.721+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:48.826 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:48.825+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:48.843 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:48.843 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:48.843 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:48.843 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:48.853 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:48.926 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:48.925+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:48.954 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:48.955 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:48.974 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:49.027 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:49.025+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:49.128 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:49.125+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:49.138 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.412682596, 2024-04-26T11:46:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:46:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:46:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:46:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:46:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:46:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:46:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:46:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:46:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:46:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:46:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.991913889999999, 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:46:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.991885412, 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:46:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:46:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:46:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.991860194999999, 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:46:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:46:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:46:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.991824109, 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:46:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:46:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.991797287000001, 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:46:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:46:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.989198049000001, 2024-04-26T11:46:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:46:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:46:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:46:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.988720791, 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:46:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.984653589000001, 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:46:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:46:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:46:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:46:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:46:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:46:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:46:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:46:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.984489469, 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:46:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.981556809000001, 2024-04-26T11:46:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:46:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:46:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.979374218, 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:46:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.976863183000001, 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:46:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:46:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:46:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.974468542, 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:46:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.974283483000001, 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:46:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.974243596999999, 2024-04-26T11:46:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.972504353, 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:46:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:46:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:46:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:46:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:46:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.971802644, 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.967923213000001, 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:46:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:46:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:46:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:46:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:46:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:46:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.967894374, 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:46:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:46:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:46:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:49.236 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:49.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:49.239 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:49.236+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:49.338 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:49.336+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:49.353 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:49.354 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:49.354 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:49.354 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:49.363 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:49.439 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:49.437+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:49.520 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:49.520 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:49.520 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:49.521 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:49.521 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:49.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:49.540 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:49.540+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:49.641 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:49.640+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:49.656 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:49.656 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:49.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:49.656 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.500611539000001, 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:49.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:49.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:49.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.500584811, 2024-04-26T11:46:49.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:49.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:49.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:49.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:49.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:49.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:49.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:49.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:49.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:49.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.50055386, 2024-04-26T11:46:49.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:49.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.498591843, 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:49.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:49.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:49.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:49.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:49.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.498566223000001, 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:49.679 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:49.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.498506029000001, 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.684 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:49.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.498479251999999, 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.689 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:49.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.498423204000002, 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.694 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:49.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.698 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.498383237999999, 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:49.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:49.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:49.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.703 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.498352627999999, 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:49.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.498278119999998, 2024-04-26T11:46:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:49.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:49.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:49.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:49.713 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.713 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.713 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.713 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.713 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:49.713 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.498210055000001, 2024-04-26T11:46:49.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:49.713 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:49.717 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.498109908, 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:49.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:49.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.478260806000002, 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:49.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:49.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.478202506999999, 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:49.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:49.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.476165248000001, 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.733 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:49.737 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.738 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.738 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.738 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:49.738 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:49.738 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.880807148000001, 2024-04-26T11:46:49.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:49.738 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.738 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.738 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:49.739 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:49.739 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:49.739 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:49.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.739 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:49.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:49.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:49.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:49.744 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.3126594110000003, 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:49.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:46:49.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:46:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.6013042540000004, 2024-04-26T11:46:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:49.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:46:49.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:49.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:46:49.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.5965420469999998, 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:49.756 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:46:49.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:46:49.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:49.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:49.761 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:49.763 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:49.763 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:49.760+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:49.863 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:49.861+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:49.878 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:49.879 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:49.879 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:49.879 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:49.889 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:49.964 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:49.964+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:50.048 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:50.048 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:50.048 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:50.048 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:50.048 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:50.058 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:50.065 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:50.064+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:50.124 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:46:50.166 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:50.165+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:50.168 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:50.168 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:50.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:50.168 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:50.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.168 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:50.168 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.444722581000001, 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:46:50.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:46:50.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:50.174 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.023953875, 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:50.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:46:50.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.023925396999999, 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.179 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.180 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:50.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:50.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:46:50.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:50.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:46:50.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:46:50.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:46:50.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:46:50.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:46:50.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:46:50.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:46:50.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:46:50.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:46:50.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:46:50.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:46:50.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:46:50.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:46:50.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:46:50.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:46:50.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:46:50.186 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.186 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.186 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.187 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.187 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:50.187 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.02390018, 2024-04-26T11:46:50.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:46:50.187 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.187 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.187 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:50.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:50.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:46:50.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:50.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:46:50.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:46:50.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:46:50.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:46:50.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:46:50.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:46:50.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:46:50.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:46:50.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:46:50.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:46:50.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:46:50.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:46:50.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.195 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.023864094, 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:46:50.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:46:50.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:46:50.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:46:50.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.200 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.023837272, 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:50.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:46:50.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:50.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:46:50.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:46:50.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.021238034, 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:46:50.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.020760775999999, 2024-04-26T11:46:50.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:46:50.214 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.016693574, 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:46:50.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:46:50.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:46:50.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:46:50.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.016529454, 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:46:50.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:46:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:46:50.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:46:50.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:46:50.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:46:50.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:46:50.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.013596794, 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:46:50.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:46:50.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:46:50.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:46:50.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:46:50.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:46:50.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:46:50.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:46:50.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:50.230 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.011414202999999, 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:46:50.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:46:50.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:46:50.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:46:50.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:46:50.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:46:50.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.236 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.008903168, 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:50.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:46:50.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:50.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:46:50.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:46:50.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:46:50.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:46:50.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:46:50.241 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.006508526999999, 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:50.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:50.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:46:50.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:46:50.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.006323468, 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:46:50.247 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:46:50.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.006283582, 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:46:50.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:46:50.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:46:50.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:46:50.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:46:50.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:46:50.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:46:50.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:46:50.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.004544338000001, 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.257 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.003842628999999, 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:46:50.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:50.266 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.999963198, 2024-04-26T11:46:50.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:46:50.267 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.267 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.267 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:50.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:46:50.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.999934359000001, 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:50.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:46:50.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:50.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:50.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:50.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:46:50.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:46:50.276 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.276 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.276 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.276 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:50.276 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:50.276 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:50.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:50.279 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:50.276+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:50.379 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:50.376+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:50.394 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:50.394 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:50.394 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:50.394 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:50.404 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:50.454 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:50.480 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:50.480+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:50.508 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:50.508 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:50.509 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:50.509 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:50.509 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:50.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:50.581 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:50.580+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:50.603 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:50.622 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:50.623 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:50.628 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:50.628 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:50.629 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:50.629 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:50.632 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:50.633 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:50.633 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:50.682 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:50.680+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:50.756 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:50.756 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:50.767 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:50.783 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:50.781+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:50.873 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:50.874 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:50.883 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:50.884 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:50.884+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:50.984 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:50.981+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:50.985 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:50.985 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:50.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:51.086 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:51.084+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:51.115 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:51.115 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:51.118 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:46:51.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:51.187 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:51.185+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:51.239 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:51.240 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:51.250 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:51.287 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:51.288+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:51.356 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:51.356 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:51.365 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:51.407 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:51.408+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:51.478 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:51.479 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:51.489 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:51.489 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:51.485+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:51.590 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:51.589+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:51.590 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:51.590 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:51.600 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:51.691 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:51.692+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:51.725 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:51.725 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:51.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:51.792 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:51.792+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:51.849 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:51.849 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:51.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:51.893 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:51.893+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:51.969 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:51.969 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:51.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:51.994 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:51.993+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:52.096 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:52.093+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:52.098 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:52.197 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:52.193+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:52.214 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:52.215 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:52.225 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:52.298 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:52.296+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:52.331 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:52.331 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:52.341 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:52.399 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:52.396+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:52.447 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:52.447 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:52.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:52.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~118s 2024-04-26T11:46:52.504 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:52.504+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:52.572 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:52.572 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:52.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:52.601 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:52.597+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:52.634 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:52.702 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:52.700+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:52.706 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:52.706 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:52.719 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:52.779 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:52.803 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:52.801+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:52.806 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:52.806 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:52.806 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:52.806 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:52.810 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:52.811 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:52.881 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.726057401999999, 2024-04-26T11:46:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.726030674, 2024-04-26T11:46:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.725999723000001, 2024-04-26T11:46:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.724037706000001, 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.724012085999998, 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.723951891999999, 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.723925115, 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:52.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:52.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.723869066999999, 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.723829101, 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.723798491, 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.723723982999999, 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.723655917999999, 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.723555771000001, 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.703706668999999, 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.70364837, 2024-04-26T11:46:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 20.701611110999998, 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.106253011, 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.538105273999999, 2024-04-26T11:46:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:46:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:46:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:46:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:46:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:46:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:46:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:46:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:46:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:46:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:46:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:46:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:46:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:46:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:46:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 11.826750117, 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 11.821987910000001, 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:46:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:46:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:52.998 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:53.000 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:53.000 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:53.000+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:53.101 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:53.100+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:53.115 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:53.116 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:53.126 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:53.132 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:46:53.202 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:53.200+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:53.233 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:53.234 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:53.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:53.303 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:53.300+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:53.354 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:53.354 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:53.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:53.354 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:53.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.628139434000001, 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.355 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:53.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:53.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:53.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:46:53.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:46:53.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:46:53.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:53.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:46:53.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:46:53.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.361 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.362 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:53.362 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.207370728000001, 2024-04-26T11:46:53.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:46:53.362 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.362 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.362 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:53.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:53.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:53.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:46:53.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:46:53.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:46:53.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:53.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:46:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:46:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:46:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:46:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:46:53.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:46:53.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:46:53.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:46:53.367 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.367 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.367 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.368 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.368 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:53.368 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.20734225, 2024-04-26T11:46:53.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:46:53.368 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.368 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.368 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:46:53.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:46:53.372 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.207317032999999, 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:46:53.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:46:53.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.378 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.378 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:53.378 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.207280947000001, 2024-04-26T11:46:53.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:46:53.378 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.378 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.378 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:53.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:53.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:46:53.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:46:53.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:46:53.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:46:53.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:46:53.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:46:53.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:46:53.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:46:53.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:46:53.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:46:53.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:46:53.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:46:53.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:46:53.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:46:53.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:46:53.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:46:53.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:46:53.385 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.386 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.386 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.386 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.386 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:53.387 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.207254124999999, 2024-04-26T11:46:53.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:46:53.387 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.387 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.387 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:53.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:53.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:46:53.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:46:53.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:46:53.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:46:53.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:46:53.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:46:53.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:46:53.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:46:53.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:46:53.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:46:53.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:46:53.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:46:53.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:46:53.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:46:53.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:46:53.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:46:53.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:46:53.396 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.396 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.396 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.397 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.397 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:53.397 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.204654887, 2024-04-26T11:46:53.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:46:53.398 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.398 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.398 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:53.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:53.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:46:53.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:46:53.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:46:53.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:46:53.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:46:53.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:46:53.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:46:53.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:46:53.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:46:53.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:46:53.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:46:53.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:46:53.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:46:53.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:46:53.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:46:53.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:46:53.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:46:53.407 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.407 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.408 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.408 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.408 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:53.408 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.204177629, 2024-04-26T11:46:53.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:46:53.409 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.409 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.409 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:53.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:53.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:46:53.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:46:53.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:46:53.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:46:53.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:46:53.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:46:53.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:46:53.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:46:53.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:46:53.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:46:53.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:46:53.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:46:53.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:46:53.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:46:53.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:46:53.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:46:53.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:46:53.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.417 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.418 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.418 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:53.418 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.200110426999998, 2024-04-26T11:46:53.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:46:53.418 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.418 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.419 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:53.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:53.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:53.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:46:53.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:46:53.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:46:53.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:46:53.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.423 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.199946307000001, 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:53.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:53.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:53.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:46:53.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:46:53.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:46:53.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:46:53.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:46:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:46:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:46:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:46:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:46:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:46:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:46:53.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:46:53.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:46:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:46:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:46:53.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:46:53.432 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.432 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.432 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.432 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.432 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:53.433 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.197013646999999, 2024-04-26T11:46:53.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:46:53.433 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.433 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.433 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:53.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:53.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:46:53.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:46:53.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:46:53.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:46:53.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.440 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:53.440 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:53.440 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.194831056000002, 2024-04-26T11:46:53.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:46:53.440 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.440 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.440 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:53.440 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:53.440 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:53.440 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:46:53.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:46:53.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:46:53.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:46:53.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.445 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.446 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.446 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:53.446 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.192320021, 2024-04-26T11:46:53.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:46:53.446 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.446 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.446 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:53.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:53.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:46:53.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:46:53.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:46:53.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:46:53.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:46:53.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:46:53.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:46:53.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:46:53.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:46:53.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:46:53.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:46:53.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:46:53.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:46:53.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:46:53.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:46:53.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:46:53.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:46:53.453 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.453 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.453 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.453 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.454 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:53.454 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.189925379999998, 2024-04-26T11:46:53.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:46:53.454 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.454 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.454 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:53.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:53.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:46:53.458 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.189740320999999, 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.463 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.189700434999999, 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:53.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:46:53.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:46:53.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.187961190999999, 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.472 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.187259482000002, 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:46:53.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:46:53.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:46:53.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:46:53.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:46:53.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:46:53.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:46:53.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:46:53.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:46:53.478 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.183380051, 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:53.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:46:53.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:53.483 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.183351212000002, 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:53.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:46:53.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:53.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:53.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:46:53.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:46:53.488 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.488 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.488 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.488 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:53.488 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:53.488 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:53.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:53.490 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:53.488+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:53.590 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:53.589+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:53.608 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:53.608 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:53.608 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:53.608 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:53.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:53.691 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:53.688+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:53.745 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:53.746 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:53.746 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:53.746 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:53.746 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:53.755 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:53.792 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:53.789+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:53.860 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.703300324000001, 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.703273595999999, 2024-04-26T11:46:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.703242645, 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.701280627999999, 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.701255008, 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.701194814000001, 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.701168036999999, 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.701111989000001, 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.701072023000002, 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.701041412999999, 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.700966905000001, 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.700898840000001, 2024-04-26T11:46:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.700798692999999, 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.680949591000001, 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.680891291999998, 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:53.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.678854033, 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:53.939 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:53.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 18.083495932999998, 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:53.944 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:53.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.515348196, 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:53.955 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.803993039, 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:46:53.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:46:53.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:53.960 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.799230831999999, 2024-04-26T11:46:53.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:46:53.961 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:53.961 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:53.961 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:53.961 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:53.961 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:53.961 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:46:53.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.961 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:53.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:53.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.965 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:53.966 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:53.967 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:53.968 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:53.965+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:54.068 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:54.065+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:54.096 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:54.096 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:54.096 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:54.096 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:54.106 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:46:54.169 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:54.168+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:54.212 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:54.212 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:54.213 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:54.213 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:54.213 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:54.222 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:54.269 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:54.269+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:54.328 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:54.328 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:54.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:54.328 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:54.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.328 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:54.328 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:54.328 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.604600050999998, 2024-04-26T11:46:54.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:46:54.328 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:46:54.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:46:54.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.183831345000002, 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.334 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:46:54.338 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.339 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.339 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.339 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.339 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:54.339 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.183802867000001, 2024-04-26T11:46:54.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:46:54.339 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.339 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:46:54.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:46:54.343 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.18377765, 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:54.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.348 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.183741564000002, 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.183714741999999, 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.353 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.357 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.181115504000001, 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:46:54.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.362 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.180638246000001, 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.176571043999999, 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:46:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.176406923999998, 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.376 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.173474263999999, 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:54.381 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.171291672999999, 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:54.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:46:54.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:54.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:46:54.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:46:54.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:46:54.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:46:54.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.168780638000001, 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:46:54.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:46:54.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:46:54.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:46:54.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:46:54.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:46:54.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:46:54.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.392 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.166385996999999, 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:54.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:54.397 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.166200937999999, 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:46:54.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.166161052, 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.402 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:54.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.406 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.164421808, 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:54.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:46:54.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:46:54.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.163720098999999, 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:46:54.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:46:54.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.416 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.159840668000001, 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:46:54.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.421 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.159811828999999, 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:54.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:54.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:46:54.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.426 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:54.427 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:54.427 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:54.428 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:54.425+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:54.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:54.529 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:54.529+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:54.546 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:54.546 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:54.546 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:54.546 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:54.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:54.630 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:54.629+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:54.671 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:54.672 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:54.672 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:54.672 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:54.672 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:54.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:54.731 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:54.729+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:54.788 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:54.788 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.632349593999997, 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:54.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.632322866000003, 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:54.794 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:54.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:54.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:54.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:54.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:54.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:54.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.632291915000003, 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:54.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:54.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:54.805 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.630329897999999, 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:54.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.630304278000001, 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:54.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.630244084000001, 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:54.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:54.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.819 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.630217306999999, 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:54.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.630161259000001, 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:54.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.630121292999998, 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:54.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.833 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.630090682999999, 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:54.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.630016175000002, 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.838 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:54.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.842 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.629948110000001, 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:54.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.847 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.629847963, 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:54.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:54.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:54.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:54.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:54.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:54.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.852 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.609998861000001, 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:54.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:54.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.609940561999998, 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.607903303000001, 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:54.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 19.012545202999998, 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.444397466, 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:46:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:46:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:46:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:46:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.733042309, 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.728280101999999, 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:46:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:54.888 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:54.888 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:54.888 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:54.890 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:54.890 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:54.888+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:54.991 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:54.989+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:55.006 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:55.006 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:55.006 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:55.006 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:55.017 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:55.040 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:55.066 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:55.067 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:55.067 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:55.067 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:55.072 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:55.072 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:55.091 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:55.089+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:55.122 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:55.122 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:55.132 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:55.192 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:55.189+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:55.290 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:55.290 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:55.293 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:55.293+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:55.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:55.395 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:55.396+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:55.417 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:55.418 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:55.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:55.496 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:55.493+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:55.531 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:55.531 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:55.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:55.597 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:55.596+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:55.644 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:55.644 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:55.654 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:55.698 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:55.697+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:55.799 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:55.796+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:55.799 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:55.799 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:55.810 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:55.900 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:55.897+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:55.963 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:55.964 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:55.973 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:56.018 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:56.017+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:56.079 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:56.079 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:56.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:56.140 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:56.140+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:56.156 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:46:56.200 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:56.200 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:56.202 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:56.201+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:56.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:56.304 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:56.301+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:56.322 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:56.322 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:56.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:56.404 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:56.404+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:56.439 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:56.439 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:56.449 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:56.505 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:56.501+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:56.576 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:56.606 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:56.605+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:56.695 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:56.695 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:56.707 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:56.708 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:56.708+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:56.808 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:56.808+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:56.855 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:56.855 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:56.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:56.912 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:56.912+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:56.976 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:56.977 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:56.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:57.010 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:57.009+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:57.073 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:46:57.088 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:57.088 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:57.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:57.111 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:57.109+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:57.142 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:46:57.211 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:57.211 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:57.212 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:57.212+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:57.220 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:57.234 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:57.262 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:57.262 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:57.262 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:57.262 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:57.266 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:57.267 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:57.313 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:57.312+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:57.339 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:57.339 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:57.339 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:57.339 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:57.349 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:57.414 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:57.413+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:57.456 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:57.456 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:57.456 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:57.456 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:57.456 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:57.466 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:57.514 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:57.513+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:57.568 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:57.568 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:57.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:57.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:57.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.568 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:57.568 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:57.568 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.843500786, 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:46:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:46:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.422732079999999, 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.422703601999999, 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:46:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.422678385000001, 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.583 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:46:57.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:46:57.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.422642299, 2024-04-26T11:46:57.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:46:57.589 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.589 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.589 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:57.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:57.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:46:57.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:57.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:46:57.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:46:57.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:46:57.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:46:57.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:46:57.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:46:57.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:46:57.593 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.594 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.594 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.594 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.594 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:57.594 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.422615477000001, 2024-04-26T11:46:57.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:46:57.594 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.594 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.594 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:46:57.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:57.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:46:57.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:46:57.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:46:57.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:46:57.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:46:57.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:46:57.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:46:57.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:46:57.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:46:57.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:46:57.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:46:57.599 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.420016238999999, 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:57.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:46:57.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:46:57.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:46:57.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:46:57.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:46:57.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.419538980999999, 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.605 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:46:57.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:46:57.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:46:57.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:46:57.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:46:57.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.415471779000001, 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:57.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:46:57.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:46:57.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:46:57.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:46:57.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:46:57.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:46:57.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:57.616 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.415307659, 2024-04-26T11:46:57.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:46:57.617 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.617 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.617 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:57.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:46:57.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:46:57.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:46:57.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:46:57.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:46:57.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:46:57.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.412374999000001, 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.622 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:46:57.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:46:57.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:57.627 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.410192408, 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:57.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:46:57.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:46:57.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:46:57.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:46:57.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:46:57.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:46:57.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.407681372999999, 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.634 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:46:57.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:57.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:46:57.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:46:57.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:46:57.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:46:57.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:46:57.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:46:57.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:46:57.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:46:57.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:46:57.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:46:57.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:46:57.639 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.640 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.640 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.640 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.640 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:57.640 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.405286732, 2024-04-26T11:46:57.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:46:57.640 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.640 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.640 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:46:57.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:57.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:46:57.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:46:57.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:46:57.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:46:57.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:46:57.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:46:57.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:46:57.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.646 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.646 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:57.646 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.405101673000001, 2024-04-26T11:46:57.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:46:57.646 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.646 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.646 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:57.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:57.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:57.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:57.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:46:57.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.405061787000001, 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:46:57.651 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:46:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.403322543000002, 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:46:57.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.661 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.662 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.662 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.662 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:57.662 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.402620834, 2024-04-26T11:46:57.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:46:57.662 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.662 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.662 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:46:57.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.398741402999999, 2024-04-26T11:46:57.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:46:57.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:57.672 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.398712564, 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:57.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:46:57.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:57.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:46:57.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.677 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.678 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:57.678 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:57.678 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:57.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:57.681 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:57.680+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:57.779 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:57.777+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:57.821 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:57.821 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:57.821 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:46:57.821 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:57.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:57.880 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:57.877+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:57.926 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:57.926 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:57.926 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:57.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:57.981 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:57.980+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:58.045 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.88864504, 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:58.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:58.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.888618311999998, 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.888587360999999, 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:58.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.886625343999999, 2024-04-26T11:46:58.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:58.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.886599724, 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:58.067 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.88653953, 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.886512753000002, 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.886456705000001, 2024-04-26T11:46:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:58.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.886416739000001, 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:58.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:58.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.090 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.886386129000002, 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.886311621000001, 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.886243556, 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.886143408999999, 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.866294307, 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.866236008000001, 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.864198749, 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.268840649000001, 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.700692912000001, 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:46:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:46:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.989337755000001, 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:46:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:46:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.984575547999999, 2024-04-26T11:46:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:46:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:46:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:46:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:46:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:46:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.146 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:58.147 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:58.145+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:58.148 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:58.248 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:58.248+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:58.263 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:58.264 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:58.264 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:46:58.264 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:58.273 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:58.349 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:58.345+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:58.380 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:58.381 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:58.390 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:58.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~124s 2024-04-26T11:46:58.449 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:58.449+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:58.493 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:58.493 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:46:58.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:46:58.493 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:58.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.493 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.770194447000002, 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:46:58.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.349425741000001, 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:46:58.499 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:46:58.503 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.349397263, 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:58.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:46:58.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.508 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.349372045999999, 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:46:58.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.349335960000001, 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:46:58.513 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.517 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.349309137999999, 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:46:58.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.3467099, 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:58.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:46:58.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:46:58.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:46:58.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:46:58.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:46:58.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.346232642, 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:46:58.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.342165439999999, 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:46:58.532 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:46:58.536 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.342001320000001, 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:46:58.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.541 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.339068659999999, 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.336886068999998, 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.546 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:46:58.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.551 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.334375034000001, 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:46:58.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:46:58.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:46:58.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.331980392999998, 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:46:58.556 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.331795333999999, 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:46:58.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:58.565 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.331755447999999, 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:46:58.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:46:58.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:46:58.569 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.330016204, 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:58.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:46:58.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:46:58.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.574 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.329314494999998, 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:46:58.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.325435064000001, 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:46:58.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:46:58.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.583 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.325406224999998, 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:58.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:58.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:58.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:58.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:46:58.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:46:58.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:46:58.588 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.588 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.588 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.588 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:58.588 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:58.588 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:58.589 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:58.589+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:58.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:58.690 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:58.689+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:58.712 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11944 4.4 4:2040c502:::10000000c5e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.709370+0000", 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0028251610000000001, 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028475100000000001, 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709370+0000", 2024-04-26T11:46:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709370+0000", 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709367+0000", 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709380+0000", 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2753e-05 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709402+0000", 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2249999999999999e-05 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709420+0000", 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7915999999999999e-05 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709798+0000", 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00037743800000000001 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710744+0000", 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00094595499999999995 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11947 4.27 4:e5a60d85:::10000000c6d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.709439+0000", 2024-04-26T11:46:58.716 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002756189, 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028440679999999999, 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709439+0000", 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709439+0000", 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709437+0000", 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709445+0000", 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8630000000000008e-06 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709464+0000", 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8715999999999998e-05 2024-04-26T11:46:58.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709478+0000", 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3859999999999999e-05 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709603+0000", 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012502100000000001 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709844+0000", 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024105200000000001 2024-04-26T11:46:58.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710030+0000", 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018636099999999999 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11948 4.3 4:c217e4b9:::10000000c75.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.709490+0000", 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0027043330000000002, 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00286915, 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.720 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709490+0000", 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709490+0000", 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709489+0000", 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709496+0000", 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709512+0000", 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5778999999999999e-05 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709525+0000", 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3497e-05 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709607+0000", 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2161000000000002e-05 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709852+0000", 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024472799999999999 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710030+0000", 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017796899999999999 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:11924 3.14 e66/16 3:2e600548:::200.0000001a:head v 66'88, mlcod=66'86)", 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.709488+0000", 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0027066709999999999, 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0029331539999999999, 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709488+0000", 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709488+0000", 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709488+0000", 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709915+0000", 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042774099999999998 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709924+0000", 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1859999999999998e-06 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709931+0000", 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2310000000000001e-06 2024-04-26T11:46:58.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710055+0000", 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012453099999999999 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710459+0000", 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00040367400000000002 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11950 4.24 4:27248e0f:::10000000c78.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.710161+0000", 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0020339960000000002, 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023172700000000002, 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710161+0000", 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710161+0000", 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710158+0000", 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999976 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710170+0000", 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1712999999999999e-05 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710195+0000", 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5012999999999999e-05 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710212+0000", 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.717e-05 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.711528+0000", 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001316107 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.711799+0000", 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00027054800000000001 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.711883+0000", 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4307000000000004e-05 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:11927 4.25 e66/17 4:a5f7fd7e:::10000000c4d.00000000:head v 66'289, mlcod=66'286)", 2024-04-26T11:46:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.710171+0000", 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0020235589999999999, 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023620540000000002, 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710171+0000", 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710171+0000", 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710171+0000", 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710176+0000", 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4319999999999998e-06 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710604+0000", 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042808899999999999 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710612+0000", 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5429999999999996e-06 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710784+0000", 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017256300000000001 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710803+0000", 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8627999999999999e-05 2024-04-26T11:46:58.734 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11951 3.1b 3:df7def61:::10000000f45.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.710642+0000", 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0015523379999999999, 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019560100000000002, 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710642+0000", 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710642+0000", 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710622+0000", 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999795 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710647+0000", 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4620000000000001e-05 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710654+0000", 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9090000000000003e-06 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710659+0000", 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000001e-06 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710729+0000", 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0208000000000003e-05 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710900+0000", 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017070900000000001 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11952 4.8 4:13db5ef6:::10000000f46.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-26T11:46:58.738 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.710675+0000", 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0015197710000000001, 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019770059999999999, 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710675+0000", 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710675+0000", 2024-04-26T11:46:58.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710674+0000", 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710677+0000", 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8739999999999999e-06 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710684+0000", 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.28e-06 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710688+0000", 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7949999999999998e-06 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710716+0000", 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7977999999999999e-05 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710809+0000", 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2368999999999996e-05 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710858+0000", 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8881000000000002e-05 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11957 4.22 4:45cee64e:::10000000f4a.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-26T11:46:58.742 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.712040+0000", 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00015500999999999999, 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067490200000000001, 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712040+0000", 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712040+0000", 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712039+0000", 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712044+0000", 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5879999999999999e-06 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712051+0000", 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3810000000000001e-06 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712056+0000", 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7559999999999999e-06 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712099+0000", 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3402999999999998e-05 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712211+0000", 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011207199999999999 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712278+0000", 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7150999999999995e-05 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.747 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11958 4.10 4:0b0ec4dc:::10000000f4b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-26T11:46:58.747 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.712067+0000", 2024-04-26T11:46:58.747 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00012826299999999999, 2024-04-26T11:46:58.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068841300000000002, 2024-04-26T11:46:58.747 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.747 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:58.747 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712067+0000", 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712067+0000", 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712066+0000", 2024-04-26T11:46:58.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712069+0000", 2024-04-26T11:46:58.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0879999999999999e-06 2024-04-26T11:46:58.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712075+0000", 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7939999999999999e-06 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712078+0000", 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1250000000000001e-06 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712117+0000", 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9297e-05 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712244+0000", 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012683400000000001 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:11959 4.e e66/17 4:70d51104:::10000000f4c.00000000:head v 66'254, mlcod=66'251)", 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.712663+0000", 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9995313, 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012233099999999999, 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:46:58.752 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712663+0000", 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712663+0000", 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712663+0000", 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712669+0000", 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5769999999999999e-06 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712677+0000", 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.79e-06 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712683+0000", 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9410000000000004e-06 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712725+0000", 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2355999999999999e-05 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712737+0000", 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1729000000000001e-05 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.755 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11938 4.15 4:a9710ca5:::10000000c58.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.708863+0000", 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0033315660000000002, 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003954964, 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708863+0000", 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708863+0000", 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708862+0000", 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708869+0000", 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9800000000000001e-06 2024-04-26T11:46:58.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708886+0000", 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.732e-05 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708909+0000", 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2665999999999999e-05 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710081+0000", 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001171753 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.710368+0000", 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028729299999999999 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712607+0000", 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002238791 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712713+0000", 2024-04-26T11:46:58.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010603300000000001 2024-04-26T11:46:58.760 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.760 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.760 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.760 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11941 4.1f 4:fa65588e:::10000000c5b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-26T11:46:58.760 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:58.708928+0000", 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00326728, 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039268990000000002, 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708928+0000", 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708928+0000", 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708927+0000", 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708933+0000", 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1630000000000001e-06 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708949+0000", 2024-04-26T11:46:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6062999999999999e-05 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.708962+0000", 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3056e-05 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709162+0000", 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019968899999999999 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709489+0000", 2024-04-26T11:46:58.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00032797300000000001 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.709712+0000", 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022208800000000001 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:58.712420+0000", 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027082529999999999 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:46:58.764 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 13 2024-04-26T11:46:58.765 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:58.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:58.791 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:58.789+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:58.868 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:58.869 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:46:58.869 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:46:58.869 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:46:58.869 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:58.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:58.924 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:58.924+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:58.991 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:46:58.991 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:46:58.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:46:58.991 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:46:58.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.991 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:58.991 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.832401631000003, 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:58.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:46:58.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:58.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:58.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:46:58.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:58.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:58.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:46:58.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:46:58.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:58.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:46:58.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:46:58.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:58.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:46:58.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:46:58.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:58.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:46:58.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:46:58.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:58.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:46:58.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:46:58.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:58.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:46:58.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:46:58.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:58.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:46:58.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:46:58.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:58.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:46:58.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:46:58.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:58.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:46:58.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:46:58.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:58.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:58.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:46:59.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:46:59.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.000 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.000 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:59.000 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:59.000 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.832374903000002, 2024-04-26T11:46:59.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:46:59.001 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.001 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.001 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:59.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:59.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:46:59.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:46:59.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:46:59.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:46:59.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:46:59.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:46:59.007 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.007 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.007 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.007 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:46:59.007 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:59.007 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.832343952000002, 2024-04-26T11:46:59.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:46:59.007 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.007 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:46:59.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:46:59.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.830381934999998, 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.013 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:59.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:59.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:46:59.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:46:59.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.830356315, 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.018 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:59.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:46:59.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:46:59.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:46:59.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:46:59.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:46:59.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:46:59.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:46:59.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:46:59.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:46:59.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:46:59.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:46:59.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:46:59.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:46:59.024 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.024 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.024 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.025 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.025 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:59.025 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.830296121, 2024-04-26T11:46:59.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:46:59.025 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.025 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.025 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:46:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:46:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:46:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:46:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.830269344000001, 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:46:59.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:46:59.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:46:59.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.035 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.035 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.035 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:59.035 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.830213296, 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:46:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:46:59.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:46:59.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:46:59.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:46:59.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:46:59.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:46:59.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:46:59.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:46:59.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:46:59.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:46:59.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:46:59.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:46:59.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.830173330000001, 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:46:59.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:46:59.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:46:59.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:46:59.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:46:59.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:46:59.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:46:59.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:46:59.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:46:59.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:46:59.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.048 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.049 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.049 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:59.049 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.830142720000001, 2024-04-26T11:46:59.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:46:59.050 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.050 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.050 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:59.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:46:59.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:46:59.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:59.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:46:59.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:46:59.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:46:59.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:46:59.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:46:59.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:46:59.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:46:59.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:46:59.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:46:59.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:46:59.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:46:59.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:46:59.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:46:59.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:46:59.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:46:59.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:46:59.059 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.059 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.059 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.060 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.060 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:59.060 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.830068212, 2024-04-26T11:46:59.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:46:59.060 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.060 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.061 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:59.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:46:59.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:46:59.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:59.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:46:59.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:46:59.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:46:59.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:46:59.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:46:59.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:46:59.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:46:59.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:46:59.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:46:59.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:46:59.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:46:59.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:46:59.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:46:59.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:46:59.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:46:59.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:46:59.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.070 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.071 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.071 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:59.071 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.830000147, 2024-04-26T11:46:59.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:46:59.071 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.071 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.072 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:59.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:59.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.829899999999999, 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.081 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.810050898, 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:46:59.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:46:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:59.086 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.809992599000001, 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:46:59.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:46:59.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:46:59.090 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.807955339999999, 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:59.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:46:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.212597240000001, 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:59.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:46:59.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 18.644449503000001, 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:59.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:46:59.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:46:59.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.933094346000001, 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:46:59.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.928332138999998, 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:46:59.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:46:59.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:46:59.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:46:59.116 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:46:59.118 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:59.118 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:59.115+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:59.156 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:46:59.218 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:59.215+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:59.242 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12659 3.14 3:2e600548:::200.0000001a:head [write 1300413~3325 [fadvise_dontneed] in=3325b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:59.241427+0000", 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0013334880000000001, 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013766270000000001, 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:59.241427+0000", 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:59.241427+0000", 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:59.241425+0000", 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:59.241437+0000", 2024-04-26T11:46:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1856e-05 2024-04-26T11:46:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:46:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:59.241462+0000", 2024-04-26T11:46:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4643000000000001e-05 2024-04-26T11:46:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:46:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:59.241474+0000", 2024-04-26T11:46:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2166e-05 2024-04-26T11:46:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:46:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:59.241539+0000", 2024-04-26T11:46:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4828999999999999e-05 2024-04-26T11:46:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:46:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:59.241615+0000", 2024-04-26T11:46:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6501999999999994e-05 2024-04-26T11:46:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:46:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:46:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:46:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:59.241725+0000", 2024-04-26T11:46:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109381 2024-04-26T11:46:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:46:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:46:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:46:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-26T11:46:59.248 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:59.253 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:46:59.268 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:46:59.320 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:59.319+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:59.360 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:46:59.360 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:46:59.361 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:46:59.361 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:46:59.361 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:46:59.371 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:46:59.412 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:46:59.421 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:59.419+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:59.437 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:46:59.437 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:46:59.437 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:46:59.437 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:46:59.441 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:46:59.441 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:46:59.471 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:59.472 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:59.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:46:59.521 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:59.521+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:59.597 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:59.597 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:59.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:46:59.622 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:59.619+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:59.713 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:59.713 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:59.723 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:59.721+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:59.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:46:59.824 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:46:59.821+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:46:59.856 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:59.856 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:59.870 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:46:59.925 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:46:59.923+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:46:59.972 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:46:59.972 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:46:59.982 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:00.025 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:00.025+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:00.089 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:00.089 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:00.099 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:00.126 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:00.125+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:00.168 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:47:00.200 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:00.200 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:00.209 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:00.227 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:00.223+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:00.308 DEBUG:teuthology.orchestra.console.smithi082:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D3 FF GUID: 00000000 0000 0000 0000 0CC47AD8DAC6 DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.82 MASK 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.82 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d3:ff)... Configuring (net0 0c:c4:7a:8f:d3:ff).... Configuring (net0 0c:c4:7a:8f:d3:ff)..... Configuring (net0 0c:c4:7a:8f:d3:ff)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.4.0-177-generic (buildd@lcy02-amd64-112) (gcc version 9.4.0 (Ubuntu 9.4.0-1ubuntu1~20.04.2)) #197-Ubuntu SMP Thu Mar 28 22:45:47 UTC 2024 (Ubuntu 5.4.0-177.197-generic 5.4.268) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ea3fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f56000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.969 MHz processor [ 0.001008] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.001442] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001982] last_pfn = 0x78ea4 max_arch_pfn = 0x400000000 [ 0.007589] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.007631] check: Scanning 1 areas for low memory corruption [ 0.007635] Using GB pages for direct mapping [ 0.007779] RAMDISK: [mem 0x3157d000-0x34ab5fff] [ 0.007783] ACPI: Early table checksum verification disabled [ 0.007786] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.007788] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.007792] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007796] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.007798] ACPI: FACS 0x0000000079D49F80 000040 [ 0.007800] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007802] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007804] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007806] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.007808] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.007810] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.007812] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007814] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.007816] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.007818] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.007820] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.007822] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.007824] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007826] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007828] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007829] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007831] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007833] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.007834] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.007835] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.007836] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.007836] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.007837] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.007838] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.007838] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.007839] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.007840] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.007840] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.007841] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.007841] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.007842] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.007843] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.007844] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.007844] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.007845] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.007846] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.007846] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.007917] No NUMA configuration found [ 0.007918] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.007925] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.008096] Zone ranges: [ 0.008097] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008098] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008099] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008099] Device empty [ 0.008100] Movable zone start for each node [ 0.008103] Early memory node ranges [ 0.008104] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.008104] node 0: [mem 0x0000000000100000-0x0000000078ea3fff] [ 0.008105] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008338] Zeroed struct page in unavailable ranges: 29138 pages [ 0.008339] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.083747] ACPI: PM-Timer IO Port: 0x408 [ 0.083755] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.083756] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.083756] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.083757] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.083757] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.083758] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.083759] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.083759] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.083768] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.083772] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.083774] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.083775] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.083778] Using ACPI (MADT) for SMP configuration information [ 0.083779] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.083782] TSC deadline timer available [ 0.083783] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.083792] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.083793] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.083793] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.083794] PM: Registered nosave memory: [mem 0x78ea4000-0x78f55fff] [ 0.083795] PM: Registered nosave memory: [mem 0x78f56000-0x798adfff] [ 0.083796] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.083796] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.083797] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.083797] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.083798] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.083798] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.083800] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.083801] Booting paravirtualized kernel on bare hardware [ 0.083803] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.083807] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.084013] percpu: Embedded 60 pages/cpu s208896 r8192 d28672 u262144 [ 0.084035] Built 1 zonelists, mobility grouping on. Total pages: 8228830 [ 0.084036] Policy zone: Normal [ 0.084037] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.086240] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.087377] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.087458] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.164890] Memory: 32692504K/33437880K available (14339K kernel code, 2395K rwdata, 9292K rodata, 2768K init, 17228K bss, 745376K reserved, 0K cma-reserved) [ 0.165114] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.165128] Kernel/User page tables isolation: enabled [ 0.165154] ftrace: allocating 44725 entries in 175 pages [ 0.177458] ftrace: allocated 175 pages with 6 groups [ 0.177563] rcu: Hierarchical RCU implementation. [ 0.177564] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.177565] Tasks RCU enabled. [ 0.177565] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.177566] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.179764] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.179945] random: crng init done [ 0.184787] Console: colour VGA+ 80x25 [ 0.195108] printk: console [tty0] enabled [ 1.126223] printk: console [ttyS1] enabled [ 1.130477] ACPI: Core revision 20190816 [ 1.134632] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.143851] APIC: Switch to symmetric I/O mode setup [ 1.148890] DMAR: Host address width 46 [ 1.152791] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.158169] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.166259] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.172592] DMAR: ATSR flags: 0x0 [ 1.175972] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.182308] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.188729] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.195151] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.200616] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.200617] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.215742] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.221117] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.227408] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.251852] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327333a6725, max_idle_ns: 440795319410 ns [ 1.262456] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.93 BogoMIPS (lpj=13999876) [ 1.266490] mce: CPU0: Thermal monitoring enabled (TM1) [ 1.270495] process: using mwait in idle threads [ 1.274456] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.278455] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.282456] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.286456] Spectre V2 : Mitigation: Retpolines [ 1.290455] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.294455] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.298455] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.302455] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.306455] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.310455] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.314458] MDS: Mitigation: Clear CPU buffers [ 1.318455] TAA: Mitigation: Clear CPU buffers [ 1.322455] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.326459] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.330455] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.334455] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.338456] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.342455] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.346636] Freeing SMP alternatives memory: 40K [ 1.351784] pid_max: default: 32768 minimum: 301 [ 1.354476] LSM: Security Framework initializing [ 1.358462] Yama: becoming mindful. [ 1.362478] AppArmor: AppArmor initialized [ 1.366514] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.370495] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.374464] *** VALIDATE tmpfs *** [ 1.378554] *** VALIDATE proc *** [ 1.382495] *** VALIDATE cgroup1 *** [ 1.386456] *** VALIDATE cgroup2 *** [ 1.390647] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.394517] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.398456] ... version: 3 [ 1.402455] ... bit width: 48 [ 1.406455] ... generic registers: 4 [ 1.410455] ... value mask: 0000ffffffffffff [ 1.414455] ... max period: 00007fffffffffff [ 1.418455] ... fixed-purpose events: 3 [ 1.422455] ... event mask: 000000070000000f [ 1.426481] rcu: Hierarchical SRCU implementation. [ 1.431273] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.434516] smp: Bringing up secondary CPUs ... [ 1.438523] x86: Booting SMP configuration: [ 1.442457] .... node #0, CPUs: #1 #2 #3 #4 [ 1.450673] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.458455] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.462455] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.466550] #5 #6 #7 [ 1.467081] smp: Brought up 1 node, 8 CPUs [ 1.474457] smpboot: Max logical packages: 1 [ 1.478455] smpboot: Total of 8 processors activated (55999.50 BogoMIPS) [ 1.484592] devtmpfs: initialized [ 1.486494] x86/mm: Memory block size: 128MB [ 1.493567] PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.494529] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.498467] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.502498] pinctrl core: initialized pinctrl subsystem [ 1.506535] PM: RTC time: 11:46:40, date: 2024-04-26 [ 1.510543] NET: Registered protocol family 16 [ 1.514525] audit: initializing netlink subsys (disabled) [ 1.518462] audit: type=2000 audit(1714131998.332:1): state=initialized audit_enabled=0 res=1 [ 1.518539] EISA bus registered [ 1.525663] cpuidle: using governor ladder [ 1.526457] cpuidle: using governor menu [ 1.530468] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.534456] ACPI: bus type PCI registered [ 1.538456] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.542503] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.546457] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.550465] PCI: Using configuration type 1 for base access [ 1.556453] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.558458] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.562519] ACPI: Added _OSI(Module Device) [ 1.566457] ACPI: Added _OSI(Processor Device) [ 1.570462] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.574455] ACPI: Added _OSI(Processor Aggregator Device) [ 1.578455] ACPI: Added _OSI(Linux-Dell-Video) [ 1.582455] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.586455] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.632365] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.637802] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.642591] ACPI: Dynamic OEM Table Load: [ 1.670585] ACPI: Interpreter enabled [ 1.674320] ACPI: (supports S0 S4 S5) [ 1.674456] ACPI: Using IOAPIC for interrupt routing [ 1.678474] HEST: Enabling Firmware First mode for corrected errors. [ 1.682537] HEST: Table parsing has been initialized. [ 1.686457] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.691122] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.725067] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.730459] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 1.740463] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR] [ 1.751396] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.758456] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.766490] PCI host bridge to bus 0000:ff [ 1.770456] pci_bus 0000:ff: root bus resource [bus ff] [ 1.774464] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.782515] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.786505] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.794504] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.798505] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.806506] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.810508] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.818503] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.822509] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.830503] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.834505] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.842503] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.846503] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.854504] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.862504] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.866504] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.874506] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.878503] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.886504] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.890477] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.898508] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.902545] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.910516] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.914515] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.922520] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.926516] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.934514] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.938505] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.946509] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.954517] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.958522] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.966516] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 1.970517] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 1.978506] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 1.982506] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 1.990506] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 1.994506] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.002517] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.006516] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.014515] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.018520] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.026510] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.030505] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.038506] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.042509] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.050506] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.058505] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.062505] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.070511] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.074505] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.082505] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.086504] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.094478] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.098509] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.106504] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.114255] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.122458] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 2.130757] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR] [ 2.146873] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.154456] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.162716] PCI host bridge to bus 0000:00 [ 2.166456] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.174456] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.182456] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.190455] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.194456] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.202455] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.210456] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.218462] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.222604] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.230525] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.234559] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.242524] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.246553] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.254524] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.258553] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.266475] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.274592] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.278474] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.286592] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.290474] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.298591] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.306474] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.310590] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.318474] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.326594] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.330474] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.338591] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.346474] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.350592] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.358474] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.366591] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.370572] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.378592] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.382572] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.390470] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.394595] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.402682] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.406479] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.414467] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.418467] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.426467] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.430467] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.434467] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.442498] pci 0000:00:11.4: PME# supported from D3hot [ 2.446552] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.454483] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.462533] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.466542] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.474483] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.478534] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.486541] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.494483] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.498534] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.506553] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.510481] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.518560] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.522546] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.530547] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.538556] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.542548] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.550555] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.554548] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.562564] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.566481] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.574560] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.578548] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.586668] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.594477] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.598466] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.602466] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.610466] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.614466] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.622466] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.626491] pci 0000:00:1f.2: PME# supported from D3hot [ 2.634539] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.638480] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.646487] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.650691] acpiphp: Slot [1] registered [ 2.654472] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.662602] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.666478] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.674497] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.682458] pci 0000:02:00.0: enabling Extended Tags [ 2.686549] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.690457] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.698602] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.702479] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.710465] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.718478] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.722465] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.730498] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.738476] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.742456] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.754468] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.762456] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.774587] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.778478] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.786464] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.790478] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.798464] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.806498] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.810473] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.818456] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.830468] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.838456] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.846581] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.854457] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.858456] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.866457] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.874486] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.878513] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.886546] pci 0000:05:00.0: enabling Extended Tags [ 2.890528] pci 0000:05:00.0: supports D1 D2 [ 2.894455] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.902540] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.906457] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.910457] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.918503] pci_bus 0000:06: extended config space not accessible [ 2.926483] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.930485] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.938472] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.942472] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.950574] pci 0000:06:00.0: supports D1 D2 [ 2.954455] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.962531] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.966463] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.970458] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.978534] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.986492] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.990483] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.998469] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.002587] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.010502] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.018456] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.026481] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.034456] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.046509] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.050491] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.058483] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.062469] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.070584] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.074493] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.082456] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.094481] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.102456] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.110587] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.118457] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.122457] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.130459] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.135333] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15) [ 3.150501] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15) [ 3.158499] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) [ 3.166498] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 3.174498] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.182499] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.190498] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.198499] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.206668] iommu: Default domain type: Translated [ 3.210585] SCSI subsystem initialized [ 3.214473] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.218454] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.230456] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.234455] vgaarb: loaded [ 3.237233] ACPI: bus type USB registered [ 3.242465] usbcore: registered new interface driver usbfs [ 3.246459] usbcore: registered new interface driver hub [ 3.254459] usbcore: registered new device driver usb [ 3.258475] pps_core: LinuxPPS API ver. 1 registered [ 3.262455] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.274456] PTP clock support registered [ 3.278461] EDAC MC: Ver: 3.0.0 [ 3.282478] PCI: Using ACPI for IRQ routing [ 3.291760] NetLabel: Initializing [ 3.294455] NetLabel: domain hash size = 128 [ 3.298455] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.302465] NetLabel: unlabeled traffic allowed by default [ 3.311185] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.314456] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.324486] clocksource: Switched to clocksource tsc-early [ 3.336892] *** VALIDATE bpf *** [ 3.340237] VFS: Disk quotas dquot_6.6.0 [ 3.344236] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.351192] *** VALIDATE ramfs *** [ 3.354660] *** VALIDATE hugetlbfs *** [ 3.358535] AppArmor: AppArmor Filesystem Enabled [ 3.363323] pnp: PnP ACPI init [ 3.366875] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.372856] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.378834] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.384815] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.390794] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.396775] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.402756] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.409433] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.416114] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.422786] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.429460] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.436135] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.442817] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.449701] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.455687] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.461665] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.467645] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.473624] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.480503] pnp: PnP ACPI: found 5 devices [ 3.485603] thermal_sys: Registered thermal governor 'fair_share' [ 3.485604] thermal_sys: Registered thermal governor 'bang_bang' [ 3.491757] thermal_sys: Registered thermal governor 'step_wise' [ 3.497823] thermal_sys: Registered thermal governor 'user_space' [ 3.503890] thermal_sys: Registered thermal governor 'power_allocator' [ 3.514527] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.530103] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.541672] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.549586] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.554632] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.559663] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.566524] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.574175] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.582175] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.589913] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.598001] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.605653] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.613653] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.621391] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.629480] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.637129] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.645132] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.652870] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.660956] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.668610] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.676611] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.684348] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.692434] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.697464] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.703625] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.710480] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.718312] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.723362] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.728387] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.734551] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.741416] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.746700] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.752861] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.759727] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.767556] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.775467] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.783294] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.791205] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.796233] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.802393] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.809249] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.817082] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.823327] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.829567] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.836502] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 3.843434] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 3.850369] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 3.857301] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.863627] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.869260] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.875589] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.882888] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.888527] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.894856] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.900486] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.906815] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.912448] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.918774] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.926200] NET: Registered protocol family 2 [ 3.930786] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.940006] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.948985] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.957390] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.964923] TCP: Hash tables configured (established 262144 bind 65536) [ 3.971670] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.978680] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.986129] NET: Registered protocol family 1 [ 3.990556] NET: Registered protocol family 44 [ 3.995126] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 4.026629] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x670 took 23645 usecs [ 4.054671] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x670 took 20064 usecs [ 4.062159] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.068677] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 4.077140] Trying to unpack rootfs image as initramfs... [ 4.183844] Freeing initrd memory: 54500K [ 4.214536] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.221044] software IO TLB: mapped [mem 0x74ea4000-0x78ea4000] (64MB) [ 4.227943] check: Scanning for low memory corruption every 60 seconds [ 4.234979] Initialise system trusted keyrings [ 4.247130] Key type blacklist registered [ 4.251220] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.258620] zbud: loaded [ 4.261464] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.267461] fuse: init (API version 7.31) [ 4.271542] *** VALIDATE fuse *** [ 4.274919] *** VALIDATE fuse *** [ 4.278366] Platform Keyring initialized [ 4.285279] Key type asymmetric registered [ 4.289439] Asymmetric key parser 'x509' registered [ 4.294384] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244) [ 4.301878] io scheduler mq-deadline registered [ 4.306835] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.312843] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.318841] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.324792] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.330757] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.336710] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.342609] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.349958] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.358412] ACPI: Power Button [PWRB] [ 4.362160] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.369664] ACPI: Power Button [PWRF] [ 4.374641] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.382209] pstore: Registered erst as persistent store backend [ 4.388371] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 4.395953] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.422872] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.450817] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.459293] Linux agpgart interface v0.103 [ 4.594612] loop: module loaded [ 4.598011] tun: Universal TUN/TAP device driver, 1.6 [ 4.603176] PPP generic driver version 2.4.2 [ 4.607572] VFIO - User Level meta-driver version: 0.3 [ 4.612872] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.619466] ehci-pci: EHCI PCI platform driver [ 4.624116] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.629416] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.636903] ehci-pci 0000:00:1a.0: debug port 2 [ 4.645404] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 4.652268] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.670587] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.676434] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.684781] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.692083] usb usb1: Product: EHCI Host Controller [ 4.697027] usb usb1: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.703442] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.708215] hub 1-0:1.0: USB hub found [ 4.712033] hub 1-0:1.0: 2 ports detected [ 4.716314] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.721604] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.729090] ehci-pci 0000:00:1d.0: debug port 2 [ 4.737600] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 4.744450] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.762556] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.768392] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.776736] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.784040] usb usb2: Product: EHCI Host Controller [ 4.788983] usb usb2: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.795399] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.800166] hub 2-0:1.0: USB hub found [ 4.803978] hub 2-0:1.0: 2 ports detected [ 4.808182] ehci-platform: EHCI generic platform driver [ 4.813478] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.819724] ohci-pci: OHCI PCI platform driver [ 4.824244] ohci-platform: OHCI generic platform driver [ 4.829542] uhci_hcd: USB Universal Host Controller Interface driver [ 4.836098] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.841390] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.849917] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.859140] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported [ 4.866139] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.871424] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.878900] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.885250] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.893595] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.900896] usb usb3: Product: xHCI Host Controller [ 4.905837] usb usb3: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.912255] usb usb3: SerialNumber: 0000:00:14.0 [ 4.917018] hub 3-0:1.0: USB hub found [ 4.920846] hub 3-0:1.0: 15 ports detected [ 4.927126] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.04 [ 4.935473] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.942774] usb usb4: Product: xHCI Host Controller [ 4.947717] usb usb4: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.954133] usb usb4: SerialNumber: 0000:00:14.0 [ 4.958929] hub 4-0:1.0: USB hub found [ 4.962759] hub 4-0:1.0: 6 ports detected [ 4.967948] i8042: PNP: No PS/2 controller found. [ 4.972783] mousedev: PS/2 mouse device common for all mice [ 4.974549] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.978521] rtc_cmos 00:00: RTC can wake from S4 [ 4.989863] rtc_cmos 00:00: registered as rtc0 [ 4.994386] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 5.002130] i2c /dev entries driver [ 5.005705] device-mapper: uevent: version 1.0.3 [ 5.010452] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: dm-devel@redhat.com [ 5.018984] platform eisa.0: Probing EISA bus 0 [ 5.023580] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 5.030430] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 5.036936] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 5.043437] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 5.049937] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 5.056437] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 5.062550] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 5.062939] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 5.076027] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 5.082533] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 5.089033] platform eisa.0: EISA: Detected 0 cards [ 5.093978] intel_pstate: Intel P-state driver initializing [ 5.100323] ledtrig-cpu: registered to indicate activity on CPUs [ 5.106478] drop_monitor: Initializing network drop monitor service [ 5.112909] NET: Registered protocol family 10 [ 5.121413] Segment Routing with IPv6 [ 5.125149] NET: Registered protocol family 17 [ 5.129724] Key type dns_resolver registered [ 5.134440] RAS: Correctable Errors collector initialized. [ 5.138913] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.140023] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 5.148260] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.161432] microcode: Microcode Update Driver: v2.2. [ 5.161499] *** VALIDATE rdt *** [ 5.161552] hub 1-1:1.0: USB hub found [ 5.166622] resctrl: L3 allocation detected [ 5.173911] hub 1-1:1.0: 6 ports detected [ 5.177986] resctrl: L3DATA allocation detected [ 5.177987] resctrl: L3CODE allocation detected [ 5.190540] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.191284] resctrl: L3 monitoring detected [ 5.202213] IPI shorthand broadcast: enabled [ 5.206574] sched_clock: Marking stable (4200043874, 1006515617)->(5536358639, -329799148) [ 5.215014] registered taskstats version 1 [ 5.219181] Loading compiled-in X.509 certificates [ 5.222919] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.224592] Loaded X.509 cert 'Build time autogenerated kernel key: 1224c9b81ccdd6d5fadad4fbd6b8ad2b6b069117' [ 5.232314] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.242796] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 5.249676] hub 2-1:1.0: USB hub found [ 5.259406] tsc: Refined TSC clocksource calibration: 3500.055 MHz [ 5.263214] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 5.263215] blacklist: Loading compiled-in revocation X.509 certificates [ 5.263249] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 5.269481] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x3273850dcf9, max_idle_ns: 440795323136 ns [ 5.306345] clocksource: Switched to clocksource tsc [ 5.306348] hub 2-1:1.0: 8 ports detected [ 5.306394] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 5.306415] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 5.306428] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 5.306441] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 5.306454] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 5.306467] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 5.306480] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 5.306519] zswap: loaded using pool lzo/zbud [ 5.315536] Key type ._fscrypt registered [ 5.407516] Key type .fscrypt registered [ 5.411583] pstore: Using crash dump compression: deflate [ 5.420903] Key type big_key registered [ 5.426647] Key type encrypted registered [ 5.426737] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.430719] AppArmor: AppArmor sha1 policy hashing enabled [ 5.439067] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.439366] hub 3-12:1.0: USB hub found [ 5.444637] ima: No TPM chip found, activating TPM-bypass! [ 5.451998] hub 3-12:1.0: 4 ports detected [ 5.455837] ima: Allocated hash algorithm: sha1 [ 5.470140] ima: No architecture policies found [ 5.474764] evm: Initialising EVM extended attributes: [ 5.479965] evm: security.selinux [ 5.483339] evm: security.SMACK64 [ 5.486711] evm: security.SMACK64EXEC [ 5.490427] evm: security.SMACK64TRANSMUTE [ 5.494598] evm: security.SMACK64MMAP [ 5.498323] evm: security.apparmor [ 5.501781] evm: security.ima [ 5.504806] evm: security.capability [ 5.508439] evm: HMAC attrs: 0x1 [ 5.512119] PM: Magic number: 4:344:783 [ 5.516247] pci 0000:00:16.1: hash matches [ 5.520481] acpi LNXCPU:6d: hash matches [ 5.524564] rtc_cmos 00:00: setting system clock to 2024-04-26T11:46:44 UTC (1714132004) [ 5.533740] Freeing unused decrypted memory: 2040K [ 5.538980] Freeing unused kernel image memory: 2768K [ 5.566550] Write protecting the kernel read-only data: 26624k [ 5.572811] Freeing unused kernel image memory: 2036K [ 5.578089] Freeing unused kernel image memory: 948K [ 5.589530] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.596033] x86/mm: Checking user space page tables [ 5.607227] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.613729] Run /init as init process Loading, please wait... Starting version 245.4-4ubuntu3.17 [ 5.732619] dca service started, version 1.12.1 [ 5.737967] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.745634] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.753817] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.761878] nvme nvme0: pci function 0000:02:00.0 [ 5.770529] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.794954] scsi host0: ahci [ 5.798017] scsi host1: ahci [ 5.801071] scsi host2: ahci [ 5.804142] scsi host3: ahci [ 5.806610] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k [ 5.807127] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 [ 5.814109] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.821588] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 5.821590] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 5.842179] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 [ 5.849776] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k [ 5.850384] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.857518] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.871606] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.875100] nvme nvme0: 8/0/0 default/read/poll queues [ 5.922936] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.931459] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.939077] igb 0000:07:00.0: added PHC on eth0 [ 5.943701] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.950640] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:c6 [ 5.957942] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.957952] hidraw: raw HID events driver (C) Jiri Kosina [ 5.963141] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.974881] scsi host4: ahci [ 5.989773] scsi host5: ahci [ 5.992835] scsi host6: ahci [ 5.995904] scsi host7: ahci [ 5.998981] scsi host8: ahci [ 6.002017] scsi host9: ahci [ 6.004996] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 45 [ 6.012471] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 45 [ 6.019952] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 45 [ 6.027429] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 45 [ 6.034908] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 45 [ 6.042389] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 45 [ 6.069368] igb 0000:07:00.1: added PHC on eth1 [ 6.073983] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.080917] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:c7 [ 6.088199] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.093402] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.165654] ata3: SATA link down (SStatus 0 SControl 300) [ 6.171135] ata2: SATA link down (SStatus 0 SControl 300) [ 6.176609] ata1: SATA link down (SStatus 0 SControl 300) [ 6.182087] ata4: SATA link down (SStatus 0 SControl 300) [ 6.366124] ata10: SATA link down (SStatus 0 SControl 300) [ 6.371689] ata7: SATA link down (SStatus 0 SControl 300) [ 6.377164] ata9: SATA link down (SStatus 0 SControl 300) [ 6.382657] ata6: SATA link down (SStatus 0 SControl 300) [ 6.388152] ata8: SATA link down (SStatus 0 SControl 300) [ 6.393633] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.489081] ata5.00: NCQ Send/Recv Log not supported [ 6.494111] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.500446] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.509003] ata5.00: NCQ Send/Recv Log not supported [ 6.514036] ata5.00: configured for UDMA/133 [ 6.518496] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.526808] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.526880] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.539941] sd 4:0:0:0: [sda] Write Protect is off [ 6.544822] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.582708] sda: sda1 [ 6.606612] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.612577] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.618813] usbcore: registered new interface driver usbhid [ 6.624451] usbhid: USB HID core driver [ 6.630028] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.650772] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.698630] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.710583] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.722400] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 7.110718] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.121081] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.129681] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.135920] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d3:fe [ 7.143601] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.310602] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.320971] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.329569] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.336678] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d3:ff [ 7.344332] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.351859] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.374738] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.34 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 303191/61054976 files, 7809426/244190336 blocks done. [ 7.564194] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 8.299641] systemd[1]: Inserted module 'autofs4' [ 8.363978] systemd[1]: systemd 245.4-4ubuntu3.17 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid) [ 8.406637] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 20.04.4 LTS! [ 8.468458] systemd[1]: Set hostname to . [ 9.616863] systemd[1]: Created slice system-modprobe.slice. [ OK ] Created slice system-modprobe.slice. [ 9.639011] systemd[1]: Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ 9.663032] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.682646] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.714867] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.742606] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.770662] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.798588] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.826656] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.854639] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.882587] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.910686] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 9.934694] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 9.954644] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 9.978661] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 10.001615] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 10.026883] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 10.046694] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 10.070778] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 10.094759] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 10.114832] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 10.134880] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 10.154857] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 10.174668] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 10.195515] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 10.215385] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 10.239209] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 10.263357] systemd[1]: Mounting RPC Pipe File System... Mounting RPC Pipe File System... [ 10.283439] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 10.303212] RPC: Registered named UNIX socket transport module. [ 10.303465] systemd[1]: Mounting Kernel Trace File System... [ 10.309201] RPC: Registered udp transport module. [ 10.309201] RPC: Registered tcp transport module. [ 10.309203] RPC: Registered tcp NFSv4.1 backchannel transport module. Mounting Kernel Trace File System... [ 10.347624] systemd[1]: Starting Journal Service... Starting Journal Service... [ 10.366624] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 10.377574] systemd[1]: Starting Set the console keyboard layout... Startin[ 10.384350] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). g Set the console keyboard layout... [ 10.407412] systemd[1]: Starting Create list of static device nodes for the current kernel... Starting Create list of st…odes for the current kernel... [ 10.435240] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.467480] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.486562] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.497523] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped. [ 10.506671] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.516929] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.535226] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.554205] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr [ 10.563185] systemd[1]: Starting udev Coldplug all Devices... Starting udev Coldplug all Devices... [ 10.576531] lp: driver loaded but no devices found [ 10.583462] systemd[1]: Starting Uncomplicated firewall... Starting Uncom[ 10.591135] Loading iSCSI transport class v2.0-870. plicated firewall... [ 10.612029] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted RPC Pipe File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create list of st… nodes for the current kernel. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Finished Uncomplicated firewall. Activating swap /swapfile... Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting pNFS block layout mapping daemon... [ 10.910566] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Starting Flush Journal to Persistent Storage[[ 10.922891] systemd-journald[367]: Received client request to flush runtime journal. 0m... Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished udev Coldplug all Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Reached target Swap. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Preprocess NFS configuration... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting udev Kernel Device Manager... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Preprocess NFS configuration. Starting NFSv4 ID-name mapping service... [ OK ] Reached target NFS client services. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Finished Create Volatile Files and Directories. Starting RPC bind portmap service... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started udev Kernel Device Manager. [ OK ] Finished Load AppArmor profiles. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Network Service... [ OK ] Started RPC bind portmap service. [ OK ] Finished Update UTMP about System Boot/Shutdown. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API. [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Listening on Docker Socket for the API. [ OK ] Started Network Service. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started Set the CPU Frequency Scaling governor. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting Resets System Activity Data Collector... Starting Login Service... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started System Logging Service. [ OK ] Found device 82599ES 10-Gi…ion (AOC-STGN-I2S [REV 1.01]). [ OK ] Started ifup for enp3s0f1. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Finished Resets System Activity Data Collector. [ OK ] Started Login Service. Starting Raise network interfaces... [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Finished GRUB failed boot detection. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Finished Wait for Network to be Configured. Stopping Network Name Resolution... [ OK ] Stopped Network Name Resolution. Starting Network Name Resolution... [ OK ] Started Network Name Resolution. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. + myips=172.21.15.82 + attempts=1 + sleep 1 + '[' 172.21.15.82 '!=' '' ']' + set -e + '[' -n 172.21.15.82 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.82 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.82 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi082.front.sepia.ceph.com + '[' -n smithi082.front.sepia.ceph.com ']' + hostname smithi082.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi082 + echo smithi082 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.82 smithi082.front.sepia.ceph.com smithi082/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice system-getty.slice. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... Ubuntu 20.04.4 LTS smithi082.front.sepia.ceph.com ttyS1 2024-04-26T11:47:00.309 DEBUG:teuthology.orchestra.console.smithi082:expect after: smithi082 login: 2024-04-26T11:47:00.319 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:00.319 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:00.328 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:00.327+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:00.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:00.363 DEBUG:teuthology.orchestra.console.smithi082:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D3 FF GUID: 00000000 0000 0000 0000 0CC47AD8DAC6 DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.82 MASK 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.82 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d3:ff)... Configuring (net0 0c:c4:7a:8f:d3:ff).... Configuring (net0 0c:c4:7a:8f:d3:ff)..... Configuring (net0 0c:c4:7a:8f:d3:ff)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.4.0-177-generic (buildd@lcy02-amd64-112) (gcc version 9.4.0 (Ubuntu 9.4.0-1ubuntu1~20.04.2)) #197-Ubuntu SMP Thu Mar 28 22:45:47 UTC 2024 (Ubuntu 5.4.0-177.197-generic 5.4.268) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ea3fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f56000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.969 MHz processor [ 0.001008] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.001442] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001982] last_pfn = 0x78ea4 max_arch_pfn = 0x400000000 [ 0.007589] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.007631] check: Scanning 1 areas for low memory corruption [ 0.007635] Using GB pages for direct mapping [ 0.007779] RAMDISK: [mem 0x3157d000-0x34ab5fff] [ 0.007783] ACPI: Early table checksum verification disabled [ 0.007786] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.007788] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.007792] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007796] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.007798] ACPI: FACS 0x0000000079D49F80 000040 [ 0.007800] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007802] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007804] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007806] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.007808] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.007810] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.007812] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007814] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.007816] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.007818] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.007820] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.007822] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.007824] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007826] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007828] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007829] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007831] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007833] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.007834] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.007835] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.007836] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.007836] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.007837] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.007838] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.007838] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.007839] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.007840] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.007840] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.007841] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.007841] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.007842] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.007843] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.007844] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.007844] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.007845] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.007846] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.007846] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.007917] No NUMA configuration found [ 0.007918] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.007925] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.008096] Zone ranges: [ 0.008097] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008098] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008099] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008099] Device empty [ 0.008100] Movable zone start for each node [ 0.008103] Early memory node ranges [ 0.008104] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.008104] node 0: [mem 0x0000000000100000-0x0000000078ea3fff] [ 0.008105] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008338] Zeroed struct page in unavailable ranges: 29138 pages [ 0.008339] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.083747] ACPI: PM-Timer IO Port: 0x408 [ 0.083755] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.083756] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.083756] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.083757] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.083757] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.083758] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.083759] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.083759] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.083768] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.083772] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.083774] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.083775] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.083778] Using ACPI (MADT) for SMP configuration information [ 0.083779] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.083782] TSC deadline timer available [ 0.083783] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.083792] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.083793] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.083793] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.083794] PM: Registered nosave memory: [mem 0x78ea4000-0x78f55fff] [ 0.083795] PM: Registered nosave memory: [mem 0x78f56000-0x798adfff] [ 0.083796] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.083796] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.083797] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.083797] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.083798] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.083798] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.083800] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.083801] Booting paravirtualized kernel on bare hardware [ 0.083803] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.083807] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.084013] percpu: Embedded 60 pages/cpu s208896 r8192 d28672 u262144 [ 0.084035] Built 1 zonelists, mobility grouping on. Total pages: 8228830 [ 0.084036] Policy zone: Normal [ 0.084037] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.086240] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.087377] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.087458] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.164890] Memory: 32692504K/33437880K available (14339K kernel code, 2395K rwdata, 9292K rodata, 2768K init, 17228K bss, 745376K reserved, 0K cma-reserved) [ 0.165114] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.165128] Kernel/User page tables isolation: enabled [ 0.165154] ftrace: allocating 44725 entries in 175 pages [ 0.177458] ftrace: allocated 175 pages with 6 groups [ 0.177563] rcu: Hierarchical RCU implementation. [ 0.177564] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.177565] Tasks RCU enabled. [ 0.177565] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.177566] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.179764] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.179945] random: crng init done [ 0.184787] Console: colour VGA+ 80x25 [ 0.195108] printk: console [tty0] enabled [ 1.126223] printk: console [ttyS1] enabled [ 1.130477] ACPI: Core revision 20190816 [ 1.134632] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.143851] APIC: Switch to symmetric I/O mode setup [ 1.148890] DMAR: Host address width 46 [ 1.152791] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.158169] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.166259] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.172592] DMAR: ATSR flags: 0x0 [ 1.175972] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.182308] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.188729] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.195151] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.200616] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.200617] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.215742] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.221117] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.227408] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.251852] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327333a6725, max_idle_ns: 440795319410 ns [ 1.262456] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.93 BogoMIPS (lpj=13999876) [ 1.266490] mce: CPU0: Thermal monitoring enabled (TM1) [ 1.270495] process: using mwait in idle threads [ 1.274456] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.278455] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.282456] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.286456] Spectre V2 : Mitigation: Retpolines [ 1.290455] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.294455] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.298455] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.302455] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.306455] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.310455] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.314458] MDS: Mitigation: Clear CPU buffers [ 1.318455] TAA: Mitigation: Clear CPU buffers [ 1.322455] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.326459] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.330455] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.334455] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.338456] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.342455] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.346636] Freeing SMP alternatives memory: 40K [ 1.351784] pid_max: default: 32768 minimum: 301 [ 1.354476] LSM: Security Framework initializing [ 1.358462] Yama: becoming mindful. [ 1.362478] AppArmor: AppArmor initialized [ 1.366514] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.370495] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.374464] *** VALIDATE tmpfs *** [ 1.378554] *** VALIDATE proc *** [ 1.382495] *** VALIDATE cgroup1 *** [ 1.386456] *** VALIDATE cgroup2 *** [ 1.390647] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.394517] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.398456] ... version: 3 [ 1.402455] ... bit width: 48 [ 1.406455] ... generic registers: 4 [ 1.410455] ... value mask: 0000ffffffffffff [ 1.414455] ... max period: 00007fffffffffff [ 1.418455] ... fixed-purpose events: 3 [ 1.422455] ... event mask: 000000070000000f [ 1.426481] rcu: Hierarchical SRCU implementation. [ 1.431273] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.434516] smp: Bringing up secondary CPUs ... [ 1.438523] x86: Booting SMP configuration: [ 1.442457] .... node #0, CPUs: #1 #2 #3 #4 [ 1.450673] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.458455] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.462455] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.466550] #5 #6 #7 [ 1.467081] smp: Brought up 1 node, 8 CPUs [ 1.474457] smpboot: Max logical packages: 1 [ 1.478455] smpboot: Total of 8 processors activated (55999.50 BogoMIPS) [ 1.484592] devtmpfs: initialized [ 1.486494] x86/mm: Memory block size: 128MB [ 1.493567] PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.494529] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.498467] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.502498] pinctrl core: initialized pinctrl subsystem [ 1.506535] PM: RTC time: 11:46:40, date: 2024-04-26 [ 1.510543] NET: Registered protocol family 16 [ 1.514525] audit: initializing netlink subsys (disabled) [ 1.518462] audit: type=2000 audit(1714131998.332:1): state=initialized audit_enabled=0 res=1 [ 1.518539] EISA bus registered [ 1.525663] cpuidle: using governor ladder [ 1.526457] cpuidle: using governor menu [ 1.530468] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.534456] ACPI: bus type PCI registered [ 1.538456] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.542503] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.546457] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.550465] PCI: Using configuration type 1 for base access [ 1.556453] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.558458] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.562519] ACPI: Added _OSI(Module Device) [ 1.566457] ACPI: Added _OSI(Processor Device) [ 1.570462] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.574455] ACPI: Added _OSI(Processor Aggregator Device) [ 1.578455] ACPI: Added _OSI(Linux-Dell-Video) [ 1.582455] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.586455] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.632365] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.637802] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.642591] ACPI: Dynamic OEM Table Load: [ 1.670585] ACPI: Interpreter enabled [ 1.674320] ACPI: (supports S0 S4 S5) [ 1.674456] ACPI: Using IOAPIC for interrupt routing [ 1.678474] HEST: Enabling Firmware First mode for corrected errors. [ 1.682537] HEST: Table parsing has been initialized. [ 1.686457] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.691122] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.725067] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.730459] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 1.740463] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR] [ 1.751396] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.758456] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.766490] PCI host bridge to bus 0000:ff [ 1.770456] pci_bus 0000:ff: root bus resource [bus ff] [ 1.774464] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.782515] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.786505] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.794504] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.798505] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.806506] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.810508] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.818503] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.822509] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.830503] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.834505] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.842503] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.846503] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.854504] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.862504] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.866504] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.874506] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.878503] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.886504] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.890477] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.898508] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.902545] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.910516] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.914515] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.922520] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.926516] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.934514] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.938505] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.946509] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.954517] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.958522] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.966516] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 1.970517] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 1.978506] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 1.982506] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 1.990506] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 1.994506] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.002517] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.006516] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.014515] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.018520] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.026510] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.030505] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.038506] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.042509] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.050506] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.058505] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.062505] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.070511] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.074505] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.082505] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.086504] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.094478] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.098509] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.106504] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.114255] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.122458] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 2.130757] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR] [ 2.146873] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.154456] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.162716] PCI host bridge to bus 0000:00 [ 2.166456] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.174456] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.182456] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.190455] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.194456] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.202455] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.210456] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.218462] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.222604] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.230525] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.234559] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.242524] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.246553] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.254524] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.258553] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.266475] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.274592] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.278474] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.286592] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.290474] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.298591] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.306474] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.310590] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.318474] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.326594] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.330474] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.338591] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.346474] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.350592] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.358474] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.366591] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.370572] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.378592] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.382572] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.390470] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.394595] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.402682] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.406479] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.414467] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.418467] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.426467] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.430467] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.434467] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.442498] pci 0000:00:11.4: PME# supported from D3hot [ 2.446552] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.454483] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.462533] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.466542] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.474483] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.478534] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.486541] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.494483] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.498534] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.506553] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.510481] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.518560] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.522546] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.530547] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.538556] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.542548] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.550555] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.554548] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.562564] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.566481] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.574560] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.578548] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.586668] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.594477] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.598466] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.602466] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.610466] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.614466] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.622466] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.626491] pci 0000:00:1f.2: PME# supported from D3hot [ 2.634539] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.638480] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.646487] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.650691] acpiphp: Slot [1] registered [ 2.654472] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.662602] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.666478] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.674497] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.682458] pci 0000:02:00.0: enabling Extended Tags [ 2.686549] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.690457] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.698602] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.702479] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.710465] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.718478] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.722465] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.730498] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.738476] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.742456] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.754468] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.762456] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.774587] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.778478] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.786464] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.790478] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.798464] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.806498] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.810473] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.818456] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.830468] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.838456] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.846581] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.854457] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.858456] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.866457] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.874486] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.878513] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.886546] pci 0000:05:00.0: enabling Extended Tags [ 2.890528] pci 0000:05:00.0: supports D1 D2 [ 2.894455] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.902540] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.906457] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.910457] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.918503] pci_bus 0000:06: extended config space not accessible [ 2.926483] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.930485] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.938472] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.942472] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.950574] pci 0000:06:00.0: supports D1 D2 [ 2.954455] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.962531] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.966463] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.970458] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.978534] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.986492] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.990483] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.998469] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.002587] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.010502] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.018456] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.026481] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.034456] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.046509] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.050491] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.058483] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.062469] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.070584] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.074493] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.082456] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.094481] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.102456] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.110587] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.118457] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.122457] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.130459] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.135333] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15) [ 3.150501] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15) [ 3.158499] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) [ 3.166498] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 3.174498] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.182499] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.190498] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.198499] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.206668] iommu: Default domain type: Translated [ 3.210585] SCSI subsystem initialized [ 3.214473] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.218454] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.230456] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.234455] vgaarb: loaded [ 3.237233] ACPI: bus type USB registered [ 3.242465] usbcore: registered new interface driver usbfs [ 3.246459] usbcore: registered new interface driver hub [ 3.254459] usbcore: registered new device driver usb [ 3.258475] pps_core: LinuxPPS API ver. 1 registered [ 3.262455] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.274456] PTP clock support registered [ 3.278461] EDAC MC: Ver: 3.0.0 [ 3.282478] PCI: Using ACPI for IRQ routing [ 3.291760] NetLabel: Initializing [ 3.294455] NetLabel: domain hash size = 128 [ 3.298455] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.302465] NetLabel: unlabeled traffic allowed by default [ 3.311185] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.314456] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.324486] clocksource: Switched to clocksource tsc-early [ 3.336892] *** VALIDATE bpf *** [ 3.340237] VFS: Disk quotas dquot_6.6.0 [ 3.344236] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.351192] *** VALIDATE ramfs *** [ 3.354660] *** VALIDATE hugetlbfs *** [ 3.358535] AppArmor: AppArmor Filesystem Enabled [ 3.363323] pnp: PnP ACPI init [ 3.366875] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.372856] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.378834] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.384815] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.390794] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.396775] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.402756] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.409433] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.416114] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.422786] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.429460] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.436135] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.442817] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.449701] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.455687] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.461665] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.467645] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.473624] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.480503] pnp: PnP ACPI: found 5 devices [ 3.485603] thermal_sys: Registered thermal governor 'fair_share' [ 3.485604] thermal_sys: Registered thermal governor 'bang_bang' [ 3.491757] thermal_sys: Registered thermal governor 'step_wise' [ 3.497823] thermal_sys: Registered thermal governor 'user_space' [ 3.503890] thermal_sys: Registered thermal governor 'power_allocator' [ 3.514527] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.530103] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.541672] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.549586] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.554632] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.559663] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.566524] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.574175] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.582175] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.589913] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.598001] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.605653] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.613653] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.621391] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.629480] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.637129] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.645132] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.652870] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.660956] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.668610] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.676611] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.684348] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.692434] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.697464] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.703625] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.710480] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.718312] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.723362] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.728387] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.734551] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.741416] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.746700] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.752861] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.759727] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.767556] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.775467] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.783294] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.791205] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.796233] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.802393] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.809249] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.817082] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.823327] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.829567] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.836502] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 3.843434] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 3.850369] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 3.857301] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.863627] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.869260] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.875589] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.882888] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.888527] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.894856] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.900486] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.906815] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.912448] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.918774] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.926200] NET: Registered protocol family 2 [ 3.930786] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.940006] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.948985] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.957390] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.964923] TCP: Hash tables configured (established 262144 bind 65536) [ 3.971670] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.978680] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.986129] NET: Registered protocol family 1 [ 3.990556] NET: Registered protocol family 44 [ 3.995126] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 4.026629] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x670 took 23645 usecs [ 4.054671] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x670 took 20064 usecs [ 4.062159] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.068677] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 4.077140] Trying to unpack rootfs image as initramfs... [ 4.183844] Freeing initrd memory: 54500K [ 4.214536] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.221044] software IO TLB: mapped [mem 0x74ea4000-0x78ea4000] (64MB) [ 4.227943] check: Scanning for low memory corruption every 60 seconds [ 4.234979] Initialise system trusted keyrings [ 4.247130] Key type blacklist registered [ 4.251220] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.258620] zbud: loaded [ 4.261464] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.267461] fuse: init (API version 7.31) [ 4.271542] *** VALIDATE fuse *** [ 4.274919] *** VALIDATE fuse *** [ 4.278366] Platform Keyring initialized [ 4.285279] Key type asymmetric registered [ 4.289439] Asymmetric key parser 'x509' registered [ 4.294384] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244) [ 4.301878] io scheduler mq-deadline registered [ 4.306835] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.312843] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.318841] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.324792] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.330757] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.336710] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.342609] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.349958] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.358412] ACPI: Power Button [PWRB] [ 4.362160] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.369664] ACPI: Power Button [PWRF] [ 4.374641] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.382209] pstore: Registered erst as persistent store backend [ 4.388371] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 4.395953] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.422872] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.450817] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.459293] Linux agpgart interface v0.103 [ 4.594612] loop: module loaded [ 4.598011] tun: Universal TUN/TAP device driver, 1.6 [ 4.603176] PPP generic driver version 2.4.2 [ 4.607572] VFIO - User Level meta-driver version: 0.3 [ 4.612872] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.619466] ehci-pci: EHCI PCI platform driver [ 4.624116] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.629416] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.636903] ehci-pci 0000:00:1a.0: debug port 2 [ 4.645404] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 4.652268] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.670587] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.676434] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.684781] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.692083] usb usb1: Product: EHCI Host Controller [ 4.697027] usb usb1: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.703442] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.708215] hub 1-0:1.0: USB hub found [ 4.712033] hub 1-0:1.0: 2 ports detected [ 4.716314] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.721604] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.729090] ehci-pci 0000:00:1d.0: debug port 2 [ 4.737600] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 4.744450] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.762556] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.768392] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.776736] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.784040] usb usb2: Product: EHCI Host Controller [ 4.788983] usb usb2: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.795399] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.800166] hub 2-0:1.0: USB hub found [ 4.803978] hub 2-0:1.0: 2 ports detected [ 4.808182] ehci-platform: EHCI generic platform driver [ 4.813478] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.819724] ohci-pci: OHCI PCI platform driver [ 4.824244] ohci-platform: OHCI generic platform driver [ 4.829542] uhci_hcd: USB Universal Host Controller Interface driver [ 4.836098] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.841390] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.849917] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.859140] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported [ 4.866139] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.871424] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.878900] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.885250] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.893595] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.900896] usb usb3: Product: xHCI Host Controller [ 4.905837] usb usb3: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.912255] usb usb3: SerialNumber: 0000:00:14.0 [ 4.917018] hub 3-0:1.0: USB hub found [ 4.920846] hub 3-0:1.0: 15 ports detected [ 4.927126] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.04 [ 4.935473] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.942774] usb usb4: Product: xHCI Host Controller [ 4.947717] usb usb4: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.954133] usb usb4: SerialNumber: 0000:00:14.0 [ 4.958929] hub 4-0:1.0: USB hub found [ 4.962759] hub 4-0:1.0: 6 ports detected [ 4.967948] i8042: PNP: No PS/2 controller found. [ 4.972783] mousedev: PS/2 mouse device common for all mice [ 4.974549] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.978521] rtc_cmos 00:00: RTC can wake from S4 [ 4.989863] rtc_cmos 00:00: registered as rtc0 [ 4.994386] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 5.002130] i2c /dev entries driver [ 5.005705] device-mapper: uevent: version 1.0.3 [ 5.010452] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: dm-devel@redhat.com [ 5.018984] platform eisa.0: Probing EISA bus 0 [ 5.023580] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 5.030430] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 5.036936] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 5.043437] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 5.049937] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 5.056437] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 5.062550] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 5.062939] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 5.076027] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 5.082533] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 5.089033] platform eisa.0: EISA: Detected 0 cards [ 5.093978] intel_pstate: Intel P-state driver initializing [ 5.100323] ledtrig-cpu: registered to indicate activity on CPUs [ 5.106478] drop_monitor: Initializing network drop monitor service [ 5.112909] NET: Registered protocol family 10 [ 5.121413] Segment Routing with IPv6 [ 5.125149] NET: Registered protocol family 17 [ 5.129724] Key type dns_resolver registered [ 5.134440] RAS: Correctable Errors collector initialized. [ 5.138913] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.140023] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 5.148260] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.161432] microcode: Microcode Update Driver: v2.2. [ 5.161499] *** VALIDATE rdt *** [ 5.161552] hub 1-1:1.0: USB hub found [ 5.166622] resctrl: L3 allocation detected [ 5.173911] hub 1-1:1.0: 6 ports detected [ 5.177986] resctrl: L3DATA allocation detected [ 5.177987] resctrl: L3CODE allocation detected [ 5.190540] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.191284] resctrl: L3 monitoring detected [ 5.202213] IPI shorthand broadcast: enabled [ 5.206574] sched_clock: Marking stable (4200043874, 1006515617)->(5536358639, -329799148) [ 5.215014] registered taskstats version 1 [ 5.219181] Loading compiled-in X.509 certificates [ 5.222919] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.224592] Loaded X.509 cert 'Build time autogenerated kernel key: 1224c9b81ccdd6d5fadad4fbd6b8ad2b6b069117' [ 5.232314] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.242796] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 5.249676] hub 2-1:1.0: USB hub found [ 5.259406] tsc: Refined TSC clocksource calibration: 3500.055 MHz [ 5.263214] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 5.263215] blacklist: Loading compiled-in revocation X.509 certificates [ 5.263249] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 5.269481] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x3273850dcf9, max_idle_ns: 440795323136 ns [ 5.306345] clocksource: Switched to clocksource tsc [ 5.306348] hub 2-1:1.0: 8 ports detected [ 5.306394] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 5.306415] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 5.306428] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 5.306441] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 5.306454] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 5.306467] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 5.306480] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 5.306519] zswap: loaded using pool lzo/zbud [ 5.315536] Key type ._fscrypt registered [ 5.407516] Key type .fscrypt registered [ 5.411583] pstore: Using crash dump compression: deflate [ 5.420903] Key type big_key registered [ 5.426647] Key type encrypted registered [ 5.426737] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.430719] AppArmor: AppArmor sha1 policy hashing enabled [ 5.439067] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.439366] hub 3-12:1.0: USB hub found [ 5.444637] ima: No TPM chip found, activating TPM-bypass! [ 5.451998] hub 3-12:1.0: 4 ports detected [ 5.455837] ima: Allocated hash algorithm: sha1 [ 5.470140] ima: No architecture policies found [ 5.474764] evm: Initialising EVM extended attributes: [ 5.479965] evm: security.selinux [ 5.483339] evm: security.SMACK64 [ 5.486711] evm: security.SMACK64EXEC [ 5.490427] evm: security.SMACK64TRANSMUTE [ 5.494598] evm: security.SMACK64MMAP [ 5.498323] evm: security.apparmor [ 5.501781] evm: security.ima [ 5.504806] evm: security.capability [ 5.508439] evm: HMAC attrs: 0x1 [ 5.512119] PM: Magic number: 4:344:783 [ 5.516247] pci 0000:00:16.1: hash matches [ 5.520481] acpi LNXCPU:6d: hash matches [ 5.524564] rtc_cmos 00:00: setting system clock to 2024-04-26T11:46:44 UTC (1714132004) [ 5.533740] Freeing unused decrypted memory: 2040K [ 5.538980] Freeing unused kernel image memory: 2768K [ 5.566550] Write protecting the kernel read-only data: 26624k [ 5.572811] Freeing unused kernel image memory: 2036K [ 5.578089] Freeing unused kernel image memory: 948K [ 5.589530] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.596033] x86/mm: Checking user space page tables [ 5.607227] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.613729] Run /init as init process Loading, please wait... Starting version 245.4-4ubuntu3.17 [ 5.732619] dca service started, version 1.12.1 [ 5.737967] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.745634] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.753817] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.761878] nvme nvme0: pci function 0000:02:00.0 [ 5.770529] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.794954] scsi host0: ahci [ 5.798017] scsi host1: ahci [ 5.801071] scsi host2: ahci [ 5.804142] scsi host3: ahci [ 5.806610] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k [ 5.807127] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 [ 5.814109] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.821588] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 5.821590] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 5.842179] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 [ 5.849776] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k [ 5.850384] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.857518] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.871606] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.875100] nvme nvme0: 8/0/0 default/read/poll queues [ 5.922936] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.931459] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.939077] igb 0000:07:00.0: added PHC on eth0 [ 5.943701] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.950640] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:c6 [ 5.957942] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.957952] hidraw: raw HID events driver (C) Jiri Kosina [ 5.963141] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.974881] scsi host4: ahci [ 5.989773] scsi host5: ahci [ 5.992835] scsi host6: ahci [ 5.995904] scsi host7: ahci [ 5.998981] scsi host8: ahci [ 6.002017] scsi host9: ahci [ 6.004996] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 45 [ 6.012471] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 45 [ 6.019952] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 45 [ 6.027429] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 45 [ 6.034908] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 45 [ 6.042389] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 45 [ 6.069368] igb 0000:07:00.1: added PHC on eth1 [ 6.073983] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.080917] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:c7 [ 6.088199] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.093402] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.165654] ata3: SATA link down (SStatus 0 SControl 300) [ 6.171135] ata2: SATA link down (SStatus 0 SControl 300) [ 6.176609] ata1: SATA link down (SStatus 0 SControl 300) [ 6.182087] ata4: SATA link down (SStatus 0 SControl 300) [ 6.366124] ata10: SATA link down (SStatus 0 SControl 300) [ 6.371689] ata7: SATA link down (SStatus 0 SControl 300) [ 6.377164] ata9: SATA link down (SStatus 0 SControl 300) [ 6.382657] ata6: SATA link down (SStatus 0 SControl 300) [ 6.388152] ata8: SATA link down (SStatus 0 SControl 300) [ 6.393633] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.489081] ata5.00: NCQ Send/Recv Log not supported [ 6.494111] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.500446] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.509003] ata5.00: NCQ Send/Recv Log not supported [ 6.514036] ata5.00: configured for UDMA/133 [ 6.518496] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.526808] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.526880] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.539941] sd 4:0:0:0: [sda] Write Protect is off [ 6.544822] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.582708] sda: sda1 [ 6.606612] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.612577] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.618813] usbcore: registered new interface driver usbhid [ 6.624451] usbhid: USB HID core driver [ 6.630028] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.650772] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.698630] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.710583] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.722400] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 7.110718] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.121081] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.129681] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.135920] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d3:fe [ 7.143601] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.310602] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.320971] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.329569] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.336678] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d3:ff [ 7.344332] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.351859] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.374738] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.34 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 303191/61054976 files, 7809426/244190336 blocks done. [ 7.564194] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 8.299641] systemd[1]: Inserted module 'autofs4' [ 8.363978] systemd[1]: systemd 245.4-4ubuntu3.17 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid) [ 8.406637] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 20.04.4 LTS! [ 8.468458] systemd[1]: Set hostname to . [ 9.616863] systemd[1]: Created slice system-modprobe.slice. [ OK ] Created slice system-modprobe.slice. [ 9.639011] systemd[1]: Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ 9.663032] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.682646] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.714867] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.742606] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.770662] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.798588] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.826656] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.854639] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.882587] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.910686] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 9.934694] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 9.954644] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 9.978661] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 10.001615] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 10.026883] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 10.046694] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 10.070778] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 10.094759] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 10.114832] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 10.134880] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 10.154857] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 10.174668] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 10.195515] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 10.215385] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 10.239209] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 10.263357] systemd[1]: Mounting RPC Pipe File System... Mounting RPC Pipe File System... [ 10.283439] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 10.303212] RPC: Registered named UNIX socket transport module. [ 10.303465] systemd[1]: Mounting Kernel Trace File System... [ 10.309201] RPC: Registered udp transport module. [ 10.309201] RPC: Registered tcp transport module. [ 10.309203] RPC: Registered tcp NFSv4.1 backchannel transport module. Mounting Kernel Trace File System... [ 10.347624] systemd[1]: Starting Journal Service... Starting Journal Service... [ 10.366624] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 10.377574] systemd[1]: Starting Set the console keyboard layout... Startin[ 10.384350] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). g Set the console keyboard layout... [ 10.407412] systemd[1]: Starting Create list of static device nodes for the current kernel... Starting Create list of st…odes for the current kernel... [ 10.435240] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.467480] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.486562] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.497523] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped. [ 10.506671] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.516929] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.535226] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.554205] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr [ 10.563185] systemd[1]: Starting udev Coldplug all Devices... Starting udev Coldplug all Devices... [ 10.576531] lp: driver loaded but no devices found [ 10.583462] systemd[1]: Starting Uncomplicated firewall... Starting Uncom[ 10.591135] Loading iSCSI transport class v2.0-870. plicated firewall... [ 10.612029] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted RPC Pipe File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create list of st… nodes for the current kernel. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Finished Uncomplicated firewall. Activating swap /swapfile... Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting pNFS block layout mapping daemon... [ 10.910566] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Starting Flush Journal to Persistent Storage[[ 10.922891] systemd-journald[367]: Received client request to flush runtime journal. 0m... Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished udev Coldplug all Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Reached target Swap. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Preprocess NFS configuration... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting udev Kernel Device Manager... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Preprocess NFS configuration. Starting NFSv4 ID-name mapping service... [ OK ] Reached target NFS client services. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Finished Create Volatile Files and Directories. Starting RPC bind portmap service... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started udev Kernel Device Manager. [ OK ] Finished Load AppArmor profiles. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Network Service... [ OK ] Started RPC bind portmap service. [ OK ] Finished Update UTMP about System Boot/Shutdown. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API. [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Listening on Docker Socket for the API. [ OK ] Started Network Service. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started Set the CPU Frequency Scaling governor. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting Resets System Activity Data Collector... Starting Login Service... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started System Logging Service. [ OK ] Found device 82599ES 10-Gi…ion (AOC-STGN-I2S [REV 1.01]). [ OK ] Started ifup for enp3s0f1. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Finished Resets System Activity Data Collector. [ OK ] Started Login Service. Starting Raise network interfaces... [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Finished GRUB failed boot detection. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Finished Wait for Network to be Configured. Stopping Network Name Resolution... [ OK ] Stopped Network Name Resolution. Starting Network Name Resolution... [ OK ] Started Network Name Resolution. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. + myips=172.21.15.82 + attempts=1 + sleep 1 + '[' 172.21.15.82 '!=' '' ']' + set -e + '[' -n 172.21.15.82 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.82 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.82 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi082.front.sepia.ceph.com + '[' -n smithi082.front.sepia.ceph.com ']' + hostname smithi082.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi082 + echo smithi082 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.82 smithi082.front.sepia.ceph.com smithi082/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice system-getty.slice. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... Ubuntu 20.04.4 LTS smithi082.front.sepia.ceph.com ttyS1 smithi082 login: [disconnect] 2024-04-26T11:47:00.429 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:00.427+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:00.465 INFO:teuthology.misc:Re-opening connections... 2024-04-26T11:47:00.465 INFO:teuthology.misc:trying to connect to ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:47:00.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:47:00.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:47:00.488 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:00.488 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:00.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:00.560 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:00.555+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:00.608 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:00.608 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:00.618 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:00.665 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:00.665+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:00.747 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:00.747 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:00.759 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:00.757+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:00.760 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:00.854 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-26T11:47:00.860 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:00.859+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:00.868 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:00.869 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:00.879 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:00.961 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:00.957+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:00.986 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:00.986 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:00.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:01.062 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:01.059+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:01.110 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:01.110 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:01.121 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:01.162 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:01.161+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:01.225 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:01.225 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:01.235 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:01.264 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:01.261+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:01.339 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:01.339 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:01.349 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:01.364 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:01.363+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:01.442 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:47:01.465 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:01.461+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:01.469 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:01.469 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:01.479 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:01.566 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:01.565+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:01.585 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:01.586 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:01.595 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:01.601 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:47:01.632 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:47:01.633 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:47:01.633 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:47:01.633 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:47:01.637 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:47:01.637 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:47:01.668 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:01.665+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:01.703 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:01.704 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:47:01.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:47:01.704 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:01.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.704 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:01.705 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:01.705 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.977905702000001, 2024-04-26T11:47:01.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:47:01.705 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.705 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.705 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:01.706 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:01.706 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:01.706 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:47:01.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.706 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:01.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:01.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:01.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:01.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:47:01.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:47:01.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:47:01.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:47:01.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:47:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:47:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:47:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:47:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:47:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:47:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:47:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:47:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:47:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:47:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:47:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:47:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:47:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:47:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:47:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:47:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.557136996000001, 2024-04-26T11:47:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:47:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:47:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.557108518, 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:47:01.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:47:01.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:47:01.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:47:01.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:47:01.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:47:01.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:47:01.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:47:01.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:47:01.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.557083300999999, 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.733 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:47:01.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:47:01.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:47:01.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:47:01.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.557047215000001, 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.738 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.739 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:01.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:47:01.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:47:01.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:47:01.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.557020392999998, 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:47:01.744 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.745 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.745 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:01.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:01.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:47:01.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:01.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:47:01.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:47:01.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:47:01.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:47:01.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:47:01.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.554421155, 2024-04-26T11:47:01.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:47:01.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:47:01.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:47:01.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:47:01.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:47:01.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:47:01.755 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.755 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.755 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.756 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.756 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:01.756 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.553943897, 2024-04-26T11:47:01.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:47:01.756 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.756 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.756 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:01.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:01.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:47:01.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:01.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:47:01.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:47:01.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:47:01.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:47:01.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:47:01.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:47:01.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:47:01.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:47:01.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:47:01.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:47:01.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:47:01.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:47:01.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:47:01.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:47:01.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:47:01.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:47:01.763 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.763 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.764 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.764 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.764 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:01.764 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.549876695000002, 2024-04-26T11:47:01.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:47:01.764 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.765 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.765 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:01.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:01.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:01.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:01.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:47:01.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:47:01.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:47:01.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:47:01.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:47:01.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:47:01.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:47:01.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:47:01.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:47:01.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:47:01.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:47:01.772 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.772 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.773 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.773 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.773 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:01.773 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.549712575000001, 2024-04-26T11:47:01.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:47:01.774 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.774 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.774 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:01.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:01.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:01.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:01.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:47:01.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:47:01.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:47:01.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:47:01.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:47:01.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:47:01.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:47:01.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:47:01.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:47:01.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:47:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:47:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:47:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:47:01.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:47:01.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:47:01.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:47:01.781 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.781 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.781 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.782 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.782 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:01.782 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.546779914999998, 2024-04-26T11:47:01.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:47:01.782 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.782 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.783 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:01.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:01.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:47:01.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:01.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:47:01.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:47:01.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:47:01.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:47:01.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:47:01.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:47:01.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:47:01.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:47:01.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:47:01.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:47:01.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:47:01.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:47:01.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:47:01.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:47:01.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:47:01.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:47:01.790 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.790 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.790 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.790 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:47:01.791 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:01.791 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.544597324000001, 2024-04-26T11:47:01.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:47:01.791 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.791 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.791 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:01.791 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:01.791 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:01.792 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:47:01.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.792 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:01.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:01.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:47:01.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:01.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:47:01.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:47:01.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:47:01.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:47:01.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:47:01.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:47:01.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:47:01.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.542086289, 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:47:01.799 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:47:01.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:47:01.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:47:01.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:47:01.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.539691648000002, 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.804 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:47:01.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.539506588999998, 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:47:01.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:47:01.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:47:01.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:01.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:47:01.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:47:01.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:47:01.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:47:01.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:47:01.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:47:01.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:47:01.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:47:01.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:47:01.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:47:01.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:47:01.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:47:01.815 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.815 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.815 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.815 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.816 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:01.816 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.539466702999999, 2024-04-26T11:47:01.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:47:01.816 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.816 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.816 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:01.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:01.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:47:01.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:47:01.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:47:01.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:47:01.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:47:01.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:47:01.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:47:01.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:47:01.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:47:01.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:47:01.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:47:01.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:47:01.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:47:01.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:47:01.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:47:01.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:47:01.822 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.823 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.823 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.823 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:01.823 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.537727458999999, 2024-04-26T11:47:01.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:47:01.823 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.824 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.824 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:01.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:01.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:47:01.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:01.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.828 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.537025750000002, 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:01.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:01.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.833 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.533146319, 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:01.838 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 24.533117480000001, 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:01.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:47:01.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:01.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:47:01.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:47:01.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:01.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:01.844 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:01.846 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:01.843+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:01.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:01.947 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:01.947+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:01.955 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:01.955 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:01.955 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:47:01.955 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:01.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:02.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:47:02.026 DEBUG:teuthology.misc:waited 1.561509609222412 2024-04-26T11:47:02.049 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:02.045+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:02.069 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:02.069 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:02.069 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:47:02.070 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:47:02.070 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:02.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:02.149 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:02.147+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:02.185 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:47:02.189 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:47:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:47:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.032992499000002, 2024-04-26T11:47:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:47:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:47:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:47:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:47:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:47:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:47:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:47:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:47:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:47:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:47:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:47:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:47:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:47:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.032965771000001, 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:47:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:47:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.032934820000001, 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:47:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:47:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.030972803000001, 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:47:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.030947182999999, 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:47:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:47:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:47:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:47:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:47:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.030886988999999, 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:47:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.030860212, 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.030804163999999, 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.030764198, 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:47:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.030733588, 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:47:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.03065908, 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.030591014999999, 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.030490868000001, 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:47:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.010641765999999, 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:47:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.010583467, 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:47:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.264 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:02.264 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:02.264 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.008546207999999, 2024-04-26T11:47:02.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:47:02.264 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.264 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.264 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:02.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:02.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:47:02.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:47:02.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:47:02.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.413188108, 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:02.269 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:02.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:47:02.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:47:02.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:47:02.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:47:02.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.845040371, 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.275 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.133685214, 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:47:02.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.128923007000001, 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:47:02.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:02.291 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:02.291 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:02.292 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:02.293 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:02.289+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:02.393 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:02.391+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:02.412 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:15303 3.19 3.c80b70b9 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-26T11:47:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:47:02.412799+0000", 2024-04-26T11:47:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000107864, 2024-04-26T11:47:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015090700000000001, 2024-04-26T11:47:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:47:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:02.412799+0000", 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:02.412799+0000", 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:02.412796+0000", 2024-04-26T11:47:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999976 2024-04-26T11:47:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:02.412834+0000", 2024-04-26T11:47:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7676000000000003e-05 2024-04-26T11:47:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:02.412868+0000", 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4598999999999999e-05 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:02.412887+0000", 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8499999999999999e-05 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:02.412940+0000", 2024-04-26T11:47:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3081999999999998e-05 2024-04-26T11:47:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:47:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-26T11:47:02.417 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:02.423 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:02.494 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:02.491+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:02.532 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:47:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:47:02.533 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:02.542 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:02.595 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:02.591+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:02.646 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:02.646 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:47:02.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.923079299000001, 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:47:02.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:47:02.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:47:02.652 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.653 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.653 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.653 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.653 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:02.653 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.502310593000001, 2024-04-26T11:47:02.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:47:02.653 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.653 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.653 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:02.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:47:02.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:47:02.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:47:02.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:47:02.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:47:02.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:47:02.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:47:02.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:47:02.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:47:02.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:47:02.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:47:02.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:47:02.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:02.659 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.502282115, 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:47:02.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:47:02.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:47:02.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:47:02.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:47:02.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:47:02.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:47:02.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:47:02.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:47:02.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:47:02.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.502256897999999, 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.665 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:47:02.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:47:02.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.502220812000001, 2024-04-26T11:47:02.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:47:02.671 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.671 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.671 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:02.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:47:02.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.675 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.502193989999999, 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:47:02.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.499594752, 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.680 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:47:02.684 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.685 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.685 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.685 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.685 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:02.685 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.499117494, 2024-04-26T11:47:02.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:47:02.685 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.685 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.685 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:47:02.689 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.495050291999998, 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:02.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:02.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:47:02.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:47:02.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:47:02.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:47:02.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:47:02.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:47:02.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:47:02.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:47:02.695 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.695 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.695 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.494886172000001, 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:02.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:02.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:47:02.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:47:02.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:47:02.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:47:02.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:47:02.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:47:02.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:47:02.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:47:02.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:47:02.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:47:02.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:47:02.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:47:02.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:47:02.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:47:02.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:47:02.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:47:02.701 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.701 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.702 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.702 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.702 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:02.702 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.491953511999998, 2024-04-26T11:47:02.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:47:02.702 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.702 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.702 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:47:02.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:47:02.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:47:02.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:47:02.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:47:02.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:47:02.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:47:02.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:02.707 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.489770921000002, 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:02.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:02.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:47:02.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:47:02.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:47:02.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:47:02.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:47:02.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:47:02.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:47:02.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:02.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:47:02.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:47:02.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:02.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:47:02.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:47:02.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:47:02.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:47:02.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:47:02.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:47:02.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:47:02.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:47:02.714 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.714 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.714 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.714 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.714 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.487259886, 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:02.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:47:02.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:47:02.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.719 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.721 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.721 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:02.721 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.484865245000002, 2024-04-26T11:47:02.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:47:02.721 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.721 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:47:02.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:47:02.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:47:02.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:47:02.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.484680185999999, 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:47:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:47:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:47:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:47:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:47:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:47:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:47:02.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.733 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.733 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.733 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:02.733 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.484640299999999, 2024-04-26T11:47:02.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:47:02.733 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:47:02.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.482901055999999, 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:47:02.738 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:47:02.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.482199347000002, 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:47:02.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.478319916, 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:02.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:47:02.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.752 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.478291077000002, 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:02.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:02.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:47:02.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:47:02.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:02.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:47:02.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:47:02.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:02.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:47:02.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:02.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:02.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:47:02.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:47:02.758 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.758 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.758 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.758 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:02.758 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:02.758 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:02.760 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:02.757+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:02.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:02.860 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:02.857+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:02.867 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:02.867 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:02.867 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:47:02.868 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:02.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:02.962 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:02.959+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:02.979 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:02.979 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:02.979 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:47:02.979 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:47:02.979 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:02.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:03.027 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:47:03.028 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi082.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-26T11:47:03.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T11:47:03.062 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:03.061+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:03.099 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:03.099 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:47:03.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.942601975000002, 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:47:03.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:47:03.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:47:03.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:47:03.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:47:03.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:47:03.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:47:03.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:47:03.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:47:03.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:03.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.108 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:03.108 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:03.108 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.942575247000001, 2024-04-26T11:47:03.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:47:03.108 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.108 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.108 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:03.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:47:03.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.113 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.942544296000001, 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:47:03.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:47:03.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:47:03.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:47:03.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.940582279000001, 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:47:03.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.940556658999999, 2024-04-26T11:47:03.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:47:03.126 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.126 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.126 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:03.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:03.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:47:03.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:47:03.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:47:03.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:47:03.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:47:03.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.940496464999999, 2024-04-26T11:47:03.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:47:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:47:03.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:47:03.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.136 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.137 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.137 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.138 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:03.138 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.940469688, 2024-04-26T11:47:03.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:47:03.138 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.138 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.138 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:03.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:03.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:47:03.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:47:03.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:47:03.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:47:03.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:47:03.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:47:03.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:47:03.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:47:03.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:47:03.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:47:03.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:47:03.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:47:03.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:47:03.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:47:03.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:47:03.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:47:03.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:47:03.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.148 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.149 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.149 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:03.149 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.940413639999999, 2024-04-26T11:47:03.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:47:03.149 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.149 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.150 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:03.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:03.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:47:03.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:47:03.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:47:03.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:47:03.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:47:03.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:47:03.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:47:03.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:47:03.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:47:03.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:47:03.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:47:03.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:47:03.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:47:03.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:47:03.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:47:03.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:47:03.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:47:03.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.158 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.158 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.158 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.940373674, 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:03.163 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.940343064, 2024-04-26T11:47:03.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:47:03.164 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.164 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.164 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:47:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.940268555999999, 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:03.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:03.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:47:03.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:47:03.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:47:03.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:47:03.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:47:03.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:47:03.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:47:03.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:47:03.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:47:03.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:47:03.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.940200490999999, 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:47:03.177 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:47:03.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:47:03.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:47:03.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.940100344000001, 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.182 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:47:03.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:47:03.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:47:03.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:47:03.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:47:03.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:47:03.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:47:03.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:47:03.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.187 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.920251241999999, 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:03.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:47:03.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:47:03.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:47:03.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:47:03.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:03.192 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.920192943, 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:47:03.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:47:03.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:47:03.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.197 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.918155683999998, 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:03.202 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.322797584, 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:03.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:47:03.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:47:03.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:47:03.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:47:03.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:47:03.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:47:03.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.754649847, 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:47:03.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.214 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.04329469, 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.038532483000001, 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:47:03.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:47:03.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:03.225 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:03.225 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:03.227 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:47:03.227 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:03.227 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:03.223+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:03.302 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:47:03.327 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:03.323+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:03.383 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:15835 3.16 3:6b6b4f13:::200.0000001c:head [write 863415~35620 [fadvise_dontneed] in=35620b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-26T11:47:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:47:03.343330+0000", 2024-04-26T11:47:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0018285370000000001, 2024-04-26T11:47:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018900259999999999, 2024-04-26T11:47:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:03.343330+0000", 2024-04-26T11:47:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:03.343330+0000", 2024-04-26T11:47:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:03.343328+0000", 2024-04-26T11:47:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:47:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:03.343368+0000", 2024-04-26T11:47:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9509999999999999e-05 2024-04-26T11:47:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:03.343399+0000", 2024-04-26T11:47:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1219e-05 2024-04-26T11:47:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:03.343413+0000", 2024-04-26T11:47:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4153e-05 2024-04-26T11:47:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:03.343481+0000", 2024-04-26T11:47:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7514000000000004e-05 2024-04-26T11:47:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:03.343558+0000", 2024-04-26T11:47:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7755000000000003e-05 2024-04-26T11:47:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:03.345119+0000", 2024-04-26T11:47:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001560344 2024-04-26T11:47:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:03.345194+0000", 2024-04-26T11:47:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5508999999999998e-05 2024-04-26T11:47:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:47:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-26T11:47:03.390 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:03.390 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:03.427 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:03.425+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:03.434 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T11:47:03.435 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T11:47:03.438 INFO:tasks.ceph.osd.1:Started 2024-04-26T11:47:03.438 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:47:03.506 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:03.506 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:03.506 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:47:03.506 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:47:03.506 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:03.516 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:03.550 INFO:teuthology.orchestra.run.smithi082.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T11:47:03.551 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T11:47:03.552 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-26T11:47:03.562 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:03.561+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:03.625 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:03.625 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:47:03.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:47:03.625 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.900771309, 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:47:03.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:47:03.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:47:03.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.480002602999999, 2024-04-26T11:47:03.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:47:03.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:47:03.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:47:03.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.479974124999998, 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:47:03.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:47:03.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.479948908000001, 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:47:03.641 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:47:03.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:47:03.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:47:03.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:47:03.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:47:03.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:47:03.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:47:03.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:47:03.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:47:03.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.479912821999999, 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:47:03.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:47:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:47:03.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.479886, 2024-04-26T11:47:03.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:47:03.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:47:03.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.477286761999999, 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:47:03.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.660 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.476809503999998, 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:03.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:47:03.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:47:03.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:47:03.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.665 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:03.666 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.472742302, 2024-04-26T11:47:03.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:47:03.666 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.666 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.666 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:47:03.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:47:03.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.472578181999999, 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:47:03.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:47:03.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:47:03.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:47:03.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:03.675 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.469645522, 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:47:03.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:47:03.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.467462931, 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:47:03.680 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:47:03.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:47:03.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:47:03.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.464951895999999, 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:47:03.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:47:03.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.691 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.691 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:03.691 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.462557255, 2024-04-26T11:47:03.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:47:03.693 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.693 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.693 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:03.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:47:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.462372196, 2024-04-26T11:47:03.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:03.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:47:03.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.462332310000001, 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:47:03.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:47:03.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.706 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.460593066000001, 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:47:03.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:47:03.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:03.711 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.459891357, 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:47:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.456011925999999, 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.455983087, 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:47:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:47:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:03.725 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:03.726 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:47:03.727 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:03.723+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:03.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:03.828 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:03.827+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:03.862 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:03.862 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:03.862 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:47:03.863 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:03.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:03.880 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:47:03.910 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:47:03.910 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:47:03.910 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:47:03.910 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:47:03.915 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:47:03.915 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:47:03.929 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:03.925+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:03.973 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:03.973 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:03.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:04.030 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:04.029+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:04.088 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:04.088 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:04.099 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:04.146 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:04.145+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:04.221 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:04.221 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:04.231 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:04.233 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:04.231+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:04.334 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:04.331+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:04.336 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:04.336 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:04.346 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:04.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-26T11:47:04.435 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:04.431+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:04.450 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:04.450 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:04.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:04.536 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:04.533+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:04.579 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:04.579 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:04.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:04.628 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:04.915+0000 7fc37b2da880 -1 Falling back to public interface 2024-04-26T11:47:04.637 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:04.635+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:04.696 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:04.696 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:04.705 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:04.737 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:04.737+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:04.833 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:04.834 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:04.838 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:04.837+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:04.843 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:04.939 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:04.935+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:04.949 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:04.949 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:04.960 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:05.040 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:05.039+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:05.072 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:05.072 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:05.082 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:05.141 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:05.139+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:05.188 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:05.188 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:05.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:05.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:47:05.244 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:05.243+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:05.315 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:05.315 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:05.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:05.342 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:05.339+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:05.433 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:05.433 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:05.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:05.443 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:05.441+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:05.544 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:05.543+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:05.552 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:05.552 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:05.561 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:05.633 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:47:05.645 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:05.641+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:05.681 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:05.682 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:05.692 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:05.746 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:05.743+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:05.805 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:05.805 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:05.820 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:05.865 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:05.865+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:05.916 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:47:05.922 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:05.922 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:05.931 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:05.947 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:05.945+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:06.038 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:06.038 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:06.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:06.049 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:06.047+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:06.071 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:47:06.095 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:47:06.096 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:47:06.096 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:47:06.096 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:47:06.100 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:47:06.101 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:47:06.149 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:06.147+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:06.152 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:06.152 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:06.152 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:47:06.152 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:47:06.152 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:06.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:06.249 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:06.247+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:06.273 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:47:06.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:47:06.273 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:06.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.273 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:06.273 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:06.273 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.116066848999999, 2024-04-26T11:47:06.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:47:06.273 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:47:06.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:47:06.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.116040120999997, 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:47:06.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.116009169999998, 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.289 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.114047153000001, 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:06.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:47:06.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:47:06.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:47:06.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.114021532999999, 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:47:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.113961338999999, 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.113934561999997, 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.303 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:47:06.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.113878514, 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:47:06.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:47:06.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.113838547999997, 2024-04-26T11:47:06.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:47:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:47:06.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:47:06.316 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.113807938000001, 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:06.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:06.321 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.113733430000003, 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:47:06.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:47:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:47:06.325 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.113665365000003, 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.330 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.113565217999998, 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:06.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:47:06.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:47:06.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:47:06.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.093716116000003, 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.093657817, 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:47:06.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:47:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.091620558000002, 2024-04-26T11:47:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:47:06.345 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.345 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.345 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:06.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:47:06.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:47:06.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.496262458, 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.349 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:47:06.354 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.928114721, 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:06.355 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:06.360 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.216759564, 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:47:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:47:06.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:47:06.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:47:06.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:47:06.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.366 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.211997357000001, 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:06.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:47:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:47:06.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:06.371 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:06.373 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:06.374 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:06.371+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:06.474 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:06.471+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:06.491 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:47:06.492 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:06.502 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:06.575 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:06.573+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:06.612 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:06.612 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:06.612 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:47:06.613 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:47:06.613 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:06.624 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:06.676 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:06.675+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.006740712999999, 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.585972006999999, 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:47:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:47:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:47:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:47:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.585943529000001, 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:47:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:47:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.585918312, 2024-04-26T11:47:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.749 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.750 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.750 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.750 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:06.750 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.585882225999999, 2024-04-26T11:47:06.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:47:06.750 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.750 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.750 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:06.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:06.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:47:06.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.585855404, 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:47:06.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:47:06.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.583256165999998, 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.582778908000002, 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.765 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:47:06.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:47:06.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:47:06.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.578711706, 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:47:06.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:47:06.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:06.774 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.578547585999999, 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:47:06.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:47:06.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:47:06.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.575614926, 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:06.783 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.573432335, 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:47:06.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:47:06.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.570921299999998, 2024-04-26T11:47:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:47:06.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:47:06.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:47:06.793 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.568526659, 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:47:06.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:47:06.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.5683416, 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.568301714, 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:47:06.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.807 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.566562470000001, 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:47:06.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:47:06.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.565860761, 2024-04-26T11:47:06.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:47:06.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:47:06.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:47:06.816 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.561981329999998, 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:06.821 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.561952491, 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:06.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:47:06.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:06.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:06.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:06.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:47:06.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:47:06.826 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.826 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.826 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.826 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:06.826 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:06.826 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:06.827 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:06.827+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:06.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:06.925 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:06.925 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:06.925 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:47:06.925 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:06.928 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:06.925+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:06.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:07.029 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:07.027+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:07.038 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:07.038 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:07.038 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:47:07.038 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:47:07.038 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:07.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:07.130 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:07.127+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:07.156 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:07.156 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:47:07.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:47:07.156 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:07.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.156 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:07.156 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:07.156 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.998994195999998, 2024-04-26T11:47:07.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:47:07.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:47:07.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:47:07.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.161 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.998967468000004, 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:07.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:47:07.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:47:07.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:47:07.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:47:07.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:47:07.167 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.167 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.167 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.167 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:07.167 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:07.167 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.998936516999997, 2024-04-26T11:47:07.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:47:07.167 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:47:07.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.9969745, 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.996948879999998, 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:47:07.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:47:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.996888685999998, 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:07.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:47:07.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:47:07.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:07.186 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.996861909000003, 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:47:07.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.996805860999999, 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:47:07.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:47:07.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.996765895000003, 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.200 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.996735285, 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.996660777000002, 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.205 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.996592712000002, 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:47:07.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:47:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.214 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.996492564999997, 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:47:07.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:47:07.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.976643463000002, 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.223 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.976585163999999, 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:47:07.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:47:07.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:47:07.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.974547905000001, 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:07.232 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.379189804999999, 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:47:07.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:47:07.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:47:07.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.811042067999999, 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:07.238 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:47:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:47:07.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.099686910999999, 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:07.248 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.094924704, 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:47:07.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:47:07.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:47:07.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:47:07.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:07.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:47:07.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:47:07.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.253 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:07.255 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:07.255 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:07.251+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:07.355 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:07.353+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:07.373 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:07.373 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:07.373 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:47:07.373 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:07.383 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:07.456 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:07.453+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:07.488 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:07.488 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:07.489 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:47:07.489 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:47:07.489 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:07.499 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:07.557 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:07.555+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:07.605 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:07.605 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.880718774999998, 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:07.606 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:47:07.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:47:07.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:07.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.459950069000001, 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.459921591000001, 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.616 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:47:07.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:47:07.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:47:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:47:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:47:07.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:47:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:47:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:47:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.621 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.459896373999999, 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.459860288000002, 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.626 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:47:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:47:07.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:47:07.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.633 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.633 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:07.633 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.459833465999999, 2024-04-26T11:47:07.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:47:07.633 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.633 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.633 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:47:07.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:47:07.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:47:07.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:47:07.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.637 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.457234228000001, 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:07.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.456756970000001, 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.452689767999999, 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:47:07.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:47:07.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:47:07.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:47:07.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:47:07.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.452525648000002, 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:47:07.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:47:07.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:47:07.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:47:07.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:47:07.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:47:07.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:47:07.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:47:07.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:47:07.657 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.657 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.657 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.658 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.658 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:07.658 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.449592987999999, 2024-04-26T11:47:07.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:47:07.658 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.658 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.658 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:47:07.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:47:07.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:47:07.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:47:07.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:47:07.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:47:07.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:47:07.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:47:07.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.663 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:47:07.664 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:07.664 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.447410396999999, 2024-04-26T11:47:07.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:47:07.664 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.664 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.664 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:07.664 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:07.664 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:07.664 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:47:07.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.665 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:07.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:07.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.669 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.444899362000001, 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:07.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.674 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.442504720999999, 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:47:07.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:47:07.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:47:07.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.442319661999999, 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:47:07.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.683 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.684 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:07.684 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.442279775999999, 2024-04-26T11:47:07.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:47:07.684 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.684 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.684 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:07.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:47:07.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:47:07.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:47:07.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:47:07.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:47:07.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:47:07.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:47:07.689 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.689 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.689 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.689 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.689 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:07.689 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.440540532, 2024-04-26T11:47:07.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:47:07.690 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.690 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.690 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:07.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:07.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:47:07.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:47:07.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:47:07.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:47:07.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:47:07.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:47:07.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:47:07.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.694 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.439838822999999, 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:07.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:47:07.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:47:07.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:47:07.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:47:07.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:47:07.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:47:07.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:47:07.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:47:07.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:47:07.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:47:07.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:47:07.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.700 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.435959392000001, 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:47:07.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:47:07.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:47:07.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.435930552999999, 2024-04-26T11:47:07.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:47:07.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:07.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:07.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:07.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:47:07.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:47:07.710 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.710 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.710 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.710 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:07.710 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:07.710 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:07.710 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:47:07.712 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:07.709+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:07.713 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:07.812 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:07.809+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:07.851 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:07.851 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:07.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.851 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19068 4.f 4:f3b37dc9:::10000002c36.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.848900+0000", 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001449334, 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001465708, 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848900+0000", 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848900+0000", 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848900+0000", 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848903+0000", 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6740000000000001e-06 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848910+0000", 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8979999999999999e-06 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848915+0000", 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4079999999999997e-06 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848965+0000", 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9565999999999999e-05 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849086+0000", 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121855 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19069 3.1a 3:5d7bf03a:::200.0000001e:head [write 606444~22706 [fadvise_dontneed] in=22706b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.849029+0000", 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00132121, 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00137535, 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.855 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849029+0000", 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849029+0000", 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849028+0000", 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849048+0000", 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0463e-05 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849057+0000", 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1889999999999996e-06 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849065+0000", 2024-04-26T11:47:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849155+0000", 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9469999999999995e-05 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849223+0000", 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8015999999999994e-05 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19037 4.12 4:48bc1812:::10000002bae.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.844612+0000", 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0057380699999999996, 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058239490000000001, 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844612+0000", 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844612+0000", 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844611+0000", 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844615+0000", 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3470000000000001e-06 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844624+0000", 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4670000000000004e-06 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844632+0000", 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5159999999999994e-06 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844672+0000", 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9663000000000003e-05 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844788+0000", 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011663399999999999 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19038 3.18 3:1f043d00:::10000002bb2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.844645+0000", 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0057045079999999996, 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058208189999999996, 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.862 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844645+0000", 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844645+0000", 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844645+0000", 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844648+0000", 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9299999999999999e-06 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844656+0000", 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5280000000000003e-06 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844662+0000", 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8270000000000003e-06 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844783+0000", 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012100900000000001 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.844891+0000", 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107575 2024-04-26T11:47:07.865 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.d epoch 69/16 rep_tid 15613 entries 69'577 (0'0) error 3:b603ac1c:::10000002b3e.00000000:head by mds.0.3:19014 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 69'575)", 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.845790+0000", 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0045599530000000003, 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047125300000000004, 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845790+0000", 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845790+0000", 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845789+0000", 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845798+0000", 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6629999999999999e-06 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845810+0000", 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1824999999999999e-05 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845818+0000", 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6479999999999992e-06 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845875+0000", 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7042e-05 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:19034 4.25 e69/17 4:a6027abe:::10000002b98.00000000:head v 69'369, mlcod=69'367)", 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.845833+0000", 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0045172570000000002, 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004696937, 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.869 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845833+0000", 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845833+0000", 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845832+0000", 2024-04-26T11:47:07.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845837+0000", 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4499999999999997e-06 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845849+0000", 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2214e-05 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845857+0000", 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3610000000000001e-06 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845905+0000", 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7786e-05 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845922+0000", 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.872 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19040 4.12 4:49e5722b:::10000002bb4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.845945+0000", 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0044043700000000003, 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046140809999999999, 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845945+0000", 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845945+0000", 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845944+0000", 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845950+0000", 2024-04-26T11:47:07.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8130000000000001e-06 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845961+0000", 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0900999999999999e-05 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845969+0000", 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0010000000000001e-06 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846011+0000", 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2208e-05 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846118+0000", 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000106147 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19042 4.24 4:258fbf81:::10000002bb6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.845997+0000", 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0043524109999999996, 2024-04-26T11:47:07.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045916949999999998, 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845997+0000", 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845997+0000", 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.845997+0000", 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846001+0000", 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0790000000000002e-06 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846009+0000", 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9119999999999998e-06 2024-04-26T11:47:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846015+0000", 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2110000000000003e-06 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846059+0000", 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3801000000000003e-05 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846181+0000", 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012224499999999999 2024-04-26T11:47:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846287+0000", 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000106443 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848004+0000", 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001716242 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19044 4.9 4:913f2bc1:::10000002bb8.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.846036+0000", 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0043140510000000002, 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045917019999999996, 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846036+0000", 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846036+0000", 2024-04-26T11:47:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846035+0000", 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846038+0000", 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.636e-06 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846046+0000", 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0820000000000001e-06 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846052+0000", 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6579999999999996e-06 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846086+0000", 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4323000000000003e-05 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846189+0000", 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000102944 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19045 4.6 4:63913fa5:::10000002bb9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.846072+0000", 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.004277922, 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045853990000000004, 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846072+0000", 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846072+0000", 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846071+0000", 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846075+0000", 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6210000000000001e-06 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846082+0000", 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2559999999999996e-06 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846088+0000", 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8830000000000003e-06 2024-04-26T11:47:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846139+0000", 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1289000000000003e-05 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846284+0000", 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000144611 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:19041 4.5 e69/17 4:a1aa6234:::10000002bb5.00000000:head v 69'407, mlcod=69'405)", 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.846693+0000", 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0036566659999999998, 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039932910000000004, 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846693+0000", 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846693+0000", 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846692+0000", 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846699+0000", 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9959999999999996e-06 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846725+0000", 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5304999999999999e-05 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846732+0000", 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8920000000000003e-06 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846770+0000", 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8451999999999997e-05 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846788+0000", 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7435000000000002e-05 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19046 4.19 4:98fd53db:::10000002bba.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.846704+0000", 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0036458630000000001, 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004012018, 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846704+0000", 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846704+0000", 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846703+0000", 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846708+0000", 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2870000000000004e-06 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846727+0000", 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8162999999999999e-05 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846737+0000", 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0721e-05 2024-04-26T11:47:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847006+0000", 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00026824699999999999 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847134+0000", 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000128887 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19048 4.12 4:498d99d7:::10000002bbc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.846765+0000", 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0035848630000000002, 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039805630000000003, 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846765+0000", 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846765+0000", 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846764+0000", 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846768+0000", 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8210000000000003e-06 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846777+0000", 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4370000000000007e-06 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846783+0000", 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.511e-06 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846823+0000", 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0315000000000003e-05 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846902+0000", 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8567999999999997e-05 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19049 4.8 4:13f4177c:::10000002bbd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.846800+0000", 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0035502110000000002, 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039754029999999997, 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846800+0000", 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846800+0000", 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846799+0000", 2024-04-26T11:47:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846802+0000", 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.954e-06 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846809+0000", 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.905e-06 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846816+0000", 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9070000000000001e-06 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846866+0000", 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0519000000000002e-05 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846985+0000", 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118844 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847064+0000", 2024-04-26T11:47:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8548999999999996e-05 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848909+0000", 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018449810000000001 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19050 4.2e 4:7729c29a:::10000002bbe.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.846831+0000", 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0035189219999999998, 2024-04-26T11:47:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039799040000000003, 2024-04-26T11:47:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846831+0000", 2024-04-26T11:47:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846831+0000", 2024-04-26T11:47:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846830+0000", 2024-04-26T11:47:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846833+0000", 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9239999999999999e-06 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846840+0000", 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3759999999999996e-06 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846845+0000", 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.541e-06 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.846886+0000", 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0781000000000001e-05 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847008+0000", 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121753 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:19043 4.5 e69/17 4:a28108fa:::10000002bb7.00000000:head v 69'408, mlcod=69'405)", 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.847387+0000", 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0029626090000000002, 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034561750000000001, 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847387+0000", 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847387+0000", 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847387+0000", 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847391+0000", 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9009999999999996e-06 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847408+0000", 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7323e-05 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847413+0000", 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0889999999999999e-06 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847453+0000", 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0330999999999997e-05 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847892+0000", 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00043833899999999999 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19053 4.12 4:4becf34e:::10000002bcb.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.847392+0000", 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002958048, 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034811149999999999, 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847392+0000", 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847392+0000", 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847391+0000", 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847400+0000", 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4390000000000006e-06 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847409+0000", 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9549999999999998e-06 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847414+0000", 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7859999999999996e-06 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847451+0000", 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7419000000000002e-05 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847551+0000", 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9166999999999994e-05 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19054 4.2d 4:b792c2c3:::10000002bcc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.847438+0000", 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0029119770000000001, 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034645019999999999, 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847438+0000", 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847438+0000", 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847437+0000", 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847441+0000", 2024-04-26T11:47:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4649999999999999e-06 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847448+0000", 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6769999999999995e-06 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847453+0000", 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9919999999999998e-06 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847484+0000", 2024-04-26T11:47:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0645999999999998e-05 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847567+0000", 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2986999999999997e-05 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19056 4.36 4:6e2fda0e:::10000002be5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.847619+0000", 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0027309809999999999, 2024-04-26T11:47:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033130009999999999, 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847619+0000", 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847619+0000", 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847618+0000", 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847623+0000", 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3539999999999999e-06 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847633+0000", 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3139999999999993e-06 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847640+0000", 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1949999999999997e-06 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847679+0000", 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9100000000000002e-05 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.847807+0000", 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012840799999999999 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19058 3.11 3:8feef9f5:::10000002c0e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.848105+0000", 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0022445009999999999, 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002856066, 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848105+0000", 2024-04-26T11:47:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848105+0000", 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848104+0000", 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848110+0000", 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2440000000000001e-06 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848126+0000", 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6212999999999999e-05 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848133+0000", 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848194+0000", 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0878999999999998e-05 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848339+0000", 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014465699999999999 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19062 4.33 4:cd139f99:::10000002c12.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.848156+0000", 2024-04-26T11:47:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0021936, 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028346830000000002, 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848156+0000", 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848156+0000", 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848156+0000", 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848159+0000", 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3979999999999999e-06 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848168+0000", 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6389999999999998e-06 2024-04-26T11:47:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848175+0000", 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2559999999999996e-06 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848227+0000", 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2534000000000002e-05 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848433+0000", 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020552499999999999 2024-04-26T11:47:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19063 3.2 3:468d0897:::10000002c16.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.848227+0000", 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0021223549999999998, 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027930049999999999, 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848227+0000", 2024-04-26T11:47:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848227+0000", 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848227+0000", 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848231+0000", 2024-04-26T11:47:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1690000000000002e-06 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848239+0000", 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7679999999999997e-06 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848245+0000", 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9540000000000001e-06 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848340+0000", 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4534e-05 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848450+0000", 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000109552 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19064 4.28 4:1771572c:::10000002c17.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.848301+0000", 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002048561, 2024-04-26T11:47:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027484200000000001, 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848301+0000", 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848301+0000", 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848300+0000", 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848304+0000", 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8639999999999998e-06 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848357+0000", 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2299999999999997e-05 2024-04-26T11:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848364+0000", 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4580000000000004e-06 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848401+0000", 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7181999999999997e-05 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848525+0000", 2024-04-26T11:47:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000123817 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19065 4.19 4:9ab1f141:::10000002c18.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.848514+0000", 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001835686, 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002564995, 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848514+0000", 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848514+0000", 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848513+0000", 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848518+0000", 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6970000000000001e-06 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848527+0000", 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1160000000000005e-06 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848534+0000", 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4439999999999996e-06 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848604+0000", 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0624999999999996e-05 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848726+0000", 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121938 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:19061 4.13 e69/17 4:ca5dfb7d:::10000002c11.00000000:head v 69'393, mlcod=69'391)", 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.848552+0000", 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0017980730000000001, 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002556029, 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848552+0000", 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848552+0000", 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848551+0000", 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848557+0000", 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0619999999999997e-06 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848567+0000", 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6169999999999996e-06 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848573+0000", 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1380000000000004e-06 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848777+0000", 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020422600000000001 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848787+0000", 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0247e-05 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19066 4.2a 4:5632a360:::10000002c19.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.848852+0000", 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0014974280000000001, 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022847929999999998, 2024-04-26T11:47:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848852+0000", 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848852+0000", 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848852+0000", 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848856+0000", 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9400000000000001e-06 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848866+0000", 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.166e-06 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848872+0000", 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8549999999999996e-06 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848906+0000", 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3234000000000001e-05 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849008+0000", 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010275799999999999 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849098+0000", 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9977999999999998e-05 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:19067 3.8 3:135012d2:::10000002c35.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:07.848880+0000", 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0014702039999999999, 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022900110000000002, 2024-04-26T11:47:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848880+0000", 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848880+0000", 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848879+0000", 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848882+0000", 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0350000000000002e-06 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848890+0000", 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3980000000000002e-06 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848895+0000", 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6080000000000003e-06 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.848933+0000", 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8120000000000001e-05 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:07.849040+0000", 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010716499999999999 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:47:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 27 2024-04-26T11:47:07.950 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:07.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:07.952 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:07.949+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:08.052 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:08.049+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:08.067 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:47:08.067 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:47:08.067 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:08.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:08.101 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:47:08.108 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:47:08.153 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:08.151+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:08.188 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.031530480000001, 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:47:08.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:47:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:08.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:47:08.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:47:08.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:47:08.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:47:08.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:47:08.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:47:08.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.195 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.195 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:08.195 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:08.195 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.031503751999999, 2024-04-26T11:47:08.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:47:08.196 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.196 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.196 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:08.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:47:08.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:47:08.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:08.201 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.031472801, 2024-04-26T11:47:08.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:47:08.202 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.202 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.202 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:08.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:47:08.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:47:08.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:47:08.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:08.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:47:08.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.029510784000003, 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:47:08.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:47:08.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.029485164, 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:47:08.212 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:47:08.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:47:08.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:47:08.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:47:08.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:47:08.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:47:08.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:47:08.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:47:08.217 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.217 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.217 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.029424970000001, 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:47:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:47:08.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:47:08.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:47:08.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:47:08.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:47:08.222 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.222 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.029398192999999, 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:47:08.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:47:08.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:47:08.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:47:08.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:47:08.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:47:08.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:47:08.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:47:08.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:47:08.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.029342145000001, 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:47:08.228 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:47:08.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:47:08.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:47:08.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:47:08.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:47:08.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:47:08.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:47:08.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:47:08.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.234 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.234 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.235 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:08.235 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.029302178999998, 2024-04-26T11:47:08.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:47:08.235 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.235 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.235 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:08.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:47:08.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:47:08.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:47:08.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:47:08.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.029271569000002, 2024-04-26T11:47:08.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:47:08.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:08.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:47:08.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:47:08.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:47:08.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:47:08.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:47:08.245 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.029197060999998, 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:47:08.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:47:08.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:47:08.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:47:08.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:47:08.250 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.029128995999997, 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:47:08.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:47:08.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:47:08.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:47:08.255 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.255 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.255 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.256 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.256 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:08.256 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.029028848999999, 2024-04-26T11:47:08.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:47:08.256 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.256 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.256 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:47:08.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:47:08.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:47:08.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:47:08.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:47:08.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:47:08.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:47:08.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:47:08.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:47:08.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:47:08.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:47:08.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.009179746999997, 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:47:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:47:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:47:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:47:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:47:08.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:47:08.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:47:08.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:47:08.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:47:08.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:47:08.267 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.267 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.267 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.268 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.268 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:08.268 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.009121448000002, 2024-04-26T11:47:08.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:47:08.269 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.269 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.269 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:08.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:47:08.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:08.273 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.007084188999997, 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:47:08.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:47:08.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:47:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.411726088999998, 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:08.278 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:08.283 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.843578352000002, 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:47:08.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.132223195000002, 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.289 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:08.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:47:08.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.127460987999999, 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:47:08.294 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:08.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:08.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:08.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:47:08.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:47:08.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.299 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:08.299 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:08.300 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:47:08.301 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:47:08.302 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:08.302 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:08.299+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:08.302 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:47:08.303 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:47:08.303 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T11:47:08.303 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:47:08.303 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:47:08.401 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:08.401+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:08.421 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:08.421 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:08.429 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:08.502 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:08.501+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:08.536 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:08.536 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:08.546 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:08.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:47:08.603 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:08.601+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:no valid command found; 10 closest matches: 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:0 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:1 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:2 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:abort 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:assert 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:bluefs debug_inject_read_zeros 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:bluefs files list 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:bluefs stats 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:bluestore allocator dump block 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:bluestore allocator fragmentation block 2024-04-26T11:47:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:admin_socket: invalid command 2024-04-26T11:47:08.669 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T11:47:08.669 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-26T11:47:08.700 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:08.700 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:08.704 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:08.703+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:08.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:08.805 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:08.803+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:08.849 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:08.849 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:08.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:08.906 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:08.905+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:08.930 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:09.219+0000 7fc37b2da880 -1 osd.1 22 log_to_monitors true 2024-04-26T11:47:09.007 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:09.003+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:09.021 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:09.021 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:09.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:09.039 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-26T11:47:09.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T11:47:09.108 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:09.107+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:09.136 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:09.137 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:09.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:09.202 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:09.491+0000 7fc36ebcb700 -1 osd.1 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:47:09.209 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:09.207+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:09.260 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:09.260 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:09.271 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:09.311 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:09.307+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:09.326 DEBUG:teuthology.parallel:result is None 2024-04-26T11:47:09.327 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T11:47:09.344 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T11:47:09.344 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T11:47:09.353 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T11:47:09.353 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:47:09.353 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T11:47:09.361 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:47:09.361 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T11:47:09.368 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:47:09.377 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:09.377 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:09.387 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:09.411 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:09.411+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:09.494 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:09.494 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:09.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:09.552 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:09.551+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:09.613 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:09.613+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:09.620 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:09.621 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:09.631 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:09.678 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:09.678 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":71,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:47:09.102876+0000","last_up_change":"2024-04-26T11:44:51.639267+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5806080,"flags_set":["nodeep-scrub","noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":0.67000001668930054,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5800000429153442,"score_stable":1.5800000429153442,"optimal_score":0.67000001668930054,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":18195},{"type":"v1","addr":"172.21.15.82:6801","nonce":18195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":18195},{"type":"v1","addr":"172.21.15.82:6803","nonce":18195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":18195},{"type":"v1","addr":"172.21.15.82:6807","nonce":18195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":18195},{"type":"v1","addr":"172.21.15.82:6805","nonce":18195}]},"public_addr":"172.21.15.82:6801/18195","cluster_addr":"172.21.15.82:6803/18195","heartbeat_back_addr":"172.21.15.82:6807/18195","heartbeat_front_addr":"172.21.15.82:6805/18195","state":["exists"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:47:09.693 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:44:10.024928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:44:15.295362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:44:19.992912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:44:20.415578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:47:09.694 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:47:09.714 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:09.711+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:09.739 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:09.739 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:09.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:09.815 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:09.813+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:09.911 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:09.911 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:09.916 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:09.915+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:09.920 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:09.997 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-26T11:47:10.011 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:47:10.017 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:10.015+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:10.034 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:10.034 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:10.045 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:10.118 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:10.115+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:10.124 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:47:10.158 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:10.158 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:10.168 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:10.219 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:10.219+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:10.270 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:10.270 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:10.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:10.303 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:47:10.319 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2024-04-26T11:47:10.323 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:10.323+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:10.336 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T11:47:10.392 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:10.393 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:10.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:10.420 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:10.420+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:10.440 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:47:10.468 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:47:10.491 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:47:10.493 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:47:10.493 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-04-26T11:47:10.493 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:47:10.508 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:47:10.509 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:47:10.509 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:10.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:10.521 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:10.519+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:10.622 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:10.619+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:10.627 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:10.627 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:47:10.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 48.470860954000003, 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:47:10.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:47:10.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:47:10.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:47:10.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:47:10.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:10.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:47:10.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:47:10.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:47:10.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:47:10.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 48.470834226000001, 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:47:10.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:47:10.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:47:10.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:47:10.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:47:10.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:47:10.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:47:10.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:47:10.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:47:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:47:10.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 48.470803275000002, 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.641 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:10.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:10.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:47:10.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:10.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:47:10.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:47:10.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:47:10.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:47:10.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:47:10.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:47:10.647 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.647 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.647 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.647 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.468841257999998, 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:10.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.468815638000002, 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:47:10.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:47:10.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.468755444000003, 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:47:10.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:47:10.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.468728667000001, 2024-04-26T11:47:10.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:47:10.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:47:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.468672619000003, 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:47:10.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.670 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.468632653, 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.468602042999997, 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.675 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:47:10.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:47:10.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:47:10.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:47:10.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.682 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.468527535, 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.468459469999999, 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.687 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:47:10.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:47:10.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.468359323000001, 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:10.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:47:10.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:47:10.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.696 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.448510220999999, 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:10.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.448451921999997, 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.701 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:47:10.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.446414662999999, 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.851056563, 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.710 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.715 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.282908826, 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:47:10.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.721 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.571553669, 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:10.726 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.566791462000001, 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:47:10.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:47:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:10.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:10.731 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:10.733 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-26T11:47:10.734 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:10.734 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T11:47:10.735 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:10.732+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:10.833 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:10.832+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:10.850 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:10.850 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:10.851 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:47:10.851 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:10.861 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:10.934 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:10.932+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:10.971 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:10.971 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:10.971 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:47:10.971 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:47:10.971 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:10.981 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:11.035 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:11.032+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:11.042 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-26T11:47:11.058 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T11:47:11.139 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:11.132+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:11.140 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:47:11.141 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:11.141 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.415305402999998, 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:11.142 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:47:11.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.143 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:11.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:11.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.147 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.994536697000001, 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:47:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:47:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.994508218999997, 2024-04-26T11:47:11.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:47:11.156 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.994483002000003, 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.161 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.994446916000001, 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:11.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:47:11.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:47:11.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:47:11.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.994420093999999, 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.991820855999997, 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:47:11.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:47:11.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.991343598, 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:47:11.175 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.987276395999999, 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:47:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:47:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.987112275999998, 2024-04-26T11:47:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:47:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.984179615999999, 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.981997024999998, 2024-04-26T11:47:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.979485990000001, 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:47:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:47:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.977091348999998, 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.976906290000002, 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.976866403999999, 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:47:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:47:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:47:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.97512716, 2024-04-26T11:47:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:47:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.974425451000002, 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.97054602, 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:47:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:47:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:47:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 33.970517180999998, 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.235 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:11.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:11.238 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:11.235+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:11.337 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:11.335+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:11.353 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:11.353 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:11.353 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:47:11.353 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:11.363 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:11.373 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-04-26T11:47:11.383 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:47:11.383 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T11:47:11.391 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:47:11.438 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:11.436+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:11.510 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:11.510 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:11.510 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:47:11.510 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:47:11.510 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:11.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:11.539 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:11.536+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:11.634 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:11.634 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:47:11.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:47:11.634 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:11.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.634 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1983678~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:11.634 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:11.634 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.476829766000002, 2024-04-26T11:47:11.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042675584000000003, 2024-04-26T11:47:11.634 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154253+0000", 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154252+0000", 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154257+0000", 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154268+0000", 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154274+0000", 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174831+0000", 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020556664999999998 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.174915+0000", 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:47:11.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175020+0000", 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010494599999999999 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176992+0000", 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001971703 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196788+0000", 2024-04-26T11:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019796399999999999 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196868+0000", 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9552e-05 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196928+0000", 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0316999999999999e-05 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1985095~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.476803038, 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042829964999999998, 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154279+0000", 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154288+0000", 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2024-04-26T11:47:11.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154299+0000", 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0925e-05 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154305+0000", 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1460000000000001e-06 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175476+0000", 2024-04-26T11:47:11.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021170995000000001 2024-04-26T11:47:11.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175570+0000", 2024-04-26T11:47:11.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4550999999999996e-05 2024-04-26T11:47:11.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:11.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.175708+0000", 2024-04-26T11:47:11.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709099999999999 2024-04-26T11:47:11.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179302+0000", 2024-04-26T11:47:11.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00359466 2024-04-26T11:47:11.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.196986+0000", 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017683800999999999 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197057+0000", 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0981000000000004e-05 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197109+0000", 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2326e-05 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.476772087000001, 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:11.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:47:11.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.474810069999997, 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:47:11.651 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.655 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.474784450000001, 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:11.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:47:11.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:47:11.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:11.660 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.474724256000002, 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:47:11.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.474697479, 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.665 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:47:11.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.474641431000002, 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:47:11.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:47:11.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:47:11.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.474601464999999, 2024-04-26T11:47:11.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:47:11.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:47:11.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:47:11.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:47:11.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:47:11.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:47:11.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.679 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.474570855000003, 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:47:11.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:47:11.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:47:11.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:47:11.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.685 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.474496346999999, 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:47:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:47:11.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:47:11.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:47:11.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:47:11.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:47:11.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.474428281999998, 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:11.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:11.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:47:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:47:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:47:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:47:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:47:11.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.474328135, 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:47:11.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.705 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.705 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.454479032999998, 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:11.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.454420734000003, 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.710 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.714 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.452383474999998, 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:11.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:47:11.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.857025374999999, 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:47:11.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:47:11.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:47:11.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.288877637999999, 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:11.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:47:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:47:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:47:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:47:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:47:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:47:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:47:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.577522480999999, 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:47:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.572760274, 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:11.736 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:47:11.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:47:11.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:47:11.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:47:11.741 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.741 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.741 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.741 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:11.741 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:11.741 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:11.742 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:11.740+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:11.743 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:11.743 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":73,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:47:11.121000+0000","last_up_change":"2024-04-26T11:47:10.111142+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5900000333786011,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.5900000333786011,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":72,"up_thru":72,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1425},{"type":"v1","addr":"172.21.15.82:6801","nonce":1425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1425},{"type":"v1","addr":"172.21.15.82:6803","nonce":1425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1425},{"type":"v1","addr":"172.21.15.82:6807","nonce":1425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1425},{"type":"v1","addr":"172.21.15.82:6805","nonce":1425}]},"public_addr":"172.21.15.82:6801/1425","cluster_addr":"172.21.15.82:6803/1425","heartbeat_back_addr":"172.21.15.82:6807/1425","heartbeat_front_addr":"172.21.15.82:6805/1425","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"3.1","osds":[2]},{"pgid":"3.2","osds":[0]},{"pgid":"3.5","osds":[2]},{"pgid":"3.8","osds":[0]},{"pgid":"3.a","osds":[2]},{"pgid":"3.b","osds":[2]},{"pgid":"3.13","osds":[2]},{"pgid":"3.16","osds":[2]},{"pgid":"3.18","osds":[0]},{"pgid":"3.19","osds":[2]},{"pgid":"3.1a","osds":[0]},{"pgid":"3.1c","osds":[2]},{"pgid":"4.0","osds":[2]},{"pgid":"4.4","osds":[0]},{"pgid":"4.6","osds":[0]},{"pgid":"4.7","osds":[0]},{"pgid":"4.9","osds":[0]},{"pgid":"4.a","osds":[2]},{"pgid":"4.b","osds":[2]},{"pgid":"4.c","osds":[2]},{"pgid":"4.f","osds":[0]},{"pgid":"4.10","osds":[0]},{"pgid":"4.11","osds":[2]},{"pgid":"4.12","osds":[0]},{"pgid":"4.14","osds":[0]},{"pgid":"4.15","osds":[0]},{"pgid":"4.16","osds":[2]},{"pgid":"4.17","osds":[2]},{"pgid":"4.18","osds":[2]},{"pgid":"4.19","osds":[0]},{"pgid":"4.1a","osds":[2]},{"pgid":"4.1b","osds":[2]},{"pgid":"4.1c","osds":[0]},{"pgid":"4.1e","osds":[2]},{"pgid":"4.20","osds":[2]},{"pgid":"4.21","osds":[0]},{"pgid":"4.23","osds":[0]},{"pgid":"4.26","osds":[2]},{"pgid":"4.28","osds":[0]},{"pgid":"4.29","osds":[2]},{"pgid":"4.2b","osds":[2]},{"pgid":"4.2c","osds":[2]},{"pgid":"4.2d","osds":[0]},{"pgid":"4.2e","osds":[0]},{"pgid":"4.2f","osds":[0]},{"pgid":"4.30","osds":[2]},{"pgid":"4.33","osds":[0]},{"pgid":"4.35","osds":[2]},{"pgid":"4.36","osds":[0]},{"pgid":"4.37","osds":[0]},{"pgid":"4.38","osds":[2]},{"pgid":"4.39","osds":[2]},{"pgid":"4.3a","osds":[2]},{"pgid":"4.3b","osds":[0]},{"pgid":"4.3c","osds":[2]},{"pgid":"4.3e","osds":[0]},{"pgid":"4.3f","osds":[0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:47:11.744 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:11.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:44:10.024928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:44:15.295362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:44:19.992912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:44:20.415578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.590000033378601, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.590000033378601, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:47:11.745 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:47:11.843 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:11.840+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:11.860 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:11.860 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:11.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20067 3.1 3.73d97761 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e73)", 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:47:11.126868+0000", 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.73391689199999999, 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.73395931700000006, 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for peered", 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126868+0000", 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126868+0000", 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126864+0000", 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999967 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126883+0000", 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8836000000000001e-05 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126926+0000", 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2202e-05 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126953+0000", 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7217e-05 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.127093+0000", 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013991000000000001 2024-04-26T11:47:11.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.127110+0000", 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7583000000000001e-05 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.141336+0000", 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014226157 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.141347+0000", 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0292000000000001e-05 2024-04-26T11:47:11.864 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.865 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.865 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20068 3.1 3.73d97761 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e73)", 2024-04-26T11:47:11.865 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:47:11.809532+0000", 2024-04-26T11:47:11.865 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.051253126000000003, 2024-04-26T11:47:11.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051411243000000002, 2024-04-26T11:47:11.865 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for peered", 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809532+0000", 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809532+0000", 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809528+0000", 2024-04-26T11:47:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999962 2024-04-26T11:47:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809687+0000", 2024-04-26T11:47:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015904299999999999 2024-04-26T11:47:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809737+0000", 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9854000000000001e-05 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809761+0000", 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4168e-05 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809878+0000", 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116669 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:47:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809899+0000", 2024-04-26T11:47:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1562000000000001e-05 2024-04-26T11:47:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:47:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 2 2024-04-26T11:47:11.869 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:11.871 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:11.944 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:11.943+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:11.972 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:11.972 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:11.972 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:47:11.972 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:47:11.972 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:11.981 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:12.045 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:12.043+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:12.056 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-26T11:47:12.071 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:47:12.088 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:10879 4.31 4:8f6bfef1:::1000000314b.00000000:head [write 1350814~82401] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.365452245, 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043124375999999999, 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:12.089 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10879 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.721954+0000", 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722011+0000", 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7169000000000001e-05 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722022+0000", 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0968000000000001e-05 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.722026+0000", 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3660000000000002e-06 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726079+0000", 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040532789999999999 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726126+0000", 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6869999999999997e-05 2024-04-26T11:47:12.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.726195+0000", 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9178999999999996e-05 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.731788+0000", 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055929120000000002 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.764936+0000", 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033147329000000003 2024-04-26T11:47:12.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765008+0000", 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2365000000000003e-05 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:35.765079+0000", 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0684000000000003e-05 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1107 3.13 3:cb3d3880:::200.0000000d:head [write 2521286~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.944683539000003, 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043479088999999999, 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142723+0000", 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142731+0000", 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5439999999999999e-06 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142738+0000", 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142746+0000", 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4529999999999996e-06 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175185+0000", 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032439148000000001 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.175321+0000", 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013632 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186007+0000", 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010685536000000001 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186078+0000", 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0747000000000006e-05 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186202+0000", 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012457700000000001 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.944655060999999, 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.099 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:47:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:47:12.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.944629843999998, 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:47:12.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:47:12.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.944593758000003, 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.108 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:47:12.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:47:12.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:47:12.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:47:12.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:47:12.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:47:12.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:47:12.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:47:12.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:47:12.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:47:12.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.944566936000001, 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.113 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:47:12.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:47:12.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:47:12.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:47:12.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:47:12.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:47:12.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:47:12.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:47:12.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:47:12.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.941967697999999, 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:47:12.120 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.121 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.121 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:12.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.125 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.941490440000003, 2024-04-26T11:47:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:47:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:47:12.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:47:12.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:47:12.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:47:12.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:47:12.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:47:12.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:47:12.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:47:12.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:47:12.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.937423238000001, 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.131 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:12.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.136 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.136 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:12.136 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.937259118, 2024-04-26T11:47:12.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:47:12.136 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.136 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.136 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.934326458000001, 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:47:12.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:47:12.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:47:12.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.932143867000001, 2024-04-26T11:47:12.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:47:12.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:47:12.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:47:12.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.929632832000003, 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.155 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.156 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:12.156 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.927238191000001, 2024-04-26T11:47:12.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:47:12.156 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.156 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.156 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:12.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:47:12.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:47:12.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:47:12.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:47:12.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:47:12.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:47:12.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:47:12.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:47:12.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:47:12.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:47:12.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:47:12.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.927053131999998, 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.165 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.927013246000001, 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:47:12.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:47:12.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:47:12.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.925274002000002, 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.174 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.924572292999997, 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:47:12.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:47:12.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:47:12.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:47:12.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:47:12.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:47:12.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:47:12.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:47:12.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:47:12.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.920692862000003, 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:47:12.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:47:12.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.184 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.920664023, 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:12.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:12.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:12.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:12.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:47:12.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:47:12.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.189 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:12.189 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:12.189 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:12.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:12.191 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:12.187+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:12.292 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:12.288+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:12.322 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:12.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:12.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.322 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20329 3.1d 3:ba995448:::10000002b34.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.314833+0000", 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0042706469999999998, 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042863160000000001, 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314833+0000", 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314833+0000", 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314832+0000", 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314837+0000", 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2519999999999999e-06 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314853+0000", 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6050999999999999e-05 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314864+0000", 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0297e-05 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314909+0000", 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5553000000000002e-05 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315276+0000", 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036652199999999998 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20334 4.23 4:c51b93f3:::10000002b95.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.314899+0000", 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0042044400000000003, 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042560879999999999, 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.326 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314899+0000", 2024-04-26T11:47:12.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314899+0000", 2024-04-26T11:47:12.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314898+0000", 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314902+0000", 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8990000000000003e-06 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314913+0000", 2024-04-26T11:47:12.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0441999999999999e-05 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314920+0000", 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4080000000000001e-06 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315179+0000", 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000258576 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315348+0000", 2024-04-26T11:47:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000168732 2024-04-26T11:47:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315467+0000", 2024-04-26T11:47:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119157 2024-04-26T11:47:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316703+0000", 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012366460000000001 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20335 4.3f 4:ffee3be6:::10000002b96.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.314941+0000", 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0041628899999999998, 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042519979999999999, 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314941+0000", 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314941+0000", 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314940+0000", 2024-04-26T11:47:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314943+0000", 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.489e-06 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314961+0000", 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7430000000000001e-05 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314969+0000", 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6410000000000002e-06 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315019+0000", 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0430000000000003e-05 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315158+0000", 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013864199999999999 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316367+0000", 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012097130000000001 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317917+0000", 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015500749999999999 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20337 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.314977+0000", 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0041261029999999999, 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042590900000000001, 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314977+0000", 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314977+0000", 2024-04-26T11:47:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314977+0000", 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314980+0000", 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8219999999999998e-06 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314986+0000", 2024-04-26T11:47:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0859999999999998e-06 2024-04-26T11:47:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.314991+0000", 2024-04-26T11:47:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7609999999999998e-06 2024-04-26T11:47:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315022+0000", 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1371000000000002e-05 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315117+0000", 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4433999999999997e-05 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315201+0000", 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4855e-05 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316453+0000", 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012511670000000001 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20338 4.3f 4:fe7016a4:::10000002bd6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.315007+0000", 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0040968649999999999, 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043002120000000003, 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.340 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315007+0000", 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315007+0000", 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315006+0000", 2024-04-26T11:47:12.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315009+0000", 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.021e-06 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315019+0000", 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6290000000000005e-06 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315024+0000", 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3279999999999996e-06 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316808+0000", 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017835349999999999 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316936+0000", 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012781399999999999 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317018+0000", 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2329000000000004e-05 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317924+0000", 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00090608099999999999 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20341 4.28 4:17c6133a:::10000002c33.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.344 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.315050+0000", 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0040535359999999999, 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043252289999999999, 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315050+0000", 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315050+0000", 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315050+0000", 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315052+0000", 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5550000000000001e-06 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315058+0000", 2024-04-26T11:47:12.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.699e-06 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315063+0000", 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4829999999999999e-06 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315116+0000", 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2367999999999997e-05 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315252+0000", 2024-04-26T11:47:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013664800000000001 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315378+0000", 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012599700000000001 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316675+0000", 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012966150000000001 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20343 3.1d 3:be7f783c:::10000002c51.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.315771+0000", 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.003333014, 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003674854, 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315771+0000", 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315771+0000", 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315770+0000", 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315787+0000", 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7045e-05 2024-04-26T11:47:12.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315821+0000", 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4218999999999999e-05 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315829+0000", 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5839999999999995e-06 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315875+0000", 2024-04-26T11:47:12.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5702999999999999e-05 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315989+0000", 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011424799999999999 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20346 4.1c 4:3a76b7c3:::10000002c54.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.315848+0000", 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.003255876, 2024-04-26T11:47:12.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00365337, 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315848+0000", 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315848+0000", 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315847+0000", 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315852+0000", 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.006e-06 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315860+0000", 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2260000000000005e-06 2024-04-26T11:47:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315866+0000", 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1530000000000002e-06 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316134+0000", 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00026739400000000001 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316271+0000", 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137587 2024-04-26T11:47:12.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316420+0000", 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000149059 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317627+0000", 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012066399999999999 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.319343+0000", 2024-04-26T11:47:12.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017164350000000001 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.319394+0000", 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0762e-05 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20347 4.28 4:14084a2d:::10000002c55.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.315871+0000", 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0032321670000000002, 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036958400000000001, 2024-04-26T11:47:12.357 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315871+0000", 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315871+0000", 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315871+0000", 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315874+0000", 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9579999999999999e-06 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315884+0000", 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0472000000000001e-05 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315890+0000", 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7039999999999999e-06 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.315928+0000", 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8114000000000001e-05 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316081+0000", 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015267300000000001 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316201+0000", 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119716 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317493+0000", 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012928779999999999 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20349 4.1c 4:39e773f2:::10000002c57.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.316028+0000", 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0030753680000000002, 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036081429999999999, 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316028+0000", 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316028+0000", 2024-04-26T11:47:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316027+0000", 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316038+0000", 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0217000000000001e-05 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316047+0000", 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3670000000000003e-06 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316056+0000", 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7630000000000006e-06 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316885+0000", 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082910999999999998 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317043+0000", 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015830799999999999 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317179+0000", 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013553600000000001 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.319592+0000", 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024130250000000001 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20350 4.7 4:e1299055:::10000002c58.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.316063+0000", 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0030409790000000001, 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036432109999999999, 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316063+0000", 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316063+0000", 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316062+0000", 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316065+0000", 2024-04-26T11:47:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1319999999999998e-06 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316073+0000", 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3980000000000002e-06 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316078+0000", 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.677e-06 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316782+0000", 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070334599999999998 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317099+0000", 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00031743100000000002 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317214+0000", 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115375 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20351 4.37 4:ef3c0562:::10000002c59.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.316100+0000", 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0030039200000000002, 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036701849999999999, 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316100+0000", 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316100+0000", 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316099+0000", 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316102+0000", 2024-04-26T11:47:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1499999999999999e-06 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316110+0000", 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6529999999999994e-06 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316115+0000", 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5790000000000003e-06 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317294+0000", 2024-04-26T11:47:12.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001179072 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317373+0000", 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8782000000000006e-05 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317466+0000", 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2554999999999997e-05 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20354 4.24 4:251332a6:::10000002c5c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.316537+0000", 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002566296, 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033000709999999999, 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316537+0000", 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316537+0000", 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316536+0000", 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316542+0000", 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2730000000000002e-06 2024-04-26T11:47:12.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316552+0000", 2024-04-26T11:47:12.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0215e-05 2024-04-26T11:47:12.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316559+0000", 2024-04-26T11:47:12.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2370000000000003e-06 2024-04-26T11:47:12.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316867+0000", 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00030739999999999999 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.316939+0000", 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2355999999999996e-05 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317003+0000", 2024-04-26T11:47:12.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3941000000000003e-05 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317867+0000", 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00086406299999999998 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20356 4.1c 4:3a52bc85:::10000002c5e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.317820+0000", 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001283476, 2024-04-26T11:47:12.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020916379999999998, 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317820+0000", 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317820+0000", 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317819+0000", 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317823+0000", 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0339999999999998e-06 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317831+0000", 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3529999999999997e-06 2024-04-26T11:47:12.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317836+0000", 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8400000000000002e-06 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317885+0000", 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9635999999999997e-05 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318060+0000", 2024-04-26T11:47:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017448600000000001 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318183+0000", 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012341699999999999 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.319843+0000", 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016597319999999999 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20357 4.3b 4:de4f13c0:::10000002c5f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.317923+0000", 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001180391, 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002051668, 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317923+0000", 2024-04-26T11:47:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317923+0000", 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317923+0000", 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317926+0000", 2024-04-26T11:47:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.331e-06 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317930+0000", 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6280000000000004e-06 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317934+0000", 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5820000000000002e-06 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.317981+0000", 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6798999999999997e-05 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318073+0000", 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2152999999999997e-05 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318136+0000", 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3107000000000004e-05 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20358 4.22 4:465b59c0:::10000002c60.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.318370+0000", 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.000733349, 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001659748, 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318370+0000", 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318370+0000", 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318370+0000", 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318373+0000", 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9900000000000002e-06 2024-04-26T11:47:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318383+0000", 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0696999999999999e-05 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318396+0000", 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2508e-05 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318436+0000", 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9869000000000001e-05 2024-04-26T11:47:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318564+0000", 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000128646 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.318655+0000", 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0847999999999995e-05 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:20347 4.28 e74/73)", 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.319269+0000", 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9998341, 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00081399100000000002, 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.319269+0000", 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.319269+0000", 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.319269+0000", 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967296 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.319272+0000", 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3080000000000002e-06 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.319276+0000", 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5669999999999996e-06 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.319280+0000", 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8160000000000004e-06 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.319721+0000", 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00044098999999999999 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:47:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 17 2024-04-26T11:47:12.394 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:12.395 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2024-04-26T11:47:12.395 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:12.392+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:12.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:12.404 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T11:47:12.496 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:12.495+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:12.507 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:47:12.510 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:12.510 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:12.510 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:47:12.510 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:47:12.510 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:12.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:12.597 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:12.595+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:12.636 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.479667126999999, 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:47:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.477705110000002, 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:47:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:47:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:47:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:47:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:47:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:47:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:47:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:47:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.47767949, 2024-04-26T11:47:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:47:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:47:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.477619296, 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.477592518999998, 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:12.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:47:12.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.477536471000001, 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:12.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:12.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:47:12.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:47:12.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.667 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.477496504999998, 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:12.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:47:12.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:47:12.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:47:12.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:47:12.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:47:12.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.477465895000002, 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.477391386999997, 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.477323321999997, 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:47:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:47:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:47:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:47:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:47:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.477223174999999, 2024-04-26T11:47:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:47:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.457374072999997, 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:47:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:47:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.457315774000001, 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:47:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.455278515000003, 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:47:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:47:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:47:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:47:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.859920414999998, 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:47:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:47:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:47:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.291772678000001, 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:47:12.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:47:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:47:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:47:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:47:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:12.716 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.580417521000001, 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:47:12.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.575655313999999, 2024-04-26T11:47:12.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:12.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:12.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:12.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:47:12.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:47:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20069 3.1a 3:5d7bf03a:::200.0000001e:head [write 3252625~252176 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.140947+0000", 2024-04-26T11:47:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.493030623, 2024-04-26T11:47:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.119395825, 2024-04-26T11:47:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.140947+0000", 2024-04-26T11:47:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.140947+0000", 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.140944+0000", 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999967 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141481+0000", 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00053758799999999998 2024-04-26T11:47:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141517+0000", 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6106000000000003e-05 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141535+0000", 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8199999999999999e-05 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141702+0000", 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166632 2024-04-26T11:47:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141720+0000", 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.823e-05 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168265+0000", 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026544356000000002 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for peered", 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168278+0000", 2024-04-26T11:47:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2857000000000001e-05 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.252190+0000", 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.083912291 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.252454+0000", 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00026418399999999999 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.252709+0000", 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025521400000000003 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.259659+0000", 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069495319999999996 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260093+0000", 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00043409399999999999 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260173+0000", 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9833000000000006e-05 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260343+0000", 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000169968 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20071 3.1a 3:5d7bf03a:::200.0000001e:head [write 3504801~1138 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.141570+0000", 2024-04-26T11:47:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49240722999999997, 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.118929325, 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141570+0000", 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141570+0000", 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141569+0000", 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141577+0000", 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0169999999999996e-06 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141588+0000", 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.039e-05 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141596+0000", 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0390000000000005e-06 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141869+0000", 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00027378100000000001 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141896+0000", 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6979e-05 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168303+0000", 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026406959000000001 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for peered", 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168312+0000", 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8869999999999998e-06 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.254436+0000", 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.086123521999999994 2024-04-26T11:47:12.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:12.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.254567+0000", 2024-04-26T11:47:12.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013099699999999999 2024-04-26T11:47:12.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:12.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.254706+0000", 2024-04-26T11:47:12.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000139503 2024-04-26T11:47:12.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:12.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.259751+0000", 2024-04-26T11:47:12.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050443420000000003 2024-04-26T11:47:12.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:12.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260352+0000", 2024-04-26T11:47:12.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060123200000000005 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260409+0000", 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6937000000000001e-05 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260500+0000", 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0844e-05 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:12.743 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:12.745 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:47:12.745 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:47:12.745 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:47:12.745 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:47:12.745 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:47:12.745 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:47:12.746 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-26T11:47:12.746 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:12.747 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:12.743+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:12.748 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T11:47:12.845 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:12.843+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:12.863 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:12.864 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:12.874 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:12.947 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:12.944+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:12.977 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:12.977 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:12.986 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:13.047 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:13.044+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:13.060 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-26T11:47:13.074 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T11:47:13.088 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:13.088 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:13.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:13.148 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:13.144+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:13.219 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:13.219 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:13.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:13.238 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:47:13.249 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:13.248+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:13.337 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:13.337 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:13.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:13.349 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:13.347+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:13.381 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-04-26T11:47:13.392 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-04-26T11:47:13.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:47:13.392 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T11:47:13.407 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:47:13.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[19481]: fuse finished with error 0 and tester_r 0 2024-04-26T11:47:13.451 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:13.448+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:13.451 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:13.451 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:13.460 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:13.551 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:13.548+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:13.576 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:13.576 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:13.586 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:13.652 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:13.648+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:13.670 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:47:13.695 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:13.695 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:13.705 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:13.755 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:13.751+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:13.794 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:13.795 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:13.805 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T11:47:13.809 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:13.809 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:13.820 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:47:13.856 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:13.855+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:13.934 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:13.934 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:13.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:47:13.958 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:13.956+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:14.057 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:14.058 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:14.059 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:14.347+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:14.068 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:47:14.131 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:47:14.163 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:14.159+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:14.186 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:14.187 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:14.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:14.264 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:14.260+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:14.305 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:14.305 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:14.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:14.366 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:14.651+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:14.426 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:14.426 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:14.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:14.465 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:14.755+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:14.548 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:14.548 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:14.558 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:14.570 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:14.855+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:14.669 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:14.959+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:14.672 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:14.672 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:14.682 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:14.748 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:47:14.770 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:14.767+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:14.793 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:14.793 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:14.803 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:14.872 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:14.868+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:14.904 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:47:14.906 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:14.906 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:14.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:47:14.933 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:47:14.957 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:47:14.959 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:47:14.959 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:47:14.959 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:47:14.973 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:14.971+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:15.034 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:47:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:47:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 0 2024-04-26T11:47:15.034 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:47:15.044 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:47:15.073 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:15.072+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:15.136 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T11:47:15.152 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T11:47:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:47:15.160 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:47:15.160 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:47:15.160 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:47:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:47:15.170 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:47:15.173 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:15.463+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:15.274 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:15.563+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:15.277 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:20067 3.1 3.73d97761 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:11.090319+0000", 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4763770530000002, 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.35169779800000001, 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090319+0000", 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090319+0000", 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090317+0000", 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999976 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.279 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.280 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090330+0000", 2024-04-26T11:47:15.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3216e-05 2024-04-26T11:47:15.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.280 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.280 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090353+0000", 2024-04-26T11:47:15.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3303e-05 2024-04-26T11:47:15.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090377+0000", 2024-04-26T11:47:15.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3351999999999999e-05 2024-04-26T11:47:15.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090505+0000", 2024-04-26T11:47:15.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000128725 2024-04-26T11:47:15.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.091273+0000", 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00076794700000000005 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.442004+0000", 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.35073039099999997 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.442017+0000", 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3304e-05 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.282 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:20070 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.432595+0000", 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.1341013059999998, 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.118037163, 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.283 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432595+0000", 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432595+0000", 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432592+0000", 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999967 2024-04-26T11:47:15.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432621+0000", 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8819e-05 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432656+0000", 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5741999999999998e-05 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432679+0000", 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2055000000000001e-05 2024-04-26T11:47:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432815+0000", 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136439 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op must wait for map", 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432828+0000", 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2869e-05 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.437223+0000", 2024-04-26T11:47:15.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004395576 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.437455+0000", 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000231485 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.437711+0000", 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00025605700000000002 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.440270+0000", 2024-04-26T11:47:15.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0025592670000000001 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550496+0000", 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.110225868 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550565+0000", 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9387000000000005e-05 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550632+0000", 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6725999999999998e-05 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(mds.0.3:20070 3.6 e74/72 ondisk, result = 0)", 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.487060+0000", 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.079636416, 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063579518000000002, 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487060+0000", 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487060+0000", 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487059+0000", 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487064+0000", 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7539999999999997e-06 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487072+0000", 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4850000000000003e-06 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487084+0000", 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.226e-05 2024-04-26T11:47:15.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550476+0000", 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063392335999999994 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550489+0000", 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3114e-05 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550639+0000", 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000150078 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20069 3.1a e74/73 3:5d7bf03a:::200.0000001e:head v 74'343, mlcod=0'0)", 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.544647+0000", 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.0220495920000001, 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065705299999999998, 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.293 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544647+0000", 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544647+0000", 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544646+0000", 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544652+0000", 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2859999999999999e-06 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544660+0000", 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9899999999999997e-06 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544668+0000", 2024-04-26T11:47:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2330000000000006e-06 2024-04-26T11:47:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544704+0000", 2024-04-26T11:47:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6325999999999997e-05 2024-04-26T11:47:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544726+0000", 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1406000000000001e-05 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.551132+0000", 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064065099999999998 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.551217+0000", 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5152000000000001e-05 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.297 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.298 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.298 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20067 3.1 e74/73 3:86ee9bce:::500.00000001:head v 74'160, mlcod=0'0)", 2024-04-26T11:47:15.298 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.547534+0000", 2024-04-26T11:47:15.298 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.0191625260000001, 2024-04-26T11:47:15.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072860440000000002, 2024-04-26T11:47:15.298 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.298 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547534+0000", 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547534+0000", 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547533+0000", 2024-04-26T11:47:15.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547538+0000", 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2279999999999998e-06 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547546+0000", 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2740000000000002e-06 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547553+0000", 2024-04-26T11:47:15.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1949999999999997e-06 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547649+0000", 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6606000000000003e-05 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547666+0000", 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6982000000000001e-05 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.554785+0000", 2024-04-26T11:47:15.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.007118231 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.554820+0000", 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5308999999999997e-05 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20368 4.3a e74/73 4:5d1117a7:::10000002c6a.00000000:head v 74'355, mlcod=55'131)", 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612067+0000", 2024-04-26T11:47:15.302 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9546295929999999, 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068563560000000001, 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612067+0000", 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612067+0000", 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612066+0000", 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612070+0000", 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.501e-06 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612076+0000", 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4060000000000002e-06 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612082+0000", 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5840000000000002e-06 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612120+0000", 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8520999999999999e-05 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612144+0000", 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3533999999999999e-05 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618880+0000", 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067365519999999998 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618923+0000", 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2654000000000002e-05 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.306 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20363 4.1b e74/73 4:d88b9922:::10000002c65.00000000:head v 74'361, mlcod=55'122)", 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9544783290000001, 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067285640000000002, 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612222+0000", 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.904e-06 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612229+0000", 2024-04-26T11:47:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6939999999999998e-06 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612234+0000", 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7330000000000003e-06 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612270+0000", 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6350999999999998e-05 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612284+0000", 2024-04-26T11:47:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4015999999999999e-05 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618913+0000", 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066287610000000004 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618947+0000", 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3609999999999998e-05 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20375 4.20 e74/73 4:067da67c:::10000002c71.00000000:head v 74'397, mlcod=56'165)", 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.954347845, 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066753719999999997, 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612354+0000", 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5390000000000004e-06 2024-04-26T11:47:15.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612383+0000", 2024-04-26T11:47:15.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8297e-05 2024-04-26T11:47:15.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612388+0000", 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7289999999999997e-06 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612441+0000", 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2989999999999999e-05 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612459+0000", 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8139999999999999e-05 2024-04-26T11:47:15.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618998+0000", 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065383940000000003 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619024+0000", 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6001000000000001e-05 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20364 4.2e e74/73 4:7662bab1:::10000002c66.00000000:head v 74'394, mlcod=56'136)", 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612532+0000", 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9541642760000002, 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068009960000000001, 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612532+0000", 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612532+0000", 2024-04-26T11:47:15.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612531+0000", 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612540+0000", 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.789e-06 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612570+0000", 2024-04-26T11:47:15.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9685000000000001e-05 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612577+0000", 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6710000000000002e-06 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612620+0000", 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3729000000000001e-05 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612641+0000", 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0840999999999999e-05 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619229+0000", 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065881230000000004 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619333+0000", 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010380899999999999 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20377 4.35 e74/73 4:af418736:::10000002c73.00000000:head v 74'357, mlcod=56'133)", 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612576+0000", 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.954120407, 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064137359999999997, 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612576+0000", 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612576+0000", 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612575+0000", 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612581+0000", 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8730000000000004e-06 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612590+0000", 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1390000000000001e-06 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612597+0000", 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0190000000000001e-06 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612646+0000", 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8401e-05 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612666+0000", 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0506e-05 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618954+0000", 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0062876729999999997 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618990+0000", 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5787999999999997e-05 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20374 4.9 e74/73 4:90575f50:::10000002c70.00000000:head v 74'442, mlcod=55'154)", 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612589+0000", 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.954107735, 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064489930000000001, 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612589+0000", 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612589+0000", 2024-04-26T11:47:15.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612588+0000", 2024-04-26T11:47:15.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612593+0000", 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6829999999999999e-06 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612599+0000", 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612604+0000", 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612652+0000", 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7985000000000002e-05 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612669+0000", 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6969e-05 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618987+0000", 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063184030000000002 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619038+0000", 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0309999999999998e-05 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20362 4.28 e74/73 4:17c7e931:::10000002c64.00000000:head v 74'421, mlcod=55'144)", 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9540798559999999, 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064307469999999997, 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:15.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612620+0000", 2024-04-26T11:47:15.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0339999999999998e-06 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612627+0000", 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8909999999999998e-06 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612632+0000", 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9779999999999996e-06 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612694+0000", 2024-04-26T11:47:15.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1668999999999995e-05 2024-04-26T11:47:15.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612713+0000", 2024-04-26T11:47:15.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8811999999999999e-05 2024-04-26T11:47:15.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619027+0000", 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.006314432 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619047+0000", 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0213000000000001e-05 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.333 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20369 4.6 e74/73 4:618cf173:::10000002c6b.00000000:head v 74'427, mlcod=55'139)", 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612901+0000", 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9537957719999999, 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064523280000000002, 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612901+0000", 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612901+0000", 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612900+0000", 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612907+0000", 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0060000000000003e-06 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612935+0000", 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8568000000000002e-05 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612942+0000", 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8090000000000004e-06 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612973+0000", 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0543999999999998e-05 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612987+0000", 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3954999999999999e-05 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619336+0000", 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063491199999999998 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619353+0000", 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7115000000000001e-05 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20378 4.2d e74/73 4:b4d5432a:::10000002c74.00000000:head v 74'398, mlcod=55'122)", 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9537332699999999, 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060773800000000003, 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612967+0000", 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3950000000000003e-06 2024-04-26T11:47:15.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612973+0000", 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1360000000000002e-06 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612979+0000", 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9479999999999996e-06 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613018+0000", 2024-04-26T11:47:15.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8860999999999999e-05 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613039+0000", 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0852999999999998e-05 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618993+0000", 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059539780000000004 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619040+0000", 2024-04-26T11:47:15.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7651000000000002e-05 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20366 4.10 e74/73 4:0ad91db9:::10000002c68.00000000:head v 74'435, mlcod=55'138)", 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612989+0000", 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9537078050000001, 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060942130000000002, 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612989+0000", 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612989+0000", 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612988+0000", 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612993+0000", 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.561e-06 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612998+0000", 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5060000000000003e-06 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613004+0000", 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2120000000000002e-06 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613031+0000", 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7118e-05 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613050+0000", 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9245999999999998e-05 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619050+0000", 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060001530000000003 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619083+0000", 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2700000000000002e-05 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20656 4.39 e74/73 4:9fba633b:::1000000307f.00000000:head v 74'448, mlcod=56'164)", 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.653947+0000", 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9127497409999998, 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0061421419999999997, 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653947+0000", 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653947+0000", 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653946+0000", 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653953+0000", 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0849999999999999e-06 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653962+0000", 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7880000000000001e-06 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653970+0000", 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5410000000000003e-06 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.654099+0000", 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012950099999999999 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.654133+0000", 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3368000000000003e-05 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.660023+0000", 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058897589999999996 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.660089+0000", 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6186999999999995e-05 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20668 4.15 e74/73 4:aaa2e33f:::1000000308b.00000000:head v 74'401, mlcod=55'121)", 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.909835084, 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060769509999999997, 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.350 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:15.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656866+0000", 2024-04-26T11:47:15.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8640000000000001e-06 2024-04-26T11:47:15.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656874+0000", 2024-04-26T11:47:15.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7360000000000001e-06 2024-04-26T11:47:15.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656880+0000", 2024-04-26T11:47:15.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7019999999999998e-06 2024-04-26T11:47:15.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.657104+0000", 2024-04-26T11:47:15.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00022433500000000001 2024-04-26T11:47:15.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.657133+0000", 2024-04-26T11:47:15.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8611000000000001e-05 2024-04-26T11:47:15.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.662893+0000", 2024-04-26T11:47:15.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057597710000000003 2024-04-26T11:47:15.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.662938+0000", 2024-04-26T11:47:15.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5606999999999999e-05 2024-04-26T11:47:15.355 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.355 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.355 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20707 4.2e e74/73 4:779d8986:::10000002fc1.00000000:head v 74'402, mlcod=56'136)", 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.901572979, 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0062345880000000001, 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665128+0000", 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7299999999999996e-06 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665142+0000", 2024-04-26T11:47:15.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4304000000000001e-05 2024-04-26T11:47:15.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665147+0000", 2024-04-26T11:47:15.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:47:15.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665474+0000", 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00032683000000000001 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665491+0000", 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7447000000000001e-05 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671315+0000", 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058243440000000004 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671358+0000", 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2593999999999999e-05 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20716 4.26 e74/73 4:67994bf4:::10000002fca.00000000:head v 74'476, mlcod=55'163)", 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.665177+0000", 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9015198089999998, 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0062991000000000002, 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.360 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665177+0000", 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665177+0000", 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665176+0000", 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665180+0000", 2024-04-26T11:47:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9709999999999998e-06 2024-04-26T11:47:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665185+0000", 2024-04-26T11:47:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.938e-06 2024-04-26T11:47:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665188+0000", 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3450000000000002e-06 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665525+0000", 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000336177 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665546+0000", 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1668e-05 2024-04-26T11:47:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:15.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671362+0000", 2024-04-26T11:47:15.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058155450000000001 2024-04-26T11:47:15.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671476+0000", 2024-04-26T11:47:15.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011388200000000001 2024-04-26T11:47:15.364 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.364 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.365 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:20803 3.4 3:2052ff5c:::10000003021.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.887305086, 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068572590000000001, 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:15.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:15.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.367 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:15.367 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:15.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:15.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:15.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:15.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:15.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679394+0000", 2024-04-26T11:47:15.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5839999999999999e-06 2024-04-26T11:47:15.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679402+0000", 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5560000000000002e-06 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679406+0000", 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.532e-06 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:15.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679465+0000", 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8709000000000003e-05 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679636+0000", 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000171459 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.686249+0000", 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066120720000000001 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.371 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:15.372 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:15.372 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:47:15.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:15.418 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:15.707+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:15.475 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:15.475+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:15.496 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:15.496 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:15.496 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:47:15.496 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:15.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:15.576 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:15.863+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:15.617 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:47:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:47:15.617 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:15.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:15.677 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:15.672+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.581938213999997, 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:47:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:47:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:47:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:47:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:47:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.579976197000001, 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:47:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:47:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:47:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:47:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:47:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.579950576999998, 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:47:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:47:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.579890382999999, 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:47:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:47:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:47:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:47:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:47:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.579863606000004, 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.579807557999999, 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:47:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.579767592000003, 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.579736982, 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:47:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.579662474000003, 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:47:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:47:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.579594409000002, 2024-04-26T11:47:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:47:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:47:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.579494261999997, 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.559645160000002, 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.559586861, 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:47:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:47:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.557549602000002, 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:47:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:47:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:47:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.962191502000003, 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:47:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:47:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:47:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.394043764999999, 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:47:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:47:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:47:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:47:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:47:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:47:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.682688607999999, 2024-04-26T11:47:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:47:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:47:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.677926401000001, 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:47:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:47:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:47:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:47:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:47:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:47:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:47:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:47:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:47:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:47:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:47:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20069 3.1a 3:5d7bf03a:::200.0000001e:head [write 3252625~252176 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.140947+0000", 2024-04-26T11:47:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.5953017100000002, 2024-04-26T11:47:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.119395825, 2024-04-26T11:47:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.140947+0000", 2024-04-26T11:47:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.140947+0000", 2024-04-26T11:47:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.140944+0000", 2024-04-26T11:47:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999967 2024-04-26T11:47:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141481+0000", 2024-04-26T11:47:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00053758799999999998 2024-04-26T11:47:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141517+0000", 2024-04-26T11:47:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6106000000000003e-05 2024-04-26T11:47:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141535+0000", 2024-04-26T11:47:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8199999999999999e-05 2024-04-26T11:47:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141702+0000", 2024-04-26T11:47:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166632 2024-04-26T11:47:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:47:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141720+0000", 2024-04-26T11:47:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.823e-05 2024-04-26T11:47:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168265+0000", 2024-04-26T11:47:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026544356000000002 2024-04-26T11:47:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for peered", 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168278+0000", 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2857000000000001e-05 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.252190+0000", 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.083912291 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.252454+0000", 2024-04-26T11:47:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00026418399999999999 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.252709+0000", 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025521400000000003 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.259659+0000", 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069495319999999996 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260093+0000", 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00043409399999999999 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260173+0000", 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9833000000000006e-05 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260343+0000", 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000169968 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20071 3.1a 3:5d7bf03a:::200.0000001e:head [write 3504801~1138 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.141570+0000", 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.5946783170000001, 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.118929325, 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141570+0000", 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141570+0000", 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141569+0000", 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141577+0000", 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0169999999999996e-06 2024-04-26T11:47:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141588+0000", 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.039e-05 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141596+0000", 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0390000000000005e-06 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141869+0000", 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00027378100000000001 2024-04-26T11:47:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141896+0000", 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6979e-05 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168303+0000", 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026406959000000001 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for peered", 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168312+0000", 2024-04-26T11:47:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8869999999999998e-06 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.254436+0000", 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.086123521999999994 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.254567+0000", 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013099699999999999 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.254706+0000", 2024-04-26T11:47:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000139503 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.259751+0000", 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050443420000000003 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260352+0000", 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060123200000000005 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260409+0000", 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6937000000000001e-05 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260500+0000", 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0844e-05 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:15.848 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:15.850 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:15.850 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:15.847+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:15.951 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:15.948+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:15.970 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:15.970 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:15.970 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:47:15.970 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:15.981 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:16.051 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:16.051+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:16.093 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:16.093 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:16.093 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:47:16.094 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:47:16.094 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:16.103 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:16.136 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T11:47:16.146 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:47:16.150 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T11:47:16.152 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:16.151+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:16.213 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.067646103999998, 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:16.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:16.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:47:16.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.220 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.067620886999997, 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:47:16.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:47:16.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:47:16.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.067584801000002, 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.067557979, 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:47:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.064958740999998, 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.238 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.064481483000002, 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:47:16.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:47:16.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:47:16.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.060414281, 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.060250160999999, 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:16.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:47:16.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:47:16.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.057317501, 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:47:16.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.05513491, 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:47:16.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:47:16.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:47:16.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.052623875000002, 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.262 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:47:16.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:47:16.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.050229234, 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:16.271 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.050044174999996, 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:16.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:47:16.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:47:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.050004289, 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:47:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.048265045000001, 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.047563336000003, 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:47:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.043683905000002, 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:47:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:47:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:47:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.043655065999999, 2024-04-26T11:47:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20067 3.1 3:86ee9bce:::500.00000001:head [write 1346633~101] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e73)", 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:47:11.126868+0000", 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.083529918, 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.136826205, 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126868+0000", 2024-04-26T11:47:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126868+0000", 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126864+0000", 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999967 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126883+0000", 2024-04-26T11:47:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8836000000000001e-05 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126926+0000", 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2202e-05 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126953+0000", 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7217e-05 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.127093+0000", 2024-04-26T11:47:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013991000000000001 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.127110+0000", 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7583000000000001e-05 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.141336+0000", 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014226157 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.141347+0000", 2024-04-26T11:47:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0292000000000001e-05 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.255212+0000", 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1138653009999999 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.255426+0000", 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000214284 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.255654+0000", 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022803400000000001 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.257699+0000", 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002044246 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.263544+0000", 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058457220000000002 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.263607+0000", 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3087000000000001e-05 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.263694+0000", 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6594000000000005e-05 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20068 3.1 3:86ee9bce:::500.00000001:head [write 1346734~62216] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e73)", 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:47:11.809532+0000", 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.4008661519999999, 2024-04-26T11:47:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.454506254, 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809532+0000", 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809532+0000", 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809528+0000", 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999962 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809687+0000", 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015904299999999999 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809737+0000", 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9854000000000001e-05 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809761+0000", 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4168e-05 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809878+0000", 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116669 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809899+0000", 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1562000000000001e-05 2024-04-26T11:47:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.256703+0000", 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.44680386999999999 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.256806+0000", 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010312 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.256961+0000", 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000154721 2024-04-26T11:47:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.258491+0000", 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015299370000000001 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.263901+0000", 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054102589999999997 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.263959+0000", 2024-04-26T11:47:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7729999999999998e-05 2024-04-26T11:47:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.264038+0000", 2024-04-26T11:47:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9060999999999994e-05 2024-04-26T11:47:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:16.311 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:16.313 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:47:16.313 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:16.599+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:16.414 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:16.703+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:16.433 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:47:16.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:47:16.433 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 0 2024-04-26T11:47:16.434 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:47:16.443 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:47:16.514 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:16.512+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:16.548 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:47:16.548 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:47:16.549 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:47:16.549 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:47:16.549 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:47:16.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:47:16.615 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:16.612+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:16.666 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:47:16.666 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:47:16.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:47:16.666 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:47:16.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:20067 3.1 3.73d97761 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:11.090319+0000", 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 5.8648991060000002, 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.35169779800000001, 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090319+0000", 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090319+0000", 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090317+0000", 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999976 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090330+0000", 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3216e-05 2024-04-26T11:47:16.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090353+0000", 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3303e-05 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090377+0000", 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3351999999999999e-05 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090505+0000", 2024-04-26T11:47:16.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000128725 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.091273+0000", 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00076794700000000005 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.442004+0000", 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.35073039099999997 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.442017+0000", 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3304e-05 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:20070 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.432595+0000", 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.5226233589999998, 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.118037163, 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.671 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432595+0000", 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432595+0000", 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432592+0000", 2024-04-26T11:47:16.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999967 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432621+0000", 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8819e-05 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432656+0000", 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5741999999999998e-05 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432679+0000", 2024-04-26T11:47:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2055000000000001e-05 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432815+0000", 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136439 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op must wait for map", 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432828+0000", 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2869e-05 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.437223+0000", 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004395576 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.437455+0000", 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000231485 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.437711+0000", 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00025605700000000002 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.440270+0000", 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0025592670000000001 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550496+0000", 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.110225868 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550565+0000", 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9387000000000005e-05 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550632+0000", 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6725999999999998e-05 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(mds.0.3:20070 3.6 e74/72 ondisk, result = 0)", 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.487060+0000", 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4681584690000005, 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063579518000000002, 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.677 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487060+0000", 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487060+0000", 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487059+0000", 2024-04-26T11:47:16.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487064+0000", 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7539999999999997e-06 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487072+0000", 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4850000000000003e-06 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487084+0000", 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.226e-05 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550476+0000", 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063392335999999994 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550489+0000", 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3114e-05 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550639+0000", 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000150078 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20069 3.1a e74/73 3:5d7bf03a:::200.0000001e:head v 74'343, mlcod=0'0)", 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.544647+0000", 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4105716450000001, 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065705299999999998, 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.681 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544647+0000", 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544647+0000", 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544646+0000", 2024-04-26T11:47:16.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544652+0000", 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2859999999999999e-06 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544660+0000", 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9899999999999997e-06 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544668+0000", 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2330000000000006e-06 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544704+0000", 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6325999999999997e-05 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544726+0000", 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1406000000000001e-05 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.551132+0000", 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064065099999999998 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.551217+0000", 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5152000000000001e-05 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20067 3.1 e74/73 3:86ee9bce:::500.00000001:head v 74'160, mlcod=0'0)", 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.547534+0000", 2024-04-26T11:47:16.685 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4076845789999997, 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072860440000000002, 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547534+0000", 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547534+0000", 2024-04-26T11:47:16.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547533+0000", 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547538+0000", 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2279999999999998e-06 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547546+0000", 2024-04-26T11:47:16.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2740000000000002e-06 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547553+0000", 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1949999999999997e-06 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547649+0000", 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6606000000000003e-05 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547666+0000", 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6982000000000001e-05 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.554785+0000", 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.007118231 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.554820+0000", 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5308999999999997e-05 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20368 4.3a e74/73 4:5d1117a7:::10000002c6a.00000000:head v 74'355, mlcod=55'131)", 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612067+0000", 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3431516459999999, 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068563560000000001, 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612067+0000", 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612067+0000", 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612066+0000", 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612070+0000", 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.501e-06 2024-04-26T11:47:16.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612076+0000", 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4060000000000002e-06 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612082+0000", 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5840000000000002e-06 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612120+0000", 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8520999999999999e-05 2024-04-26T11:47:16.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612144+0000", 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3533999999999999e-05 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618880+0000", 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067365519999999998 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618923+0000", 2024-04-26T11:47:16.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2654000000000002e-05 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20363 4.1b e74/73 4:d88b9922:::10000002c65.00000000:head v 74'361, mlcod=55'122)", 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3430003819999996, 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067285640000000002, 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612222+0000", 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.904e-06 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612229+0000", 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6939999999999998e-06 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612234+0000", 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7330000000000003e-06 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612270+0000", 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6350999999999998e-05 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612284+0000", 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4015999999999999e-05 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618913+0000", 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066287610000000004 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618947+0000", 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3609999999999998e-05 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20375 4.20 e74/73 4:067da67c:::10000002c71.00000000:head v 74'397, mlcod=56'165)", 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.342869898, 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066753719999999997, 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.698 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612354+0000", 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5390000000000004e-06 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612383+0000", 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8297e-05 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612388+0000", 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7289999999999997e-06 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612441+0000", 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2989999999999999e-05 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612459+0000", 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8139999999999999e-05 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618998+0000", 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065383940000000003 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619024+0000", 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6001000000000001e-05 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20364 4.2e e74/73 4:7662bab1:::10000002c66.00000000:head v 74'394, mlcod=56'136)", 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612532+0000", 2024-04-26T11:47:16.702 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3426863290000002, 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068009960000000001, 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612532+0000", 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612532+0000", 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612531+0000", 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612540+0000", 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.789e-06 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612570+0000", 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9685000000000001e-05 2024-04-26T11:47:16.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612577+0000", 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6710000000000002e-06 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612620+0000", 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3729000000000001e-05 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612641+0000", 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0840999999999999e-05 2024-04-26T11:47:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619229+0000", 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065881230000000004 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619333+0000", 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010380899999999999 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.706 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20377 4.35 e74/73 4:af418736:::10000002c73.00000000:head v 74'357, mlcod=56'133)", 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612576+0000", 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3426424600000004, 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064137359999999997, 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612576+0000", 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612576+0000", 2024-04-26T11:47:16.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612575+0000", 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612581+0000", 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8730000000000004e-06 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612590+0000", 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1390000000000001e-06 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612597+0000", 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0190000000000001e-06 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612646+0000", 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8401e-05 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612666+0000", 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0506e-05 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618954+0000", 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0062876729999999997 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618990+0000", 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5787999999999997e-05 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.710 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20374 4.9 e74/73 4:90575f50:::10000002c70.00000000:head v 74'442, mlcod=55'154)", 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612589+0000", 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.342629788, 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064489930000000001, 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612589+0000", 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612589+0000", 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612588+0000", 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612593+0000", 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6829999999999999e-06 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612599+0000", 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612604+0000", 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612652+0000", 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7985000000000002e-05 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612669+0000", 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6969e-05 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618987+0000", 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063184030000000002 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619038+0000", 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0309999999999998e-05 2024-04-26T11:47:16.714 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20362 4.28 e74/73 4:17c7e931:::10000002c64.00000000:head v 74'421, mlcod=55'144)", 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3426019089999999, 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064307469999999997, 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612620+0000", 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0339999999999998e-06 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612627+0000", 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8909999999999998e-06 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612632+0000", 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9779999999999996e-06 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612694+0000", 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1668999999999995e-05 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612713+0000", 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8811999999999999e-05 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619027+0000", 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.006314432 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619047+0000", 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0213000000000001e-05 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20369 4.6 e74/73 4:618cf173:::10000002c6b.00000000:head v 74'427, mlcod=55'139)", 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612901+0000", 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3423178250000003, 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064523280000000002, 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612901+0000", 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612901+0000", 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612900+0000", 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612907+0000", 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0060000000000003e-06 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612935+0000", 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8568000000000002e-05 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612942+0000", 2024-04-26T11:47:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8090000000000004e-06 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612973+0000", 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0543999999999998e-05 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612987+0000", 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3954999999999999e-05 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619336+0000", 2024-04-26T11:47:16.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063491199999999998 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619353+0000", 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7115000000000001e-05 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20378 4.2d e74/73 4:b4d5432a:::10000002c74.00000000:head v 74'398, mlcod=55'122)", 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3422553229999998, 2024-04-26T11:47:16.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060773800000000003, 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612967+0000", 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3950000000000003e-06 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612973+0000", 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1360000000000002e-06 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612979+0000", 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9479999999999996e-06 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613018+0000", 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8860999999999999e-05 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613039+0000", 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0852999999999998e-05 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618993+0000", 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059539780000000004 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619040+0000", 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7651000000000002e-05 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20366 4.10 e74/73 4:0ad91db9:::10000002c68.00000000:head v 74'435, mlcod=55'138)", 2024-04-26T11:47:16.727 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612989+0000", 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3422298579999996, 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060942130000000002, 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612989+0000", 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612989+0000", 2024-04-26T11:47:16.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612988+0000", 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612993+0000", 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.561e-06 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612998+0000", 2024-04-26T11:47:16.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5060000000000003e-06 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613004+0000", 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2120000000000002e-06 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613031+0000", 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7118e-05 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613050+0000", 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9245999999999998e-05 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619050+0000", 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060001530000000003 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619083+0000", 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2700000000000002e-05 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20656 4.39 e74/73 4:9fba633b:::1000000307f.00000000:head v 74'448, mlcod=56'164)", 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.653947+0000", 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3012717939999998, 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0061421419999999997, 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653947+0000", 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653947+0000", 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653946+0000", 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653953+0000", 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0849999999999999e-06 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653962+0000", 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7880000000000001e-06 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653970+0000", 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5410000000000003e-06 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.654099+0000", 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012950099999999999 2024-04-26T11:47:16.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.654133+0000", 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3368000000000003e-05 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.660023+0000", 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058897589999999996 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.660089+0000", 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6186999999999995e-05 2024-04-26T11:47:16.735 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20668 4.15 e74/73 4:aaa2e33f:::1000000308b.00000000:head v 74'401, mlcod=55'121)", 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.298357137, 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060769509999999997, 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:16.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656866+0000", 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8640000000000001e-06 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656874+0000", 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7360000000000001e-06 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656880+0000", 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7019999999999998e-06 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.657104+0000", 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00022433500000000001 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.657133+0000", 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8611000000000001e-05 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.662893+0000", 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057597710000000003 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.662938+0000", 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5606999999999999e-05 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20707 4.2e e74/73 4:779d8986:::10000002fc1.00000000:head v 74'402, mlcod=56'136)", 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.290095032, 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0062345880000000001, 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:16.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665128+0000", 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7299999999999996e-06 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665142+0000", 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4304000000000001e-05 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665147+0000", 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665474+0000", 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00032683000000000001 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665491+0000", 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7447000000000001e-05 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671315+0000", 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058243440000000004 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671358+0000", 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2593999999999999e-05 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20716 4.26 e74/73 4:67994bf4:::10000002fca.00000000:head v 74'476, mlcod=55'163)", 2024-04-26T11:47:16.744 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.665177+0000", 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.2900418619999998, 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0062991000000000002, 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665177+0000", 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665177+0000", 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665176+0000", 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665180+0000", 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9709999999999998e-06 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665185+0000", 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.938e-06 2024-04-26T11:47:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665188+0000", 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3450000000000002e-06 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665525+0000", 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000336177 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665546+0000", 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1668e-05 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671362+0000", 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058155450000000001 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671476+0000", 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011388200000000001 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:20803 3.4 3:2052ff5c:::10000003021.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.2758271390000004, 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068572590000000001, 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679394+0000", 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5839999999999999e-06 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679402+0000", 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5560000000000002e-06 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679406+0000", 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.532e-06 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679465+0000", 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8709000000000003e-05 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679636+0000", 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000171459 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.686249+0000", 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066120720000000001 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:16.752 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:47:16.754 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:17.043+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:16.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:16.854 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:17.143+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:16.878 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:47:16.879 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:16.889 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:16.956 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:16.952+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:16.972 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:47:16.998 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:47:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:47:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:47:16.999 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:17.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:17.057 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:17.056+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:17.122 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:47:17.123 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:47:17.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:47:17.123 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:47:17.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.123 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1986501~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:47:17.123 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:17.123 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.964593815000001, 2024-04-26T11:47:17.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043764834000000002, 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154310+0000", 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154314+0000", 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7110000000000003e-06 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154325+0000", 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0891e-05 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.154332+0000", 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176148+0000", 2024-04-26T11:47:17.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021816105999999998 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176243+0000", 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4955000000000001e-05 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.176381+0000", 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013801800000000001 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.179654+0000", 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032732740000000001 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197863+0000", 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018209396999999999 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.197981+0000", 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117237 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:22.198075+0000", 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4575999999999997e-05 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:322 3.2 3:4272d415:::200.0000000b:head [write 1507151~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:17.129 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.962631797999997, 2024-04-26T11:47:17.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042847458999999997, 2024-04-26T11:47:17.130 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.130 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.130 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:17.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156272+0000", 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156277+0000", 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156285+0000", 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156292+0000", 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194025+0000", 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037732709000000003 2024-04-26T11:47:17.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.194138+0000", 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112565 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199023+0000", 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048858640000000002 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199065+0000", 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2086000000000003e-05 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199120+0000", 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4314999999999998e-05 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:323 3.2 3:4272d415:::200.0000000b:head [write 1508553~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.134 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:17.135 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.962606178000001, 2024-04-26T11:47:17.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044081018, 2024-04-26T11:47:17.135 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.135 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.135 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:17.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156298+0000", 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156297+0000", 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156306+0000", 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156336+0000", 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9709e-05 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156350+0000", 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4080000000000001e-05 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195380+0000", 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039030377999999998 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.195480+0000", 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9914000000000006e-05 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200258+0000", 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004777786 2024-04-26T11:47:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200301+0000", 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3132e-05 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200379+0000", 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7693000000000003e-05 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:324 3.2 3:4272d415:::200.0000000b:head [write 1509954~2252 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.962545984000002, 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044107276000000001, 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156358+0000", 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156357+0000", 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156363+0000", 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156372+0000", 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8070000000000006e-06 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156379+0000", 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196140+0000", 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039760485999999998 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196258+0000", 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117819 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200387+0000", 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041294720000000004 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200416+0000", 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9371999999999999e-05 2024-04-26T11:47:17.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200465+0000", 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9067000000000003e-05 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:325 3.2 3:4272d415:::200.0000000b:head [write 1512206~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.962519207, 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044166115999999998, 2024-04-26T11:47:17.144 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156385+0000", 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156384+0000", 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156412+0000", 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7206e-05 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156422+0000", 2024-04-26T11:47:17.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2024-04-26T11:47:17.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156434+0000", 2024-04-26T11:47:17.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2272999999999999e-05 2024-04-26T11:47:17.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.196965+0000", 2024-04-26T11:47:17.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040530588999999999 2024-04-26T11:47:17.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197024+0000", 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9213999999999999e-05 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200477+0000", 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034526729999999999 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200512+0000", 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4817999999999998e-05 2024-04-26T11:47:17.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200551+0000", 2024-04-26T11:47:17.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9523000000000001e-05 2024-04-26T11:47:17.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.149 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.149 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:326 3.2 3:4272d415:::200.0000000b:head [write 1513613~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.962463159000002, 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048144117, 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156441+0000", 2024-04-26T11:47:17.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156440+0000", 2024-04-26T11:47:17.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:17.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156445+0000", 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156458+0000", 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.26e-05 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156475+0000", 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6776e-05 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197375+0000", 2024-04-26T11:47:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040899910999999997 2024-04-26T11:47:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.197467+0000", 2024-04-26T11:47:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2158999999999996e-05 2024-04-26T11:47:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204427+0000", 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069598519999999999 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204473+0000", 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6773000000000001e-05 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204585+0000", 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111649 2024-04-26T11:47:17.154 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:327 3.2 3:4272d415:::200.0000000b:head [write 1515023~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.962423192999999, 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048201332, 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:17.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156481+0000", 2024-04-26T11:47:17.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156480+0000", 2024-04-26T11:47:17.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:17.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156489+0000", 2024-04-26T11:47:17.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8729999999999996e-06 2024-04-26T11:47:17.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156497+0000", 2024-04-26T11:47:17.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1969999999999996e-06 2024-04-26T11:47:17.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156504+0000", 2024-04-26T11:47:17.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2024-04-26T11:47:17.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198030+0000", 2024-04-26T11:47:17.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041525711999999999 2024-04-26T11:47:17.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.198076+0000", 2024-04-26T11:47:17.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6066999999999998e-05 2024-04-26T11:47:17.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204598+0000", 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065222400000000003 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204633+0000", 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4798999999999997e-05 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.204682+0000", 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9487999999999998e-05 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.160 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:328 3.2 3:4272d415:::200.0000000b:head [write 1516428~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.962392583000003, 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049959236999999997, 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156512+0000", 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156511+0000", 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156518+0000", 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2024-04-26T11:47:17.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156532+0000", 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4372999999999999e-05 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156576+0000", 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3829000000000003e-05 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199182+0000", 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042606039999999998 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199302+0000", 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011956900000000001 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206366+0000", 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070638139999999999 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206411+0000", 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5059999999999999e-05 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206471+0000", 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9993e-05 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:329 3.2 3:4272d415:::200.0000000b:head [write 1517827~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.165 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.962318074999999, 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050010337000000002, 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156586+0000", 2024-04-26T11:47:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156585+0000", 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156597+0000", 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1355999999999999e-05 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156615+0000", 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8569000000000001e-05 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156643+0000", 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7847e-05 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199868+0000", 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043225044999999997 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.199934+0000", 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6110000000000002e-05 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206484+0000", 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065500719999999997 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206523+0000", 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8271e-05 2024-04-26T11:47:17.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.206596+0000", 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3826999999999996e-05 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:330 3.2 3:4272d415:::200.0000000b:head [write 1519240~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.962250009999998, 2024-04-26T11:47:17.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051390371999999997, 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156654+0000", 2024-04-26T11:47:17.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:17.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156660+0000", 2024-04-26T11:47:17.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2024-04-26T11:47:17.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156680+0000", 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9740000000000001e-05 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156695+0000", 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5682999999999999e-05 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200591+0000", 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043896091999999998 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.200644+0000", 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689000000000003e-05 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207948+0000", 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073036530000000002 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.207988+0000", 2024-04-26T11:47:17.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0720999999999999e-05 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208045+0000", 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110999999999999e-05 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:331 3.2 3:4272d415:::200.0000000b:head [write 1521158~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.175 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.962149863, 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051412508000000003, 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:17.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156754+0000", 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156764+0000", 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156783+0000", 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9153000000000001e-05 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.156801+0000", 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8499e-05 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203798+0000", 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046996410000000002 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.203921+0000", 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000122994 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208083+0000", 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041617420000000004 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208118+0000", 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5636000000000002e-05 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.208167+0000", 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8587000000000001e-05 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:338 3.2 3:4272d415:::200.0000000b:head [write 1558423~1934 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.942300760999998, 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045644939000000002, 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176603+0000", 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:17.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176607+0000", 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999999e-06 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176642+0000", 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5562999999999998e-05 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176653+0000", 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1083e-05 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210002+0000", 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033348573999999999 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210103+0000", 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100962 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222102+0000", 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011998604 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222150+0000", 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8223999999999998e-05 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222248+0000", 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8511999999999995e-05 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.184 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:339 3.2 3:4272d415:::200.0000000b:head [write 1560357~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.942242462000003, 2024-04-26T11:47:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045713103999999997, 2024-04-26T11:47:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.185 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176662+0000", 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176661+0000", 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176665+0000", 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176672+0000", 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.176677+0000", 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210589+0000", 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033911845000000003 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.210689+0000", 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9607999999999999e-05 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222261+0000", 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011572735000000001 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222296+0000", 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4938000000000003e-05 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222375+0000", 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8529999999999995e-05 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.189 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:340 3.2 3:4272d415:::200.0000000b:head [write 1562281~5857 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 44.940205202999998, 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043853122000000001, 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178699+0000", 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178697+0000", 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999981 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178713+0000", 2024-04-26T11:47:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5875e-05 2024-04-26T11:47:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178730+0000", 2024-04-26T11:47:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6917000000000001e-05 2024-04-26T11:47:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.178741+0000", 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212466+0000", 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033725362000000002 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.212523+0000", 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6750999999999999e-05 2024-04-26T11:47:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222391+0000", 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009868379 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222433+0000", 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1622999999999998e-05 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:32.222552+0000", 2024-04-26T11:47:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119208 2024-04-26T11:47:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:10897 4.1 4:823e197f:::10000003110.00000000:head [write 0~4194304 [2@1038275]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:47:17.195 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.344847102999999, 2024-04-26T11:47:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049966568000000003, 2024-04-26T11:47:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 10897 2024-04-26T11:47:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.196 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774057+0000", 2024-04-26T11:47:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.774056+0000", 2024-04-26T11:47:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779690+0000", 2024-04-26T11:47:17.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056340280000000001 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779711+0000", 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1061999999999999e-05 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779722+0000", 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0759e-05 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779814+0000", 2024-04-26T11:47:17.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2510999999999996e-05 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.779952+0000", 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000137279 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.780138+0000", 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018683 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.795210+0000", 2024-04-26T11:47:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015071826 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823896+0000", 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028685314999999999 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.823961+0000", 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5543999999999995e-05 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:35.824024+0000", 2024-04-26T11:47:17.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2477000000000005e-05 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:13773 4.3 4:c134563c:::10000003536.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.776699366000003, 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049138071999999998, 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:17.202 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13773 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342205+0000", 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.342204+0000", 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348271+0000", 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060675399999999997 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348287+0000", 2024-04-26T11:47:17.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914999999999999e-05 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348295+0000", 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9109999999999993e-06 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348345+0000", 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9518999999999998e-05 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348452+0000", 2024-04-26T11:47:17.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107193 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.348617+0000", 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016489200000000001 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.365553+0000", 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016936142000000001 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391276+0000", 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025723183 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391316+0000", 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0054e-05 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:40.391343+0000", 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6812e-05 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14402 4.3e 4:7ecc211e:::100000030c6.00000000:head [write 0~4194304 [4@1203343]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.065344209000003, 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056388769999999998, 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14402 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053560+0000", 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.053558+0000", 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:47:17.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058120+0000", 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045613549999999996 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058149+0000", 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9430000000000001e-05 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058171+0000", 2024-04-26T11:47:17.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058240+0000", 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9317000000000001e-05 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058407+0000", 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166692 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109846+0000", 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051439488999999998 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109903+0000", 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6986e-05 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109949+0000", 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5219999999999997e-05 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4541.0:14405 4.36 4:6fec5295:::1000000371c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.060582001999997, 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051710236, 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4541", 2024-04-26T11:47:17.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 14405 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.058322+0000", 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064926+0000", 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066044249999999997 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064939+0000", 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2942000000000001e-05 2024-04-26T11:47:17.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.064946+0000", 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065071+0000", 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012557000000000001 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.065416+0000", 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000344464 2024-04-26T11:47:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109962+0000", 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044545932000000003 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.109995+0000", 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2682999999999999e-05 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:46:41.110032+0000", 2024-04-26T11:47:17.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7854e-05 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20069 3.1a 3:5d7bf03a:::200.0000001e:head [write 3252625~252176 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.140947+0000", 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9779573109999999, 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.119395825, 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.140947+0000", 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.140947+0000", 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.140944+0000", 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999967 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141481+0000", 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00053758799999999998 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141517+0000", 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6106000000000003e-05 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141535+0000", 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8199999999999999e-05 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141702+0000", 2024-04-26T11:47:17.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166632 2024-04-26T11:47:17.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:47:17.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141720+0000", 2024-04-26T11:47:17.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.823e-05 2024-04-26T11:47:17.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168265+0000", 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026544356000000002 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for peered", 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168278+0000", 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2857000000000001e-05 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.252190+0000", 2024-04-26T11:47:17.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.083912291 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.252454+0000", 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00026418399999999999 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.252709+0000", 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025521400000000003 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:17.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.259659+0000", 2024-04-26T11:47:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069495319999999996 2024-04-26T11:47:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260093+0000", 2024-04-26T11:47:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00043409399999999999 2024-04-26T11:47:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260173+0000", 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9833000000000006e-05 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260343+0000", 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000169968 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:20071 3.1a 3:5d7bf03a:::200.0000001e:head [write 3504801~1138 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:47:12.141570+0000", 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9773339180000002, 2024-04-26T11:47:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.118929325, 2024-04-26T11:47:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:47:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:47:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:47:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141570+0000", 2024-04-26T11:47:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141570+0000", 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141569+0000", 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141577+0000", 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0169999999999996e-06 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:47:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141588+0000", 2024-04-26T11:47:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.039e-05 2024-04-26T11:47:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:47:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141596+0000", 2024-04-26T11:47:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0390000000000005e-06 2024-04-26T11:47:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141869+0000", 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00027378100000000001 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.141896+0000", 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6979e-05 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168303+0000", 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026406959000000001 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for peered", 2024-04-26T11:47:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.168312+0000", 2024-04-26T11:47:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8869999999999998e-06 2024-04-26T11:47:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:47:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.254436+0000", 2024-04-26T11:47:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.086123521999999994 2024-04-26T11:47:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:47:17.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.254567+0000", 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013099699999999999 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.254706+0000", 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000139503 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.259751+0000", 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050443420000000003 2024-04-26T11:47:17.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260352+0000", 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060123200000000005 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260409+0000", 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6937000000000001e-05 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:47:17.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:47:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:47:12.260500+0000", 2024-04-26T11:47:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0844e-05 2024-04-26T11:47:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:47:17.233 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:47:17.233 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:47:17.235 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:47:17.235 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:17.232+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T11:47:17.237 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:17.237 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:47:17.238 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T11:47:17.238 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:17.239 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:47:17.239 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:47:17.240 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:47:17.240 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:47:17.240 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:47:17.336 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:17.335+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:17.353 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:17.353 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:17.363 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:17.437 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:17.723+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:17.474 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:17.474 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:17.483 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:17.538 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:17.827+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:17.569 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:17.583 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-04-26T11:47:17.127031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127155508,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7795,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2805,"num_read_kb":1335940,"num_write":30668,"num_write_kb":4174830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33578,"ondisk_log_size":33578,"up":210,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":500692,"kb_used_data":250280,"kb_used_omap":9,"kb_used_meta":250358,"kb_avail":282614828,"statfs":{"total":289910292480,"available":289397583872,"internally_reserved":0,"allocated":256286720,"data_stored":255219730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":256366732},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8423054,"num_objects":-989,"num_object_clones":0,"num_object_copies":-1978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7053,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-989,"num_whiteouts":0,"num_read":5,"num_read_kb":116,"num_write":1004,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.973560"},"pg_stats":[{"pgid":"4.3f","version":"74'405","reported_seq":545,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.394309+0000","last_change":"2024-04-26T11:47:12.248393+0000","last_active":"2024-04-26T11:47:12.394309+0000","last_peered":"2024-04-26T11:47:12.394309+0000","last_clean":"2024-04-26T11:44:49.187479+0000","last_became_active":"2024-04-26T11:47:12.244392+0000","last_became_peered":"2024-04-26T11:47:12.244392+0000","last_unstale":"2024-04-26T11:47:12.394309+0000","last_undegraded":"2024-04-26T11:47:12.159303+0000","last_fullsized":"2024-04-26T11:47:12.146683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:47.078164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"74'434","reported_seq":584,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.368684+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:12.368684+0000","last_peered":"2024-04-26T11:47:12.368684+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:12.368684+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"74'383","reported_seq":477,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394557+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:12.394557+0000","last_peered":"2024-04-26T11:47:12.394557+0000","last_clean":"2024-04-26T11:47:12.394557+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:12.394557+0000","last_undegraded":"2024-04-26T11:47:12.394557+0000","last_fullsized":"2024-04-26T11:47:12.394557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"74'356","reported_seq":449,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386104+0000","last_change":"2024-04-26T11:47:12.252178+0000","last_active":"2024-04-26T11:47:12.386104+0000","last_peered":"2024-04-26T11:47:12.386104+0000","last_clean":"2024-04-26T11:44:50.721907+0000","last_became_active":"2024-04-26T11:47:12.247695+0000","last_became_peered":"2024-04-26T11:47:12.247695+0000","last_unstale":"2024-04-26T11:47:12.386104+0000","last_undegraded":"2024-04-26T11:47:12.156427+0000","last_fullsized":"2024-04-26T11:47:12.145436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:16.946912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"74'399","reported_seq":503,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387295+0000","last_change":"2024-04-26T11:47:12.258595+0000","last_active":"2024-04-26T11:47:12.387295+0000","last_peered":"2024-04-26T11:47:12.387295+0000","last_clean":"2024-04-26T11:44:49.186299+0000","last_became_active":"2024-04-26T11:47:12.256827+0000","last_became_peered":"2024-04-26T11:47:12.256827+0000","last_unstale":"2024-04-26T11:47:12.387295+0000","last_undegraded":"2024-04-26T11:47:12.160500+0000","last_fullsized":"2024-04-26T11:47:12.146275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:42.419089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"74'358","reported_seq":788,"reported_epoch":75,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:14.043798+0000","last_change":"2024-04-26T11:47:13.436951+0000","last_active":"2024-04-26T11:47:14.043798+0000","last_peered":"2024-04-26T11:47:14.043798+0000","last_clean":"2024-04-26T11:44:50.722165+0000","last_became_active":"2024-04-26T11:47:12.239030+0000","last_became_peered":"2024-04-26T11:47:12.239030+0000","last_unstale":"2024-04-26T11:47:14.043798+0000","last_undegraded":"2024-04-26T11:47:12.161120+0000","last_fullsized":"2024-04-26T11:47:12.143723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.949917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"74'449","reported_seq":600,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386065+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:12.386065+0000","last_peered":"2024-04-26T11:47:12.386065+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:12.386065+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"74'358","reported_seq":473,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387095+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:12.387095+0000","last_peered":"2024-04-26T11:47:12.387095+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:12.387095+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"74'410","reported_seq":485,"reported_epoch":76,"state":"peering","last_fresh":"2024-04-26T11:47:14.426070+0000","last_change":"2024-04-26T11:47:14.422861+0000","last_active":"2024-04-26T11:47:14.422861+0000","last_peered":"2024-04-26T11:47:12.371524+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.244530+0000","last_became_peered":"2024-04-26T11:47:12.244530+0000","last_unstale":"2024-04-26T11:47:14.426070+0000","last_undegraded":"2024-04-26T11:47:14.426070+0000","last_fullsized":"2024-04-26T11:47:14.426070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:39.121653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'408","reported_seq":546,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.381028+0000","last_change":"2024-04-26T11:47:12.262968+0000","last_active":"2024-04-26T11:47:12.381028+0000","last_peered":"2024-04-26T11:47:12.381028+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:12.381028+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"74'366","reported_seq":491,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.389972+0000","last_change":"2024-04-26T11:47:12.243876+0000","last_active":"2024-04-26T11:47:12.389972+0000","last_peered":"2024-04-26T11:47:12.389972+0000","last_clean":"2024-04-26T11:44:50.722156+0000","last_became_active":"2024-04-26T11:47:12.208201+0000","last_became_peered":"2024-04-26T11:47:12.208201+0000","last_unstale":"2024-04-26T11:47:12.389972+0000","last_undegraded":"2024-04-26T11:47:12.155452+0000","last_fullsized":"2024-04-26T11:47:12.147840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:27.558419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":163,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"74'338","reported_seq":444,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394419+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:12.394419+0000","last_peered":"2024-04-26T11:47:12.394419+0000","last_clean":"2024-04-26T11:47:12.394419+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:12.394419+0000","last_undegraded":"2024-04-26T11:47:12.394419+0000","last_fullsized":"2024-04-26T11:47:12.394419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"74'378","reported_seq":491,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387254+0000","last_change":"2024-04-26T11:47:12.253471+0000","last_active":"2024-04-26T11:47:12.387254+0000","last_peered":"2024-04-26T11:47:12.387254+0000","last_clean":"2024-04-26T11:44:49.186209+0000","last_became_active":"2024-04-26T11:47:12.250397+0000","last_became_peered":"2024-04-26T11:47:12.250397+0000","last_unstale":"2024-04-26T11:47:12.387254+0000","last_undegraded":"2024-04-26T11:47:12.157224+0000","last_fullsized":"2024-04-26T11:47:12.147628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:15.499511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"74'411","reported_seq":516,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.375482+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:12.375482+0000","last_peered":"2024-04-26T11:47:12.375482+0000","last_clean":"2024-04-26T11:47:12.375482+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:12.375482+0000","last_undegraded":"2024-04-26T11:47:12.375482+0000","last_fullsized":"2024-04-26T11:47:12.375482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"74'421","reported_seq":558,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.383352+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:12.383352+0000","last_peered":"2024-04-26T11:47:12.383352+0000","last_clean":"2024-04-26T11:47:12.383352+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:12.383352+0000","last_undegraded":"2024-04-26T11:47:12.383352+0000","last_fullsized":"2024-04-26T11:47:12.383352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":611,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387696+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:12.387696+0000","last_peered":"2024-04-26T11:47:12.387696+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:12.387696+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"74'384","reported_seq":467,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.165141+0000","last_change":"2024-04-26T11:47:12.252062+0000","last_active":"2024-04-26T11:47:13.165141+0000","last_peered":"2024-04-26T11:47:13.165141+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.247384+0000","last_became_peered":"2024-04-26T11:47:12.247384+0000","last_unstale":"2024-04-26T11:47:13.165141+0000","last_undegraded":"2024-04-26T11:47:12.160607+0000","last_fullsized":"2024-04-26T11:47:12.147502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:25.813076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-11}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"74'403","reported_seq":511,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387603+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:12.387603+0000","last_peered":"2024-04-26T11:47:12.387603+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:12.387603+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"74'406","reported_seq":514,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.694225+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:12.694225+0000","last_peered":"2024-04-26T11:47:12.694225+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:12.694225+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"74'433","reported_seq":560,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.379888+0000","last_change":"2024-04-26T11:47:12.249800+0000","last_active":"2024-04-26T11:47:12.379888+0000","last_peered":"2024-04-26T11:47:12.379888+0000","last_clean":"2024-04-26T11:44:50.722977+0000","last_became_active":"2024-04-26T11:47:12.247396+0000","last_became_peered":"2024-04-26T11:47:12.247396+0000","last_unstale":"2024-04-26T11:47:12.379888+0000","last_undegraded":"2024-04-26T11:47:12.157741+0000","last_fullsized":"2024-04-26T11:47:12.153164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:05.443284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-10}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"74'393","reported_seq":525,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.392168+0000","last_change":"2024-04-26T11:47:12.265247+0000","last_active":"2024-04-26T11:47:12.392168+0000","last_peered":"2024-04-26T11:47:12.392168+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:12.392168+0000","last_undegraded":"2024-04-26T11:47:12.167328+0000","last_fullsized":"2024-04-26T11:47:12.157724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:35.162556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-13}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"74'414","reported_seq":527,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.373856+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:12.373856+0000","last_peered":"2024-04-26T11:47:12.373856+0000","last_clean":"2024-04-26T11:47:12.373856+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:12.373856+0000","last_undegraded":"2024-04-26T11:47:12.373856+0000","last_fullsized":"2024-04-26T11:47:12.373856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"74'398","reported_seq":480,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.381089+0000","last_change":"2024-04-26T11:47:12.255039+0000","last_active":"2024-04-26T11:47:12.381089+0000","last_peered":"2024-04-26T11:47:12.381089+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251782+0000","last_became_peered":"2024-04-26T11:47:12.251782+0000","last_unstale":"2024-04-26T11:47:12.381089+0000","last_undegraded":"2024-04-26T11:47:12.160070+0000","last_fullsized":"2024-04-26T11:47:12.143241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"74'433","reported_seq":576,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387495+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:12.387495+0000","last_peered":"2024-04-26T11:47:12.387495+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:12.387495+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"74'390","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.380409+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:12.380409+0000","last_peered":"2024-04-26T11:47:12.380409+0000","last_clean":"2024-04-26T11:47:12.380409+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:12.380409+0000","last_undegraded":"2024-04-26T11:47:12.380409+0000","last_fullsized":"2024-04-26T11:47:12.380409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"74'477","reported_seq":602,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380531+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:12.380531+0000","last_peered":"2024-04-26T11:47:12.380531+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:12.380531+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"74'388","reported_seq":469,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.373439+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:12.373439+0000","last_peered":"2024-04-26T11:47:12.373439+0000","last_clean":"2024-04-26T11:47:12.373439+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:12.373439+0000","last_undegraded":"2024-04-26T11:47:12.373439+0000","last_fullsized":"2024-04-26T11:47:12.373439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"74'394","reported_seq":552,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.384599+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:12.384599+0000","last_peered":"2024-04-26T11:47:12.384599+0000","last_clean":"2024-04-26T11:47:12.384599+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:12.384599+0000","last_undegraded":"2024-04-26T11:47:12.384599+0000","last_fullsized":"2024-04-26T11:47:12.384599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'377","reported_seq":474,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.351414+0000","last_change":"2024-04-26T11:47:12.258316+0000","last_active":"2024-04-26T11:47:12.351414+0000","last_peered":"2024-04-26T11:47:12.351414+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.256893+0000","last_became_peered":"2024-04-26T11:47:12.256893+0000","last_unstale":"2024-04-26T11:47:12.351414+0000","last_undegraded":"2024-04-26T11:47:12.163546+0000","last_fullsized":"2024-04-26T11:47:12.157883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:48.825981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"74'459","reported_seq":577,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394347+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:12.394347+0000","last_peered":"2024-04-26T11:47:12.394347+0000","last_clean":"2024-04-26T11:47:12.394347+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:12.394347+0000","last_undegraded":"2024-04-26T11:47:12.394347+0000","last_fullsized":"2024-04-26T11:47:12.394347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"74'417","reported_seq":544,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380117+0000","last_change":"2024-04-26T11:47:12.262325+0000","last_active":"2024-04-26T11:47:12.380117+0000","last_peered":"2024-04-26T11:47:12.380117+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259636+0000","last_became_peered":"2024-04-26T11:47:12.259636+0000","last_unstale":"2024-04-26T11:47:12.380117+0000","last_undegraded":"2024-04-26T11:47:12.166109+0000","last_fullsized":"2024-04-26T11:47:12.158494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:27.521969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"74'403","reported_seq":509,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387290+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:12.387290+0000","last_peered":"2024-04-26T11:47:12.387290+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:12.387290+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"74'359","reported_seq":453,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.834447+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:12.834447+0000","last_peered":"2024-04-26T11:47:12.834447+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:12.834447+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":576,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.167546+0000","last_change":"2024-04-26T11:47:13.167700+0000","last_active":"2024-04-26T11:47:13.167546+0000","last_peered":"2024-04-26T11:47:12.759461+0000","last_clean":"2024-04-26T11:44:50.722776+0000","last_became_active":"2024-04-26T11:47:12.257022+0000","last_became_peered":"2024-04-26T11:47:12.257022+0000","last_unstale":"2024-04-26T11:47:13.167546+0000","last_undegraded":"2024-04-26T11:47:13.167546+0000","last_fullsized":"2024-04-26T11:47:13.167546+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:31.084050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"74'405","reported_seq":569,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.760993+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:12.760993+0000","last_peered":"2024-04-26T11:47:12.760993+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:12.760993+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.454484+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:13.454484+0000","last_peered":"2024-04-26T11:47:13.454484+0000","last_clean":"2024-04-26T11:47:13.454484+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:13.454484+0000","last_undegraded":"2024-04-26T11:47:13.454484+0000","last_fullsized":"2024-04-26T11:47:13.454484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'403","reported_seq":485,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.389337+0000","last_change":"2024-04-26T11:47:12.262102+0000","last_active":"2024-04-26T11:47:12.389337+0000","last_peered":"2024-04-26T11:47:12.389337+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259702+0000","last_became_peered":"2024-04-26T11:47:12.259702+0000","last_unstale":"2024-04-26T11:47:12.389337+0000","last_undegraded":"2024-04-26T11:47:12.156439+0000","last_fullsized":"2024-04-26T11:47:12.146012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":128,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.166336+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:12.166336+0000","last_peered":"2024-04-26T11:47:12.166336+0000","last_clean":"2024-04-26T11:47:12.166336+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:12.166336+0000","last_undegraded":"2024-04-26T11:47:12.166336+0000","last_fullsized":"2024-04-26T11:47:12.166336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"74'385","reported_seq":506,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.362493+0000","last_change":"2024-04-26T11:47:12.245609+0000","last_active":"2024-04-26T11:47:12.362493+0000","last_peered":"2024-04-26T11:47:12.362493+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.241903+0000","last_became_peered":"2024-04-26T11:47:12.241903+0000","last_unstale":"2024-04-26T11:47:12.362493+0000","last_undegraded":"2024-04-26T11:47:12.158911+0000","last_fullsized":"2024-04-26T11:47:12.148743+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:26.552945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-7}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"74'66","reported_seq":134,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.288503+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:12.288503+0000","last_peered":"2024-04-26T11:47:12.288503+0000","last_clean":"2024-04-26T11:47:12.288503+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:12.288503+0000","last_undegraded":"2024-04-26T11:47:12.288503+0000","last_fullsized":"2024-04-26T11:47:12.288503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":282,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394481+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:12.394481+0000","last_peered":"2024-04-26T11:47:12.394481+0000","last_clean":"2024-04-26T11:47:12.394481+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:12.394481+0000","last_undegraded":"2024-04-26T11:47:12.394481+0000","last_fullsized":"2024-04-26T11:47:12.394481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"74'397","reported_seq":491,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.358530+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:12.358530+0000","last_peered":"2024-04-26T11:47:12.358530+0000","last_clean":"2024-04-26T11:47:12.358530+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:12.358530+0000","last_undegraded":"2024-04-26T11:47:12.358530+0000","last_fullsized":"2024-04-26T11:47:12.358530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":460,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.300516+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:12.300516+0000","last_peered":"2024-04-26T11:47:12.300516+0000","last_clean":"2024-04-26T11:47:12.300516+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:12.300516+0000","last_undegraded":"2024-04-26T11:47:12.300516+0000","last_fullsized":"2024-04-26T11:47:12.300516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"74'451","reported_seq":577,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391400+0000","last_change":"2024-04-26T11:47:12.256711+0000","last_active":"2024-04-26T11:47:12.391400+0000","last_peered":"2024-04-26T11:47:12.391400+0000","last_clean":"2024-04-26T11:44:49.185565+0000","last_became_active":"2024-04-26T11:47:12.252329+0000","last_became_peered":"2024-04-26T11:47:12.252329+0000","last_unstale":"2024-04-26T11:47:12.391400+0000","last_undegraded":"2024-04-26T11:47:12.158212+0000","last_fullsized":"2024-04-26T11:47:12.148030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:23.263270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":654,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394571+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:12.394571+0000","last_peered":"2024-04-26T11:47:12.394571+0000","last_clean":"2024-04-26T11:47:12.394571+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:12.394571+0000","last_undegraded":"2024-04-26T11:47:12.394571+0000","last_fullsized":"2024-04-26T11:47:12.394571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"74'441","reported_seq":574,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391351+0000","last_change":"2024-04-26T11:47:12.254082+0000","last_active":"2024-04-26T11:47:12.391351+0000","last_peered":"2024-04-26T11:47:12.391351+0000","last_clean":"2024-04-26T11:44:50.721822+0000","last_became_active":"2024-04-26T11:47:12.251151+0000","last_became_peered":"2024-04-26T11:47:12.251151+0000","last_unstale":"2024-04-26T11:47:12.391351+0000","last_undegraded":"2024-04-26T11:47:12.155484+0000","last_fullsized":"2024-04-26T11:47:12.144270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:40.503436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":143,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.341564+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:12.341564+0000","last_peered":"2024-04-26T11:47:12.341564+0000","last_clean":"2024-04-26T11:47:12.341564+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:12.341564+0000","last_undegraded":"2024-04-26T11:47:12.341564+0000","last_fullsized":"2024-04-26T11:47:12.341564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"74'441","reported_seq":580,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.354154+0000","last_change":"2024-04-26T11:47:12.252630+0000","last_active":"2024-04-26T11:47:12.354154+0000","last_peered":"2024-04-26T11:47:12.354154+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.250306+0000","last_became_peered":"2024-04-26T11:47:12.250306+0000","last_unstale":"2024-04-26T11:47:12.354154+0000","last_undegraded":"2024-04-26T11:47:12.156978+0000","last_fullsized":"2024-04-26T11:47:12.144300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":327,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.419117+0000","last_change":"2024-04-26T11:47:14.419449+0000","last_active":"2024-04-26T11:47:14.419117+0000","last_peered":"2024-04-26T11:47:12.832926+0000","last_clean":"2024-04-26T11:44:21.435988+0000","last_became_active":"2024-04-26T11:47:12.257934+0000","last_became_peered":"2024-04-26T11:47:12.257934+0000","last_unstale":"2024-04-26T11:47:14.419117+0000","last_undegraded":"2024-04-26T11:47:14.419117+0000","last_fullsized":"2024-04-26T11:47:14.419117+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":3}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'418","reported_seq":518,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387647+0000","last_change":"2024-04-26T11:47:12.257450+0000","last_active":"2024-04-26T11:47:12.387647+0000","last_peered":"2024-04-26T11:47:12.387647+0000","last_clean":"2024-04-26T11:44:50.722159+0000","last_became_active":"2024-04-26T11:47:12.255880+0000","last_became_peered":"2024-04-26T11:47:12.255880+0000","last_unstale":"2024-04-26T11:47:12.387647+0000","last_undegraded":"2024-04-26T11:47:12.165276+0000","last_fullsized":"2024-04-26T11:47:12.156834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.490162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-16}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":236,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164188+0000","last_change":"2024-04-26T11:47:13.164583+0000","last_active":"2024-04-26T11:47:13.164188+0000","last_peered":"2024-04-26T11:47:12.525388+0000","last_clean":"2024-04-26T11:44:50.723083+0000","last_became_active":"2024-04-26T11:47:12.253850+0000","last_became_peered":"2024-04-26T11:47:12.253850+0000","last_unstale":"2024-04-26T11:47:13.164188+0000","last_undegraded":"2024-04-26T11:47:13.164188+0000","last_fullsized":"2024-04-26T11:47:13.164188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:24.810487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"74'396","reported_seq":501,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.337370+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:12.337370+0000","last_peered":"2024-04-26T11:47:12.337370+0000","last_clean":"2024-04-26T11:47:12.337370+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:12.337370+0000","last_undegraded":"2024-04-26T11:47:12.337370+0000","last_fullsized":"2024-04-26T11:47:12.337370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":122,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.307568+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:12.307568+0000","last_peered":"2024-04-26T11:47:12.307568+0000","last_clean":"2024-04-26T11:47:12.307568+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:12.307568+0000","last_undegraded":"2024-04-26T11:47:12.307568+0000","last_fullsized":"2024-04-26T11:47:12.307568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"74'339","reported_seq":441,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.391438+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:12.391438+0000","last_peered":"2024-04-26T11:47:12.391438+0000","last_clean":"2024-04-26T11:47:12.391438+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:12.391438+0000","last_undegraded":"2024-04-26T11:47:12.391438+0000","last_fullsized":"2024-04-26T11:47:12.391438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":587,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.165687+0000","last_change":"2024-04-26T11:47:13.166133+0000","last_active":"2024-04-26T11:47:13.165687+0000","last_peered":"2024-04-26T11:47:12.564825+0000","last_clean":"2024-04-26T11:44:49.185623+0000","last_became_active":"2024-04-26T11:47:12.261412+0000","last_became_peered":"2024-04-26T11:47:12.261412+0000","last_unstale":"2024-04-26T11:47:13.165687+0000","last_undegraded":"2024-04-26T11:47:13.165687+0000","last_fullsized":"2024-04-26T11:47:13.165687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:22.060390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"74'379","reported_seq":490,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386228+0000","last_change":"2024-04-26T11:47:12.257493+0000","last_active":"2024-04-26T11:47:12.386228+0000","last_peered":"2024-04-26T11:47:12.386228+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255726+0000","last_became_peered":"2024-04-26T11:47:12.255726+0000","last_unstale":"2024-04-26T11:47:12.386228+0000","last_undegraded":"2024-04-26T11:47:12.167230+0000","last_fullsized":"2024-04-26T11:47:12.165520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:41.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":270,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.165708+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:12.165708+0000","last_peered":"2024-04-26T11:47:12.165708+0000","last_clean":"2024-04-26T11:47:12.165708+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:12.165708+0000","last_undegraded":"2024-04-26T11:47:12.165708+0000","last_fullsized":"2024-04-26T11:47:12.165708+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.166413+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:12.166413+0000","last_peered":"2024-04-26T11:47:12.166413+0000","last_clean":"2024-04-26T11:47:12.166413+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:12.166413+0000","last_undegraded":"2024-04-26T11:47:12.166413+0000","last_fullsized":"2024-04-26T11:47:12.166413+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":574,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-26T11:47:14.427139+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:14.427139+0000","last_peered":"2024-04-26T11:47:14.427139+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:14.427139+0000","last_undegraded":"2024-04-26T11:47:14.427139+0000","last_fullsized":"2024-04-26T11:47:14.427139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'427","reported_seq":529,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394615+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:12.394615+0000","last_peered":"2024-04-26T11:47:12.394615+0000","last_clean":"2024-04-26T11:47:12.394615+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:12.394615+0000","last_undegraded":"2024-04-26T11:47:12.394615+0000","last_fullsized":"2024-04-26T11:47:12.394615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.165231+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:12.165231+0000","last_peered":"2024-04-26T11:47:12.165231+0000","last_clean":"2024-04-26T11:47:12.165231+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:12.165231+0000","last_undegraded":"2024-04-26T11:47:12.165231+0000","last_fullsized":"2024-04-26T11:47:12.165231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"74'167","reported_seq":319,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.418655+0000","last_change":"2024-04-26T11:47:14.419948+0000","last_active":"2024-04-26T11:47:14.418655+0000","last_peered":"2024-04-26T11:47:12.578926+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:12.254543+0000","last_became_peered":"2024-04-26T11:47:12.254543+0000","last_unstale":"2024-04-26T11:47:14.418655+0000","last_undegraded":"2024-04-26T11:47:14.418655+0000","last_fullsized":"2024-04-26T11:47:14.418655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421777,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":1445,"num_write":93,"num_write_kb":1446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'438","reported_seq":555,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391168+0000","last_change":"2024-04-26T11:47:12.262868+0000","last_active":"2024-04-26T11:47:12.391168+0000","last_peered":"2024-04-26T11:47:12.391168+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:12.391168+0000","last_undegraded":"2024-04-26T11:47:12.156540+0000","last_fullsized":"2024-04-26T11:47:12.146571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:45.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453806+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:13.453806+0000","last_peered":"2024-04-26T11:47:13.453806+0000","last_clean":"2024-04-26T11:47:13.453806+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:13.453806+0000","last_undegraded":"2024-04-26T11:47:13.453806+0000","last_fullsized":"2024-04-26T11:47:13.453806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":491,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.300670+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:12.300670+0000","last_peered":"2024-04-26T11:47:12.300670+0000","last_clean":"2024-04-26T11:47:12.300670+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:12.300670+0000","last_undegraded":"2024-04-26T11:47:12.300670+0000","last_fullsized":"2024-04-26T11:47:12.300670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"74'331","reported_seq":417,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380133+0000","last_change":"2024-04-26T11:47:12.254070+0000","last_active":"2024-04-26T11:47:12.380133+0000","last_peered":"2024-04-26T11:47:12.380133+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.250084+0000","last_became_peered":"2024-04-26T11:47:12.250084+0000","last_unstale":"2024-04-26T11:47:12.380133+0000","last_undegraded":"2024-04-26T11:47:12.165871+0000","last_fullsized":"2024-04-26T11:47:12.161090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:19.765756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":152,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.161632+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:12.161632+0000","last_peered":"2024-04-26T11:47:12.161632+0000","last_clean":"2024-04-26T11:47:12.161632+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:12.161632+0000","last_undegraded":"2024-04-26T11:47:12.161632+0000","last_fullsized":"2024-04-26T11:47:12.161632+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":146,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.387141+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:12.387141+0000","last_peered":"2024-04-26T11:47:12.387141+0000","last_clean":"2024-04-26T11:47:12.387141+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:12.387141+0000","last_undegraded":"2024-04-26T11:47:12.387141+0000","last_fullsized":"2024-04-26T11:47:12.387141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"74'371","reported_seq":465,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.394270+0000","last_change":"2024-04-26T11:47:12.256944+0000","last_active":"2024-04-26T11:47:12.394270+0000","last_peered":"2024-04-26T11:47:12.394270+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255779+0000","last_became_peered":"2024-04-26T11:47:12.255779+0000","last_unstale":"2024-04-26T11:47:12.394270+0000","last_undegraded":"2024-04-26T11:47:12.164475+0000","last_fullsized":"2024-04-26T11:47:12.155432+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:51.100421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":598,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164310+0000","last_change":"2024-04-26T11:47:13.164702+0000","last_active":"2024-04-26T11:47:13.164310+0000","last_peered":"2024-04-26T11:47:12.391164+0000","last_clean":"2024-04-26T11:44:50.722744+0000","last_became_active":"2024-04-26T11:47:12.243398+0000","last_became_peered":"2024-04-26T11:47:12.243398+0000","last_unstale":"2024-04-26T11:47:13.164310+0000","last_undegraded":"2024-04-26T11:47:13.164310+0000","last_fullsized":"2024-04-26T11:47:13.164310+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:26.445411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.452997+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:13.452997+0000","last_peered":"2024-04-26T11:47:13.452997+0000","last_clean":"2024-04-26T11:47:13.452997+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:13.452997+0000","last_undegraded":"2024-04-26T11:47:13.452997+0000","last_fullsized":"2024-04-26T11:47:13.452997+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'336","reported_seq":438,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.391321+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:12.391321+0000","last_peered":"2024-04-26T11:47:12.391321+0000","last_clean":"2024-04-26T11:47:12.391321+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:12.391321+0000","last_undegraded":"2024-04-26T11:47:12.391321+0000","last_fullsized":"2024-04-26T11:47:12.391321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453822+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:13.453822+0000","last_peered":"2024-04-26T11:47:13.453822+0000","last_clean":"2024-04-26T11:47:13.453822+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:13.453822+0000","last_undegraded":"2024-04-26T11:47:13.453822+0000","last_fullsized":"2024-04-26T11:47:13.453822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.160723+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:12.160723+0000","last_peered":"2024-04-26T11:47:12.160723+0000","last_clean":"2024-04-26T11:47:12.160723+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:12.160723+0000","last_undegraded":"2024-04-26T11:47:12.160723+0000","last_fullsized":"2024-04-26T11:47:12.160723+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"74'380","reported_seq":480,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.391722+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:12.391722+0000","last_peered":"2024-04-26T11:47:12.391722+0000","last_clean":"2024-04-26T11:47:12.391722+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:12.391722+0000","last_undegraded":"2024-04-26T11:47:12.391722+0000","last_fullsized":"2024-04-26T11:47:12.391722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.455709+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:13.455709+0000","last_peered":"2024-04-26T11:47:13.455709+0000","last_clean":"2024-04-26T11:47:13.455709+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:13.455709+0000","last_undegraded":"2024-04-26T11:47:13.455709+0000","last_fullsized":"2024-04-26T11:47:13.455709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453264+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:13.453264+0000","last_peered":"2024-04-26T11:47:13.453264+0000","last_clean":"2024-04-26T11:47:13.453264+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:13.453264+0000","last_undegraded":"2024-04-26T11:47:13.453264+0000","last_fullsized":"2024-04-26T11:47:13.453264+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'384","reported_seq":457,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391265+0000","last_change":"2024-04-26T11:47:12.265335+0000","last_active":"2024-04-26T11:47:12.391265+0000","last_peered":"2024-04-26T11:47:12.391265+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:12.391265+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"74'70","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453367+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:13.453367+0000","last_peered":"2024-04-26T11:47:13.453367+0000","last_clean":"2024-04-26T11:47:13.453367+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:13.453367+0000","last_undegraded":"2024-04-26T11:47:13.453367+0000","last_fullsized":"2024-04-26T11:47:13.453367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.160630+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:12.160630+0000","last_peered":"2024-04-26T11:47:12.160630+0000","last_clean":"2024-04-26T11:47:12.160630+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:12.160630+0000","last_undegraded":"2024-04-26T11:47:12.160630+0000","last_fullsized":"2024-04-26T11:47:12.160630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"74'391","reported_seq":515,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.366094+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:12.366094+0000","last_peered":"2024-04-26T11:47:12.366094+0000","last_clean":"2024-04-26T11:47:12.366094+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:12.366094+0000","last_undegraded":"2024-04-26T11:47:12.366094+0000","last_fullsized":"2024-04-26T11:47:12.366094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"74'412","reported_seq":517,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.379295+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:12.379295+0000","last_peered":"2024-04-26T11:47:12.379295+0000","last_clean":"2024-04-26T11:47:12.379295+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:12.379295+0000","last_undegraded":"2024-04-26T11:47:12.379295+0000","last_fullsized":"2024-04-26T11:47:12.379295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":479,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.377124+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:12.377124+0000","last_peered":"2024-04-26T11:47:12.377124+0000","last_clean":"2024-04-26T11:47:12.377124+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:12.377124+0000","last_undegraded":"2024-04-26T11:47:12.377124+0000","last_fullsized":"2024-04-26T11:47:12.377124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"74'414","reported_seq":516,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.163327+0000","last_change":"2024-04-26T11:47:12.261430+0000","last_active":"2024-04-26T11:47:13.163327+0000","last_peered":"2024-04-26T11:47:13.163327+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259639+0000","last_became_peered":"2024-04-26T11:47:12.259639+0000","last_unstale":"2024-04-26T11:47:13.163327+0000","last_undegraded":"2024-04-26T11:47:12.167836+0000","last_fullsized":"2024-04-26T11:47:12.160846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:57.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"74'102","reported_seq":170,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.396076+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:12.396076+0000","last_peered":"2024-04-26T11:47:12.396076+0000","last_clean":"2024-04-26T11:47:12.396076+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:12.396076+0000","last_undegraded":"2024-04-26T11:47:12.396076+0000","last_fullsized":"2024-04-26T11:47:12.396076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":419,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164948+0000","last_change":"2024-04-26T11:47:13.166538+0000","last_active":"2024-04-26T11:47:13.164948+0000","last_peered":"2024-04-26T11:47:12.868366+0000","last_clean":"2024-04-26T11:44:50.723214+0000","last_became_active":"2024-04-26T11:47:12.261856+0000","last_became_peered":"2024-04-26T11:47:12.261856+0000","last_unstale":"2024-04-26T11:47:13.164948+0000","last_undegraded":"2024-04-26T11:47:13.164948+0000","last_fullsized":"2024-04-26T11:47:13.164948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:06.537844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"74'457","reported_seq":546,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.159909+0000","last_change":"2024-04-26T11:47:12.254913+0000","last_active":"2024-04-26T11:47:13.159909+0000","last_peered":"2024-04-26T11:47:13.159909+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251682+0000","last_became_peered":"2024-04-26T11:47:12.251682+0000","last_unstale":"2024-04-26T11:47:13.159909+0000","last_undegraded":"2024-04-26T11:47:12.157689+0000","last_fullsized":"2024-04-26T11:47:12.143256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:13.489428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":203,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.456185+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:13.456185+0000","last_peered":"2024-04-26T11:47:13.456185+0000","last_clean":"2024-04-26T11:47:13.456185+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:13.456185+0000","last_undegraded":"2024-04-26T11:47:13.456185+0000","last_fullsized":"2024-04-26T11:47:13.456185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'441","reported_seq":555,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.163079+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:13.163079+0000","last_peered":"2024-04-26T11:47:13.163079+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:13.163079+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"74'360","reported_seq":472,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.384613+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:12.384613+0000","last_peered":"2024-04-26T11:47:12.384613+0000","last_clean":"2024-04-26T11:47:12.384613+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:12.384613+0000","last_undegraded":"2024-04-26T11:47:12.384613+0000","last_fullsized":"2024-04-26T11:47:12.384613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":830,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.418345+0000","last_change":"2024-04-26T11:47:14.418746+0000","last_active":"2024-04-26T11:47:14.418345+0000","last_peered":"2024-04-26T11:47:12.655146+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:12.263598+0000","last_became_peered":"2024-04-26T11:47:12.263598+0000","last_unstale":"2024-04-26T11:47:14.418345+0000","last_undegraded":"2024-04-26T11:47:14.418345+0000","last_fullsized":"2024-04-26T11:47:14.418345+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'380","reported_seq":470,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386110+0000","last_change":"2024-04-26T11:47:12.262558+0000","last_active":"2024-04-26T11:47:12.386110+0000","last_peered":"2024-04-26T11:47:12.386110+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.260513+0000","last_became_peered":"2024-04-26T11:47:12.260513+0000","last_unstale":"2024-04-26T11:47:12.386110+0000","last_undegraded":"2024-04-26T11:47:12.161322+0000","last_fullsized":"2024-04-26T11:47:12.156833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:46.502879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":387,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.418773+0000","last_change":"2024-04-26T11:47:14.419126+0000","last_active":"2024-04-26T11:47:14.418773+0000","last_peered":"2024-04-26T11:47:12.692702+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:12.254760+0000","last_became_peered":"2024-04-26T11:47:12.254760+0000","last_unstale":"2024-04-26T11:47:14.418773+0000","last_undegraded":"2024-04-26T11:47:14.418773+0000","last_fullsized":"2024-04-26T11:47:14.418773+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'370","reported_seq":484,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394315+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:12.394315+0000","last_peered":"2024-04-26T11:47:12.394315+0000","last_clean":"2024-04-26T11:47:12.394315+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:12.394315+0000","last_undegraded":"2024-04-26T11:47:12.394315+0000","last_fullsized":"2024-04-26T11:47:12.394315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"74'349","reported_seq":439,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.165692+0000","last_change":"2024-04-26T11:47:13.166133+0000","last_active":"2024-04-26T11:47:13.165692+0000","last_peered":"2024-04-26T11:47:12.489133+0000","last_clean":"2024-04-26T11:44:49.186164+0000","last_became_active":"2024-04-26T11:47:12.251407+0000","last_became_peered":"2024-04-26T11:47:12.251407+0000","last_unstale":"2024-04-26T11:47:13.165692+0000","last_undegraded":"2024-04-26T11:47:13.165692+0000","last_fullsized":"2024-04-26T11:47:13.165692+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:15.939830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11895685,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":11786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"74'360","reported_seq":471,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.371794+0000","last_change":"2024-04-26T11:47:12.252278+0000","last_active":"2024-04-26T11:47:12.371794+0000","last_peered":"2024-04-26T11:47:12.371794+0000","last_clean":"2024-04-26T11:44:49.186726+0000","last_became_active":"2024-04-26T11:47:12.247841+0000","last_became_peered":"2024-04-26T11:47:12.247841+0000","last_unstale":"2024-04-26T11:47:12.371794+0000","last_undegraded":"2024-04-26T11:47:12.157717+0000","last_fullsized":"2024-04-26T11:47:12.147708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:40.552007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":162,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-10}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.163909+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:12.163909+0000","last_peered":"2024-04-26T11:47:12.163909+0000","last_clean":"2024-04-26T11:47:12.163909+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:12.163909+0000","last_undegraded":"2024-04-26T11:47:12.163909+0000","last_fullsized":"2024-04-26T11:47:12.163909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"74'369","reported_seq":498,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380870+0000","last_change":"2024-04-26T11:47:12.259550+0000","last_active":"2024-04-26T11:47:12.380870+0000","last_peered":"2024-04-26T11:47:12.380870+0000","last_clean":"2024-04-26T11:44:50.722361+0000","last_became_active":"2024-04-26T11:47:12.256906+0000","last_became_peered":"2024-04-26T11:47:12.256906+0000","last_unstale":"2024-04-26T11:47:12.380870+0000","last_undegraded":"2024-04-26T11:47:12.156736+0000","last_fullsized":"2024-04-26T11:47:12.144812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:25.280569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":361,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164357+0000","last_change":"2024-04-26T11:47:13.164767+0000","last_active":"2024-04-26T11:47:13.164357+0000","last_peered":"2024-04-26T11:47:12.396143+0000","last_clean":"2024-04-26T11:44:50.722396+0000","last_became_active":"2024-04-26T11:47:12.249342+0000","last_became_peered":"2024-04-26T11:47:12.249342+0000","last_unstale":"2024-04-26T11:47:13.164357+0000","last_undegraded":"2024-04-26T11:47:13.164357+0000","last_fullsized":"2024-04-26T11:47:13.164357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:26.375129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"74'384","reported_seq":494,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.393015+0000","last_change":"2024-04-26T11:47:12.254097+0000","last_active":"2024-04-26T11:47:12.393015+0000","last_peered":"2024-04-26T11:47:12.393015+0000","last_clean":"2024-04-26T11:44:50.722199+0000","last_became_active":"2024-04-26T11:47:12.251646+0000","last_became_peered":"2024-04-26T11:47:12.251646+0000","last_unstale":"2024-04-26T11:47:12.393015+0000","last_undegraded":"2024-04-26T11:47:12.161281+0000","last_fullsized":"2024-04-26T11:47:12.156381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:20.045697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":397,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.322536+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:12.322536+0000","last_peered":"2024-04-26T11:47:12.322536+0000","last_clean":"2024-04-26T11:47:12.322536+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:12.322536+0000","last_undegraded":"2024-04-26T11:47:12.322536+0000","last_fullsized":"2024-04-26T11:47:12.322536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":518,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.388572+0000","last_change":"2024-04-26T11:47:12.254202+0000","last_active":"2024-04-26T11:47:12.388572+0000","last_peered":"2024-04-26T11:47:12.388572+0000","last_clean":"2024-04-26T11:44:49.185959+0000","last_became_active":"2024-04-26T11:47:12.252111+0000","last_became_peered":"2024-04-26T11:47:12.252111+0000","last_unstale":"2024-04-26T11:47:12.388572+0000","last_undegraded":"2024-04-26T11:47:12.160789+0000","last_fullsized":"2024-04-26T11:47:12.146173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:57.514673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-10}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.456417+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:13.456417+0000","last_peered":"2024-04-26T11:47:13.456417+0000","last_clean":"2024-04-26T11:47:13.456417+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:13.456417+0000","last_undegraded":"2024-04-26T11:47:13.456417+0000","last_fullsized":"2024-04-26T11:47:13.456417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'428","reported_seq":536,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.381352+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:12.381352+0000","last_peered":"2024-04-26T11:47:12.381352+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:12.381352+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.455316+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:13.455316+0000","last_peered":"2024-04-26T11:47:13.455316+0000","last_clean":"2024-04-26T11:47:13.455316+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:13.455316+0000","last_undegraded":"2024-04-26T11:47:13.455316+0000","last_fullsized":"2024-04-26T11:47:13.455316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7795,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25552,"ondisk_log_size":25552,"up":128,"acting":84,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":126565140,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":92,"num_read_kb":1445,"num_write":6021,"num_write_kb":127746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253198336,"data_stored":253130280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7869,"ondisk_log_size":7869,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738409,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200076,"kb_used_data":88636,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171764,"statfs":{"total":96636764160,"available":96431886336,"internally_reserved":0,"allocated":90763264,"data_stored":90397615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":1,"up_from":72,"seq":309237645314,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110808,"kb_used_data":79176,"kb_used_omap":6,"kb_used_meta":31609,"kb_avail":94261032,"statfs":{"total":96636764160,"available":96523296768,"internally_reserved":0,"allocated":81076224,"data_stored":80730558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":32367872},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189808,"kb_used_data":82468,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94182032,"statfs":{"total":96636764160,"available":96442400768,"internally_reserved":0,"allocated":84447232,"data_stored":84091557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83222528,"data_stored":83199707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80441344,"data_stored":80426942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:17.588 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:17.589 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:17.589 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:17.596 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:47:17.640 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:17.636+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:17.711 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:17.711 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:17.721 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:47:17.740 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:18.027+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:17.824 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:17.824 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:17.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:47:17.841 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:18.127+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:17.938 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:17.938 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:17.942 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:17.944 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:17.944 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:17.940+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:17.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:17.956 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-04-26T11:47:17.127031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127155508,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7795,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2805,"num_read_kb":1335940,"num_write":30668,"num_write_kb":4174830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33578,"ondisk_log_size":33578,"up":210,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":500692,"kb_used_data":250280,"kb_used_omap":9,"kb_used_meta":250358,"kb_avail":282614828,"statfs":{"total":289910292480,"available":289397583872,"internally_reserved":0,"allocated":256286720,"data_stored":255219730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":256366732},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8423054,"num_objects":-989,"num_object_clones":0,"num_object_copies":-1978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7053,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-989,"num_whiteouts":0,"num_read":5,"num_read_kb":116,"num_write":1004,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.973560"},"pg_stats":[{"pgid":"4.3f","version":"74'405","reported_seq":545,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.394309+0000","last_change":"2024-04-26T11:47:12.248393+0000","last_active":"2024-04-26T11:47:12.394309+0000","last_peered":"2024-04-26T11:47:12.394309+0000","last_clean":"2024-04-26T11:44:49.187479+0000","last_became_active":"2024-04-26T11:47:12.244392+0000","last_became_peered":"2024-04-26T11:47:12.244392+0000","last_unstale":"2024-04-26T11:47:12.394309+0000","last_undegraded":"2024-04-26T11:47:12.159303+0000","last_fullsized":"2024-04-26T11:47:12.146683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:47.078164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"74'434","reported_seq":584,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.368684+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:12.368684+0000","last_peered":"2024-04-26T11:47:12.368684+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:12.368684+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"74'383","reported_seq":477,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394557+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:12.394557+0000","last_peered":"2024-04-26T11:47:12.394557+0000","last_clean":"2024-04-26T11:47:12.394557+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:12.394557+0000","last_undegraded":"2024-04-26T11:47:12.394557+0000","last_fullsized":"2024-04-26T11:47:12.394557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"74'356","reported_seq":449,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386104+0000","last_change":"2024-04-26T11:47:12.252178+0000","last_active":"2024-04-26T11:47:12.386104+0000","last_peered":"2024-04-26T11:47:12.386104+0000","last_clean":"2024-04-26T11:44:50.721907+0000","last_became_active":"2024-04-26T11:47:12.247695+0000","last_became_peered":"2024-04-26T11:47:12.247695+0000","last_unstale":"2024-04-26T11:47:12.386104+0000","last_undegraded":"2024-04-26T11:47:12.156427+0000","last_fullsized":"2024-04-26T11:47:12.145436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:16.946912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"74'399","reported_seq":503,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387295+0000","last_change":"2024-04-26T11:47:12.258595+0000","last_active":"2024-04-26T11:47:12.387295+0000","last_peered":"2024-04-26T11:47:12.387295+0000","last_clean":"2024-04-26T11:44:49.186299+0000","last_became_active":"2024-04-26T11:47:12.256827+0000","last_became_peered":"2024-04-26T11:47:12.256827+0000","last_unstale":"2024-04-26T11:47:12.387295+0000","last_undegraded":"2024-04-26T11:47:12.160500+0000","last_fullsized":"2024-04-26T11:47:12.146275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:42.419089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"74'358","reported_seq":788,"reported_epoch":75,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:14.043798+0000","last_change":"2024-04-26T11:47:13.436951+0000","last_active":"2024-04-26T11:47:14.043798+0000","last_peered":"2024-04-26T11:47:14.043798+0000","last_clean":"2024-04-26T11:44:50.722165+0000","last_became_active":"2024-04-26T11:47:12.239030+0000","last_became_peered":"2024-04-26T11:47:12.239030+0000","last_unstale":"2024-04-26T11:47:14.043798+0000","last_undegraded":"2024-04-26T11:47:12.161120+0000","last_fullsized":"2024-04-26T11:47:12.143723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.949917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"74'449","reported_seq":600,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386065+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:12.386065+0000","last_peered":"2024-04-26T11:47:12.386065+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:12.386065+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"74'358","reported_seq":473,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387095+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:12.387095+0000","last_peered":"2024-04-26T11:47:12.387095+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:12.387095+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"74'410","reported_seq":485,"reported_epoch":76,"state":"peering","last_fresh":"2024-04-26T11:47:14.426070+0000","last_change":"2024-04-26T11:47:14.422861+0000","last_active":"2024-04-26T11:47:14.422861+0000","last_peered":"2024-04-26T11:47:12.371524+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.244530+0000","last_became_peered":"2024-04-26T11:47:12.244530+0000","last_unstale":"2024-04-26T11:47:14.426070+0000","last_undegraded":"2024-04-26T11:47:14.426070+0000","last_fullsized":"2024-04-26T11:47:14.426070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:39.121653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'408","reported_seq":546,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.381028+0000","last_change":"2024-04-26T11:47:12.262968+0000","last_active":"2024-04-26T11:47:12.381028+0000","last_peered":"2024-04-26T11:47:12.381028+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:12.381028+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"74'366","reported_seq":491,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.389972+0000","last_change":"2024-04-26T11:47:12.243876+0000","last_active":"2024-04-26T11:47:12.389972+0000","last_peered":"2024-04-26T11:47:12.389972+0000","last_clean":"2024-04-26T11:44:50.722156+0000","last_became_active":"2024-04-26T11:47:12.208201+0000","last_became_peered":"2024-04-26T11:47:12.208201+0000","last_unstale":"2024-04-26T11:47:12.389972+0000","last_undegraded":"2024-04-26T11:47:12.155452+0000","last_fullsized":"2024-04-26T11:47:12.147840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:27.558419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":163,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"74'338","reported_seq":444,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394419+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:12.394419+0000","last_peered":"2024-04-26T11:47:12.394419+0000","last_clean":"2024-04-26T11:47:12.394419+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:12.394419+0000","last_undegraded":"2024-04-26T11:47:12.394419+0000","last_fullsized":"2024-04-26T11:47:12.394419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"74'378","reported_seq":491,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387254+0000","last_change":"2024-04-26T11:47:12.253471+0000","last_active":"2024-04-26T11:47:12.387254+0000","last_peered":"2024-04-26T11:47:12.387254+0000","last_clean":"2024-04-26T11:44:49.186209+0000","last_became_active":"2024-04-26T11:47:12.250397+0000","last_became_peered":"2024-04-26T11:47:12.250397+0000","last_unstale":"2024-04-26T11:47:12.387254+0000","last_undegraded":"2024-04-26T11:47:12.157224+0000","last_fullsized":"2024-04-26T11:47:12.147628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:15.499511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"74'411","reported_seq":516,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.375482+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:12.375482+0000","last_peered":"2024-04-26T11:47:12.375482+0000","last_clean":"2024-04-26T11:47:12.375482+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:12.375482+0000","last_undegraded":"2024-04-26T11:47:12.375482+0000","last_fullsized":"2024-04-26T11:47:12.375482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"74'421","reported_seq":558,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.383352+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:12.383352+0000","last_peered":"2024-04-26T11:47:12.383352+0000","last_clean":"2024-04-26T11:47:12.383352+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:12.383352+0000","last_undegraded":"2024-04-26T11:47:12.383352+0000","last_fullsized":"2024-04-26T11:47:12.383352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":611,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387696+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:12.387696+0000","last_peered":"2024-04-26T11:47:12.387696+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:12.387696+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"74'384","reported_seq":467,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.165141+0000","last_change":"2024-04-26T11:47:12.252062+0000","last_active":"2024-04-26T11:47:13.165141+0000","last_peered":"2024-04-26T11:47:13.165141+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.247384+0000","last_became_peered":"2024-04-26T11:47:12.247384+0000","last_unstale":"2024-04-26T11:47:13.165141+0000","last_undegraded":"2024-04-26T11:47:12.160607+0000","last_fullsized":"2024-04-26T11:47:12.147502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:25.813076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-11}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"74'403","reported_seq":511,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387603+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:12.387603+0000","last_peered":"2024-04-26T11:47:12.387603+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:12.387603+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"74'406","reported_seq":514,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.694225+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:12.694225+0000","last_peered":"2024-04-26T11:47:12.694225+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:12.694225+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"74'433","reported_seq":560,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.379888+0000","last_change":"2024-04-26T11:47:12.249800+0000","last_active":"2024-04-26T11:47:12.379888+0000","last_peered":"2024-04-26T11:47:12.379888+0000","last_clean":"2024-04-26T11:44:50.722977+0000","last_became_active":"2024-04-26T11:47:12.247396+0000","last_became_peered":"2024-04-26T11:47:12.247396+0000","last_unstale":"2024-04-26T11:47:12.379888+0000","last_undegraded":"2024-04-26T11:47:12.157741+0000","last_fullsized":"2024-04-26T11:47:12.153164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:05.443284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-10}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"74'393","reported_seq":525,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.392168+0000","last_change":"2024-04-26T11:47:12.265247+0000","last_active":"2024-04-26T11:47:12.392168+0000","last_peered":"2024-04-26T11:47:12.392168+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:12.392168+0000","last_undegraded":"2024-04-26T11:47:12.167328+0000","last_fullsized":"2024-04-26T11:47:12.157724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:35.162556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-13}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"74'414","reported_seq":527,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.373856+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:12.373856+0000","last_peered":"2024-04-26T11:47:12.373856+0000","last_clean":"2024-04-26T11:47:12.373856+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:12.373856+0000","last_undegraded":"2024-04-26T11:47:12.373856+0000","last_fullsized":"2024-04-26T11:47:12.373856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"74'398","reported_seq":480,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.381089+0000","last_change":"2024-04-26T11:47:12.255039+0000","last_active":"2024-04-26T11:47:12.381089+0000","last_peered":"2024-04-26T11:47:12.381089+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251782+0000","last_became_peered":"2024-04-26T11:47:12.251782+0000","last_unstale":"2024-04-26T11:47:12.381089+0000","last_undegraded":"2024-04-26T11:47:12.160070+0000","last_fullsized":"2024-04-26T11:47:12.143241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"74'433","reported_seq":576,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387495+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:12.387495+0000","last_peered":"2024-04-26T11:47:12.387495+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:12.387495+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"74'390","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.380409+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:12.380409+0000","last_peered":"2024-04-26T11:47:12.380409+0000","last_clean":"2024-04-26T11:47:12.380409+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:12.380409+0000","last_undegraded":"2024-04-26T11:47:12.380409+0000","last_fullsized":"2024-04-26T11:47:12.380409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"74'477","reported_seq":602,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380531+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:12.380531+0000","last_peered":"2024-04-26T11:47:12.380531+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:12.380531+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"74'388","reported_seq":469,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.373439+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:12.373439+0000","last_peered":"2024-04-26T11:47:12.373439+0000","last_clean":"2024-04-26T11:47:12.373439+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:12.373439+0000","last_undegraded":"2024-04-26T11:47:12.373439+0000","last_fullsized":"2024-04-26T11:47:12.373439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"74'394","reported_seq":552,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.384599+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:12.384599+0000","last_peered":"2024-04-26T11:47:12.384599+0000","last_clean":"2024-04-26T11:47:12.384599+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:12.384599+0000","last_undegraded":"2024-04-26T11:47:12.384599+0000","last_fullsized":"2024-04-26T11:47:12.384599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'377","reported_seq":474,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.351414+0000","last_change":"2024-04-26T11:47:12.258316+0000","last_active":"2024-04-26T11:47:12.351414+0000","last_peered":"2024-04-26T11:47:12.351414+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.256893+0000","last_became_peered":"2024-04-26T11:47:12.256893+0000","last_unstale":"2024-04-26T11:47:12.351414+0000","last_undegraded":"2024-04-26T11:47:12.163546+0000","last_fullsized":"2024-04-26T11:47:12.157883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:48.825981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"74'459","reported_seq":577,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394347+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:12.394347+0000","last_peered":"2024-04-26T11:47:12.394347+0000","last_clean":"2024-04-26T11:47:12.394347+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:12.394347+0000","last_undegraded":"2024-04-26T11:47:12.394347+0000","last_fullsized":"2024-04-26T11:47:12.394347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"74'417","reported_seq":544,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380117+0000","last_change":"2024-04-26T11:47:12.262325+0000","last_active":"2024-04-26T11:47:12.380117+0000","last_peered":"2024-04-26T11:47:12.380117+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259636+0000","last_became_peered":"2024-04-26T11:47:12.259636+0000","last_unstale":"2024-04-26T11:47:12.380117+0000","last_undegraded":"2024-04-26T11:47:12.166109+0000","last_fullsized":"2024-04-26T11:47:12.158494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:27.521969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"74'403","reported_seq":509,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387290+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:12.387290+0000","last_peered":"2024-04-26T11:47:12.387290+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:12.387290+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"74'359","reported_seq":453,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.834447+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:12.834447+0000","last_peered":"2024-04-26T11:47:12.834447+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:12.834447+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":576,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.167546+0000","last_change":"2024-04-26T11:47:13.167700+0000","last_active":"2024-04-26T11:47:13.167546+0000","last_peered":"2024-04-26T11:47:12.759461+0000","last_clean":"2024-04-26T11:44:50.722776+0000","last_became_active":"2024-04-26T11:47:12.257022+0000","last_became_peered":"2024-04-26T11:47:12.257022+0000","last_unstale":"2024-04-26T11:47:13.167546+0000","last_undegraded":"2024-04-26T11:47:13.167546+0000","last_fullsized":"2024-04-26T11:47:13.167546+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:31.084050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"74'405","reported_seq":569,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.760993+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:12.760993+0000","last_peered":"2024-04-26T11:47:12.760993+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:12.760993+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.454484+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:13.454484+0000","last_peered":"2024-04-26T11:47:13.454484+0000","last_clean":"2024-04-26T11:47:13.454484+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:13.454484+0000","last_undegraded":"2024-04-26T11:47:13.454484+0000","last_fullsized":"2024-04-26T11:47:13.454484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'403","reported_seq":485,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.389337+0000","last_change":"2024-04-26T11:47:12.262102+0000","last_active":"2024-04-26T11:47:12.389337+0000","last_peered":"2024-04-26T11:47:12.389337+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259702+0000","last_became_peered":"2024-04-26T11:47:12.259702+0000","last_unstale":"2024-04-26T11:47:12.389337+0000","last_undegraded":"2024-04-26T11:47:12.156439+0000","last_fullsized":"2024-04-26T11:47:12.146012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":128,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.166336+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:12.166336+0000","last_peered":"2024-04-26T11:47:12.166336+0000","last_clean":"2024-04-26T11:47:12.166336+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:12.166336+0000","last_undegraded":"2024-04-26T11:47:12.166336+0000","last_fullsized":"2024-04-26T11:47:12.166336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"74'385","reported_seq":506,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.362493+0000","last_change":"2024-04-26T11:47:12.245609+0000","last_active":"2024-04-26T11:47:12.362493+0000","last_peered":"2024-04-26T11:47:12.362493+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.241903+0000","last_became_peered":"2024-04-26T11:47:12.241903+0000","last_unstale":"2024-04-26T11:47:12.362493+0000","last_undegraded":"2024-04-26T11:47:12.158911+0000","last_fullsized":"2024-04-26T11:47:12.148743+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:26.552945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-7}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"74'66","reported_seq":134,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.288503+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:12.288503+0000","last_peered":"2024-04-26T11:47:12.288503+0000","last_clean":"2024-04-26T11:47:12.288503+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:12.288503+0000","last_undegraded":"2024-04-26T11:47:12.288503+0000","last_fullsized":"2024-04-26T11:47:12.288503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":282,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394481+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:12.394481+0000","last_peered":"2024-04-26T11:47:12.394481+0000","last_clean":"2024-04-26T11:47:12.394481+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:12.394481+0000","last_undegraded":"2024-04-26T11:47:12.394481+0000","last_fullsized":"2024-04-26T11:47:12.394481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"74'397","reported_seq":491,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.358530+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:12.358530+0000","last_peered":"2024-04-26T11:47:12.358530+0000","last_clean":"2024-04-26T11:47:12.358530+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:12.358530+0000","last_undegraded":"2024-04-26T11:47:12.358530+0000","last_fullsized":"2024-04-26T11:47:12.358530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":460,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.300516+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:12.300516+0000","last_peered":"2024-04-26T11:47:12.300516+0000","last_clean":"2024-04-26T11:47:12.300516+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:12.300516+0000","last_undegraded":"2024-04-26T11:47:12.300516+0000","last_fullsized":"2024-04-26T11:47:12.300516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"74'451","reported_seq":577,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391400+0000","last_change":"2024-04-26T11:47:12.256711+0000","last_active":"2024-04-26T11:47:12.391400+0000","last_peered":"2024-04-26T11:47:12.391400+0000","last_clean":"2024-04-26T11:44:49.185565+0000","last_became_active":"2024-04-26T11:47:12.252329+0000","last_became_peered":"2024-04-26T11:47:12.252329+0000","last_unstale":"2024-04-26T11:47:12.391400+0000","last_undegraded":"2024-04-26T11:47:12.158212+0000","last_fullsized":"2024-04-26T11:47:12.148030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:23.263270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":654,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394571+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:12.394571+0000","last_peered":"2024-04-26T11:47:12.394571+0000","last_clean":"2024-04-26T11:47:12.394571+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:12.394571+0000","last_undegraded":"2024-04-26T11:47:12.394571+0000","last_fullsized":"2024-04-26T11:47:12.394571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"74'441","reported_seq":574,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391351+0000","last_change":"2024-04-26T11:47:12.254082+0000","last_active":"2024-04-26T11:47:12.391351+0000","last_peered":"2024-04-26T11:47:12.391351+0000","last_clean":"2024-04-26T11:44:50.721822+0000","last_became_active":"2024-04-26T11:47:12.251151+0000","last_became_peered":"2024-04-26T11:47:12.251151+0000","last_unstale":"2024-04-26T11:47:12.391351+0000","last_undegraded":"2024-04-26T11:47:12.155484+0000","last_fullsized":"2024-04-26T11:47:12.144270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:40.503436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":143,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.341564+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:12.341564+0000","last_peered":"2024-04-26T11:47:12.341564+0000","last_clean":"2024-04-26T11:47:12.341564+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:12.341564+0000","last_undegraded":"2024-04-26T11:47:12.341564+0000","last_fullsized":"2024-04-26T11:47:12.341564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"74'441","reported_seq":580,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.354154+0000","last_change":"2024-04-26T11:47:12.252630+0000","last_active":"2024-04-26T11:47:12.354154+0000","last_peered":"2024-04-26T11:47:12.354154+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.250306+0000","last_became_peered":"2024-04-26T11:47:12.250306+0000","last_unstale":"2024-04-26T11:47:12.354154+0000","last_undegraded":"2024-04-26T11:47:12.156978+0000","last_fullsized":"2024-04-26T11:47:12.144300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":327,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.419117+0000","last_change":"2024-04-26T11:47:14.419449+0000","last_active":"2024-04-26T11:47:14.419117+0000","last_peered":"2024-04-26T11:47:12.832926+0000","last_clean":"2024-04-26T11:44:21.435988+0000","last_became_active":"2024-04-26T11:47:12.257934+0000","last_became_peered":"2024-04-26T11:47:12.257934+0000","last_unstale":"2024-04-26T11:47:14.419117+0000","last_undegraded":"2024-04-26T11:47:14.419117+0000","last_fullsized":"2024-04-26T11:47:14.419117+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":3}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'418","reported_seq":518,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387647+0000","last_change":"2024-04-26T11:47:12.257450+0000","last_active":"2024-04-26T11:47:12.387647+0000","last_peered":"2024-04-26T11:47:12.387647+0000","last_clean":"2024-04-26T11:44:50.722159+0000","last_became_active":"2024-04-26T11:47:12.255880+0000","last_became_peered":"2024-04-26T11:47:12.255880+0000","last_unstale":"2024-04-26T11:47:12.387647+0000","last_undegraded":"2024-04-26T11:47:12.165276+0000","last_fullsized":"2024-04-26T11:47:12.156834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.490162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-16}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":236,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164188+0000","last_change":"2024-04-26T11:47:13.164583+0000","last_active":"2024-04-26T11:47:13.164188+0000","last_peered":"2024-04-26T11:47:12.525388+0000","last_clean":"2024-04-26T11:44:50.723083+0000","last_became_active":"2024-04-26T11:47:12.253850+0000","last_became_peered":"2024-04-26T11:47:12.253850+0000","last_unstale":"2024-04-26T11:47:13.164188+0000","last_undegraded":"2024-04-26T11:47:13.164188+0000","last_fullsized":"2024-04-26T11:47:13.164188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:24.810487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"74'396","reported_seq":501,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.337370+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:12.337370+0000","last_peered":"2024-04-26T11:47:12.337370+0000","last_clean":"2024-04-26T11:47:12.337370+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:12.337370+0000","last_undegraded":"2024-04-26T11:47:12.337370+0000","last_fullsized":"2024-04-26T11:47:12.337370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":122,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.307568+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:12.307568+0000","last_peered":"2024-04-26T11:47:12.307568+0000","last_clean":"2024-04-26T11:47:12.307568+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:12.307568+0000","last_undegraded":"2024-04-26T11:47:12.307568+0000","last_fullsized":"2024-04-26T11:47:12.307568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"74'339","reported_seq":441,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.391438+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:12.391438+0000","last_peered":"2024-04-26T11:47:12.391438+0000","last_clean":"2024-04-26T11:47:12.391438+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:12.391438+0000","last_undegraded":"2024-04-26T11:47:12.391438+0000","last_fullsized":"2024-04-26T11:47:12.391438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":587,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.165687+0000","last_change":"2024-04-26T11:47:13.166133+0000","last_active":"2024-04-26T11:47:13.165687+0000","last_peered":"2024-04-26T11:47:12.564825+0000","last_clean":"2024-04-26T11:44:49.185623+0000","last_became_active":"2024-04-26T11:47:12.261412+0000","last_became_peered":"2024-04-26T11:47:12.261412+0000","last_unstale":"2024-04-26T11:47:13.165687+0000","last_undegraded":"2024-04-26T11:47:13.165687+0000","last_fullsized":"2024-04-26T11:47:13.165687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:22.060390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"74'379","reported_seq":490,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386228+0000","last_change":"2024-04-26T11:47:12.257493+0000","last_active":"2024-04-26T11:47:12.386228+0000","last_peered":"2024-04-26T11:47:12.386228+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255726+0000","last_became_peered":"2024-04-26T11:47:12.255726+0000","last_unstale":"2024-04-26T11:47:12.386228+0000","last_undegraded":"2024-04-26T11:47:12.167230+0000","last_fullsized":"2024-04-26T11:47:12.165520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:41.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":270,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.165708+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:12.165708+0000","last_peered":"2024-04-26T11:47:12.165708+0000","last_clean":"2024-04-26T11:47:12.165708+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:12.165708+0000","last_undegraded":"2024-04-26T11:47:12.165708+0000","last_fullsized":"2024-04-26T11:47:12.165708+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.166413+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:12.166413+0000","last_peered":"2024-04-26T11:47:12.166413+0000","last_clean":"2024-04-26T11:47:12.166413+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:12.166413+0000","last_undegraded":"2024-04-26T11:47:12.166413+0000","last_fullsized":"2024-04-26T11:47:12.166413+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":574,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-26T11:47:14.427139+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:14.427139+0000","last_peered":"2024-04-26T11:47:14.427139+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:14.427139+0000","last_undegraded":"2024-04-26T11:47:14.427139+0000","last_fullsized":"2024-04-26T11:47:14.427139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'427","reported_seq":529,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394615+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:12.394615+0000","last_peered":"2024-04-26T11:47:12.394615+0000","last_clean":"2024-04-26T11:47:12.394615+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:12.394615+0000","last_undegraded":"2024-04-26T11:47:12.394615+0000","last_fullsized":"2024-04-26T11:47:12.394615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.165231+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:12.165231+0000","last_peered":"2024-04-26T11:47:12.165231+0000","last_clean":"2024-04-26T11:47:12.165231+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:12.165231+0000","last_undegraded":"2024-04-26T11:47:12.165231+0000","last_fullsized":"2024-04-26T11:47:12.165231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"74'167","reported_seq":319,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.418655+0000","last_change":"2024-04-26T11:47:14.419948+0000","last_active":"2024-04-26T11:47:14.418655+0000","last_peered":"2024-04-26T11:47:12.578926+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:12.254543+0000","last_became_peered":"2024-04-26T11:47:12.254543+0000","last_unstale":"2024-04-26T11:47:14.418655+0000","last_undegraded":"2024-04-26T11:47:14.418655+0000","last_fullsized":"2024-04-26T11:47:14.418655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421777,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":1445,"num_write":93,"num_write_kb":1446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'438","reported_seq":555,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391168+0000","last_change":"2024-04-26T11:47:12.262868+0000","last_active":"2024-04-26T11:47:12.391168+0000","last_peered":"2024-04-26T11:47:12.391168+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:12.391168+0000","last_undegraded":"2024-04-26T11:47:12.156540+0000","last_fullsized":"2024-04-26T11:47:12.146571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:45.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453806+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:13.453806+0000","last_peered":"2024-04-26T11:47:13.453806+0000","last_clean":"2024-04-26T11:47:13.453806+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:13.453806+0000","last_undegraded":"2024-04-26T11:47:13.453806+0000","last_fullsized":"2024-04-26T11:47:13.453806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":491,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.300670+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:12.300670+0000","last_peered":"2024-04-26T11:47:12.300670+0000","last_clean":"2024-04-26T11:47:12.300670+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:12.300670+0000","last_undegraded":"2024-04-26T11:47:12.300670+0000","last_fullsized":"2024-04-26T11:47:12.300670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"74'331","reported_seq":417,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380133+0000","last_change":"2024-04-26T11:47:12.254070+0000","last_active":"2024-04-26T11:47:12.380133+0000","last_peered":"2024-04-26T11:47:12.380133+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.250084+0000","last_became_peered":"2024-04-26T11:47:12.250084+0000","last_unstale":"2024-04-26T11:47:12.380133+0000","last_undegraded":"2024-04-26T11:47:12.165871+0000","last_fullsized":"2024-04-26T11:47:12.161090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:19.765756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":152,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.161632+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:12.161632+0000","last_peered":"2024-04-26T11:47:12.161632+0000","last_clean":"2024-04-26T11:47:12.161632+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:12.161632+0000","last_undegraded":"2024-04-26T11:47:12.161632+0000","last_fullsized":"2024-04-26T11:47:12.161632+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":146,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.387141+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:12.387141+0000","last_peered":"2024-04-26T11:47:12.387141+0000","last_clean":"2024-04-26T11:47:12.387141+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:12.387141+0000","last_undegraded":"2024-04-26T11:47:12.387141+0000","last_fullsized":"2024-04-26T11:47:12.387141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"74'371","reported_seq":465,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.394270+0000","last_change":"2024-04-26T11:47:12.256944+0000","last_active":"2024-04-26T11:47:12.394270+0000","last_peered":"2024-04-26T11:47:12.394270+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255779+0000","last_became_peered":"2024-04-26T11:47:12.255779+0000","last_unstale":"2024-04-26T11:47:12.394270+0000","last_undegraded":"2024-04-26T11:47:12.164475+0000","last_fullsized":"2024-04-26T11:47:12.155432+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:51.100421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":598,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164310+0000","last_change":"2024-04-26T11:47:13.164702+0000","last_active":"2024-04-26T11:47:13.164310+0000","last_peered":"2024-04-26T11:47:12.391164+0000","last_clean":"2024-04-26T11:44:50.722744+0000","last_became_active":"2024-04-26T11:47:12.243398+0000","last_became_peered":"2024-04-26T11:47:12.243398+0000","last_unstale":"2024-04-26T11:47:13.164310+0000","last_undegraded":"2024-04-26T11:47:13.164310+0000","last_fullsized":"2024-04-26T11:47:13.164310+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:26.445411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.452997+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:13.452997+0000","last_peered":"2024-04-26T11:47:13.452997+0000","last_clean":"2024-04-26T11:47:13.452997+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:13.452997+0000","last_undegraded":"2024-04-26T11:47:13.452997+0000","last_fullsized":"2024-04-26T11:47:13.452997+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'336","reported_seq":438,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.391321+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:12.391321+0000","last_peered":"2024-04-26T11:47:12.391321+0000","last_clean":"2024-04-26T11:47:12.391321+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:12.391321+0000","last_undegraded":"2024-04-26T11:47:12.391321+0000","last_fullsized":"2024-04-26T11:47:12.391321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453822+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:13.453822+0000","last_peered":"2024-04-26T11:47:13.453822+0000","last_clean":"2024-04-26T11:47:13.453822+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:13.453822+0000","last_undegraded":"2024-04-26T11:47:13.453822+0000","last_fullsized":"2024-04-26T11:47:13.453822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.160723+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:12.160723+0000","last_peered":"2024-04-26T11:47:12.160723+0000","last_clean":"2024-04-26T11:47:12.160723+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:12.160723+0000","last_undegraded":"2024-04-26T11:47:12.160723+0000","last_fullsized":"2024-04-26T11:47:12.160723+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"74'380","reported_seq":480,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.391722+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:12.391722+0000","last_peered":"2024-04-26T11:47:12.391722+0000","last_clean":"2024-04-26T11:47:12.391722+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:12.391722+0000","last_undegraded":"2024-04-26T11:47:12.391722+0000","last_fullsized":"2024-04-26T11:47:12.391722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.455709+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:13.455709+0000","last_peered":"2024-04-26T11:47:13.455709+0000","last_clean":"2024-04-26T11:47:13.455709+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:13.455709+0000","last_undegraded":"2024-04-26T11:47:13.455709+0000","last_fullsized":"2024-04-26T11:47:13.455709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453264+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:13.453264+0000","last_peered":"2024-04-26T11:47:13.453264+0000","last_clean":"2024-04-26T11:47:13.453264+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:13.453264+0000","last_undegraded":"2024-04-26T11:47:13.453264+0000","last_fullsized":"2024-04-26T11:47:13.453264+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'384","reported_seq":457,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391265+0000","last_change":"2024-04-26T11:47:12.265335+0000","last_active":"2024-04-26T11:47:12.391265+0000","last_peered":"2024-04-26T11:47:12.391265+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:12.391265+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"74'70","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453367+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:13.453367+0000","last_peered":"2024-04-26T11:47:13.453367+0000","last_clean":"2024-04-26T11:47:13.453367+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:13.453367+0000","last_undegraded":"2024-04-26T11:47:13.453367+0000","last_fullsized":"2024-04-26T11:47:13.453367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.160630+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:12.160630+0000","last_peered":"2024-04-26T11:47:12.160630+0000","last_clean":"2024-04-26T11:47:12.160630+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:12.160630+0000","last_undegraded":"2024-04-26T11:47:12.160630+0000","last_fullsized":"2024-04-26T11:47:12.160630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"74'391","reported_seq":515,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.366094+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:12.366094+0000","last_peered":"2024-04-26T11:47:12.366094+0000","last_clean":"2024-04-26T11:47:12.366094+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:12.366094+0000","last_undegraded":"2024-04-26T11:47:12.366094+0000","last_fullsized":"2024-04-26T11:47:12.366094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"74'412","reported_seq":517,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.379295+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:12.379295+0000","last_peered":"2024-04-26T11:47:12.379295+0000","last_clean":"2024-04-26T11:47:12.379295+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:12.379295+0000","last_undegraded":"2024-04-26T11:47:12.379295+0000","last_fullsized":"2024-04-26T11:47:12.379295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":479,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.377124+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:12.377124+0000","last_peered":"2024-04-26T11:47:12.377124+0000","last_clean":"2024-04-26T11:47:12.377124+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:12.377124+0000","last_undegraded":"2024-04-26T11:47:12.377124+0000","last_fullsized":"2024-04-26T11:47:12.377124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"74'414","reported_seq":516,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.163327+0000","last_change":"2024-04-26T11:47:12.261430+0000","last_active":"2024-04-26T11:47:13.163327+0000","last_peered":"2024-04-26T11:47:13.163327+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259639+0000","last_became_peered":"2024-04-26T11:47:12.259639+0000","last_unstale":"2024-04-26T11:47:13.163327+0000","last_undegraded":"2024-04-26T11:47:12.167836+0000","last_fullsized":"2024-04-26T11:47:12.160846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:57.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"74'102","reported_seq":170,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.396076+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:12.396076+0000","last_peered":"2024-04-26T11:47:12.396076+0000","last_clean":"2024-04-26T11:47:12.396076+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:12.396076+0000","last_undegraded":"2024-04-26T11:47:12.396076+0000","last_fullsized":"2024-04-26T11:47:12.396076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":419,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164948+0000","last_change":"2024-04-26T11:47:13.166538+0000","last_active":"2024-04-26T11:47:13.164948+0000","last_peered":"2024-04-26T11:47:12.868366+0000","last_clean":"2024-04-26T11:44:50.723214+0000","last_became_active":"2024-04-26T11:47:12.261856+0000","last_became_peered":"2024-04-26T11:47:12.261856+0000","last_unstale":"2024-04-26T11:47:13.164948+0000","last_undegraded":"2024-04-26T11:47:13.164948+0000","last_fullsized":"2024-04-26T11:47:13.164948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:06.537844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"74'457","reported_seq":546,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.159909+0000","last_change":"2024-04-26T11:47:12.254913+0000","last_active":"2024-04-26T11:47:13.159909+0000","last_peered":"2024-04-26T11:47:13.159909+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251682+0000","last_became_peered":"2024-04-26T11:47:12.251682+0000","last_unstale":"2024-04-26T11:47:13.159909+0000","last_undegraded":"2024-04-26T11:47:12.157689+0000","last_fullsized":"2024-04-26T11:47:12.143256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:13.489428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":203,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.456185+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:13.456185+0000","last_peered":"2024-04-26T11:47:13.456185+0000","last_clean":"2024-04-26T11:47:13.456185+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:13.456185+0000","last_undegraded":"2024-04-26T11:47:13.456185+0000","last_fullsized":"2024-04-26T11:47:13.456185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'441","reported_seq":555,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.163079+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:13.163079+0000","last_peered":"2024-04-26T11:47:13.163079+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:13.163079+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"74'360","reported_seq":472,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.384613+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:12.384613+0000","last_peered":"2024-04-26T11:47:12.384613+0000","last_clean":"2024-04-26T11:47:12.384613+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:12.384613+0000","last_undegraded":"2024-04-26T11:47:12.384613+0000","last_fullsized":"2024-04-26T11:47:12.384613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":830,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.418345+0000","last_change":"2024-04-26T11:47:14.418746+0000","last_active":"2024-04-26T11:47:14.418345+0000","last_peered":"2024-04-26T11:47:12.655146+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:12.263598+0000","last_became_peered":"2024-04-26T11:47:12.263598+0000","last_unstale":"2024-04-26T11:47:14.418345+0000","last_undegraded":"2024-04-26T11:47:14.418345+0000","last_fullsized":"2024-04-26T11:47:14.418345+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'380","reported_seq":470,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386110+0000","last_change":"2024-04-26T11:47:12.262558+0000","last_active":"2024-04-26T11:47:12.386110+0000","last_peered":"2024-04-26T11:47:12.386110+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.260513+0000","last_became_peered":"2024-04-26T11:47:12.260513+0000","last_unstale":"2024-04-26T11:47:12.386110+0000","last_undegraded":"2024-04-26T11:47:12.161322+0000","last_fullsized":"2024-04-26T11:47:12.156833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:46.502879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":387,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.418773+0000","last_change":"2024-04-26T11:47:14.419126+0000","last_active":"2024-04-26T11:47:14.418773+0000","last_peered":"2024-04-26T11:47:12.692702+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:12.254760+0000","last_became_peered":"2024-04-26T11:47:12.254760+0000","last_unstale":"2024-04-26T11:47:14.418773+0000","last_undegraded":"2024-04-26T11:47:14.418773+0000","last_fullsized":"2024-04-26T11:47:14.418773+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'370","reported_seq":484,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394315+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:12.394315+0000","last_peered":"2024-04-26T11:47:12.394315+0000","last_clean":"2024-04-26T11:47:12.394315+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:12.394315+0000","last_undegraded":"2024-04-26T11:47:12.394315+0000","last_fullsized":"2024-04-26T11:47:12.394315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"74'349","reported_seq":439,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.165692+0000","last_change":"2024-04-26T11:47:13.166133+0000","last_active":"2024-04-26T11:47:13.165692+0000","last_peered":"2024-04-26T11:47:12.489133+0000","last_clean":"2024-04-26T11:44:49.186164+0000","last_became_active":"2024-04-26T11:47:12.251407+0000","last_became_peered":"2024-04-26T11:47:12.251407+0000","last_unstale":"2024-04-26T11:47:13.165692+0000","last_undegraded":"2024-04-26T11:47:13.165692+0000","last_fullsized":"2024-04-26T11:47:13.165692+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:15.939830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11895685,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":11786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"74'360","reported_seq":471,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.371794+0000","last_change":"2024-04-26T11:47:12.252278+0000","last_active":"2024-04-26T11:47:12.371794+0000","last_peered":"2024-04-26T11:47:12.371794+0000","last_clean":"2024-04-26T11:44:49.186726+0000","last_became_active":"2024-04-26T11:47:12.247841+0000","last_became_peered":"2024-04-26T11:47:12.247841+0000","last_unstale":"2024-04-26T11:47:12.371794+0000","last_undegraded":"2024-04-26T11:47:12.157717+0000","last_fullsized":"2024-04-26T11:47:12.147708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:40.552007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":162,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-10}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.163909+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:12.163909+0000","last_peered":"2024-04-26T11:47:12.163909+0000","last_clean":"2024-04-26T11:47:12.163909+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:12.163909+0000","last_undegraded":"2024-04-26T11:47:12.163909+0000","last_fullsized":"2024-04-26T11:47:12.163909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"74'369","reported_seq":498,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380870+0000","last_change":"2024-04-26T11:47:12.259550+0000","last_active":"2024-04-26T11:47:12.380870+0000","last_peered":"2024-04-26T11:47:12.380870+0000","last_clean":"2024-04-26T11:44:50.722361+0000","last_became_active":"2024-04-26T11:47:12.256906+0000","last_became_peered":"2024-04-26T11:47:12.256906+0000","last_unstale":"2024-04-26T11:47:12.380870+0000","last_undegraded":"2024-04-26T11:47:12.156736+0000","last_fullsized":"2024-04-26T11:47:12.144812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:25.280569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":361,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164357+0000","last_change":"2024-04-26T11:47:13.164767+0000","last_active":"2024-04-26T11:47:13.164357+0000","last_peered":"2024-04-26T11:47:12.396143+0000","last_clean":"2024-04-26T11:44:50.722396+0000","last_became_active":"2024-04-26T11:47:12.249342+0000","last_became_peered":"2024-04-26T11:47:12.249342+0000","last_unstale":"2024-04-26T11:47:13.164357+0000","last_undegraded":"2024-04-26T11:47:13.164357+0000","last_fullsized":"2024-04-26T11:47:13.164357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:26.375129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"74'384","reported_seq":494,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.393015+0000","last_change":"2024-04-26T11:47:12.254097+0000","last_active":"2024-04-26T11:47:12.393015+0000","last_peered":"2024-04-26T11:47:12.393015+0000","last_clean":"2024-04-26T11:44:50.722199+0000","last_became_active":"2024-04-26T11:47:12.251646+0000","last_became_peered":"2024-04-26T11:47:12.251646+0000","last_unstale":"2024-04-26T11:47:12.393015+0000","last_undegraded":"2024-04-26T11:47:12.161281+0000","last_fullsized":"2024-04-26T11:47:12.156381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:20.045697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":397,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.322536+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:12.322536+0000","last_peered":"2024-04-26T11:47:12.322536+0000","last_clean":"2024-04-26T11:47:12.322536+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:12.322536+0000","last_undegraded":"2024-04-26T11:47:12.322536+0000","last_fullsized":"2024-04-26T11:47:12.322536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":518,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.388572+0000","last_change":"2024-04-26T11:47:12.254202+0000","last_active":"2024-04-26T11:47:12.388572+0000","last_peered":"2024-04-26T11:47:12.388572+0000","last_clean":"2024-04-26T11:44:49.185959+0000","last_became_active":"2024-04-26T11:47:12.252111+0000","last_became_peered":"2024-04-26T11:47:12.252111+0000","last_unstale":"2024-04-26T11:47:12.388572+0000","last_undegraded":"2024-04-26T11:47:12.160789+0000","last_fullsized":"2024-04-26T11:47:12.146173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:57.514673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-10}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.456417+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:13.456417+0000","last_peered":"2024-04-26T11:47:13.456417+0000","last_clean":"2024-04-26T11:47:13.456417+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:13.456417+0000","last_undegraded":"2024-04-26T11:47:13.456417+0000","last_fullsized":"2024-04-26T11:47:13.456417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'428","reported_seq":536,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.381352+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:12.381352+0000","last_peered":"2024-04-26T11:47:12.381352+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:12.381352+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.455316+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:13.455316+0000","last_peered":"2024-04-26T11:47:13.455316+0000","last_clean":"2024-04-26T11:47:13.455316+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:13.455316+0000","last_undegraded":"2024-04-26T11:47:13.455316+0000","last_fullsized":"2024-04-26T11:47:13.455316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7795,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25552,"ondisk_log_size":25552,"up":128,"acting":84,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":126565140,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":92,"num_read_kb":1445,"num_write":6021,"num_write_kb":127746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253198336,"data_stored":253130280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7869,"ondisk_log_size":7869,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738409,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200076,"kb_used_data":88636,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171764,"statfs":{"total":96636764160,"available":96431886336,"internally_reserved":0,"allocated":90763264,"data_stored":90397615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":1,"up_from":72,"seq":309237645314,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110808,"kb_used_data":79176,"kb_used_omap":6,"kb_used_meta":31609,"kb_avail":94261032,"statfs":{"total":96636764160,"available":96523296768,"internally_reserved":0,"allocated":81076224,"data_stored":80730558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":32367872},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189808,"kb_used_data":82468,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94182032,"statfs":{"total":96636764160,"available":96442400768,"internally_reserved":0,"allocated":84447232,"data_stored":84091557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83222528,"data_stored":83199707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80441344,"data_stored":80426942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:17.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:47:18.045 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:18.335+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:18.069 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:18.070 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:18.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:18.146 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:18.143+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:18.188 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:18.188 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:18.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:18.247 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:18.535+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:18.302 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:18.302 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:18.312 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:18.331 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:18.332 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub flag(s) set","count":7},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 7795/108 objects degraded (7217.593%), 44 pgs degraded","count":44},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":199,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":80,"num_osds":3,"num_up_osds":3,"osd_up_since":1714132030,"num_in_osds":3,"osd_in_since":1714131840,"num_remapped_pgs":37},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":49},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":43},{"state_name":"peering","count":8},{"state_name":"activating","count":4},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127155508,"bytes_used":512708608,"bytes_avail":289397583872,"bytes_total":289910292480,"inactive_pgs_ratio":0.11428571492433548,"degraded_objects":7795,"degraded_total":108,"degraded_ratio":72.175925925925924,"recovering_objects_per_sec":47,"recovering_bytes_per_sec":20097036,"recovering_keys_per_sec":63,"num_objects_recovered":189,"num_bytes_recovered":80434283,"num_keys_recovered":255,"read_bytes_sec":29678,"write_bytes_sec":95944,"read_op_per_sec":1,"write_op_per_sec":250},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4213}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T11:45:27.979634+0000","services":{}},"progress_events":{}} 2024-04-26T11:47:18.347 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:47:18.347 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:18.348 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:18.635+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:18.427 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:18.427 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:18.438 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:18.450 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:18.447+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:18.548 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:18.548 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:18.551 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:18.547+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:18.558 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:18.651 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:18.651+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:18.661 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:18.664 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:18.664 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:18.674 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:47:18.680 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-04-26T11:47:18.129195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127155508,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7795,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2805,"num_read_kb":1335940,"num_write":30668,"num_write_kb":4174830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33578,"ondisk_log_size":33578,"up":210,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":500692,"kb_used_data":250280,"kb_used_omap":9,"kb_used_meta":250358,"kb_avail":282614828,"statfs":{"total":289910292480,"available":289397583872,"internally_reserved":0,"allocated":256286720,"data_stored":255219730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":256366732},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":116352,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":116,"num_write":9,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-177,"num_bytes_recovered":39170513,"num_keys_recovered":255,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.010412"},"pg_stats":[{"pgid":"4.3f","version":"74'405","reported_seq":545,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.394309+0000","last_change":"2024-04-26T11:47:12.248393+0000","last_active":"2024-04-26T11:47:12.394309+0000","last_peered":"2024-04-26T11:47:12.394309+0000","last_clean":"2024-04-26T11:44:49.187479+0000","last_became_active":"2024-04-26T11:47:12.244392+0000","last_became_peered":"2024-04-26T11:47:12.244392+0000","last_unstale":"2024-04-26T11:47:12.394309+0000","last_undegraded":"2024-04-26T11:47:12.159303+0000","last_fullsized":"2024-04-26T11:47:12.146683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:47.078164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"74'434","reported_seq":584,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.368684+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:12.368684+0000","last_peered":"2024-04-26T11:47:12.368684+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:12.368684+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"74'383","reported_seq":477,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394557+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:12.394557+0000","last_peered":"2024-04-26T11:47:12.394557+0000","last_clean":"2024-04-26T11:47:12.394557+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:12.394557+0000","last_undegraded":"2024-04-26T11:47:12.394557+0000","last_fullsized":"2024-04-26T11:47:12.394557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"74'356","reported_seq":449,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386104+0000","last_change":"2024-04-26T11:47:12.252178+0000","last_active":"2024-04-26T11:47:12.386104+0000","last_peered":"2024-04-26T11:47:12.386104+0000","last_clean":"2024-04-26T11:44:50.721907+0000","last_became_active":"2024-04-26T11:47:12.247695+0000","last_became_peered":"2024-04-26T11:47:12.247695+0000","last_unstale":"2024-04-26T11:47:12.386104+0000","last_undegraded":"2024-04-26T11:47:12.156427+0000","last_fullsized":"2024-04-26T11:47:12.145436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:16.946912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"74'399","reported_seq":503,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387295+0000","last_change":"2024-04-26T11:47:12.258595+0000","last_active":"2024-04-26T11:47:12.387295+0000","last_peered":"2024-04-26T11:47:12.387295+0000","last_clean":"2024-04-26T11:44:49.186299+0000","last_became_active":"2024-04-26T11:47:12.256827+0000","last_became_peered":"2024-04-26T11:47:12.256827+0000","last_unstale":"2024-04-26T11:47:12.387295+0000","last_undegraded":"2024-04-26T11:47:12.160500+0000","last_fullsized":"2024-04-26T11:47:12.146275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:42.419089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"74'358","reported_seq":788,"reported_epoch":75,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:14.043798+0000","last_change":"2024-04-26T11:47:13.436951+0000","last_active":"2024-04-26T11:47:14.043798+0000","last_peered":"2024-04-26T11:47:14.043798+0000","last_clean":"2024-04-26T11:44:50.722165+0000","last_became_active":"2024-04-26T11:47:12.239030+0000","last_became_peered":"2024-04-26T11:47:12.239030+0000","last_unstale":"2024-04-26T11:47:14.043798+0000","last_undegraded":"2024-04-26T11:47:12.161120+0000","last_fullsized":"2024-04-26T11:47:12.143723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.949917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"74'449","reported_seq":600,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386065+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:12.386065+0000","last_peered":"2024-04-26T11:47:12.386065+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:12.386065+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"74'358","reported_seq":473,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387095+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:12.387095+0000","last_peered":"2024-04-26T11:47:12.387095+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:12.387095+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"74'410","reported_seq":485,"reported_epoch":76,"state":"peering","last_fresh":"2024-04-26T11:47:14.426070+0000","last_change":"2024-04-26T11:47:14.422861+0000","last_active":"2024-04-26T11:47:14.422861+0000","last_peered":"2024-04-26T11:47:12.371524+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.244530+0000","last_became_peered":"2024-04-26T11:47:12.244530+0000","last_unstale":"2024-04-26T11:47:14.426070+0000","last_undegraded":"2024-04-26T11:47:14.426070+0000","last_fullsized":"2024-04-26T11:47:14.426070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:39.121653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'408","reported_seq":546,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.381028+0000","last_change":"2024-04-26T11:47:12.262968+0000","last_active":"2024-04-26T11:47:12.381028+0000","last_peered":"2024-04-26T11:47:12.381028+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:12.381028+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"74'366","reported_seq":491,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.389972+0000","last_change":"2024-04-26T11:47:12.243876+0000","last_active":"2024-04-26T11:47:12.389972+0000","last_peered":"2024-04-26T11:47:12.389972+0000","last_clean":"2024-04-26T11:44:50.722156+0000","last_became_active":"2024-04-26T11:47:12.208201+0000","last_became_peered":"2024-04-26T11:47:12.208201+0000","last_unstale":"2024-04-26T11:47:12.389972+0000","last_undegraded":"2024-04-26T11:47:12.155452+0000","last_fullsized":"2024-04-26T11:47:12.147840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:27.558419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":163,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"74'338","reported_seq":444,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394419+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:12.394419+0000","last_peered":"2024-04-26T11:47:12.394419+0000","last_clean":"2024-04-26T11:47:12.394419+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:12.394419+0000","last_undegraded":"2024-04-26T11:47:12.394419+0000","last_fullsized":"2024-04-26T11:47:12.394419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"74'378","reported_seq":491,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387254+0000","last_change":"2024-04-26T11:47:12.253471+0000","last_active":"2024-04-26T11:47:12.387254+0000","last_peered":"2024-04-26T11:47:12.387254+0000","last_clean":"2024-04-26T11:44:49.186209+0000","last_became_active":"2024-04-26T11:47:12.250397+0000","last_became_peered":"2024-04-26T11:47:12.250397+0000","last_unstale":"2024-04-26T11:47:12.387254+0000","last_undegraded":"2024-04-26T11:47:12.157224+0000","last_fullsized":"2024-04-26T11:47:12.147628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:15.499511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"74'411","reported_seq":516,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.375482+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:12.375482+0000","last_peered":"2024-04-26T11:47:12.375482+0000","last_clean":"2024-04-26T11:47:12.375482+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:12.375482+0000","last_undegraded":"2024-04-26T11:47:12.375482+0000","last_fullsized":"2024-04-26T11:47:12.375482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"74'421","reported_seq":558,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.383352+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:12.383352+0000","last_peered":"2024-04-26T11:47:12.383352+0000","last_clean":"2024-04-26T11:47:12.383352+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:12.383352+0000","last_undegraded":"2024-04-26T11:47:12.383352+0000","last_fullsized":"2024-04-26T11:47:12.383352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":611,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387696+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:12.387696+0000","last_peered":"2024-04-26T11:47:12.387696+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:12.387696+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"74'384","reported_seq":467,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.165141+0000","last_change":"2024-04-26T11:47:12.252062+0000","last_active":"2024-04-26T11:47:13.165141+0000","last_peered":"2024-04-26T11:47:13.165141+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.247384+0000","last_became_peered":"2024-04-26T11:47:12.247384+0000","last_unstale":"2024-04-26T11:47:13.165141+0000","last_undegraded":"2024-04-26T11:47:12.160607+0000","last_fullsized":"2024-04-26T11:47:12.147502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:25.813076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-11}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"74'403","reported_seq":511,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387603+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:12.387603+0000","last_peered":"2024-04-26T11:47:12.387603+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:12.387603+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"74'406","reported_seq":514,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.694225+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:12.694225+0000","last_peered":"2024-04-26T11:47:12.694225+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:12.694225+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"74'433","reported_seq":560,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.379888+0000","last_change":"2024-04-26T11:47:12.249800+0000","last_active":"2024-04-26T11:47:12.379888+0000","last_peered":"2024-04-26T11:47:12.379888+0000","last_clean":"2024-04-26T11:44:50.722977+0000","last_became_active":"2024-04-26T11:47:12.247396+0000","last_became_peered":"2024-04-26T11:47:12.247396+0000","last_unstale":"2024-04-26T11:47:12.379888+0000","last_undegraded":"2024-04-26T11:47:12.157741+0000","last_fullsized":"2024-04-26T11:47:12.153164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:05.443284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-10}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"74'393","reported_seq":525,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.392168+0000","last_change":"2024-04-26T11:47:12.265247+0000","last_active":"2024-04-26T11:47:12.392168+0000","last_peered":"2024-04-26T11:47:12.392168+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:12.392168+0000","last_undegraded":"2024-04-26T11:47:12.167328+0000","last_fullsized":"2024-04-26T11:47:12.157724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:35.162556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-13}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"74'414","reported_seq":527,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.373856+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:12.373856+0000","last_peered":"2024-04-26T11:47:12.373856+0000","last_clean":"2024-04-26T11:47:12.373856+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:12.373856+0000","last_undegraded":"2024-04-26T11:47:12.373856+0000","last_fullsized":"2024-04-26T11:47:12.373856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"74'398","reported_seq":480,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.381089+0000","last_change":"2024-04-26T11:47:12.255039+0000","last_active":"2024-04-26T11:47:12.381089+0000","last_peered":"2024-04-26T11:47:12.381089+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251782+0000","last_became_peered":"2024-04-26T11:47:12.251782+0000","last_unstale":"2024-04-26T11:47:12.381089+0000","last_undegraded":"2024-04-26T11:47:12.160070+0000","last_fullsized":"2024-04-26T11:47:12.143241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"74'433","reported_seq":576,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387495+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:12.387495+0000","last_peered":"2024-04-26T11:47:12.387495+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:12.387495+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"74'390","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.380409+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:12.380409+0000","last_peered":"2024-04-26T11:47:12.380409+0000","last_clean":"2024-04-26T11:47:12.380409+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:12.380409+0000","last_undegraded":"2024-04-26T11:47:12.380409+0000","last_fullsized":"2024-04-26T11:47:12.380409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"74'477","reported_seq":602,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380531+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:12.380531+0000","last_peered":"2024-04-26T11:47:12.380531+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:12.380531+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"74'388","reported_seq":469,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.373439+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:12.373439+0000","last_peered":"2024-04-26T11:47:12.373439+0000","last_clean":"2024-04-26T11:47:12.373439+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:12.373439+0000","last_undegraded":"2024-04-26T11:47:12.373439+0000","last_fullsized":"2024-04-26T11:47:12.373439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"74'394","reported_seq":552,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.384599+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:12.384599+0000","last_peered":"2024-04-26T11:47:12.384599+0000","last_clean":"2024-04-26T11:47:12.384599+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:12.384599+0000","last_undegraded":"2024-04-26T11:47:12.384599+0000","last_fullsized":"2024-04-26T11:47:12.384599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'377","reported_seq":474,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.351414+0000","last_change":"2024-04-26T11:47:12.258316+0000","last_active":"2024-04-26T11:47:12.351414+0000","last_peered":"2024-04-26T11:47:12.351414+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.256893+0000","last_became_peered":"2024-04-26T11:47:12.256893+0000","last_unstale":"2024-04-26T11:47:12.351414+0000","last_undegraded":"2024-04-26T11:47:12.163546+0000","last_fullsized":"2024-04-26T11:47:12.157883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:48.825981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"74'459","reported_seq":577,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394347+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:12.394347+0000","last_peered":"2024-04-26T11:47:12.394347+0000","last_clean":"2024-04-26T11:47:12.394347+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:12.394347+0000","last_undegraded":"2024-04-26T11:47:12.394347+0000","last_fullsized":"2024-04-26T11:47:12.394347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"74'417","reported_seq":544,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380117+0000","last_change":"2024-04-26T11:47:12.262325+0000","last_active":"2024-04-26T11:47:12.380117+0000","last_peered":"2024-04-26T11:47:12.380117+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259636+0000","last_became_peered":"2024-04-26T11:47:12.259636+0000","last_unstale":"2024-04-26T11:47:12.380117+0000","last_undegraded":"2024-04-26T11:47:12.166109+0000","last_fullsized":"2024-04-26T11:47:12.158494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:27.521969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"74'403","reported_seq":509,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387290+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:12.387290+0000","last_peered":"2024-04-26T11:47:12.387290+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:12.387290+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"74'359","reported_seq":453,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.834447+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:12.834447+0000","last_peered":"2024-04-26T11:47:12.834447+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:12.834447+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":576,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.167546+0000","last_change":"2024-04-26T11:47:13.167700+0000","last_active":"2024-04-26T11:47:13.167546+0000","last_peered":"2024-04-26T11:47:12.759461+0000","last_clean":"2024-04-26T11:44:50.722776+0000","last_became_active":"2024-04-26T11:47:12.257022+0000","last_became_peered":"2024-04-26T11:47:12.257022+0000","last_unstale":"2024-04-26T11:47:13.167546+0000","last_undegraded":"2024-04-26T11:47:13.167546+0000","last_fullsized":"2024-04-26T11:47:13.167546+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:31.084050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"74'405","reported_seq":569,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.760993+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:12.760993+0000","last_peered":"2024-04-26T11:47:12.760993+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:12.760993+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.454484+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:13.454484+0000","last_peered":"2024-04-26T11:47:13.454484+0000","last_clean":"2024-04-26T11:47:13.454484+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:13.454484+0000","last_undegraded":"2024-04-26T11:47:13.454484+0000","last_fullsized":"2024-04-26T11:47:13.454484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'403","reported_seq":485,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.389337+0000","last_change":"2024-04-26T11:47:12.262102+0000","last_active":"2024-04-26T11:47:12.389337+0000","last_peered":"2024-04-26T11:47:12.389337+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259702+0000","last_became_peered":"2024-04-26T11:47:12.259702+0000","last_unstale":"2024-04-26T11:47:12.389337+0000","last_undegraded":"2024-04-26T11:47:12.156439+0000","last_fullsized":"2024-04-26T11:47:12.146012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":128,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.166336+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:12.166336+0000","last_peered":"2024-04-26T11:47:12.166336+0000","last_clean":"2024-04-26T11:47:12.166336+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:12.166336+0000","last_undegraded":"2024-04-26T11:47:12.166336+0000","last_fullsized":"2024-04-26T11:47:12.166336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"74'385","reported_seq":506,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.362493+0000","last_change":"2024-04-26T11:47:12.245609+0000","last_active":"2024-04-26T11:47:12.362493+0000","last_peered":"2024-04-26T11:47:12.362493+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.241903+0000","last_became_peered":"2024-04-26T11:47:12.241903+0000","last_unstale":"2024-04-26T11:47:12.362493+0000","last_undegraded":"2024-04-26T11:47:12.158911+0000","last_fullsized":"2024-04-26T11:47:12.148743+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:26.552945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-7}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"74'66","reported_seq":134,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.288503+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:12.288503+0000","last_peered":"2024-04-26T11:47:12.288503+0000","last_clean":"2024-04-26T11:47:12.288503+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:12.288503+0000","last_undegraded":"2024-04-26T11:47:12.288503+0000","last_fullsized":"2024-04-26T11:47:12.288503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":282,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394481+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:12.394481+0000","last_peered":"2024-04-26T11:47:12.394481+0000","last_clean":"2024-04-26T11:47:12.394481+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:12.394481+0000","last_undegraded":"2024-04-26T11:47:12.394481+0000","last_fullsized":"2024-04-26T11:47:12.394481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"74'397","reported_seq":491,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.358530+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:12.358530+0000","last_peered":"2024-04-26T11:47:12.358530+0000","last_clean":"2024-04-26T11:47:12.358530+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:12.358530+0000","last_undegraded":"2024-04-26T11:47:12.358530+0000","last_fullsized":"2024-04-26T11:47:12.358530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":460,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.300516+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:12.300516+0000","last_peered":"2024-04-26T11:47:12.300516+0000","last_clean":"2024-04-26T11:47:12.300516+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:12.300516+0000","last_undegraded":"2024-04-26T11:47:12.300516+0000","last_fullsized":"2024-04-26T11:47:12.300516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"74'451","reported_seq":577,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391400+0000","last_change":"2024-04-26T11:47:12.256711+0000","last_active":"2024-04-26T11:47:12.391400+0000","last_peered":"2024-04-26T11:47:12.391400+0000","last_clean":"2024-04-26T11:44:49.185565+0000","last_became_active":"2024-04-26T11:47:12.252329+0000","last_became_peered":"2024-04-26T11:47:12.252329+0000","last_unstale":"2024-04-26T11:47:12.391400+0000","last_undegraded":"2024-04-26T11:47:12.158212+0000","last_fullsized":"2024-04-26T11:47:12.148030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:23.263270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":654,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394571+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:12.394571+0000","last_peered":"2024-04-26T11:47:12.394571+0000","last_clean":"2024-04-26T11:47:12.394571+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:12.394571+0000","last_undegraded":"2024-04-26T11:47:12.394571+0000","last_fullsized":"2024-04-26T11:47:12.394571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"74'441","reported_seq":574,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391351+0000","last_change":"2024-04-26T11:47:12.254082+0000","last_active":"2024-04-26T11:47:12.391351+0000","last_peered":"2024-04-26T11:47:12.391351+0000","last_clean":"2024-04-26T11:44:50.721822+0000","last_became_active":"2024-04-26T11:47:12.251151+0000","last_became_peered":"2024-04-26T11:47:12.251151+0000","last_unstale":"2024-04-26T11:47:12.391351+0000","last_undegraded":"2024-04-26T11:47:12.155484+0000","last_fullsized":"2024-04-26T11:47:12.144270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:40.503436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":143,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.341564+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:12.341564+0000","last_peered":"2024-04-26T11:47:12.341564+0000","last_clean":"2024-04-26T11:47:12.341564+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:12.341564+0000","last_undegraded":"2024-04-26T11:47:12.341564+0000","last_fullsized":"2024-04-26T11:47:12.341564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"74'441","reported_seq":580,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.354154+0000","last_change":"2024-04-26T11:47:12.252630+0000","last_active":"2024-04-26T11:47:12.354154+0000","last_peered":"2024-04-26T11:47:12.354154+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.250306+0000","last_became_peered":"2024-04-26T11:47:12.250306+0000","last_unstale":"2024-04-26T11:47:12.354154+0000","last_undegraded":"2024-04-26T11:47:12.156978+0000","last_fullsized":"2024-04-26T11:47:12.144300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":327,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.419117+0000","last_change":"2024-04-26T11:47:14.419449+0000","last_active":"2024-04-26T11:47:14.419117+0000","last_peered":"2024-04-26T11:47:12.832926+0000","last_clean":"2024-04-26T11:44:21.435988+0000","last_became_active":"2024-04-26T11:47:12.257934+0000","last_became_peered":"2024-04-26T11:47:12.257934+0000","last_unstale":"2024-04-26T11:47:14.419117+0000","last_undegraded":"2024-04-26T11:47:14.419117+0000","last_fullsized":"2024-04-26T11:47:14.419117+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":3}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'418","reported_seq":518,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.387647+0000","last_change":"2024-04-26T11:47:12.257450+0000","last_active":"2024-04-26T11:47:12.387647+0000","last_peered":"2024-04-26T11:47:12.387647+0000","last_clean":"2024-04-26T11:44:50.722159+0000","last_became_active":"2024-04-26T11:47:12.255880+0000","last_became_peered":"2024-04-26T11:47:12.255880+0000","last_unstale":"2024-04-26T11:47:12.387647+0000","last_undegraded":"2024-04-26T11:47:12.165276+0000","last_fullsized":"2024-04-26T11:47:12.156834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.490162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-16}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":236,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164188+0000","last_change":"2024-04-26T11:47:13.164583+0000","last_active":"2024-04-26T11:47:13.164188+0000","last_peered":"2024-04-26T11:47:12.525388+0000","last_clean":"2024-04-26T11:44:50.723083+0000","last_became_active":"2024-04-26T11:47:12.253850+0000","last_became_peered":"2024-04-26T11:47:12.253850+0000","last_unstale":"2024-04-26T11:47:13.164188+0000","last_undegraded":"2024-04-26T11:47:13.164188+0000","last_fullsized":"2024-04-26T11:47:13.164188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:24.810487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"74'396","reported_seq":501,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.337370+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:12.337370+0000","last_peered":"2024-04-26T11:47:12.337370+0000","last_clean":"2024-04-26T11:47:12.337370+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:12.337370+0000","last_undegraded":"2024-04-26T11:47:12.337370+0000","last_fullsized":"2024-04-26T11:47:12.337370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":122,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.307568+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:12.307568+0000","last_peered":"2024-04-26T11:47:12.307568+0000","last_clean":"2024-04-26T11:47:12.307568+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:12.307568+0000","last_undegraded":"2024-04-26T11:47:12.307568+0000","last_fullsized":"2024-04-26T11:47:12.307568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"74'339","reported_seq":441,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.391438+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:12.391438+0000","last_peered":"2024-04-26T11:47:12.391438+0000","last_clean":"2024-04-26T11:47:12.391438+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:12.391438+0000","last_undegraded":"2024-04-26T11:47:12.391438+0000","last_fullsized":"2024-04-26T11:47:12.391438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":587,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.165687+0000","last_change":"2024-04-26T11:47:13.166133+0000","last_active":"2024-04-26T11:47:13.165687+0000","last_peered":"2024-04-26T11:47:12.564825+0000","last_clean":"2024-04-26T11:44:49.185623+0000","last_became_active":"2024-04-26T11:47:12.261412+0000","last_became_peered":"2024-04-26T11:47:12.261412+0000","last_unstale":"2024-04-26T11:47:13.165687+0000","last_undegraded":"2024-04-26T11:47:13.165687+0000","last_fullsized":"2024-04-26T11:47:13.165687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:22.060390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"74'379","reported_seq":490,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386228+0000","last_change":"2024-04-26T11:47:12.257493+0000","last_active":"2024-04-26T11:47:12.386228+0000","last_peered":"2024-04-26T11:47:12.386228+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255726+0000","last_became_peered":"2024-04-26T11:47:12.255726+0000","last_unstale":"2024-04-26T11:47:12.386228+0000","last_undegraded":"2024-04-26T11:47:12.167230+0000","last_fullsized":"2024-04-26T11:47:12.165520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:41.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":270,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.165708+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:12.165708+0000","last_peered":"2024-04-26T11:47:12.165708+0000","last_clean":"2024-04-26T11:47:12.165708+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:12.165708+0000","last_undegraded":"2024-04-26T11:47:12.165708+0000","last_fullsized":"2024-04-26T11:47:12.165708+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.166413+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:12.166413+0000","last_peered":"2024-04-26T11:47:12.166413+0000","last_clean":"2024-04-26T11:47:12.166413+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:12.166413+0000","last_undegraded":"2024-04-26T11:47:12.166413+0000","last_fullsized":"2024-04-26T11:47:12.166413+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":574,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-26T11:47:14.427139+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:14.427139+0000","last_peered":"2024-04-26T11:47:14.427139+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:14.427139+0000","last_undegraded":"2024-04-26T11:47:14.427139+0000","last_fullsized":"2024-04-26T11:47:14.427139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'427","reported_seq":529,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394615+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:12.394615+0000","last_peered":"2024-04-26T11:47:12.394615+0000","last_clean":"2024-04-26T11:47:12.394615+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:12.394615+0000","last_undegraded":"2024-04-26T11:47:12.394615+0000","last_fullsized":"2024-04-26T11:47:12.394615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.165231+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:12.165231+0000","last_peered":"2024-04-26T11:47:12.165231+0000","last_clean":"2024-04-26T11:47:12.165231+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:12.165231+0000","last_undegraded":"2024-04-26T11:47:12.165231+0000","last_fullsized":"2024-04-26T11:47:12.165231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"74'167","reported_seq":319,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.418655+0000","last_change":"2024-04-26T11:47:14.419948+0000","last_active":"2024-04-26T11:47:14.418655+0000","last_peered":"2024-04-26T11:47:12.578926+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:12.254543+0000","last_became_peered":"2024-04-26T11:47:12.254543+0000","last_unstale":"2024-04-26T11:47:14.418655+0000","last_undegraded":"2024-04-26T11:47:14.418655+0000","last_fullsized":"2024-04-26T11:47:14.418655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421777,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":1445,"num_write":93,"num_write_kb":1446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'438","reported_seq":555,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391168+0000","last_change":"2024-04-26T11:47:12.262868+0000","last_active":"2024-04-26T11:47:12.391168+0000","last_peered":"2024-04-26T11:47:12.391168+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:12.391168+0000","last_undegraded":"2024-04-26T11:47:12.156540+0000","last_fullsized":"2024-04-26T11:47:12.146571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:45.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453806+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:13.453806+0000","last_peered":"2024-04-26T11:47:13.453806+0000","last_clean":"2024-04-26T11:47:13.453806+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:13.453806+0000","last_undegraded":"2024-04-26T11:47:13.453806+0000","last_fullsized":"2024-04-26T11:47:13.453806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":491,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.300670+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:12.300670+0000","last_peered":"2024-04-26T11:47:12.300670+0000","last_clean":"2024-04-26T11:47:12.300670+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:12.300670+0000","last_undegraded":"2024-04-26T11:47:12.300670+0000","last_fullsized":"2024-04-26T11:47:12.300670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"74'331","reported_seq":417,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380133+0000","last_change":"2024-04-26T11:47:12.254070+0000","last_active":"2024-04-26T11:47:12.380133+0000","last_peered":"2024-04-26T11:47:12.380133+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.250084+0000","last_became_peered":"2024-04-26T11:47:12.250084+0000","last_unstale":"2024-04-26T11:47:12.380133+0000","last_undegraded":"2024-04-26T11:47:12.165871+0000","last_fullsized":"2024-04-26T11:47:12.161090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:19.765756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":152,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.161632+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:12.161632+0000","last_peered":"2024-04-26T11:47:12.161632+0000","last_clean":"2024-04-26T11:47:12.161632+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:12.161632+0000","last_undegraded":"2024-04-26T11:47:12.161632+0000","last_fullsized":"2024-04-26T11:47:12.161632+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":146,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.387141+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:12.387141+0000","last_peered":"2024-04-26T11:47:12.387141+0000","last_clean":"2024-04-26T11:47:12.387141+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:12.387141+0000","last_undegraded":"2024-04-26T11:47:12.387141+0000","last_fullsized":"2024-04-26T11:47:12.387141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"74'371","reported_seq":465,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.394270+0000","last_change":"2024-04-26T11:47:12.256944+0000","last_active":"2024-04-26T11:47:12.394270+0000","last_peered":"2024-04-26T11:47:12.394270+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255779+0000","last_became_peered":"2024-04-26T11:47:12.255779+0000","last_unstale":"2024-04-26T11:47:12.394270+0000","last_undegraded":"2024-04-26T11:47:12.164475+0000","last_fullsized":"2024-04-26T11:47:12.155432+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:51.100421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":598,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164310+0000","last_change":"2024-04-26T11:47:13.164702+0000","last_active":"2024-04-26T11:47:13.164310+0000","last_peered":"2024-04-26T11:47:12.391164+0000","last_clean":"2024-04-26T11:44:50.722744+0000","last_became_active":"2024-04-26T11:47:12.243398+0000","last_became_peered":"2024-04-26T11:47:12.243398+0000","last_unstale":"2024-04-26T11:47:13.164310+0000","last_undegraded":"2024-04-26T11:47:13.164310+0000","last_fullsized":"2024-04-26T11:47:13.164310+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:26.445411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.452997+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:13.452997+0000","last_peered":"2024-04-26T11:47:13.452997+0000","last_clean":"2024-04-26T11:47:13.452997+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:13.452997+0000","last_undegraded":"2024-04-26T11:47:13.452997+0000","last_fullsized":"2024-04-26T11:47:13.452997+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'336","reported_seq":438,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.391321+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:12.391321+0000","last_peered":"2024-04-26T11:47:12.391321+0000","last_clean":"2024-04-26T11:47:12.391321+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:12.391321+0000","last_undegraded":"2024-04-26T11:47:12.391321+0000","last_fullsized":"2024-04-26T11:47:12.391321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453822+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:13.453822+0000","last_peered":"2024-04-26T11:47:13.453822+0000","last_clean":"2024-04-26T11:47:13.453822+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:13.453822+0000","last_undegraded":"2024-04-26T11:47:13.453822+0000","last_fullsized":"2024-04-26T11:47:13.453822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.160723+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:12.160723+0000","last_peered":"2024-04-26T11:47:12.160723+0000","last_clean":"2024-04-26T11:47:12.160723+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:12.160723+0000","last_undegraded":"2024-04-26T11:47:12.160723+0000","last_fullsized":"2024-04-26T11:47:12.160723+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"74'380","reported_seq":480,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.391722+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:12.391722+0000","last_peered":"2024-04-26T11:47:12.391722+0000","last_clean":"2024-04-26T11:47:12.391722+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:12.391722+0000","last_undegraded":"2024-04-26T11:47:12.391722+0000","last_fullsized":"2024-04-26T11:47:12.391722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.455709+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:13.455709+0000","last_peered":"2024-04-26T11:47:13.455709+0000","last_clean":"2024-04-26T11:47:13.455709+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:13.455709+0000","last_undegraded":"2024-04-26T11:47:13.455709+0000","last_fullsized":"2024-04-26T11:47:13.455709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453264+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:13.453264+0000","last_peered":"2024-04-26T11:47:13.453264+0000","last_clean":"2024-04-26T11:47:13.453264+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:13.453264+0000","last_undegraded":"2024-04-26T11:47:13.453264+0000","last_fullsized":"2024-04-26T11:47:13.453264+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'384","reported_seq":457,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.391265+0000","last_change":"2024-04-26T11:47:12.265335+0000","last_active":"2024-04-26T11:47:12.391265+0000","last_peered":"2024-04-26T11:47:12.391265+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:12.391265+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"74'70","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.453367+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:13.453367+0000","last_peered":"2024-04-26T11:47:13.453367+0000","last_clean":"2024-04-26T11:47:13.453367+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:13.453367+0000","last_undegraded":"2024-04-26T11:47:13.453367+0000","last_fullsized":"2024-04-26T11:47:13.453367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.160630+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:12.160630+0000","last_peered":"2024-04-26T11:47:12.160630+0000","last_clean":"2024-04-26T11:47:12.160630+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:12.160630+0000","last_undegraded":"2024-04-26T11:47:12.160630+0000","last_fullsized":"2024-04-26T11:47:12.160630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"74'391","reported_seq":515,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.366094+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:12.366094+0000","last_peered":"2024-04-26T11:47:12.366094+0000","last_clean":"2024-04-26T11:47:12.366094+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:12.366094+0000","last_undegraded":"2024-04-26T11:47:12.366094+0000","last_fullsized":"2024-04-26T11:47:12.366094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"74'412","reported_seq":517,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.379295+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:12.379295+0000","last_peered":"2024-04-26T11:47:12.379295+0000","last_clean":"2024-04-26T11:47:12.379295+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:12.379295+0000","last_undegraded":"2024-04-26T11:47:12.379295+0000","last_fullsized":"2024-04-26T11:47:12.379295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":479,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.377124+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:12.377124+0000","last_peered":"2024-04-26T11:47:12.377124+0000","last_clean":"2024-04-26T11:47:12.377124+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:12.377124+0000","last_undegraded":"2024-04-26T11:47:12.377124+0000","last_fullsized":"2024-04-26T11:47:12.377124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"74'414","reported_seq":516,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.163327+0000","last_change":"2024-04-26T11:47:12.261430+0000","last_active":"2024-04-26T11:47:13.163327+0000","last_peered":"2024-04-26T11:47:13.163327+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259639+0000","last_became_peered":"2024-04-26T11:47:12.259639+0000","last_unstale":"2024-04-26T11:47:13.163327+0000","last_undegraded":"2024-04-26T11:47:12.167836+0000","last_fullsized":"2024-04-26T11:47:12.160846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:57.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"74'102","reported_seq":170,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.396076+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:12.396076+0000","last_peered":"2024-04-26T11:47:12.396076+0000","last_clean":"2024-04-26T11:47:12.396076+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:12.396076+0000","last_undegraded":"2024-04-26T11:47:12.396076+0000","last_fullsized":"2024-04-26T11:47:12.396076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":419,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164948+0000","last_change":"2024-04-26T11:47:13.166538+0000","last_active":"2024-04-26T11:47:13.164948+0000","last_peered":"2024-04-26T11:47:12.868366+0000","last_clean":"2024-04-26T11:44:50.723214+0000","last_became_active":"2024-04-26T11:47:12.261856+0000","last_became_peered":"2024-04-26T11:47:12.261856+0000","last_unstale":"2024-04-26T11:47:13.164948+0000","last_undegraded":"2024-04-26T11:47:13.164948+0000","last_fullsized":"2024-04-26T11:47:13.164948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:06.537844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"74'457","reported_seq":546,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.159909+0000","last_change":"2024-04-26T11:47:12.254913+0000","last_active":"2024-04-26T11:47:13.159909+0000","last_peered":"2024-04-26T11:47:13.159909+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251682+0000","last_became_peered":"2024-04-26T11:47:12.251682+0000","last_unstale":"2024-04-26T11:47:13.159909+0000","last_undegraded":"2024-04-26T11:47:12.157689+0000","last_fullsized":"2024-04-26T11:47:12.143256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:13.489428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":203,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.456185+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:13.456185+0000","last_peered":"2024-04-26T11:47:13.456185+0000","last_clean":"2024-04-26T11:47:13.456185+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:13.456185+0000","last_undegraded":"2024-04-26T11:47:13.456185+0000","last_fullsized":"2024-04-26T11:47:13.456185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'441","reported_seq":555,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:13.163079+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:13.163079+0000","last_peered":"2024-04-26T11:47:13.163079+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:13.163079+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"74'360","reported_seq":472,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.384613+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:12.384613+0000","last_peered":"2024-04-26T11:47:12.384613+0000","last_clean":"2024-04-26T11:47:12.384613+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:12.384613+0000","last_undegraded":"2024-04-26T11:47:12.384613+0000","last_fullsized":"2024-04-26T11:47:12.384613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":830,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.418345+0000","last_change":"2024-04-26T11:47:14.418746+0000","last_active":"2024-04-26T11:47:14.418345+0000","last_peered":"2024-04-26T11:47:12.655146+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:12.263598+0000","last_became_peered":"2024-04-26T11:47:12.263598+0000","last_unstale":"2024-04-26T11:47:14.418345+0000","last_undegraded":"2024-04-26T11:47:14.418345+0000","last_fullsized":"2024-04-26T11:47:14.418345+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'380","reported_seq":470,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.386110+0000","last_change":"2024-04-26T11:47:12.262558+0000","last_active":"2024-04-26T11:47:12.386110+0000","last_peered":"2024-04-26T11:47:12.386110+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.260513+0000","last_became_peered":"2024-04-26T11:47:12.260513+0000","last_unstale":"2024-04-26T11:47:12.386110+0000","last_undegraded":"2024-04-26T11:47:12.161322+0000","last_fullsized":"2024-04-26T11:47:12.156833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:46.502879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":387,"reported_epoch":76,"state":"activating","last_fresh":"2024-04-26T11:47:14.418773+0000","last_change":"2024-04-26T11:47:14.419126+0000","last_active":"2024-04-26T11:47:14.418773+0000","last_peered":"2024-04-26T11:47:12.692702+0000","last_clean":"2024-04-26T11:44:20.031920+0000","last_became_active":"2024-04-26T11:47:12.254760+0000","last_became_peered":"2024-04-26T11:47:12.254760+0000","last_unstale":"2024-04-26T11:47:14.418773+0000","last_undegraded":"2024-04-26T11:47:14.418773+0000","last_fullsized":"2024-04-26T11:47:14.418773+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'370","reported_seq":484,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.394315+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:12.394315+0000","last_peered":"2024-04-26T11:47:12.394315+0000","last_clean":"2024-04-26T11:47:12.394315+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:12.394315+0000","last_undegraded":"2024-04-26T11:47:12.394315+0000","last_fullsized":"2024-04-26T11:47:12.394315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"74'349","reported_seq":439,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.165692+0000","last_change":"2024-04-26T11:47:13.166133+0000","last_active":"2024-04-26T11:47:13.165692+0000","last_peered":"2024-04-26T11:47:12.489133+0000","last_clean":"2024-04-26T11:44:49.186164+0000","last_became_active":"2024-04-26T11:47:12.251407+0000","last_became_peered":"2024-04-26T11:47:12.251407+0000","last_unstale":"2024-04-26T11:47:13.165692+0000","last_undegraded":"2024-04-26T11:47:13.165692+0000","last_fullsized":"2024-04-26T11:47:13.165692+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:15.939830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11895685,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":11786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"74'360","reported_seq":471,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.371794+0000","last_change":"2024-04-26T11:47:12.252278+0000","last_active":"2024-04-26T11:47:12.371794+0000","last_peered":"2024-04-26T11:47:12.371794+0000","last_clean":"2024-04-26T11:44:49.186726+0000","last_became_active":"2024-04-26T11:47:12.247841+0000","last_became_peered":"2024-04-26T11:47:12.247841+0000","last_unstale":"2024-04-26T11:47:12.371794+0000","last_undegraded":"2024-04-26T11:47:12.157717+0000","last_fullsized":"2024-04-26T11:47:12.147708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:40.552007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":162,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-10}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.163909+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:12.163909+0000","last_peered":"2024-04-26T11:47:12.163909+0000","last_clean":"2024-04-26T11:47:12.163909+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:12.163909+0000","last_undegraded":"2024-04-26T11:47:12.163909+0000","last_fullsized":"2024-04-26T11:47:12.163909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"74'369","reported_seq":498,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.380870+0000","last_change":"2024-04-26T11:47:12.259550+0000","last_active":"2024-04-26T11:47:12.380870+0000","last_peered":"2024-04-26T11:47:12.380870+0000","last_clean":"2024-04-26T11:44:50.722361+0000","last_became_active":"2024-04-26T11:47:12.256906+0000","last_became_peered":"2024-04-26T11:47:12.256906+0000","last_unstale":"2024-04-26T11:47:12.380870+0000","last_undegraded":"2024-04-26T11:47:12.156736+0000","last_fullsized":"2024-04-26T11:47:12.144812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:25.280569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":361,"reported_epoch":75,"state":"peering","last_fresh":"2024-04-26T11:47:13.164357+0000","last_change":"2024-04-26T11:47:13.164767+0000","last_active":"2024-04-26T11:47:13.164357+0000","last_peered":"2024-04-26T11:47:12.396143+0000","last_clean":"2024-04-26T11:44:50.722396+0000","last_became_active":"2024-04-26T11:47:12.249342+0000","last_became_peered":"2024-04-26T11:47:12.249342+0000","last_unstale":"2024-04-26T11:47:13.164357+0000","last_undegraded":"2024-04-26T11:47:13.164357+0000","last_fullsized":"2024-04-26T11:47:13.164357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:26.375129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"74'384","reported_seq":494,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.393015+0000","last_change":"2024-04-26T11:47:12.254097+0000","last_active":"2024-04-26T11:47:12.393015+0000","last_peered":"2024-04-26T11:47:12.393015+0000","last_clean":"2024-04-26T11:44:50.722199+0000","last_became_active":"2024-04-26T11:47:12.251646+0000","last_became_peered":"2024-04-26T11:47:12.251646+0000","last_unstale":"2024-04-26T11:47:12.393015+0000","last_undegraded":"2024-04-26T11:47:12.161281+0000","last_fullsized":"2024-04-26T11:47:12.156381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:20.045697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":397,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-26T11:47:12.322536+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:12.322536+0000","last_peered":"2024-04-26T11:47:12.322536+0000","last_clean":"2024-04-26T11:47:12.322536+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:12.322536+0000","last_undegraded":"2024-04-26T11:47:12.322536+0000","last_fullsized":"2024-04-26T11:47:12.322536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":518,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.388572+0000","last_change":"2024-04-26T11:47:12.254202+0000","last_active":"2024-04-26T11:47:12.388572+0000","last_peered":"2024-04-26T11:47:12.388572+0000","last_clean":"2024-04-26T11:44:49.185959+0000","last_became_active":"2024-04-26T11:47:12.252111+0000","last_became_peered":"2024-04-26T11:47:12.252111+0000","last_unstale":"2024-04-26T11:47:12.388572+0000","last_undegraded":"2024-04-26T11:47:12.160789+0000","last_fullsized":"2024-04-26T11:47:12.146173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:57.514673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-10}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.456417+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:13.456417+0000","last_peered":"2024-04-26T11:47:13.456417+0000","last_clean":"2024-04-26T11:47:13.456417+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:13.456417+0000","last_undegraded":"2024-04-26T11:47:13.456417+0000","last_fullsized":"2024-04-26T11:47:13.456417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'428","reported_seq":536,"reported_epoch":74,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:12.381352+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:12.381352+0000","last_peered":"2024-04-26T11:47:12.381352+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:12.381352+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T11:47:13.455316+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:13.455316+0000","last_peered":"2024-04-26T11:47:13.455316+0000","last_clean":"2024-04-26T11:47:13.455316+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:13.455316+0000","last_undegraded":"2024-04-26T11:47:13.455316+0000","last_fullsized":"2024-04-26T11:47:13.455316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7795,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25552,"ondisk_log_size":25552,"up":128,"acting":84,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":126565140,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":92,"num_read_kb":1445,"num_write":6021,"num_write_kb":127746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253198336,"data_stored":253130280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7869,"ondisk_log_size":7869,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738409,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200076,"kb_used_data":88636,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171764,"statfs":{"total":96636764160,"available":96431886336,"internally_reserved":0,"allocated":90763264,"data_stored":90397615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":1,"up_from":72,"seq":309237645314,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110808,"kb_used_data":79176,"kb_used_omap":6,"kb_used_meta":31609,"kb_avail":94261032,"statfs":{"total":96636764160,"available":96523296768,"internally_reserved":0,"allocated":81076224,"data_stored":80730558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":32367872},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189808,"kb_used_data":82468,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94182032,"statfs":{"total":96636764160,"available":96442400768,"internally_reserved":0,"allocated":84447232,"data_stored":84091557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83222528,"data_stored":83199707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80441344,"data_stored":80426942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:18.753 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:18.751+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:18.792 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:18.792 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:18.804 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:47:18.854 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:18.851+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:18.917 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:18.917 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:18.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:47:18.957 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:19.243+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:19.043 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:19.043 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:19.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:47:19.065 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:19.063+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:19.157 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:47:19.155+0000 7fa0f6b29700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18210) UID: 0 2024-04-26T11:47:19.179 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:19.179 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:19.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:47:19.238 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:47:19.240 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:47:19.258 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:19.547+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:19.298 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:19.298 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:19.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:47:19.359 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:19.647+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:19.419 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:47:19.419 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:47:19.430 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:47:19.439 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:47:19.460 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:47:19.456+0000 7fde8351d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18321) UID: 0 2024-04-26T11:47:19.462 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:47:19.485 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:47:19.487 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:47:19.487 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:47:19.487 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:47:19.509 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T11:47:19.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:47:19.509 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T11:47:19.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:47:19.528 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-04-26T11:47:19.546 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:19.546 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:19.546 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:47:19.546 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:19.556 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:47:19.560 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:19.847+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:19.577 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T11:47:19.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:47:19.578 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T11:47:19.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:47:19.592 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-04-26T11:47:19.661 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:47:19.951+0000 7fc377aa0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 1408) UID: 0 2024-04-26T11:47:19.708 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T11:47:19.752 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T11:47:19.753 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:19.753 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:47:19.754 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:47:19.754 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:47:19.754 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:19.754 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:47:19.864 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:47:19.864 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:47:19.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:47:19.864 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:47:19.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.864 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1108 3.13 3:cb3d3880:::200.0000000d:head [write 2523547~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.864 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.716151797000002, 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0483501, 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142752+0000", 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142751+0000", 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142756+0000", 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142764+0000", 2024-04-26T11:47:19.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142769+0000", 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8220000000000003e-06 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176027+0000", 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.033257264000000002 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.176150+0000", 2024-04-26T11:47:19.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012292999999999999 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190839+0000", 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014689413 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190933+0000", 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3993000000000006e-05 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191102+0000", 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016864500000000001 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1109 3.13 3:cb3d3880:::200.0000000d:head [write 2524950~2261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.716126580000001, 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048518682, 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142777+0000", 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142776+0000", 2024-04-26T11:47:19.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:19.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142785+0000", 2024-04-26T11:47:19.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.054e-06 2024-04-26T11:47:19.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142793+0000", 2024-04-26T11:47:19.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142805+0000", 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2503e-05 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177568+0000", 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034762459000000002 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.177740+0000", 2024-04-26T11:47:19.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017227599999999999 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191116+0000", 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013375809000000001 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191207+0000", 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1367999999999997e-05 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191295+0000", 2024-04-26T11:47:19.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8140999999999995e-05 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1110 3.13 3:cb3d3880:::200.0000000d:head [write 2527211~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.716090493999999, 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048817847999999997, 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142813+0000", 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142812+0000", 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142817+0000", 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142825+0000", 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142833+0000", 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5789999999999998e-06 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178121+0000", 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035287850000000003 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.178221+0000", 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100571 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191341+0000", 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013119574 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191454+0000", 2024-04-26T11:47:19.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113702 2024-04-26T11:47:19.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191631+0000", 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000176331 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1111 3.13 3:cb3d3880:::200.0000000d:head [write 2528616~2259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:19.879 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.716063671999997, 2024-04-26T11:47:19.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.04908328, 2024-04-26T11:47:19.880 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.880 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.880 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:19.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142840+0000", 2024-04-26T11:47:19.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142839+0000", 2024-04-26T11:47:19.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:19.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142852+0000", 2024-04-26T11:47:19.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3236e-05 2024-04-26T11:47:19.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142861+0000", 2024-04-26T11:47:19.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2840000000000006e-06 2024-04-26T11:47:19.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.142868+0000", 2024-04-26T11:47:19.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:47:19.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.179958+0000", 2024-04-26T11:47:19.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037090172999999997 2024-04-26T11:47:19.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180003+0000", 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5566999999999999e-05 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191650+0000", 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011646154000000001 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191752+0000", 2024-04-26T11:47:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010282500000000001 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.191923+0000", 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000170629 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1112 3.13 3:cb3d3880:::200.0000000d:head [write 2530875~11623 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.713464434000002, 2024-04-26T11:47:19.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052154120999999998, 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145439+0000", 2024-04-26T11:47:19.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145438+0000", 2024-04-26T11:47:19.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:19.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145525+0000", 2024-04-26T11:47:19.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7095000000000006e-05 2024-04-26T11:47:19.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145534+0000", 2024-04-26T11:47:19.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8200000000000003e-06 2024-04-26T11:47:19.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145538+0000", 2024-04-26T11:47:19.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7239999999999998e-06 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180834+0000", 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035295998000000002 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.180930+0000", 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6230000000000005e-05 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197457+0000", 2024-04-26T11:47:19.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016526585999999999 2024-04-26T11:47:19.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197533+0000", 2024-04-26T11:47:19.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6039999999999997e-05 2024-04-26T11:47:19.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197593+0000", 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0331000000000002e-05 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1113 3.13 3:cb3d3880:::200.0000000d:head [write 2542498~2805 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.712987175999999, 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051787958000000002, 2024-04-26T11:47:19.891 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145916+0000", 2024-04-26T11:47:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145915+0000", 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145921+0000", 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145927+0000", 2024-04-26T11:47:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.959e-06 2024-04-26T11:47:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.145930+0000", 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.422e-06 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183048+0000", 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037117967000000002 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.183212+0000", 2024-04-26T11:47:19.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016447599999999999 2024-04-26T11:47:19.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197602+0000", 2024-04-26T11:47:19.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014389544000000001 2024-04-26T11:47:19.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197640+0000", 2024-04-26T11:47:19.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7734000000000002e-05 2024-04-26T11:47:19.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197704+0000", 2024-04-26T11:47:19.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4383999999999999e-05 2024-04-26T11:47:19.897 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.897 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.897 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.897 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1116 3.13 3:cb3d3880:::200.0000000d:head [write 2545303~15476 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.708919973999997, 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051315685999999999, 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.149983+0000", 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150017+0000", 2024-04-26T11:47:19.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4357000000000003e-05 2024-04-26T11:47:19.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150024+0000", 2024-04-26T11:47:19.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-26T11:47:19.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150028+0000", 2024-04-26T11:47:19.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.715e-06 2024-04-26T11:47:19.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186272+0000", 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036243648000000003 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.186374+0000", 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010249 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201156+0000", 2024-04-26T11:47:19.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014781771000000001 2024-04-26T11:47:19.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201215+0000", 2024-04-26T11:47:19.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8570000000000003e-05 2024-04-26T11:47:19.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201299+0000", 2024-04-26T11:47:19.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4450999999999995e-05 2024-04-26T11:47:19.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1117 3.13 3:cb3d3880:::200.0000000d:head [write 2560779~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.708755854000003, 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.053980495000000003, 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150147+0000", 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:19.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150152+0000", 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9289999999999997e-06 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150157+0000", 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0250000000000002e-06 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.150161+0000", 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9979999999999997e-06 2024-04-26T11:47:19.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.189930+0000", 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039769421999999999 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.190048+0000", 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117957 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204026+0000", 2024-04-26T11:47:19.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013977616 2024-04-26T11:47:19.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204071+0000", 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5348e-05 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.204128+0000", 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6910999999999998e-05 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.910 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1118 3.13 3:cb3d3880:::200.0000000d:head [write 2563229~9796 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.705823193999997, 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054972812000000003, 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153080+0000", 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153079+0000", 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:19.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153092+0000", 2024-04-26T11:47:19.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2882e-05 2024-04-26T11:47:19.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153104+0000", 2024-04-26T11:47:19.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.202e-05 2024-04-26T11:47:19.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.153114+0000", 2024-04-26T11:47:19.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0344e-05 2024-04-26T11:47:19.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192064+0000", 2024-04-26T11:47:19.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038949689000000003 2024-04-26T11:47:19.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192236+0000", 2024-04-26T11:47:19.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171948 2024-04-26T11:47:19.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.207977+0000", 2024-04-26T11:47:19.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015740780999999999 2024-04-26T11:47:19.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208005+0000", 2024-04-26T11:47:19.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8462999999999998e-05 2024-04-26T11:47:19.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208053+0000", 2024-04-26T11:47:19.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7672e-05 2024-04-26T11:47:19.917 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.917 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.917 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4541.0:11671 4.13 4:cae5e35d:::100000031d8.00000000:head [write 293785~11819] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.703640602999997, 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052922534, 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4541", 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/3501606203", 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 11671 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.918 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155263+0000", 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155262+0000", 2024-04-26T11:47:19.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155278+0000", 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6475000000000001e-05 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155289+0000", 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.155297+0000", 2024-04-26T11:47:19.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5950000000000001e-06 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192033+0000", 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036736357999999997 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192172+0000", 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013879100000000001 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:47:19.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.192357+0000", 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018491199999999999 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200300+0000", 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079438519999999995 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208132+0000", 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078316099999999993 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208156+0000", 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3672999999999998e-05 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208185+0000", 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9569000000000001e-05 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1119 3.13 3:cb3d3880:::200.0000000d:head [write 2573025~5619 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:19.923 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.701129567999999, 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050351234000000002, 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157774+0000", 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157773+0000", 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157784+0000", 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0913e-05 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157797+0000", 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3251000000000001e-05 2024-04-26T11:47:19.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.157804+0000", 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193656+0000", 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035852819000000001 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.193864+0000", 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020801500000000001 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208062+0000", 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014197278000000001 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208086+0000", 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513999999999999e-05 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208125+0000", 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8757999999999997e-05 2024-04-26T11:47:19.927 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1120 3.13 3:cb3d3880:::200.0000000d:head [write 2578644~8222 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.698734926999997, 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048749195000000002, 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:19.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160168+0000", 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160167+0000", 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160178+0000", 2024-04-26T11:47:19.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0787e-05 2024-04-26T11:47:19.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160192+0000", 2024-04-26T11:47:19.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4238e-05 2024-04-26T11:47:19.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160199+0000", 2024-04-26T11:47:19.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.754e-06 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194850+0000", 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034650800000000002 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.194990+0000", 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014002400000000001 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208854+0000", 2024-04-26T11:47:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013864009 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208880+0000", 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6409000000000001e-05 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.208918+0000", 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7209999999999998e-05 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1121 3.13 3:cb3d3880:::200.0000000d:head [write 2586866~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.698549868000001, 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049750906999999997, 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160353+0000", 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160377+0000", 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160386+0000", 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9430000000000006e-06 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160390+0000", 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8039999999999999e-06 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196286+0000", 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035895943 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.196426+0000", 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140617 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210037+0000", 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01361103 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210064+0000", 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7059999999999998e-05 2024-04-26T11:47:19.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210104+0000", 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0132000000000001e-05 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1122 3.13 3:cb3d3880:::200.0000000d:head [write 2588788~4824 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.698509981999997, 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.049771653999999999, 2024-04-26T11:47:19.937 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160393+0000", 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160399+0000", 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160411+0000", 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2330000000000001e-05 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.160415+0000", 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2849999999999999e-06 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.197802+0000", 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037387384000000003 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.198044+0000", 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024194099999999999 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210109+0000", 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012064741 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210131+0000", 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2665000000000001e-05 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210165+0000", 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714000000000003e-05 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.941 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1123 3.13 3:cb3d3880:::200.0000000d:head [write 2593612~7988 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.696770737999998, 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048097262000000002, 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162133+0000", 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162132+0000", 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162142+0000", 2024-04-26T11:47:19.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7000000000000003e-06 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162155+0000", 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3390000000000001e-05 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162163+0000", 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2940000000000006e-06 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199112+0000", 2024-04-26T11:47:19.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036948812999999997 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.199226+0000", 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113878 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210168+0000", 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010942478 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210190+0000", 2024-04-26T11:47:19.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1180999999999999e-05 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210230+0000", 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0329e-05 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1124 3.13 3:cb3d3880:::200.0000000d:head [write 2601600~9058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.696069029, 2024-04-26T11:47:19.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047457863000000003, 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162834+0000", 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162833+0000", 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162853+0000", 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0080000000000001e-05 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162878+0000", 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4813000000000001e-05 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.162883+0000", 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5680000000000001e-06 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200295+0000", 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037412036000000003 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.200392+0000", 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6798000000000004e-05 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210233+0000", 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098415459999999996 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210257+0000", 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3492000000000001e-05 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210292+0000", 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5460000000000003e-05 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.950 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1125 3.13 3:cb3d3880:::200.0000000d:head [write 2610658~15790 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.692189597999999, 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043644896000000002, 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166714+0000", 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166713+0000", 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166726+0000", 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3175e-05 2024-04-26T11:47:19.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166732+0000", 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166737+0000", 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201335+0000", 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034597158000000003 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.201391+0000", 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6647000000000002e-05 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210296+0000", 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089043149999999995 2024-04-26T11:47:19.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210325+0000", 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9876999999999999e-05 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210359+0000", 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3256999999999997e-05 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.956 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1126 3.13 3:cb3d3880:::200.0000000d:head [write 2626448~1923 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-26T11:47:19.956 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:19.956 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.692160758999997, 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043674712999999997, 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166743+0000", 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166742+0000", 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166745+0000", 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9390000000000002e-06 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166749+0000", 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9740000000000004e-06 2024-04-26T11:47:19.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.166753+0000", 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639999999999999e-06 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203515+0000", 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036762454 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.203591+0000", 2024-04-26T11:47:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5741000000000005e-05 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210362+0000", 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067711569999999999 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210383+0000", 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0869e-05 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:46:37.210417+0000", 2024-04-26T11:47:19.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20067 3.1 3:86ee9bce:::500.00000001:head [write 1346633~101] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e73)", 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:47:11.126868+0000", 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.7320356110000006, 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.136826205, 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126868+0000", 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126868+0000", 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126864+0000", 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999967 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126883+0000", 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8836000000000001e-05 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126926+0000", 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2202e-05 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.126953+0000", 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7217e-05 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.127093+0000", 2024-04-26T11:47:19.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013991000000000001 2024-04-26T11:47:19.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:47:19.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.127110+0000", 2024-04-26T11:47:19.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7583000000000001e-05 2024-04-26T11:47:19.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.141336+0000", 2024-04-26T11:47:19.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014226157 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.141347+0000", 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0292000000000001e-05 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.255212+0000", 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1138653009999999 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.255426+0000", 2024-04-26T11:47:19.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000214284 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.255654+0000", 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022803400000000001 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.257699+0000", 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002044246 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:19.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.263544+0000", 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058457220000000002 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.263607+0000", 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3087000000000001e-05 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.263694+0000", 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6594000000000005e-05 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20068 3.1 3:86ee9bce:::500.00000001:head [write 1346734~62216] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e73)", 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:47:11.809532+0000", 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.0493718449999996, 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.454506254, 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809532+0000", 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809532+0000", 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809528+0000", 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999962 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809687+0000", 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015904299999999999 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809737+0000", 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9854000000000001e-05 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809761+0000", 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4168e-05 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809878+0000", 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116669 2024-04-26T11:47:19.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:11.809899+0000", 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1562000000000001e-05 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.256703+0000", 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.44680386999999999 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.256806+0000", 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010312 2024-04-26T11:47:19.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.256961+0000", 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000154721 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.258491+0000", 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015299370000000001 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.263901+0000", 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054102589999999997 2024-04-26T11:47:19.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.263959+0000", 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7729999999999998e-05 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:47:12.264038+0000", 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9060999999999994e-05 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:47:19.973 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:47:19.975 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:47:20.097 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:47:20.097 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:47:20.097 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 0 2024-04-26T11:47:20.097 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:47:20.107 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:47:20.151 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:47:20.214 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:47:20.215 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:47:20.215 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:47:20.215 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:47:20.215 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:47:20.225 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:47:20.337 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:20067 3.1 3.73d97761 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:11.090319+0000", 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.5364790589999995, 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.35169779800000001, 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090319+0000", 2024-04-26T11:47:20.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090319+0000", 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090317+0000", 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999976 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090330+0000", 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3216e-05 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090353+0000", 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3303e-05 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090377+0000", 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3351999999999999e-05 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.090505+0000", 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000128725 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.091273+0000", 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00076794700000000005 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.442004+0000", 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.35073039099999997 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:11.442017+0000", 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3304e-05 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:20070 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.432595+0000", 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.1942033120000008, 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.118037163, 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432595+0000", 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432595+0000", 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432592+0000", 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999967 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432621+0000", 2024-04-26T11:47:20.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8819e-05 2024-04-26T11:47:20.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432656+0000", 2024-04-26T11:47:20.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5741999999999998e-05 2024-04-26T11:47:20.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432679+0000", 2024-04-26T11:47:20.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2055000000000001e-05 2024-04-26T11:47:20.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432815+0000", 2024-04-26T11:47:20.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136439 2024-04-26T11:47:20.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op must wait for map", 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.432828+0000", 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2869e-05 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.437223+0000", 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004395576 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.437455+0000", 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000231485 2024-04-26T11:47:20.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.437711+0000", 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00025605700000000002 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.440270+0000", 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0025592670000000001 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550496+0000", 2024-04-26T11:47:20.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.110225868 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550565+0000", 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9387000000000005e-05 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550632+0000", 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6725999999999998e-05 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(mds.0.3:20070 3.6 e74/72 ondisk, result = 0)", 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.487060+0000", 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.1397384220000006, 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063579518000000002, 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487060+0000", 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487060+0000", 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487059+0000", 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487064+0000", 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7539999999999997e-06 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487072+0000", 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4850000000000003e-06 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.487084+0000", 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.226e-05 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550476+0000", 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063392335999999994 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550489+0000", 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3114e-05 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.550639+0000", 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000150078 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20069 3.1a e74/73 3:5d7bf03a:::200.0000001e:head v 74'343, mlcod=0'0)", 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.544647+0000", 2024-04-26T11:47:20.353 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0821515979999994, 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065705299999999998, 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544647+0000", 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544647+0000", 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544646+0000", 2024-04-26T11:47:20.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544652+0000", 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2859999999999999e-06 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544660+0000", 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9899999999999997e-06 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544668+0000", 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2330000000000006e-06 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544704+0000", 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6325999999999997e-05 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.544726+0000", 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1406000000000001e-05 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.551132+0000", 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064065099999999998 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.551217+0000", 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5152000000000001e-05 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20067 3.1 e74/73 3:86ee9bce:::500.00000001:head v 74'160, mlcod=0'0)", 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.547534+0000", 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0792645319999998, 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072860440000000002, 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.358 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547534+0000", 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547534+0000", 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547533+0000", 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:20.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547538+0000", 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2279999999999998e-06 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547546+0000", 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2740000000000002e-06 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547553+0000", 2024-04-26T11:47:20.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1949999999999997e-06 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547649+0000", 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6606000000000003e-05 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.547666+0000", 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6982000000000001e-05 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.554785+0000", 2024-04-26T11:47:20.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.007118231 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.554820+0000", 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5308999999999997e-05 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20368 4.3a e74/73 4:5d1117a7:::10000002c6a.00000000:head v 74'355, mlcod=55'131)", 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612067+0000", 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0147315989999992, 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068563560000000001, 2024-04-26T11:47:20.362 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612067+0000", 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612067+0000", 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612066+0000", 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612070+0000", 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.501e-06 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612076+0000", 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4060000000000002e-06 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612082+0000", 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5840000000000002e-06 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612120+0000", 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8520999999999999e-05 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612144+0000", 2024-04-26T11:47:20.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3533999999999999e-05 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618880+0000", 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067365519999999998 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618923+0000", 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2654000000000002e-05 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.366 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20363 4.1b e74/73 4:d88b9922:::10000002c65.00000000:head v 74'361, mlcod=55'122)", 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0145803349999998, 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067285640000000002, 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:20.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612218+0000", 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612222+0000", 2024-04-26T11:47:20.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.904e-06 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612229+0000", 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6939999999999998e-06 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612234+0000", 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7330000000000003e-06 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612270+0000", 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6350999999999998e-05 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612284+0000", 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4015999999999999e-05 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618913+0000", 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066287610000000004 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618947+0000", 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3609999999999998e-05 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20375 4.20 e74/73 4:067da67c:::10000002c71.00000000:head v 74'397, mlcod=56'165)", 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0144498510000002, 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066753719999999997, 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.371 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612348+0000", 2024-04-26T11:47:20.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612354+0000", 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5390000000000004e-06 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612383+0000", 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8297e-05 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612388+0000", 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7289999999999997e-06 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612441+0000", 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2989999999999999e-05 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612459+0000", 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8139999999999999e-05 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618998+0000", 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065383940000000003 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619024+0000", 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6001000000000001e-05 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20364 4.2e e74/73 4:7662bab1:::10000002c66.00000000:head v 74'394, mlcod=56'136)", 2024-04-26T11:47:20.375 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612532+0000", 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0142662819999995, 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068009960000000001, 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612532+0000", 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612532+0000", 2024-04-26T11:47:20.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612531+0000", 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612540+0000", 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.789e-06 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612570+0000", 2024-04-26T11:47:20.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9685000000000001e-05 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612577+0000", 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6710000000000002e-06 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612620+0000", 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3729000000000001e-05 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612641+0000", 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0840999999999999e-05 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619229+0000", 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065881230000000004 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619333+0000", 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010380899999999999 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.379 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20377 4.35 e74/73 4:af418736:::10000002c73.00000000:head v 74'357, mlcod=56'133)", 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612576+0000", 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0142224130000006, 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064137359999999997, 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612576+0000", 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612576+0000", 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612575+0000", 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612581+0000", 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8730000000000004e-06 2024-04-26T11:47:20.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612590+0000", 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1390000000000001e-06 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612597+0000", 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0190000000000001e-06 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612646+0000", 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8401e-05 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612666+0000", 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0506e-05 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618954+0000", 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0062876729999999997 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618990+0000", 2024-04-26T11:47:20.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5787999999999997e-05 2024-04-26T11:47:20.384 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.384 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.384 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.384 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20374 4.9 e74/73 4:90575f50:::10000002c70.00000000:head v 74'442, mlcod=55'154)", 2024-04-26T11:47:20.384 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612589+0000", 2024-04-26T11:47:20.384 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0142097410000002, 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064489930000000001, 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612589+0000", 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612589+0000", 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612588+0000", 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612593+0000", 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6829999999999999e-06 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612599+0000", 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:47:20.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612604+0000", 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612652+0000", 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7985000000000002e-05 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612669+0000", 2024-04-26T11:47:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6969e-05 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618987+0000", 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063184030000000002 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619038+0000", 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0309999999999998e-05 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20362 4.28 e74/73 4:17c7e931:::10000002c64.00000000:head v 74'421, mlcod=55'144)", 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0141818619999992, 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064307469999999997, 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612616+0000", 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612620+0000", 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0339999999999998e-06 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612627+0000", 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8909999999999998e-06 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612632+0000", 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9779999999999996e-06 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612694+0000", 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1668999999999995e-05 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612713+0000", 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8811999999999999e-05 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619027+0000", 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.006314432 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619047+0000", 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0213000000000001e-05 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20369 4.6 e74/73 4:618cf173:::10000002c6b.00000000:head v 74'427, mlcod=55'139)", 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612901+0000", 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0138977780000005, 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064523280000000002, 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612901+0000", 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612901+0000", 2024-04-26T11:47:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612900+0000", 2024-04-26T11:47:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612907+0000", 2024-04-26T11:47:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0060000000000003e-06 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612935+0000", 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8568000000000002e-05 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612942+0000", 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8090000000000004e-06 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612973+0000", 2024-04-26T11:47:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0543999999999998e-05 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612987+0000", 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3954999999999999e-05 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619336+0000", 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063491199999999998 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619353+0000", 2024-04-26T11:47:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7115000000000001e-05 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20378 4.2d e74/73 4:b4d5432a:::10000002c74.00000000:head v 74'398, mlcod=55'122)", 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.013835276, 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060773800000000003, 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612963+0000", 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612967+0000", 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3950000000000003e-06 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612973+0000", 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1360000000000002e-06 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612979+0000", 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9479999999999996e-06 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613018+0000", 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8860999999999999e-05 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613039+0000", 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0852999999999998e-05 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.618993+0000", 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059539780000000004 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619040+0000", 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7651000000000002e-05 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20366 4.10 e74/73 4:0ad91db9:::10000002c68.00000000:head v 74'435, mlcod=55'138)", 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.612989+0000", 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0138098109999998, 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060942130000000002, 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612989+0000", 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612989+0000", 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612988+0000", 2024-04-26T11:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612993+0000", 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.561e-06 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.612998+0000", 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5060000000000003e-06 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613004+0000", 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2120000000000002e-06 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613031+0000", 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7118e-05 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.613050+0000", 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9245999999999998e-05 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619050+0000", 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060001530000000003 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.619083+0000", 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2700000000000002e-05 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20656 4.39 e74/73 4:9fba633b:::1000000307f.00000000:head v 74'448, mlcod=56'164)", 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.653947+0000", 2024-04-26T11:47:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.972851747, 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0061421419999999997, 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653947+0000", 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653947+0000", 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653946+0000", 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653953+0000", 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0849999999999999e-06 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653962+0000", 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7880000000000001e-06 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.653970+0000", 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5410000000000003e-06 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.654099+0000", 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012950099999999999 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.654133+0000", 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3368000000000003e-05 2024-04-26T11:47:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.660023+0000", 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058897589999999996 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.660089+0000", 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6186999999999995e-05 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20668 4.15 e74/73 4:aaa2e33f:::1000000308b.00000000:head v 74'401, mlcod=55'121)", 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.9699370900000002, 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060769509999999997, 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656861+0000", 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656866+0000", 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8640000000000001e-06 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656874+0000", 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7360000000000001e-06 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.656880+0000", 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7019999999999998e-06 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.657104+0000", 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00022433500000000001 2024-04-26T11:47:20.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.657133+0000", 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8611000000000001e-05 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.662893+0000", 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057597710000000003 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.662938+0000", 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5606999999999999e-05 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20707 4.2e e74/73 4:779d8986:::10000002fc1.00000000:head v 74'402, mlcod=56'136)", 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.9616749850000001, 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0062345880000000001, 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665123+0000", 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665128+0000", 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7299999999999996e-06 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665142+0000", 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4304000000000001e-05 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665147+0000", 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665474+0000", 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00032683000000000001 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665491+0000", 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7447000000000001e-05 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671315+0000", 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058243440000000004 2024-04-26T11:47:20.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671358+0000", 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2593999999999999e-05 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(mds.0.3:20716 4.26 e74/73 4:67994bf4:::10000002fca.00000000:head v 74'476, mlcod=55'163)", 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.665177+0000", 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.961621815, 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0062991000000000002, 2024-04-26T11:47:20.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665177+0000", 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665177+0000", 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665176+0000", 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665180+0000", 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9709999999999998e-06 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665185+0000", 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.938e-06 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665188+0000", 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3450000000000002e-06 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665525+0000", 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000336177 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.665546+0000", 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1668e-05 2024-04-26T11:47:20.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671362+0000", 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058155450000000001 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.671476+0000", 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011388200000000001 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:20803 3.4 3:2052ff5c:::10000003021.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.9474070919999997, 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068572590000000001, 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:47:20.424 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679391+0000", 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679394+0000", 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5839999999999999e-06 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.425 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679402+0000", 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5560000000000002e-06 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679406+0000", 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.532e-06 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679465+0000", 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8709000000000003e-05 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.679636+0000", 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000171459 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:47:12.686249+0000", 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066120720000000001 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:47:20.427 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:47:21.688 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:22.017 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:22.019 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:22.032 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-04-26T11:47:21.150075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6416,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1732,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":173,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":509936,"kb_used_data":251332,"kb_used_omap":9,"kb_used_meta":258550,"kb_avail":282605584,"statfs":{"total":289910292480,"available":289388118016,"internally_reserved":0,"allocated":257363968,"data_stored":256195479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":264755340},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":448303,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1379,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1543,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.023043"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":926,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134923+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:17.134923+0000","last_peered":"2024-04-26T11:47:17.134923+0000","last_clean":"2024-04-26T11:47:17.134923+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:17.134923+0000","last_undegraded":"2024-04-26T11:47:17.134923+0000","last_fullsized":"2024-04-26T11:47:17.134923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":593,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133795+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:17.133795+0000","last_peered":"2024-04-26T11:47:17.133795+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:17.133795+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":489,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134637+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:17.134637+0000","last_peered":"2024-04-26T11:47:17.134637+0000","last_clean":"2024-04-26T11:47:17.134637+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:17.134637+0000","last_undegraded":"2024-04-26T11:47:17.134637+0000","last_fullsized":"2024-04-26T11:47:17.134637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":729,"reported_epoch":80,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:19.047509+0000","last_change":"2024-04-26T11:47:18.528392+0000","last_active":"2024-04-26T11:47:19.047509+0000","last_peered":"2024-04-26T11:47:19.047509+0000","last_clean":"2024-04-26T11:44:50.721907+0000","last_became_active":"2024-04-26T11:47:12.247695+0000","last_became_peered":"2024-04-26T11:47:12.247695+0000","last_unstale":"2024-04-26T11:47:19.047509+0000","last_undegraded":"2024-04-26T11:47:12.156427+0000","last_fullsized":"2024-04-26T11:47:12.145436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:16.946912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":512,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134184+0000","last_change":"2024-04-26T11:47:12.258595+0000","last_active":"2024-04-26T11:47:17.134184+0000","last_peered":"2024-04-26T11:47:17.134184+0000","last_clean":"2024-04-26T11:44:49.186299+0000","last_became_active":"2024-04-26T11:47:12.256827+0000","last_became_peered":"2024-04-26T11:47:12.256827+0000","last_unstale":"2024-04-26T11:47:17.134184+0000","last_undegraded":"2024-04-26T11:47:12.160500+0000","last_fullsized":"2024-04-26T11:47:12.146275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:42.419089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":810,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133585+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:17.133585+0000","last_peered":"2024-04-26T11:47:17.133585+0000","last_clean":"2024-04-26T11:47:17.133585+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:17.133585+0000","last_undegraded":"2024-04-26T11:47:17.133585+0000","last_fullsized":"2024-04-26T11:47:17.133585+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":610,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134949+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:17.134949+0000","last_peered":"2024-04-26T11:47:17.134949+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:17.134949+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":487,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133376+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:17.133376+0000","last_peered":"2024-04-26T11:47:17.133376+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:17.133376+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":508,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.430920+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:18.430920+0000","last_peered":"2024-04-26T11:47:18.430920+0000","last_clean":"2024-04-26T11:47:18.430920+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:18.430920+0000","last_undegraded":"2024-04-26T11:47:18.430920+0000","last_fullsized":"2024-04-26T11:47:18.430920+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":567,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134155+0000","last_change":"2024-04-26T11:47:12.262968+0000","last_active":"2024-04-26T11:47:17.134155+0000","last_peered":"2024-04-26T11:47:17.134155+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:17.134155+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":838,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.145221+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:17.145221+0000","last_peered":"2024-04-26T11:47:17.145221+0000","last_clean":"2024-04-26T11:47:17.145221+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:17.145221+0000","last_undegraded":"2024-04-26T11:47:17.145221+0000","last_fullsized":"2024-04-26T11:47:17.145221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":456,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133956+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:17.133956+0000","last_peered":"2024-04-26T11:47:17.133956+0000","last_clean":"2024-04-26T11:47:17.133956+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:17.133956+0000","last_undegraded":"2024-04-26T11:47:17.133956+0000","last_fullsized":"2024-04-26T11:47:17.133956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":850,"reported_epoch":80,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:18.527138+0000","last_change":"2024-04-26T11:47:18.527603+0000","last_active":"2024-04-26T11:47:18.527138+0000","last_peered":"2024-04-26T11:47:18.527138+0000","last_clean":"2024-04-26T11:44:49.186209+0000","last_became_active":"2024-04-26T11:47:12.250397+0000","last_became_peered":"2024-04-26T11:47:12.250397+0000","last_unstale":"2024-04-26T11:47:18.527138+0000","last_undegraded":"2024-04-26T11:47:12.157224+0000","last_fullsized":"2024-04-26T11:47:12.147628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:15.499511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":528,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133816+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:17.133816+0000","last_peered":"2024-04-26T11:47:17.133816+0000","last_clean":"2024-04-26T11:47:17.133816+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:17.133816+0000","last_undegraded":"2024-04-26T11:47:17.133816+0000","last_fullsized":"2024-04-26T11:47:17.133816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":570,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135038+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:17.135038+0000","last_peered":"2024-04-26T11:47:17.135038+0000","last_clean":"2024-04-26T11:47:17.135038+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:17.135038+0000","last_undegraded":"2024-04-26T11:47:17.135038+0000","last_fullsized":"2024-04-26T11:47:17.135038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":625,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133414+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:17.133414+0000","last_peered":"2024-04-26T11:47:17.133414+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:17.133414+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":476,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.430242+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:18.430242+0000","last_peered":"2024-04-26T11:47:18.430242+0000","last_clean":"2024-04-26T11:47:18.430242+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:18.430242+0000","last_undegraded":"2024-04-26T11:47:18.430242+0000","last_fullsized":"2024-04-26T11:47:18.430242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":526,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134331+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:17.134331+0000","last_peered":"2024-04-26T11:47:17.134331+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:17.134331+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":526,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133645+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:17.133645+0000","last_peered":"2024-04-26T11:47:17.133645+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:17.133645+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":972,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-26T11:47:18.138166+0000","last_change":"2024-04-26T11:47:18.139049+0000","last_active":"2024-04-26T11:47:18.138166+0000","last_peered":"2024-04-26T11:47:17.899579+0000","last_clean":"2024-04-26T11:44:50.722977+0000","last_became_active":"2024-04-26T11:47:12.247396+0000","last_became_peered":"2024-04-26T11:47:12.247396+0000","last_unstale":"2024-04-26T11:47:18.138166+0000","last_undegraded":"2024-04-26T11:47:18.138166+0000","last_fullsized":"2024-04-26T11:47:18.138166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:31.753210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":541,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.135279+0000","last_change":"2024-04-26T11:47:12.265247+0000","last_active":"2024-04-26T11:47:17.135279+0000","last_peered":"2024-04-26T11:47:17.135279+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:17.135279+0000","last_undegraded":"2024-04-26T11:47:12.167328+0000","last_fullsized":"2024-04-26T11:47:12.157724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:35.162556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-13}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":542,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.132913+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:17.132913+0000","last_peered":"2024-04-26T11:47:17.132913+0000","last_clean":"2024-04-26T11:47:17.132913+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:17.132913+0000","last_undegraded":"2024-04-26T11:47:17.132913+0000","last_fullsized":"2024-04-26T11:47:17.132913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":493,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133260+0000","last_change":"2024-04-26T11:47:12.255039+0000","last_active":"2024-04-26T11:47:17.133260+0000","last_peered":"2024-04-26T11:47:17.133260+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251782+0000","last_became_peered":"2024-04-26T11:47:12.251782+0000","last_unstale":"2024-04-26T11:47:17.133260+0000","last_undegraded":"2024-04-26T11:47:12.160070+0000","last_fullsized":"2024-04-26T11:47:12.143241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":587,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132267+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:17.132267+0000","last_peered":"2024-04-26T11:47:17.132267+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:17.132267+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":478,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134850+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:17.134850+0000","last_peered":"2024-04-26T11:47:17.134850+0000","last_clean":"2024-04-26T11:47:17.134850+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:17.134850+0000","last_undegraded":"2024-04-26T11:47:17.134850+0000","last_fullsized":"2024-04-26T11:47:17.134850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":622,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.136532+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:17.136532+0000","last_peered":"2024-04-26T11:47:17.136532+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:17.136532+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":480,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134817+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:17.134817+0000","last_peered":"2024-04-26T11:47:17.134817+0000","last_clean":"2024-04-26T11:47:17.134817+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:17.134817+0000","last_undegraded":"2024-04-26T11:47:17.134817+0000","last_fullsized":"2024-04-26T11:47:17.134817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":561,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134961+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:17.134961+0000","last_peered":"2024-04-26T11:47:17.134961+0000","last_clean":"2024-04-26T11:47:17.134961+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:17.134961+0000","last_undegraded":"2024-04-26T11:47:17.134961+0000","last_fullsized":"2024-04-26T11:47:17.134961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":486,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133665+0000","last_change":"2024-04-26T11:47:12.258316+0000","last_active":"2024-04-26T11:47:17.133665+0000","last_peered":"2024-04-26T11:47:17.133665+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.256893+0000","last_became_peered":"2024-04-26T11:47:12.256893+0000","last_unstale":"2024-04-26T11:47:17.133665+0000","last_undegraded":"2024-04-26T11:47:12.163546+0000","last_fullsized":"2024-04-26T11:47:12.157883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:48.825981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":590,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133404+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:17.133404+0000","last_peered":"2024-04-26T11:47:17.133404+0000","last_clean":"2024-04-26T11:47:17.133404+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:17.133404+0000","last_undegraded":"2024-04-26T11:47:17.133404+0000","last_fullsized":"2024-04-26T11:47:17.133404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":561,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132471+0000","last_change":"2024-04-26T11:47:12.262325+0000","last_active":"2024-04-26T11:47:17.132471+0000","last_peered":"2024-04-26T11:47:17.132471+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259636+0000","last_became_peered":"2024-04-26T11:47:12.259636+0000","last_unstale":"2024-04-26T11:47:17.132471+0000","last_undegraded":"2024-04-26T11:47:12.166109+0000","last_fullsized":"2024-04-26T11:47:12.158494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:27.521969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":523,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133886+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:17.133886+0000","last_peered":"2024-04-26T11:47:17.133886+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:17.133886+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":469,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134631+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:17.134631+0000","last_peered":"2024-04-26T11:47:17.134631+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:17.134631+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":588,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135714+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:17.135714+0000","last_peered":"2024-04-26T11:47:17.135714+0000","last_clean":"2024-04-26T11:47:17.135714+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:17.135714+0000","last_undegraded":"2024-04-26T11:47:17.135714+0000","last_fullsized":"2024-04-26T11:47:17.135714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":580,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134314+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:17.134314+0000","last_peered":"2024-04-26T11:47:17.134314+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:17.134314+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.427756+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:18.427756+0000","last_peered":"2024-04-26T11:47:18.427756+0000","last_clean":"2024-04-26T11:47:18.427756+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:18.427756+0000","last_undegraded":"2024-04-26T11:47:18.427756+0000","last_fullsized":"2024-04-26T11:47:18.427756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":501,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:18.136551+0000","last_change":"2024-04-26T11:47:12.262102+0000","last_active":"2024-04-26T11:47:18.136551+0000","last_peered":"2024-04-26T11:47:18.136551+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259702+0000","last_became_peered":"2024-04-26T11:47:12.259702+0000","last_unstale":"2024-04-26T11:47:18.136551+0000","last_undegraded":"2024-04-26T11:47:12.156439+0000","last_fullsized":"2024-04-26T11:47:12.146012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133016+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:17.133016+0000","last_peered":"2024-04-26T11:47:17.133016+0000","last_clean":"2024-04-26T11:47:17.133016+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:17.133016+0000","last_undegraded":"2024-04-26T11:47:17.133016+0000","last_fullsized":"2024-04-26T11:47:17.133016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":516,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.442380+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:18.442380+0000","last_peered":"2024-04-26T11:47:18.442380+0000","last_clean":"2024-04-26T11:47:18.442380+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:18.442380+0000","last_undegraded":"2024-04-26T11:47:18.442380+0000","last_fullsized":"2024-04-26T11:47:18.442380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133860+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:17.133860+0000","last_peered":"2024-04-26T11:47:17.133860+0000","last_clean":"2024-04-26T11:47:17.133860+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:17.133860+0000","last_undegraded":"2024-04-26T11:47:17.133860+0000","last_fullsized":"2024-04-26T11:47:17.133860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":287,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136849+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:17.136849+0000","last_peered":"2024-04-26T11:47:17.136849+0000","last_clean":"2024-04-26T11:47:17.136849+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:17.136849+0000","last_undegraded":"2024-04-26T11:47:17.136849+0000","last_fullsized":"2024-04-26T11:47:17.136849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":505,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.132436+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:17.132436+0000","last_peered":"2024-04-26T11:47:17.132436+0000","last_clean":"2024-04-26T11:47:17.132436+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:17.132436+0000","last_undegraded":"2024-04-26T11:47:17.132436+0000","last_fullsized":"2024-04-26T11:47:17.132436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":465,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134651+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:17.134651+0000","last_peered":"2024-04-26T11:47:17.134651+0000","last_clean":"2024-04-26T11:47:17.134651+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:17.134651+0000","last_undegraded":"2024-04-26T11:47:17.134651+0000","last_fullsized":"2024-04-26T11:47:17.134651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":584,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132591+0000","last_change":"2024-04-26T11:47:12.256711+0000","last_active":"2024-04-26T11:47:17.132591+0000","last_peered":"2024-04-26T11:47:17.132591+0000","last_clean":"2024-04-26T11:44:49.185565+0000","last_became_active":"2024-04-26T11:47:12.252329+0000","last_became_peered":"2024-04-26T11:47:12.252329+0000","last_unstale":"2024-04-26T11:47:17.132591+0000","last_undegraded":"2024-04-26T11:47:12.158212+0000","last_fullsized":"2024-04-26T11:47:12.148030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:23.263270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":659,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135703+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:17.135703+0000","last_peered":"2024-04-26T11:47:17.135703+0000","last_clean":"2024-04-26T11:47:17.135703+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:17.135703+0000","last_undegraded":"2024-04-26T11:47:17.135703+0000","last_fullsized":"2024-04-26T11:47:17.135703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":584,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.135217+0000","last_change":"2024-04-26T11:47:12.254082+0000","last_active":"2024-04-26T11:47:17.135217+0000","last_peered":"2024-04-26T11:47:17.135217+0000","last_clean":"2024-04-26T11:44:50.721822+0000","last_became_active":"2024-04-26T11:47:12.251151+0000","last_became_peered":"2024-04-26T11:47:12.251151+0000","last_unstale":"2024-04-26T11:47:17.135217+0000","last_undegraded":"2024-04-26T11:47:12.155484+0000","last_fullsized":"2024-04-26T11:47:12.144270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:40.503436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":148,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136667+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:17.136667+0000","last_peered":"2024-04-26T11:47:17.136667+0000","last_clean":"2024-04-26T11:47:17.136667+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:17.136667+0000","last_undegraded":"2024-04-26T11:47:17.136667+0000","last_fullsized":"2024-04-26T11:47:17.136667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":593,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133716+0000","last_change":"2024-04-26T11:47:12.252630+0000","last_active":"2024-04-26T11:47:17.133716+0000","last_peered":"2024-04-26T11:47:17.133716+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.250306+0000","last_became_peered":"2024-04-26T11:47:12.250306+0000","last_unstale":"2024-04-26T11:47:17.133716+0000","last_undegraded":"2024-04-26T11:47:12.156978+0000","last_fullsized":"2024-04-26T11:47:12.144300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":338,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428812+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:18.428812+0000","last_peered":"2024-04-26T11:47:18.428812+0000","last_clean":"2024-04-26T11:47:18.428812+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:18.428812+0000","last_undegraded":"2024-04-26T11:47:18.428812+0000","last_fullsized":"2024-04-26T11:47:18.428812+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":529,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.136120+0000","last_change":"2024-04-26T11:47:12.257450+0000","last_active":"2024-04-26T11:47:17.136120+0000","last_peered":"2024-04-26T11:47:17.136120+0000","last_clean":"2024-04-26T11:44:50.722159+0000","last_became_active":"2024-04-26T11:47:12.255880+0000","last_became_peered":"2024-04-26T11:47:12.255880+0000","last_unstale":"2024-04-26T11:47:17.136120+0000","last_undegraded":"2024-04-26T11:47:12.165276+0000","last_fullsized":"2024-04-26T11:47:12.156834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.490162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-16}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":248,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135530+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:17.135530+0000","last_peered":"2024-04-26T11:47:17.135530+0000","last_clean":"2024-04-26T11:47:17.135530+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:17.135530+0000","last_undegraded":"2024-04-26T11:47:17.135530+0000","last_fullsized":"2024-04-26T11:47:17.135530+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":513,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135176+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:17.135176+0000","last_peered":"2024-04-26T11:47:17.135176+0000","last_clean":"2024-04-26T11:47:17.135176+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:17.135176+0000","last_undegraded":"2024-04-26T11:47:17.135176+0000","last_fullsized":"2024-04-26T11:47:17.135176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133109+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:17.133109+0000","last_peered":"2024-04-26T11:47:17.133109+0000","last_clean":"2024-04-26T11:47:17.133109+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:17.133109+0000","last_undegraded":"2024-04-26T11:47:17.133109+0000","last_fullsized":"2024-04-26T11:47:17.133109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":451,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136214+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:17.136214+0000","last_peered":"2024-04-26T11:47:17.136214+0000","last_clean":"2024-04-26T11:47:17.136214+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:17.136214+0000","last_undegraded":"2024-04-26T11:47:17.136214+0000","last_fullsized":"2024-04-26T11:47:17.136214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":599,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.132523+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:17.132523+0000","last_peered":"2024-04-26T11:47:17.132523+0000","last_clean":"2024-04-26T11:47:17.132523+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:17.132523+0000","last_undegraded":"2024-04-26T11:47:17.132523+0000","last_fullsized":"2024-04-26T11:47:17.132523+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":504,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133005+0000","last_change":"2024-04-26T11:47:12.257493+0000","last_active":"2024-04-26T11:47:17.133005+0000","last_peered":"2024-04-26T11:47:17.133005+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255726+0000","last_became_peered":"2024-04-26T11:47:12.255726+0000","last_unstale":"2024-04-26T11:47:17.133005+0000","last_undegraded":"2024-04-26T11:47:12.167230+0000","last_fullsized":"2024-04-26T11:47:12.165520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:41.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134533+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:17.134533+0000","last_peered":"2024-04-26T11:47:17.134533+0000","last_clean":"2024-04-26T11:47:17.134533+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:17.134533+0000","last_undegraded":"2024-04-26T11:47:17.134533+0000","last_fullsized":"2024-04-26T11:47:17.134533+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136179+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:17.136179+0000","last_peered":"2024-04-26T11:47:17.136179+0000","last_clean":"2024-04-26T11:47:17.136179+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:17.136179+0000","last_undegraded":"2024-04-26T11:47:17.136179+0000","last_fullsized":"2024-04-26T11:47:17.136179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":580,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428083+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:18.428083+0000","last_peered":"2024-04-26T11:47:18.428083+0000","last_clean":"2024-04-26T11:47:18.428083+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:18.428083+0000","last_undegraded":"2024-04-26T11:47:18.428083+0000","last_fullsized":"2024-04-26T11:47:18.428083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":539,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135419+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:17.135419+0000","last_peered":"2024-04-26T11:47:17.135419+0000","last_clean":"2024-04-26T11:47:17.135419+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:17.135419+0000","last_undegraded":"2024-04-26T11:47:17.135419+0000","last_fullsized":"2024-04-26T11:47:17.135419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134224+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:17.134224+0000","last_peered":"2024-04-26T11:47:17.134224+0000","last_clean":"2024-04-26T11:47:17.134224+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:17.134224+0000","last_undegraded":"2024-04-26T11:47:17.134224+0000","last_fullsized":"2024-04-26T11:47:17.134224+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.427306+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:18.427306+0000","last_peered":"2024-04-26T11:47:18.427306+0000","last_clean":"2024-04-26T11:47:18.427306+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:18.427306+0000","last_undegraded":"2024-04-26T11:47:18.427306+0000","last_fullsized":"2024-04-26T11:47:18.427306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":567,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134656+0000","last_change":"2024-04-26T11:47:12.262868+0000","last_active":"2024-04-26T11:47:17.134656+0000","last_peered":"2024-04-26T11:47:17.134656+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:17.134656+0000","last_undegraded":"2024-04-26T11:47:12.156540+0000","last_fullsized":"2024-04-26T11:47:12.146571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:45.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.427830+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:18.427830+0000","last_peered":"2024-04-26T11:47:18.427830+0000","last_clean":"2024-04-26T11:47:18.427830+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:18.427830+0000","last_undegraded":"2024-04-26T11:47:18.427830+0000","last_fullsized":"2024-04-26T11:47:18.427830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":496,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.132632+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:17.132632+0000","last_peered":"2024-04-26T11:47:17.132632+0000","last_clean":"2024-04-26T11:47:17.132632+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:17.132632+0000","last_undegraded":"2024-04-26T11:47:17.132632+0000","last_fullsized":"2024-04-26T11:47:17.132632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":427,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133211+0000","last_change":"2024-04-26T11:47:12.254070+0000","last_active":"2024-04-26T11:47:17.133211+0000","last_peered":"2024-04-26T11:47:17.133211+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.250084+0000","last_became_peered":"2024-04-26T11:47:12.250084+0000","last_unstale":"2024-04-26T11:47:17.133211+0000","last_undegraded":"2024-04-26T11:47:12.165871+0000","last_fullsized":"2024-04-26T11:47:12.161090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:19.765756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":152,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135732+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:17.135732+0000","last_peered":"2024-04-26T11:47:17.135732+0000","last_clean":"2024-04-26T11:47:17.135732+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:17.135732+0000","last_undegraded":"2024-04-26T11:47:17.135732+0000","last_fullsized":"2024-04-26T11:47:17.135732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":151,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135950+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:17.135950+0000","last_peered":"2024-04-26T11:47:17.135950+0000","last_clean":"2024-04-26T11:47:17.135950+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:17.135950+0000","last_undegraded":"2024-04-26T11:47:17.135950+0000","last_fullsized":"2024-04-26T11:47:17.135950+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":479,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134594+0000","last_change":"2024-04-26T11:47:12.256944+0000","last_active":"2024-04-26T11:47:17.134594+0000","last_peered":"2024-04-26T11:47:17.134594+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255779+0000","last_became_peered":"2024-04-26T11:47:12.255779+0000","last_unstale":"2024-04-26T11:47:17.134594+0000","last_undegraded":"2024-04-26T11:47:12.164475+0000","last_fullsized":"2024-04-26T11:47:12.155432+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:51.100421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":610,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135947+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:17.135947+0000","last_peered":"2024-04-26T11:47:17.135947+0000","last_clean":"2024-04-26T11:47:17.135947+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:17.135947+0000","last_undegraded":"2024-04-26T11:47:17.135947+0000","last_fullsized":"2024-04-26T11:47:17.135947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428173+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:18.428173+0000","last_peered":"2024-04-26T11:47:18.428173+0000","last_clean":"2024-04-26T11:47:18.428173+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:18.428173+0000","last_undegraded":"2024-04-26T11:47:18.428173+0000","last_fullsized":"2024-04-26T11:47:18.428173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":451,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133162+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:17.133162+0000","last_peered":"2024-04-26T11:47:17.133162+0000","last_clean":"2024-04-26T11:47:17.133162+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:17.133162+0000","last_undegraded":"2024-04-26T11:47:17.133162+0000","last_fullsized":"2024-04-26T11:47:17.133162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428406+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:18.428406+0000","last_peered":"2024-04-26T11:47:18.428406+0000","last_clean":"2024-04-26T11:47:18.428406+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:18.428406+0000","last_undegraded":"2024-04-26T11:47:18.428406+0000","last_fullsized":"2024-04-26T11:47:18.428406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134453+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:17.134453+0000","last_peered":"2024-04-26T11:47:17.134453+0000","last_clean":"2024-04-26T11:47:17.134453+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:17.134453+0000","last_undegraded":"2024-04-26T11:47:17.134453+0000","last_fullsized":"2024-04-26T11:47:17.134453+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":492,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134059+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:17.134059+0000","last_peered":"2024-04-26T11:47:17.134059+0000","last_clean":"2024-04-26T11:47:17.134059+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:17.134059+0000","last_undegraded":"2024-04-26T11:47:17.134059+0000","last_fullsized":"2024-04-26T11:47:17.134059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.430058+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:18.430058+0000","last_peered":"2024-04-26T11:47:18.430058+0000","last_clean":"2024-04-26T11:47:18.430058+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:18.430058+0000","last_undegraded":"2024-04-26T11:47:18.430058+0000","last_fullsized":"2024-04-26T11:47:18.430058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428649+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:18.428649+0000","last_peered":"2024-04-26T11:47:18.428649+0000","last_clean":"2024-04-26T11:47:18.428649+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:18.428649+0000","last_undegraded":"2024-04-26T11:47:18.428649+0000","last_fullsized":"2024-04-26T11:47:18.428649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":470,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132950+0000","last_change":"2024-04-26T11:47:12.265335+0000","last_active":"2024-04-26T11:47:17.132950+0000","last_peered":"2024-04-26T11:47:17.132950+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:17.132950+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428826+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:18.428826+0000","last_peered":"2024-04-26T11:47:18.428826+0000","last_clean":"2024-04-26T11:47:18.428826+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:18.428826+0000","last_undegraded":"2024-04-26T11:47:18.428826+0000","last_fullsized":"2024-04-26T11:47:18.428826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.137015+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:17.137015+0000","last_peered":"2024-04-26T11:47:17.137015+0000","last_clean":"2024-04-26T11:47:17.137015+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:17.137015+0000","last_undegraded":"2024-04-26T11:47:17.137015+0000","last_fullsized":"2024-04-26T11:47:17.137015+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":525,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.132877+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:17.132877+0000","last_peered":"2024-04-26T11:47:17.132877+0000","last_clean":"2024-04-26T11:47:17.132877+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:17.132877+0000","last_undegraded":"2024-04-26T11:47:17.132877+0000","last_fullsized":"2024-04-26T11:47:17.132877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134798+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:17.134798+0000","last_peered":"2024-04-26T11:47:17.134798+0000","last_clean":"2024-04-26T11:47:17.134798+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:17.134798+0000","last_undegraded":"2024-04-26T11:47:17.134798+0000","last_fullsized":"2024-04-26T11:47:17.134798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":484,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136735+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:17.136735+0000","last_peered":"2024-04-26T11:47:17.136735+0000","last_clean":"2024-04-26T11:47:17.136735+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:17.136735+0000","last_undegraded":"2024-04-26T11:47:17.136735+0000","last_fullsized":"2024-04-26T11:47:17.136735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":530,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132721+0000","last_change":"2024-04-26T11:47:12.261430+0000","last_active":"2024-04-26T11:47:17.132721+0000","last_peered":"2024-04-26T11:47:17.132721+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259639+0000","last_became_peered":"2024-04-26T11:47:12.259639+0000","last_unstale":"2024-04-26T11:47:17.132721+0000","last_undegraded":"2024-04-26T11:47:12.167836+0000","last_fullsized":"2024-04-26T11:47:12.160846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:57.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":176,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134312+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:17.134312+0000","last_peered":"2024-04-26T11:47:17.134312+0000","last_clean":"2024-04-26T11:47:17.134312+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:17.134312+0000","last_undegraded":"2024-04-26T11:47:17.134312+0000","last_fullsized":"2024-04-26T11:47:17.134312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":431,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136902+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:17.136902+0000","last_peered":"2024-04-26T11:47:17.136902+0000","last_clean":"2024-04-26T11:47:17.136902+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:17.136902+0000","last_undegraded":"2024-04-26T11:47:17.136902+0000","last_fullsized":"2024-04-26T11:47:17.136902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":557,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133306+0000","last_change":"2024-04-26T11:47:12.254913+0000","last_active":"2024-04-26T11:47:17.133306+0000","last_peered":"2024-04-26T11:47:17.133306+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251682+0000","last_became_peered":"2024-04-26T11:47:12.251682+0000","last_unstale":"2024-04-26T11:47:17.133306+0000","last_undegraded":"2024-04-26T11:47:12.157689+0000","last_fullsized":"2024-04-26T11:47:12.143256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:13.489428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":203,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.430975+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:18.430975+0000","last_peered":"2024-04-26T11:47:18.430975+0000","last_clean":"2024-04-26T11:47:18.430975+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:18.430975+0000","last_undegraded":"2024-04-26T11:47:18.430975+0000","last_fullsized":"2024-04-26T11:47:18.430975+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":566,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132307+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:17.132307+0000","last_peered":"2024-04-26T11:47:17.132307+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:17.132307+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":483,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134932+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:17.134932+0000","last_peered":"2024-04-26T11:47:17.134932+0000","last_clean":"2024-04-26T11:47:17.134932+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:17.134932+0000","last_undegraded":"2024-04-26T11:47:17.134932+0000","last_fullsized":"2024-04-26T11:47:17.134932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":841,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.427229+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:18.427229+0000","last_peered":"2024-04-26T11:47:18.427229+0000","last_clean":"2024-04-26T11:47:18.427229+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:18.427229+0000","last_undegraded":"2024-04-26T11:47:18.427229+0000","last_fullsized":"2024-04-26T11:47:18.427229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":480,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.135685+0000","last_change":"2024-04-26T11:47:12.262558+0000","last_active":"2024-04-26T11:47:17.135685+0000","last_peered":"2024-04-26T11:47:17.135685+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.260513+0000","last_became_peered":"2024-04-26T11:47:12.260513+0000","last_unstale":"2024-04-26T11:47:17.135685+0000","last_undegraded":"2024-04-26T11:47:12.161322+0000","last_fullsized":"2024-04-26T11:47:12.156833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:46.502879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":398,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.427565+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:18.427565+0000","last_peered":"2024-04-26T11:47:18.427565+0000","last_clean":"2024-04-26T11:47:18.427565+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:18.427565+0000","last_undegraded":"2024-04-26T11:47:18.427565+0000","last_fullsized":"2024-04-26T11:47:18.427565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":504,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134033+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:17.134033+0000","last_peered":"2024-04-26T11:47:17.134033+0000","last_clean":"2024-04-26T11:47:17.134033+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:17.134033+0000","last_undegraded":"2024-04-26T11:47:17.134033+0000","last_fullsized":"2024-04-26T11:47:17.134033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":453,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133490+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:17.133490+0000","last_peered":"2024-04-26T11:47:17.133490+0000","last_clean":"2024-04-26T11:47:17.133490+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:17.133490+0000","last_undegraded":"2024-04-26T11:47:17.133490+0000","last_fullsized":"2024-04-26T11:47:17.133490+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":812,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-26T11:47:18.140942+0000","last_change":"2024-04-26T11:47:18.141284+0000","last_active":"2024-04-26T11:47:18.140942+0000","last_peered":"2024-04-26T11:47:17.160873+0000","last_clean":"2024-04-26T11:44:49.186726+0000","last_became_active":"2024-04-26T11:47:12.247841+0000","last_became_peered":"2024-04-26T11:47:12.247841+0000","last_unstale":"2024-04-26T11:47:18.140942+0000","last_undegraded":"2024-04-26T11:47:18.140942+0000","last_fullsized":"2024-04-26T11:47:18.140942+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134292+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:17.134292+0000","last_peered":"2024-04-26T11:47:17.134292+0000","last_clean":"2024-04-26T11:47:17.134292+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:17.134292+0000","last_undegraded":"2024-04-26T11:47:17.134292+0000","last_fullsized":"2024-04-26T11:47:17.134292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":511,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.136235+0000","last_change":"2024-04-26T11:47:12.259550+0000","last_active":"2024-04-26T11:47:17.136235+0000","last_peered":"2024-04-26T11:47:17.136235+0000","last_clean":"2024-04-26T11:44:50.722361+0000","last_became_active":"2024-04-26T11:47:12.256906+0000","last_became_peered":"2024-04-26T11:47:12.256906+0000","last_unstale":"2024-04-26T11:47:17.136235+0000","last_undegraded":"2024-04-26T11:47:12.156736+0000","last_fullsized":"2024-04-26T11:47:12.144812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:25.280569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":373,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136517+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:17.136517+0000","last_peered":"2024-04-26T11:47:17.136517+0000","last_clean":"2024-04-26T11:47:17.136517+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:17.136517+0000","last_undegraded":"2024-04-26T11:47:17.136517+0000","last_fullsized":"2024-04-26T11:47:17.136517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":506,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.136417+0000","last_change":"2024-04-26T11:47:12.254097+0000","last_active":"2024-04-26T11:47:17.136417+0000","last_peered":"2024-04-26T11:47:17.136417+0000","last_clean":"2024-04-26T11:44:50.722199+0000","last_became_active":"2024-04-26T11:47:12.251646+0000","last_became_peered":"2024-04-26T11:47:12.251646+0000","last_unstale":"2024-04-26T11:47:17.136417+0000","last_undegraded":"2024-04-26T11:47:12.161281+0000","last_fullsized":"2024-04-26T11:47:12.156381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:20.045697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":402,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134160+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:17.134160+0000","last_peered":"2024-04-26T11:47:17.134160+0000","last_clean":"2024-04-26T11:47:17.134160+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:17.134160+0000","last_undegraded":"2024-04-26T11:47:17.134160+0000","last_fullsized":"2024-04-26T11:47:17.134160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":533,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133627+0000","last_change":"2024-04-26T11:47:12.254202+0000","last_active":"2024-04-26T11:47:17.133627+0000","last_peered":"2024-04-26T11:47:17.133627+0000","last_clean":"2024-04-26T11:44:49.185959+0000","last_became_active":"2024-04-26T11:47:12.252111+0000","last_became_peered":"2024-04-26T11:47:12.252111+0000","last_unstale":"2024-04-26T11:47:17.133627+0000","last_undegraded":"2024-04-26T11:47:12.160789+0000","last_fullsized":"2024-04-26T11:47:12.146173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:57.514673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-10}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.429530+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:18.429530+0000","last_peered":"2024-04-26T11:47:18.429530+0000","last_clean":"2024-04-26T11:47:18.429530+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:18.429530+0000","last_undegraded":"2024-04-26T11:47:18.429530+0000","last_fullsized":"2024-04-26T11:47:18.429530+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":549,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134988+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:17.134988+0000","last_peered":"2024-04-26T11:47:17.134988+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:17.134988+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.429847+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:18.429847+0000","last_peered":"2024-04-26T11:47:18.429847+0000","last_clean":"2024-04-26T11:47:18.429847+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:18.429847+0000","last_undegraded":"2024-04-26T11:47:18.429847+0000","last_fullsized":"2024-04-26T11:47:18.429847+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6416,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1711,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":91,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738410,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200132,"kb_used_data":88696,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171708,"statfs":{"total":96636764160,"available":96431828992,"internally_reserved":0,"allocated":90824704,"data_stored":90424097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":1,"up_from":72,"seq":309237645315,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119492,"kb_used_data":79672,"kb_used_omap":6,"kb_used_meta":39801,"kb_avail":94252348,"statfs":{"total":96636764160,"available":96514404352,"internally_reserved":0,"allocated":81584128,"data_stored":81205242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":40756480},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":0,"up_from":8,"seq":34359738409,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190312,"kb_used_data":82964,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181528,"statfs":{"total":96636764160,"available":96441884672,"internally_reserved":0,"allocated":84955136,"data_stored":84566140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:22.036 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:47:22.166 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:47:22.406 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:22.406 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub,nodeep-scrub flag(s) set","count":20},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 6416/108 objects degraded (5940.741%), 36 pgs degraded","count":36},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":203,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":84,"num_osds":3,"num_up_osds":3,"osd_up_since":1714132030,"num_in_osds":3,"osd_in_since":1714131840,"num_remapped_pgs":31},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":66},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":35},{"state_name":"peering","count":2},{"state_name":"active+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127603811,"bytes_used":522174464,"bytes_avail":289388118016,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":6416,"degraded_total":108,"degraded_ratio":59.407407407407412,"recovering_objects_per_sec":385,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1543,"num_bytes_recovered":0,"num_keys_recovered":0,"read_bytes_sec":255,"write_bytes_sec":112835,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4213}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T11:45:27.979634+0000","services":{}},"progress_events":{}} 2024-04-26T11:47:22.426 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:47:22.426 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:22.736 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:22.738 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:22.752 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-04-26T11:47:22.157956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6416,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1732,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":173,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":509936,"kb_used_data":251332,"kb_used_omap":9,"kb_used_meta":258550,"kb_avail":282605584,"statfs":{"total":289910292480,"available":289388118016,"internally_reserved":0,"allocated":257363968,"data_stored":256195479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":264755340},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":448303,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1379,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1543,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028760"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":926,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134923+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:17.134923+0000","last_peered":"2024-04-26T11:47:17.134923+0000","last_clean":"2024-04-26T11:47:17.134923+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:17.134923+0000","last_undegraded":"2024-04-26T11:47:17.134923+0000","last_fullsized":"2024-04-26T11:47:17.134923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":593,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133795+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:17.133795+0000","last_peered":"2024-04-26T11:47:17.133795+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:17.133795+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":489,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134637+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:17.134637+0000","last_peered":"2024-04-26T11:47:17.134637+0000","last_clean":"2024-04-26T11:47:17.134637+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:17.134637+0000","last_undegraded":"2024-04-26T11:47:17.134637+0000","last_fullsized":"2024-04-26T11:47:17.134637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":729,"reported_epoch":80,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:19.047509+0000","last_change":"2024-04-26T11:47:18.528392+0000","last_active":"2024-04-26T11:47:19.047509+0000","last_peered":"2024-04-26T11:47:19.047509+0000","last_clean":"2024-04-26T11:44:50.721907+0000","last_became_active":"2024-04-26T11:47:12.247695+0000","last_became_peered":"2024-04-26T11:47:12.247695+0000","last_unstale":"2024-04-26T11:47:19.047509+0000","last_undegraded":"2024-04-26T11:47:12.156427+0000","last_fullsized":"2024-04-26T11:47:12.145436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:16.946912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":512,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134184+0000","last_change":"2024-04-26T11:47:12.258595+0000","last_active":"2024-04-26T11:47:17.134184+0000","last_peered":"2024-04-26T11:47:17.134184+0000","last_clean":"2024-04-26T11:44:49.186299+0000","last_became_active":"2024-04-26T11:47:12.256827+0000","last_became_peered":"2024-04-26T11:47:12.256827+0000","last_unstale":"2024-04-26T11:47:17.134184+0000","last_undegraded":"2024-04-26T11:47:12.160500+0000","last_fullsized":"2024-04-26T11:47:12.146275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:42.419089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":810,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133585+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:17.133585+0000","last_peered":"2024-04-26T11:47:17.133585+0000","last_clean":"2024-04-26T11:47:17.133585+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:17.133585+0000","last_undegraded":"2024-04-26T11:47:17.133585+0000","last_fullsized":"2024-04-26T11:47:17.133585+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":610,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134949+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:17.134949+0000","last_peered":"2024-04-26T11:47:17.134949+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:17.134949+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":487,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133376+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:17.133376+0000","last_peered":"2024-04-26T11:47:17.133376+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:17.133376+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":508,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.430920+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:18.430920+0000","last_peered":"2024-04-26T11:47:18.430920+0000","last_clean":"2024-04-26T11:47:18.430920+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:18.430920+0000","last_undegraded":"2024-04-26T11:47:18.430920+0000","last_fullsized":"2024-04-26T11:47:18.430920+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":567,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134155+0000","last_change":"2024-04-26T11:47:12.262968+0000","last_active":"2024-04-26T11:47:17.134155+0000","last_peered":"2024-04-26T11:47:17.134155+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:17.134155+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":838,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.145221+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:17.145221+0000","last_peered":"2024-04-26T11:47:17.145221+0000","last_clean":"2024-04-26T11:47:17.145221+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:17.145221+0000","last_undegraded":"2024-04-26T11:47:17.145221+0000","last_fullsized":"2024-04-26T11:47:17.145221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":456,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133956+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:17.133956+0000","last_peered":"2024-04-26T11:47:17.133956+0000","last_clean":"2024-04-26T11:47:17.133956+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:17.133956+0000","last_undegraded":"2024-04-26T11:47:17.133956+0000","last_fullsized":"2024-04-26T11:47:17.133956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":850,"reported_epoch":80,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:18.527138+0000","last_change":"2024-04-26T11:47:18.527603+0000","last_active":"2024-04-26T11:47:18.527138+0000","last_peered":"2024-04-26T11:47:18.527138+0000","last_clean":"2024-04-26T11:44:49.186209+0000","last_became_active":"2024-04-26T11:47:12.250397+0000","last_became_peered":"2024-04-26T11:47:12.250397+0000","last_unstale":"2024-04-26T11:47:18.527138+0000","last_undegraded":"2024-04-26T11:47:12.157224+0000","last_fullsized":"2024-04-26T11:47:12.147628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:15.499511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":528,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133816+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:17.133816+0000","last_peered":"2024-04-26T11:47:17.133816+0000","last_clean":"2024-04-26T11:47:17.133816+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:17.133816+0000","last_undegraded":"2024-04-26T11:47:17.133816+0000","last_fullsized":"2024-04-26T11:47:17.133816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":570,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135038+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:17.135038+0000","last_peered":"2024-04-26T11:47:17.135038+0000","last_clean":"2024-04-26T11:47:17.135038+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:17.135038+0000","last_undegraded":"2024-04-26T11:47:17.135038+0000","last_fullsized":"2024-04-26T11:47:17.135038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":625,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133414+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:17.133414+0000","last_peered":"2024-04-26T11:47:17.133414+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:17.133414+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":476,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.430242+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:18.430242+0000","last_peered":"2024-04-26T11:47:18.430242+0000","last_clean":"2024-04-26T11:47:18.430242+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:18.430242+0000","last_undegraded":"2024-04-26T11:47:18.430242+0000","last_fullsized":"2024-04-26T11:47:18.430242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":526,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134331+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:17.134331+0000","last_peered":"2024-04-26T11:47:17.134331+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:17.134331+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":526,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133645+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:17.133645+0000","last_peered":"2024-04-26T11:47:17.133645+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:17.133645+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":972,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-26T11:47:18.138166+0000","last_change":"2024-04-26T11:47:18.139049+0000","last_active":"2024-04-26T11:47:18.138166+0000","last_peered":"2024-04-26T11:47:17.899579+0000","last_clean":"2024-04-26T11:44:50.722977+0000","last_became_active":"2024-04-26T11:47:12.247396+0000","last_became_peered":"2024-04-26T11:47:12.247396+0000","last_unstale":"2024-04-26T11:47:18.138166+0000","last_undegraded":"2024-04-26T11:47:18.138166+0000","last_fullsized":"2024-04-26T11:47:18.138166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:31.753210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":541,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.135279+0000","last_change":"2024-04-26T11:47:12.265247+0000","last_active":"2024-04-26T11:47:17.135279+0000","last_peered":"2024-04-26T11:47:17.135279+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:17.135279+0000","last_undegraded":"2024-04-26T11:47:12.167328+0000","last_fullsized":"2024-04-26T11:47:12.157724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:35.162556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-13}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":542,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.132913+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:17.132913+0000","last_peered":"2024-04-26T11:47:17.132913+0000","last_clean":"2024-04-26T11:47:17.132913+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:17.132913+0000","last_undegraded":"2024-04-26T11:47:17.132913+0000","last_fullsized":"2024-04-26T11:47:17.132913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":493,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133260+0000","last_change":"2024-04-26T11:47:12.255039+0000","last_active":"2024-04-26T11:47:17.133260+0000","last_peered":"2024-04-26T11:47:17.133260+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251782+0000","last_became_peered":"2024-04-26T11:47:12.251782+0000","last_unstale":"2024-04-26T11:47:17.133260+0000","last_undegraded":"2024-04-26T11:47:12.160070+0000","last_fullsized":"2024-04-26T11:47:12.143241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":587,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132267+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:17.132267+0000","last_peered":"2024-04-26T11:47:17.132267+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:17.132267+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":478,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134850+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:17.134850+0000","last_peered":"2024-04-26T11:47:17.134850+0000","last_clean":"2024-04-26T11:47:17.134850+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:17.134850+0000","last_undegraded":"2024-04-26T11:47:17.134850+0000","last_fullsized":"2024-04-26T11:47:17.134850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":622,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.136532+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:17.136532+0000","last_peered":"2024-04-26T11:47:17.136532+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:17.136532+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":480,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134817+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:17.134817+0000","last_peered":"2024-04-26T11:47:17.134817+0000","last_clean":"2024-04-26T11:47:17.134817+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:17.134817+0000","last_undegraded":"2024-04-26T11:47:17.134817+0000","last_fullsized":"2024-04-26T11:47:17.134817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":561,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134961+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:17.134961+0000","last_peered":"2024-04-26T11:47:17.134961+0000","last_clean":"2024-04-26T11:47:17.134961+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:17.134961+0000","last_undegraded":"2024-04-26T11:47:17.134961+0000","last_fullsized":"2024-04-26T11:47:17.134961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":486,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133665+0000","last_change":"2024-04-26T11:47:12.258316+0000","last_active":"2024-04-26T11:47:17.133665+0000","last_peered":"2024-04-26T11:47:17.133665+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.256893+0000","last_became_peered":"2024-04-26T11:47:12.256893+0000","last_unstale":"2024-04-26T11:47:17.133665+0000","last_undegraded":"2024-04-26T11:47:12.163546+0000","last_fullsized":"2024-04-26T11:47:12.157883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:48.825981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":590,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133404+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:17.133404+0000","last_peered":"2024-04-26T11:47:17.133404+0000","last_clean":"2024-04-26T11:47:17.133404+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:17.133404+0000","last_undegraded":"2024-04-26T11:47:17.133404+0000","last_fullsized":"2024-04-26T11:47:17.133404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":561,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132471+0000","last_change":"2024-04-26T11:47:12.262325+0000","last_active":"2024-04-26T11:47:17.132471+0000","last_peered":"2024-04-26T11:47:17.132471+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259636+0000","last_became_peered":"2024-04-26T11:47:12.259636+0000","last_unstale":"2024-04-26T11:47:17.132471+0000","last_undegraded":"2024-04-26T11:47:12.166109+0000","last_fullsized":"2024-04-26T11:47:12.158494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:27.521969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":523,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133886+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:17.133886+0000","last_peered":"2024-04-26T11:47:17.133886+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:17.133886+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":469,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134631+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:17.134631+0000","last_peered":"2024-04-26T11:47:17.134631+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:17.134631+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":588,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135714+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:17.135714+0000","last_peered":"2024-04-26T11:47:17.135714+0000","last_clean":"2024-04-26T11:47:17.135714+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:17.135714+0000","last_undegraded":"2024-04-26T11:47:17.135714+0000","last_fullsized":"2024-04-26T11:47:17.135714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":580,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134314+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:17.134314+0000","last_peered":"2024-04-26T11:47:17.134314+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:17.134314+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.427756+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:18.427756+0000","last_peered":"2024-04-26T11:47:18.427756+0000","last_clean":"2024-04-26T11:47:18.427756+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:18.427756+0000","last_undegraded":"2024-04-26T11:47:18.427756+0000","last_fullsized":"2024-04-26T11:47:18.427756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":501,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:18.136551+0000","last_change":"2024-04-26T11:47:12.262102+0000","last_active":"2024-04-26T11:47:18.136551+0000","last_peered":"2024-04-26T11:47:18.136551+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259702+0000","last_became_peered":"2024-04-26T11:47:12.259702+0000","last_unstale":"2024-04-26T11:47:18.136551+0000","last_undegraded":"2024-04-26T11:47:12.156439+0000","last_fullsized":"2024-04-26T11:47:12.146012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133016+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:17.133016+0000","last_peered":"2024-04-26T11:47:17.133016+0000","last_clean":"2024-04-26T11:47:17.133016+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:17.133016+0000","last_undegraded":"2024-04-26T11:47:17.133016+0000","last_fullsized":"2024-04-26T11:47:17.133016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":516,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.442380+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:18.442380+0000","last_peered":"2024-04-26T11:47:18.442380+0000","last_clean":"2024-04-26T11:47:18.442380+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:18.442380+0000","last_undegraded":"2024-04-26T11:47:18.442380+0000","last_fullsized":"2024-04-26T11:47:18.442380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133860+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:17.133860+0000","last_peered":"2024-04-26T11:47:17.133860+0000","last_clean":"2024-04-26T11:47:17.133860+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:17.133860+0000","last_undegraded":"2024-04-26T11:47:17.133860+0000","last_fullsized":"2024-04-26T11:47:17.133860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":287,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136849+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:17.136849+0000","last_peered":"2024-04-26T11:47:17.136849+0000","last_clean":"2024-04-26T11:47:17.136849+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:17.136849+0000","last_undegraded":"2024-04-26T11:47:17.136849+0000","last_fullsized":"2024-04-26T11:47:17.136849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":505,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.132436+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:17.132436+0000","last_peered":"2024-04-26T11:47:17.132436+0000","last_clean":"2024-04-26T11:47:17.132436+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:17.132436+0000","last_undegraded":"2024-04-26T11:47:17.132436+0000","last_fullsized":"2024-04-26T11:47:17.132436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":465,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134651+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:17.134651+0000","last_peered":"2024-04-26T11:47:17.134651+0000","last_clean":"2024-04-26T11:47:17.134651+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:17.134651+0000","last_undegraded":"2024-04-26T11:47:17.134651+0000","last_fullsized":"2024-04-26T11:47:17.134651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":584,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132591+0000","last_change":"2024-04-26T11:47:12.256711+0000","last_active":"2024-04-26T11:47:17.132591+0000","last_peered":"2024-04-26T11:47:17.132591+0000","last_clean":"2024-04-26T11:44:49.185565+0000","last_became_active":"2024-04-26T11:47:12.252329+0000","last_became_peered":"2024-04-26T11:47:12.252329+0000","last_unstale":"2024-04-26T11:47:17.132591+0000","last_undegraded":"2024-04-26T11:47:12.158212+0000","last_fullsized":"2024-04-26T11:47:12.148030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:23.263270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":659,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135703+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:17.135703+0000","last_peered":"2024-04-26T11:47:17.135703+0000","last_clean":"2024-04-26T11:47:17.135703+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:17.135703+0000","last_undegraded":"2024-04-26T11:47:17.135703+0000","last_fullsized":"2024-04-26T11:47:17.135703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":584,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.135217+0000","last_change":"2024-04-26T11:47:12.254082+0000","last_active":"2024-04-26T11:47:17.135217+0000","last_peered":"2024-04-26T11:47:17.135217+0000","last_clean":"2024-04-26T11:44:50.721822+0000","last_became_active":"2024-04-26T11:47:12.251151+0000","last_became_peered":"2024-04-26T11:47:12.251151+0000","last_unstale":"2024-04-26T11:47:17.135217+0000","last_undegraded":"2024-04-26T11:47:12.155484+0000","last_fullsized":"2024-04-26T11:47:12.144270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:40.503436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":148,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136667+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:17.136667+0000","last_peered":"2024-04-26T11:47:17.136667+0000","last_clean":"2024-04-26T11:47:17.136667+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:17.136667+0000","last_undegraded":"2024-04-26T11:47:17.136667+0000","last_fullsized":"2024-04-26T11:47:17.136667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":593,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133716+0000","last_change":"2024-04-26T11:47:12.252630+0000","last_active":"2024-04-26T11:47:17.133716+0000","last_peered":"2024-04-26T11:47:17.133716+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.250306+0000","last_became_peered":"2024-04-26T11:47:12.250306+0000","last_unstale":"2024-04-26T11:47:17.133716+0000","last_undegraded":"2024-04-26T11:47:12.156978+0000","last_fullsized":"2024-04-26T11:47:12.144300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":338,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428812+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:18.428812+0000","last_peered":"2024-04-26T11:47:18.428812+0000","last_clean":"2024-04-26T11:47:18.428812+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:18.428812+0000","last_undegraded":"2024-04-26T11:47:18.428812+0000","last_fullsized":"2024-04-26T11:47:18.428812+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":529,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.136120+0000","last_change":"2024-04-26T11:47:12.257450+0000","last_active":"2024-04-26T11:47:17.136120+0000","last_peered":"2024-04-26T11:47:17.136120+0000","last_clean":"2024-04-26T11:44:50.722159+0000","last_became_active":"2024-04-26T11:47:12.255880+0000","last_became_peered":"2024-04-26T11:47:12.255880+0000","last_unstale":"2024-04-26T11:47:17.136120+0000","last_undegraded":"2024-04-26T11:47:12.165276+0000","last_fullsized":"2024-04-26T11:47:12.156834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.490162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-16}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":248,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135530+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:17.135530+0000","last_peered":"2024-04-26T11:47:17.135530+0000","last_clean":"2024-04-26T11:47:17.135530+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:17.135530+0000","last_undegraded":"2024-04-26T11:47:17.135530+0000","last_fullsized":"2024-04-26T11:47:17.135530+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":513,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135176+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:17.135176+0000","last_peered":"2024-04-26T11:47:17.135176+0000","last_clean":"2024-04-26T11:47:17.135176+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:17.135176+0000","last_undegraded":"2024-04-26T11:47:17.135176+0000","last_fullsized":"2024-04-26T11:47:17.135176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133109+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:17.133109+0000","last_peered":"2024-04-26T11:47:17.133109+0000","last_clean":"2024-04-26T11:47:17.133109+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:17.133109+0000","last_undegraded":"2024-04-26T11:47:17.133109+0000","last_fullsized":"2024-04-26T11:47:17.133109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":451,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136214+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:17.136214+0000","last_peered":"2024-04-26T11:47:17.136214+0000","last_clean":"2024-04-26T11:47:17.136214+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:17.136214+0000","last_undegraded":"2024-04-26T11:47:17.136214+0000","last_fullsized":"2024-04-26T11:47:17.136214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":599,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.132523+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:17.132523+0000","last_peered":"2024-04-26T11:47:17.132523+0000","last_clean":"2024-04-26T11:47:17.132523+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:17.132523+0000","last_undegraded":"2024-04-26T11:47:17.132523+0000","last_fullsized":"2024-04-26T11:47:17.132523+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":504,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133005+0000","last_change":"2024-04-26T11:47:12.257493+0000","last_active":"2024-04-26T11:47:17.133005+0000","last_peered":"2024-04-26T11:47:17.133005+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255726+0000","last_became_peered":"2024-04-26T11:47:12.255726+0000","last_unstale":"2024-04-26T11:47:17.133005+0000","last_undegraded":"2024-04-26T11:47:12.167230+0000","last_fullsized":"2024-04-26T11:47:12.165520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:41.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134533+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:17.134533+0000","last_peered":"2024-04-26T11:47:17.134533+0000","last_clean":"2024-04-26T11:47:17.134533+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:17.134533+0000","last_undegraded":"2024-04-26T11:47:17.134533+0000","last_fullsized":"2024-04-26T11:47:17.134533+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136179+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:17.136179+0000","last_peered":"2024-04-26T11:47:17.136179+0000","last_clean":"2024-04-26T11:47:17.136179+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:17.136179+0000","last_undegraded":"2024-04-26T11:47:17.136179+0000","last_fullsized":"2024-04-26T11:47:17.136179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":580,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428083+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:18.428083+0000","last_peered":"2024-04-26T11:47:18.428083+0000","last_clean":"2024-04-26T11:47:18.428083+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:18.428083+0000","last_undegraded":"2024-04-26T11:47:18.428083+0000","last_fullsized":"2024-04-26T11:47:18.428083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":539,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135419+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:17.135419+0000","last_peered":"2024-04-26T11:47:17.135419+0000","last_clean":"2024-04-26T11:47:17.135419+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:17.135419+0000","last_undegraded":"2024-04-26T11:47:17.135419+0000","last_fullsized":"2024-04-26T11:47:17.135419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134224+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:17.134224+0000","last_peered":"2024-04-26T11:47:17.134224+0000","last_clean":"2024-04-26T11:47:17.134224+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:17.134224+0000","last_undegraded":"2024-04-26T11:47:17.134224+0000","last_fullsized":"2024-04-26T11:47:17.134224+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.427306+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:18.427306+0000","last_peered":"2024-04-26T11:47:18.427306+0000","last_clean":"2024-04-26T11:47:18.427306+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:18.427306+0000","last_undegraded":"2024-04-26T11:47:18.427306+0000","last_fullsized":"2024-04-26T11:47:18.427306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":567,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134656+0000","last_change":"2024-04-26T11:47:12.262868+0000","last_active":"2024-04-26T11:47:17.134656+0000","last_peered":"2024-04-26T11:47:17.134656+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:17.134656+0000","last_undegraded":"2024-04-26T11:47:12.156540+0000","last_fullsized":"2024-04-26T11:47:12.146571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:45.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.427830+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:18.427830+0000","last_peered":"2024-04-26T11:47:18.427830+0000","last_clean":"2024-04-26T11:47:18.427830+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:18.427830+0000","last_undegraded":"2024-04-26T11:47:18.427830+0000","last_fullsized":"2024-04-26T11:47:18.427830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":496,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.132632+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:17.132632+0000","last_peered":"2024-04-26T11:47:17.132632+0000","last_clean":"2024-04-26T11:47:17.132632+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:17.132632+0000","last_undegraded":"2024-04-26T11:47:17.132632+0000","last_fullsized":"2024-04-26T11:47:17.132632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":427,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133211+0000","last_change":"2024-04-26T11:47:12.254070+0000","last_active":"2024-04-26T11:47:17.133211+0000","last_peered":"2024-04-26T11:47:17.133211+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.250084+0000","last_became_peered":"2024-04-26T11:47:12.250084+0000","last_unstale":"2024-04-26T11:47:17.133211+0000","last_undegraded":"2024-04-26T11:47:12.165871+0000","last_fullsized":"2024-04-26T11:47:12.161090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:19.765756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":152,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135732+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:17.135732+0000","last_peered":"2024-04-26T11:47:17.135732+0000","last_clean":"2024-04-26T11:47:17.135732+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:17.135732+0000","last_undegraded":"2024-04-26T11:47:17.135732+0000","last_fullsized":"2024-04-26T11:47:17.135732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":151,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135950+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:17.135950+0000","last_peered":"2024-04-26T11:47:17.135950+0000","last_clean":"2024-04-26T11:47:17.135950+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:17.135950+0000","last_undegraded":"2024-04-26T11:47:17.135950+0000","last_fullsized":"2024-04-26T11:47:17.135950+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":479,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134594+0000","last_change":"2024-04-26T11:47:12.256944+0000","last_active":"2024-04-26T11:47:17.134594+0000","last_peered":"2024-04-26T11:47:17.134594+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255779+0000","last_became_peered":"2024-04-26T11:47:12.255779+0000","last_unstale":"2024-04-26T11:47:17.134594+0000","last_undegraded":"2024-04-26T11:47:12.164475+0000","last_fullsized":"2024-04-26T11:47:12.155432+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:51.100421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":610,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.135947+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:17.135947+0000","last_peered":"2024-04-26T11:47:17.135947+0000","last_clean":"2024-04-26T11:47:17.135947+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:17.135947+0000","last_undegraded":"2024-04-26T11:47:17.135947+0000","last_fullsized":"2024-04-26T11:47:17.135947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428173+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:18.428173+0000","last_peered":"2024-04-26T11:47:18.428173+0000","last_clean":"2024-04-26T11:47:18.428173+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:18.428173+0000","last_undegraded":"2024-04-26T11:47:18.428173+0000","last_fullsized":"2024-04-26T11:47:18.428173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":451,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133162+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:17.133162+0000","last_peered":"2024-04-26T11:47:17.133162+0000","last_clean":"2024-04-26T11:47:17.133162+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:17.133162+0000","last_undegraded":"2024-04-26T11:47:17.133162+0000","last_fullsized":"2024-04-26T11:47:17.133162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428406+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:18.428406+0000","last_peered":"2024-04-26T11:47:18.428406+0000","last_clean":"2024-04-26T11:47:18.428406+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:18.428406+0000","last_undegraded":"2024-04-26T11:47:18.428406+0000","last_fullsized":"2024-04-26T11:47:18.428406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134453+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:17.134453+0000","last_peered":"2024-04-26T11:47:17.134453+0000","last_clean":"2024-04-26T11:47:17.134453+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:17.134453+0000","last_undegraded":"2024-04-26T11:47:17.134453+0000","last_fullsized":"2024-04-26T11:47:17.134453+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":492,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134059+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:17.134059+0000","last_peered":"2024-04-26T11:47:17.134059+0000","last_clean":"2024-04-26T11:47:17.134059+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:17.134059+0000","last_undegraded":"2024-04-26T11:47:17.134059+0000","last_fullsized":"2024-04-26T11:47:17.134059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.430058+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:18.430058+0000","last_peered":"2024-04-26T11:47:18.430058+0000","last_clean":"2024-04-26T11:47:18.430058+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:18.430058+0000","last_undegraded":"2024-04-26T11:47:18.430058+0000","last_fullsized":"2024-04-26T11:47:18.430058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428649+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:18.428649+0000","last_peered":"2024-04-26T11:47:18.428649+0000","last_clean":"2024-04-26T11:47:18.428649+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:18.428649+0000","last_undegraded":"2024-04-26T11:47:18.428649+0000","last_fullsized":"2024-04-26T11:47:18.428649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":470,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132950+0000","last_change":"2024-04-26T11:47:12.265335+0000","last_active":"2024-04-26T11:47:17.132950+0000","last_peered":"2024-04-26T11:47:17.132950+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:17.132950+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.428826+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:18.428826+0000","last_peered":"2024-04-26T11:47:18.428826+0000","last_clean":"2024-04-26T11:47:18.428826+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:18.428826+0000","last_undegraded":"2024-04-26T11:47:18.428826+0000","last_fullsized":"2024-04-26T11:47:18.428826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.137015+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:17.137015+0000","last_peered":"2024-04-26T11:47:17.137015+0000","last_clean":"2024-04-26T11:47:17.137015+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:17.137015+0000","last_undegraded":"2024-04-26T11:47:17.137015+0000","last_fullsized":"2024-04-26T11:47:17.137015+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":525,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.132877+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:17.132877+0000","last_peered":"2024-04-26T11:47:17.132877+0000","last_clean":"2024-04-26T11:47:17.132877+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:17.132877+0000","last_undegraded":"2024-04-26T11:47:17.132877+0000","last_fullsized":"2024-04-26T11:47:17.132877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134798+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:17.134798+0000","last_peered":"2024-04-26T11:47:17.134798+0000","last_clean":"2024-04-26T11:47:17.134798+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:17.134798+0000","last_undegraded":"2024-04-26T11:47:17.134798+0000","last_fullsized":"2024-04-26T11:47:17.134798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":484,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136735+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:17.136735+0000","last_peered":"2024-04-26T11:47:17.136735+0000","last_clean":"2024-04-26T11:47:17.136735+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:17.136735+0000","last_undegraded":"2024-04-26T11:47:17.136735+0000","last_fullsized":"2024-04-26T11:47:17.136735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":530,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132721+0000","last_change":"2024-04-26T11:47:12.261430+0000","last_active":"2024-04-26T11:47:17.132721+0000","last_peered":"2024-04-26T11:47:17.132721+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259639+0000","last_became_peered":"2024-04-26T11:47:12.259639+0000","last_unstale":"2024-04-26T11:47:17.132721+0000","last_undegraded":"2024-04-26T11:47:12.167836+0000","last_fullsized":"2024-04-26T11:47:12.160846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:57.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":176,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134312+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:17.134312+0000","last_peered":"2024-04-26T11:47:17.134312+0000","last_clean":"2024-04-26T11:47:17.134312+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:17.134312+0000","last_undegraded":"2024-04-26T11:47:17.134312+0000","last_fullsized":"2024-04-26T11:47:17.134312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":431,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136902+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:17.136902+0000","last_peered":"2024-04-26T11:47:17.136902+0000","last_clean":"2024-04-26T11:47:17.136902+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:17.136902+0000","last_undegraded":"2024-04-26T11:47:17.136902+0000","last_fullsized":"2024-04-26T11:47:17.136902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":557,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133306+0000","last_change":"2024-04-26T11:47:12.254913+0000","last_active":"2024-04-26T11:47:17.133306+0000","last_peered":"2024-04-26T11:47:17.133306+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251682+0000","last_became_peered":"2024-04-26T11:47:12.251682+0000","last_unstale":"2024-04-26T11:47:17.133306+0000","last_undegraded":"2024-04-26T11:47:12.157689+0000","last_fullsized":"2024-04-26T11:47:12.143256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:13.489428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":203,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.430975+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:18.430975+0000","last_peered":"2024-04-26T11:47:18.430975+0000","last_clean":"2024-04-26T11:47:18.430975+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:18.430975+0000","last_undegraded":"2024-04-26T11:47:18.430975+0000","last_fullsized":"2024-04-26T11:47:18.430975+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":566,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.132307+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:17.132307+0000","last_peered":"2024-04-26T11:47:17.132307+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:17.132307+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":483,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134932+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:17.134932+0000","last_peered":"2024-04-26T11:47:17.134932+0000","last_clean":"2024-04-26T11:47:17.134932+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:17.134932+0000","last_undegraded":"2024-04-26T11:47:17.134932+0000","last_fullsized":"2024-04-26T11:47:17.134932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":841,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.427229+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:18.427229+0000","last_peered":"2024-04-26T11:47:18.427229+0000","last_clean":"2024-04-26T11:47:18.427229+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:18.427229+0000","last_undegraded":"2024-04-26T11:47:18.427229+0000","last_fullsized":"2024-04-26T11:47:18.427229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":480,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.135685+0000","last_change":"2024-04-26T11:47:12.262558+0000","last_active":"2024-04-26T11:47:17.135685+0000","last_peered":"2024-04-26T11:47:17.135685+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.260513+0000","last_became_peered":"2024-04-26T11:47:12.260513+0000","last_unstale":"2024-04-26T11:47:17.135685+0000","last_undegraded":"2024-04-26T11:47:12.161322+0000","last_fullsized":"2024-04-26T11:47:12.156833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:46.502879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":398,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.427565+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:18.427565+0000","last_peered":"2024-04-26T11:47:18.427565+0000","last_clean":"2024-04-26T11:47:18.427565+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:18.427565+0000","last_undegraded":"2024-04-26T11:47:18.427565+0000","last_fullsized":"2024-04-26T11:47:18.427565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":504,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134033+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:17.134033+0000","last_peered":"2024-04-26T11:47:17.134033+0000","last_clean":"2024-04-26T11:47:17.134033+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:17.134033+0000","last_undegraded":"2024-04-26T11:47:17.134033+0000","last_fullsized":"2024-04-26T11:47:17.134033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":453,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.133490+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:17.133490+0000","last_peered":"2024-04-26T11:47:17.133490+0000","last_clean":"2024-04-26T11:47:17.133490+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:17.133490+0000","last_undegraded":"2024-04-26T11:47:17.133490+0000","last_fullsized":"2024-04-26T11:47:17.133490+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":812,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-26T11:47:18.140942+0000","last_change":"2024-04-26T11:47:18.141284+0000","last_active":"2024-04-26T11:47:18.140942+0000","last_peered":"2024-04-26T11:47:17.160873+0000","last_clean":"2024-04-26T11:44:49.186726+0000","last_became_active":"2024-04-26T11:47:12.247841+0000","last_became_peered":"2024-04-26T11:47:12.247841+0000","last_unstale":"2024-04-26T11:47:18.140942+0000","last_undegraded":"2024-04-26T11:47:18.140942+0000","last_fullsized":"2024-04-26T11:47:18.140942+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134292+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:17.134292+0000","last_peered":"2024-04-26T11:47:17.134292+0000","last_clean":"2024-04-26T11:47:17.134292+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:17.134292+0000","last_undegraded":"2024-04-26T11:47:17.134292+0000","last_fullsized":"2024-04-26T11:47:17.134292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":511,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.136235+0000","last_change":"2024-04-26T11:47:12.259550+0000","last_active":"2024-04-26T11:47:17.136235+0000","last_peered":"2024-04-26T11:47:17.136235+0000","last_clean":"2024-04-26T11:44:50.722361+0000","last_became_active":"2024-04-26T11:47:12.256906+0000","last_became_peered":"2024-04-26T11:47:12.256906+0000","last_unstale":"2024-04-26T11:47:17.136235+0000","last_undegraded":"2024-04-26T11:47:12.156736+0000","last_fullsized":"2024-04-26T11:47:12.144812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:25.280569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":373,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.136517+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:17.136517+0000","last_peered":"2024-04-26T11:47:17.136517+0000","last_clean":"2024-04-26T11:47:17.136517+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:17.136517+0000","last_undegraded":"2024-04-26T11:47:17.136517+0000","last_fullsized":"2024-04-26T11:47:17.136517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":506,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.136417+0000","last_change":"2024-04-26T11:47:12.254097+0000","last_active":"2024-04-26T11:47:17.136417+0000","last_peered":"2024-04-26T11:47:17.136417+0000","last_clean":"2024-04-26T11:44:50.722199+0000","last_became_active":"2024-04-26T11:47:12.251646+0000","last_became_peered":"2024-04-26T11:47:12.251646+0000","last_unstale":"2024-04-26T11:47:17.136417+0000","last_undegraded":"2024-04-26T11:47:12.161281+0000","last_fullsized":"2024-04-26T11:47:12.156381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:20.045697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":402,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T11:47:17.134160+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:17.134160+0000","last_peered":"2024-04-26T11:47:17.134160+0000","last_clean":"2024-04-26T11:47:17.134160+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:17.134160+0000","last_undegraded":"2024-04-26T11:47:17.134160+0000","last_fullsized":"2024-04-26T11:47:17.134160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":533,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.133627+0000","last_change":"2024-04-26T11:47:12.254202+0000","last_active":"2024-04-26T11:47:17.133627+0000","last_peered":"2024-04-26T11:47:17.133627+0000","last_clean":"2024-04-26T11:44:49.185959+0000","last_became_active":"2024-04-26T11:47:12.252111+0000","last_became_peered":"2024-04-26T11:47:12.252111+0000","last_unstale":"2024-04-26T11:47:17.133627+0000","last_undegraded":"2024-04-26T11:47:12.160789+0000","last_fullsized":"2024-04-26T11:47:12.146173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:57.514673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-10}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.429530+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:18.429530+0000","last_peered":"2024-04-26T11:47:18.429530+0000","last_clean":"2024-04-26T11:47:18.429530+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:18.429530+0000","last_undegraded":"2024-04-26T11:47:18.429530+0000","last_fullsized":"2024-04-26T11:47:18.429530+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":549,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:17.134988+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:17.134988+0000","last_peered":"2024-04-26T11:47:17.134988+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:17.134988+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T11:47:18.429847+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:18.429847+0000","last_peered":"2024-04-26T11:47:18.429847+0000","last_clean":"2024-04-26T11:47:18.429847+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:18.429847+0000","last_undegraded":"2024-04-26T11:47:18.429847+0000","last_fullsized":"2024-04-26T11:47:18.429847+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6416,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1711,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":91,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738410,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200132,"kb_used_data":88696,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171708,"statfs":{"total":96636764160,"available":96431828992,"internally_reserved":0,"allocated":90824704,"data_stored":90424097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":1,"up_from":72,"seq":309237645315,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119492,"kb_used_data":79672,"kb_used_omap":6,"kb_used_meta":39801,"kb_avail":94252348,"statfs":{"total":96636764160,"available":96514404352,"internally_reserved":0,"allocated":81584128,"data_stored":81205242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":40756480},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":0,"up_from":8,"seq":34359738409,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190312,"kb_used_data":82964,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181528,"statfs":{"total":96636764160,"available":96441884672,"internally_reserved":0,"allocated":84955136,"data_stored":84566140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:23.174 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:47:23.187 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:47:24.135 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:47:25.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:26.089 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:26.091 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:26.106 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-04-26T11:47:26.041021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4957,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2879,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":181,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":506020,"kb_used_data":251512,"kb_used_omap":9,"kb_used_meta":254454,"kb_avail":282609500,"statfs":{"total":289910292480,"available":289392128000,"internally_reserved":0,"allocated":257548288,"data_stored":256271664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":260561036},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1459,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001723"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":931,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166648+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:22.166648+0000","last_peered":"2024-04-26T11:47:22.166648+0000","last_clean":"2024-04-26T11:47:22.166648+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:22.166648+0000","last_undegraded":"2024-04-26T11:47:22.166648+0000","last_fullsized":"2024-04-26T11:47:22.166648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":598,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165401+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:22.165401+0000","last_peered":"2024-04-26T11:47:22.165401+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:22.165401+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":494,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167276+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:22.167276+0000","last_peered":"2024-04-26T11:47:22.167276+0000","last_clean":"2024-04-26T11:47:22.167276+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:22.167276+0000","last_undegraded":"2024-04-26T11:47:22.167276+0000","last_fullsized":"2024-04-26T11:47:22.167276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":809,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165501+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:22.165501+0000","last_peered":"2024-04-26T11:47:22.165501+0000","last_clean":"2024-04-26T11:47:22.165501+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:22.165501+0000","last_undegraded":"2024-04-26T11:47:22.165501+0000","last_fullsized":"2024-04-26T11:47:22.165501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":517,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166356+0000","last_change":"2024-04-26T11:47:12.258595+0000","last_active":"2024-04-26T11:47:22.166356+0000","last_peered":"2024-04-26T11:47:22.166356+0000","last_clean":"2024-04-26T11:44:49.186299+0000","last_became_active":"2024-04-26T11:47:12.256827+0000","last_became_peered":"2024-04-26T11:47:12.256827+0000","last_unstale":"2024-04-26T11:47:22.166356+0000","last_undegraded":"2024-04-26T11:47:12.160500+0000","last_fullsized":"2024-04-26T11:47:12.146275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:42.419089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":815,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164614+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:22.164614+0000","last_peered":"2024-04-26T11:47:22.164614+0000","last_clean":"2024-04-26T11:47:22.164614+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:22.164614+0000","last_undegraded":"2024-04-26T11:47:22.164614+0000","last_fullsized":"2024-04-26T11:47:22.164614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":615,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165659+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:22.165659+0000","last_peered":"2024-04-26T11:47:22.165659+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:22.165659+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":492,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164247+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:22.164247+0000","last_peered":"2024-04-26T11:47:22.164247+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:22.164247+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":513,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463824+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:23.463824+0000","last_peered":"2024-04-26T11:47:23.463824+0000","last_clean":"2024-04-26T11:47:23.463824+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:23.463824+0000","last_undegraded":"2024-04-26T11:47:23.463824+0000","last_fullsized":"2024-04-26T11:47:23.463824+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":572,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165621+0000","last_change":"2024-04-26T11:47:12.262968+0000","last_active":"2024-04-26T11:47:22.165621+0000","last_peered":"2024-04-26T11:47:22.165621+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:22.165621+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":843,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165750+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:22.165750+0000","last_peered":"2024-04-26T11:47:22.165750+0000","last_clean":"2024-04-26T11:47:22.165750+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:22.165750+0000","last_undegraded":"2024-04-26T11:47:22.165750+0000","last_fullsized":"2024-04-26T11:47:22.165750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":461,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165532+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:22.165532+0000","last_peered":"2024-04-26T11:47:22.165532+0000","last_clean":"2024-04-26T11:47:22.165532+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:22.165532+0000","last_undegraded":"2024-04-26T11:47:22.165532+0000","last_fullsized":"2024-04-26T11:47:22.165532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":863,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165820+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:22.165820+0000","last_peered":"2024-04-26T11:47:22.165820+0000","last_clean":"2024-04-26T11:47:22.165820+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:22.165820+0000","last_undegraded":"2024-04-26T11:47:22.165820+0000","last_fullsized":"2024-04-26T11:47:22.165820+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":533,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165694+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:22.165694+0000","last_peered":"2024-04-26T11:47:22.165694+0000","last_clean":"2024-04-26T11:47:22.165694+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:22.165694+0000","last_undegraded":"2024-04-26T11:47:22.165694+0000","last_fullsized":"2024-04-26T11:47:22.165694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":575,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165165+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:22.165165+0000","last_peered":"2024-04-26T11:47:22.165165+0000","last_clean":"2024-04-26T11:47:22.165165+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:22.165165+0000","last_undegraded":"2024-04-26T11:47:22.165165+0000","last_fullsized":"2024-04-26T11:47:22.165165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":630,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164423+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:22.164423+0000","last_peered":"2024-04-26T11:47:22.164423+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:22.164423+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":481,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463596+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:23.463596+0000","last_peered":"2024-04-26T11:47:23.463596+0000","last_clean":"2024-04-26T11:47:23.463596+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:23.463596+0000","last_undegraded":"2024-04-26T11:47:23.463596+0000","last_fullsized":"2024-04-26T11:47:23.463596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":531,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166092+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:22.166092+0000","last_peered":"2024-04-26T11:47:22.166092+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:22.166092+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":531,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166994+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:22.166994+0000","last_peered":"2024-04-26T11:47:22.166994+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:22.166994+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":984,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166872+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:22.166872+0000","last_peered":"2024-04-26T11:47:22.166872+0000","last_clean":"2024-04-26T11:47:22.166872+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:22.166872+0000","last_undegraded":"2024-04-26T11:47:22.166872+0000","last_fullsized":"2024-04-26T11:47:22.166872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":546,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.167888+0000","last_change":"2024-04-26T11:47:12.265247+0000","last_active":"2024-04-26T11:47:22.167888+0000","last_peered":"2024-04-26T11:47:22.167888+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:22.167888+0000","last_undegraded":"2024-04-26T11:47:12.167328+0000","last_fullsized":"2024-04-26T11:47:12.157724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:35.162556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-13}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":547,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165123+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:22.165123+0000","last_peered":"2024-04-26T11:47:22.165123+0000","last_clean":"2024-04-26T11:47:22.165123+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:22.165123+0000","last_undegraded":"2024-04-26T11:47:22.165123+0000","last_fullsized":"2024-04-26T11:47:22.165123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":498,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164118+0000","last_change":"2024-04-26T11:47:12.255039+0000","last_active":"2024-04-26T11:47:22.164118+0000","last_peered":"2024-04-26T11:47:22.164118+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251782+0000","last_became_peered":"2024-04-26T11:47:12.251782+0000","last_unstale":"2024-04-26T11:47:22.164118+0000","last_undegraded":"2024-04-26T11:47:12.160070+0000","last_fullsized":"2024-04-26T11:47:12.143241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":592,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164050+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:22.164050+0000","last_peered":"2024-04-26T11:47:22.164050+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:22.164050+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166762+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:22.166762+0000","last_peered":"2024-04-26T11:47:22.166762+0000","last_clean":"2024-04-26T11:47:22.166762+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:22.166762+0000","last_undegraded":"2024-04-26T11:47:22.166762+0000","last_fullsized":"2024-04-26T11:47:22.166762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":627,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.168043+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:22.168043+0000","last_peered":"2024-04-26T11:47:22.168043+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:22.168043+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":485,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166917+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:22.166917+0000","last_peered":"2024-04-26T11:47:22.166917+0000","last_clean":"2024-04-26T11:47:22.166917+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:22.166917+0000","last_undegraded":"2024-04-26T11:47:22.166917+0000","last_fullsized":"2024-04-26T11:47:22.166917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":566,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165805+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:22.165805+0000","last_peered":"2024-04-26T11:47:22.165805+0000","last_clean":"2024-04-26T11:47:22.165805+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:22.165805+0000","last_undegraded":"2024-04-26T11:47:22.165805+0000","last_fullsized":"2024-04-26T11:47:22.165805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":491,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165525+0000","last_change":"2024-04-26T11:47:12.258316+0000","last_active":"2024-04-26T11:47:22.165525+0000","last_peered":"2024-04-26T11:47:22.165525+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.256893+0000","last_became_peered":"2024-04-26T11:47:12.256893+0000","last_unstale":"2024-04-26T11:47:22.165525+0000","last_undegraded":"2024-04-26T11:47:12.163546+0000","last_fullsized":"2024-04-26T11:47:12.157883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:48.825981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":595,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165605+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:22.165605+0000","last_peered":"2024-04-26T11:47:22.165605+0000","last_clean":"2024-04-26T11:47:22.165605+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:22.165605+0000","last_undegraded":"2024-04-26T11:47:22.165605+0000","last_fullsized":"2024-04-26T11:47:22.165605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":566,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164183+0000","last_change":"2024-04-26T11:47:12.262325+0000","last_active":"2024-04-26T11:47:22.164183+0000","last_peered":"2024-04-26T11:47:22.164183+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259636+0000","last_became_peered":"2024-04-26T11:47:12.259636+0000","last_unstale":"2024-04-26T11:47:22.164183+0000","last_undegraded":"2024-04-26T11:47:12.166109+0000","last_fullsized":"2024-04-26T11:47:12.158494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:27.521969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":528,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165628+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:22.165628+0000","last_peered":"2024-04-26T11:47:22.165628+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:22.165628+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":474,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.167895+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:22.167895+0000","last_peered":"2024-04-26T11:47:22.167895+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:22.167895+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":593,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165501+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:22.165501+0000","last_peered":"2024-04-26T11:47:22.165501+0000","last_clean":"2024-04-26T11:47:22.165501+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:22.165501+0000","last_undegraded":"2024-04-26T11:47:22.165501+0000","last_fullsized":"2024-04-26T11:47:22.165501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":585,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.167344+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:22.167344+0000","last_peered":"2024-04-26T11:47:22.167344+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:22.167344+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.462329+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:23.462329+0000","last_peered":"2024-04-26T11:47:23.462329+0000","last_clean":"2024-04-26T11:47:23.462329+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:23.462329+0000","last_undegraded":"2024-04-26T11:47:23.462329+0000","last_fullsized":"2024-04-26T11:47:23.462329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":506,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166193+0000","last_change":"2024-04-26T11:47:12.262102+0000","last_active":"2024-04-26T11:47:22.166193+0000","last_peered":"2024-04-26T11:47:22.166193+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259702+0000","last_became_peered":"2024-04-26T11:47:12.259702+0000","last_unstale":"2024-04-26T11:47:22.166193+0000","last_undegraded":"2024-04-26T11:47:12.156439+0000","last_fullsized":"2024-04-26T11:47:12.146012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164809+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:22.164809+0000","last_peered":"2024-04-26T11:47:22.164809+0000","last_clean":"2024-04-26T11:47:22.164809+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:22.164809+0000","last_undegraded":"2024-04-26T11:47:22.164809+0000","last_fullsized":"2024-04-26T11:47:22.164809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":521,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463050+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:23.463050+0000","last_peered":"2024-04-26T11:47:23.463050+0000","last_clean":"2024-04-26T11:47:23.463050+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:23.463050+0000","last_undegraded":"2024-04-26T11:47:23.463050+0000","last_fullsized":"2024-04-26T11:47:23.463050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":145,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164910+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:22.164910+0000","last_peered":"2024-04-26T11:47:22.164910+0000","last_clean":"2024-04-26T11:47:22.164910+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:22.164910+0000","last_undegraded":"2024-04-26T11:47:22.164910+0000","last_fullsized":"2024-04-26T11:47:22.164910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166611+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:22.166611+0000","last_peered":"2024-04-26T11:47:22.166611+0000","last_clean":"2024-04-26T11:47:22.166611+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:22.166611+0000","last_undegraded":"2024-04-26T11:47:22.166611+0000","last_fullsized":"2024-04-26T11:47:22.166611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":510,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164253+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:22.164253+0000","last_peered":"2024-04-26T11:47:22.164253+0000","last_clean":"2024-04-26T11:47:22.164253+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:22.164253+0000","last_undegraded":"2024-04-26T11:47:22.164253+0000","last_fullsized":"2024-04-26T11:47:22.164253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":470,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166486+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:22.166486+0000","last_peered":"2024-04-26T11:47:22.166486+0000","last_clean":"2024-04-26T11:47:22.166486+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:22.166486+0000","last_undegraded":"2024-04-26T11:47:22.166486+0000","last_fullsized":"2024-04-26T11:47:22.166486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":994,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-26T11:47:23.175176+0000","last_change":"2024-04-26T11:47:23.175607+0000","last_active":"2024-04-26T11:47:23.175176+0000","last_peered":"2024-04-26T11:47:22.724258+0000","last_clean":"2024-04-26T11:44:49.185565+0000","last_became_active":"2024-04-26T11:47:12.252329+0000","last_became_peered":"2024-04-26T11:47:12.252329+0000","last_unstale":"2024-04-26T11:47:23.175176+0000","last_undegraded":"2024-04-26T11:47:23.175176+0000","last_fullsized":"2024-04-26T11:47:23.175176+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":664,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167579+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:22.167579+0000","last_peered":"2024-04-26T11:47:22.167579+0000","last_clean":"2024-04-26T11:47:22.167579+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:22.167579+0000","last_undegraded":"2024-04-26T11:47:22.167579+0000","last_fullsized":"2024-04-26T11:47:22.167579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":985,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.181778+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:23.181778+0000","last_peered":"2024-04-26T11:47:23.181778+0000","last_clean":"2024-04-26T11:47:23.181778+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:23.181778+0000","last_undegraded":"2024-04-26T11:47:23.181778+0000","last_fullsized":"2024-04-26T11:47:23.181778+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":153,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167321+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:22.167321+0000","last_peered":"2024-04-26T11:47:22.167321+0000","last_clean":"2024-04-26T11:47:22.167321+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:22.167321+0000","last_undegraded":"2024-04-26T11:47:22.167321+0000","last_fullsized":"2024-04-26T11:47:22.167321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":591,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463543+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:23.463543+0000","last_peered":"2024-04-26T11:47:23.463543+0000","last_clean":"2024-04-26T11:47:23.463543+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:23.463543+0000","last_undegraded":"2024-04-26T11:47:23.463543+0000","last_fullsized":"2024-04-26T11:47:23.463543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":343,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.462868+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:23.462868+0000","last_peered":"2024-04-26T11:47:23.462868+0000","last_clean":"2024-04-26T11:47:23.462868+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:23.462868+0000","last_undegraded":"2024-04-26T11:47:23.462868+0000","last_fullsized":"2024-04-26T11:47:23.462868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":534,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166930+0000","last_change":"2024-04-26T11:47:12.257450+0000","last_active":"2024-04-26T11:47:22.166930+0000","last_peered":"2024-04-26T11:47:22.166930+0000","last_clean":"2024-04-26T11:44:50.722159+0000","last_became_active":"2024-04-26T11:47:12.255880+0000","last_became_peered":"2024-04-26T11:47:12.255880+0000","last_unstale":"2024-04-26T11:47:22.166930+0000","last_undegraded":"2024-04-26T11:47:12.165276+0000","last_fullsized":"2024-04-26T11:47:12.156834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.490162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-16}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":253,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166603+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:22.166603+0000","last_peered":"2024-04-26T11:47:22.166603+0000","last_clean":"2024-04-26T11:47:22.166603+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:22.166603+0000","last_undegraded":"2024-04-26T11:47:22.166603+0000","last_fullsized":"2024-04-26T11:47:22.166603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167357+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:22.167357+0000","last_peered":"2024-04-26T11:47:22.167357+0000","last_clean":"2024-04-26T11:47:22.167357+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:22.167357+0000","last_undegraded":"2024-04-26T11:47:22.167357+0000","last_fullsized":"2024-04-26T11:47:22.167357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164965+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:22.164965+0000","last_peered":"2024-04-26T11:47:22.164965+0000","last_clean":"2024-04-26T11:47:22.164965+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:22.164965+0000","last_undegraded":"2024-04-26T11:47:22.164965+0000","last_fullsized":"2024-04-26T11:47:22.164965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":456,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167794+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:22.167794+0000","last_peered":"2024-04-26T11:47:22.167794+0000","last_clean":"2024-04-26T11:47:22.167794+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:22.167794+0000","last_undegraded":"2024-04-26T11:47:22.167794+0000","last_fullsized":"2024-04-26T11:47:22.167794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":604,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164545+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:22.164545+0000","last_peered":"2024-04-26T11:47:22.164545+0000","last_clean":"2024-04-26T11:47:22.164545+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:22.164545+0000","last_undegraded":"2024-04-26T11:47:22.164545+0000","last_fullsized":"2024-04-26T11:47:22.164545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":509,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166262+0000","last_change":"2024-04-26T11:47:12.257493+0000","last_active":"2024-04-26T11:47:22.166262+0000","last_peered":"2024-04-26T11:47:22.166262+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255726+0000","last_became_peered":"2024-04-26T11:47:12.255726+0000","last_unstale":"2024-04-26T11:47:22.166262+0000","last_undegraded":"2024-04-26T11:47:12.167230+0000","last_fullsized":"2024-04-26T11:47:12.165520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:41.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":280,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166294+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:22.166294+0000","last_peered":"2024-04-26T11:47:22.166294+0000","last_clean":"2024-04-26T11:47:22.166294+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:22.166294+0000","last_undegraded":"2024-04-26T11:47:22.166294+0000","last_fullsized":"2024-04-26T11:47:22.166294+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166158+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:22.166158+0000","last_peered":"2024-04-26T11:47:22.166158+0000","last_clean":"2024-04-26T11:47:22.166158+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:22.166158+0000","last_undegraded":"2024-04-26T11:47:22.166158+0000","last_fullsized":"2024-04-26T11:47:22.166158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":585,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.462921+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:23.462921+0000","last_peered":"2024-04-26T11:47:23.462921+0000","last_clean":"2024-04-26T11:47:23.462921+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:23.462921+0000","last_undegraded":"2024-04-26T11:47:23.462921+0000","last_fullsized":"2024-04-26T11:47:23.462921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":544,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167521+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:22.167521+0000","last_peered":"2024-04-26T11:47:22.167521+0000","last_clean":"2024-04-26T11:47:22.167521+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:22.167521+0000","last_undegraded":"2024-04-26T11:47:22.167521+0000","last_fullsized":"2024-04-26T11:47:22.167521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166601+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:22.166601+0000","last_peered":"2024-04-26T11:47:22.166601+0000","last_clean":"2024-04-26T11:47:22.166601+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:22.166601+0000","last_undegraded":"2024-04-26T11:47:22.166601+0000","last_fullsized":"2024-04-26T11:47:22.166601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":337,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.461845+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:23.461845+0000","last_peered":"2024-04-26T11:47:23.461845+0000","last_clean":"2024-04-26T11:47:23.461845+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:23.461845+0000","last_undegraded":"2024-04-26T11:47:23.461845+0000","last_fullsized":"2024-04-26T11:47:23.461845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":572,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.168004+0000","last_change":"2024-04-26T11:47:12.262868+0000","last_active":"2024-04-26T11:47:22.168004+0000","last_peered":"2024-04-26T11:47:22.168004+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:22.168004+0000","last_undegraded":"2024-04-26T11:47:12.156540+0000","last_fullsized":"2024-04-26T11:47:12.146571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:45.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.462506+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:23.462506+0000","last_peered":"2024-04-26T11:47:23.462506+0000","last_clean":"2024-04-26T11:47:23.462506+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:23.462506+0000","last_undegraded":"2024-04-26T11:47:23.462506+0000","last_fullsized":"2024-04-26T11:47:23.462506+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":501,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164532+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:22.164532+0000","last_peered":"2024-04-26T11:47:22.164532+0000","last_clean":"2024-04-26T11:47:22.164532+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:22.164532+0000","last_undegraded":"2024-04-26T11:47:22.164532+0000","last_fullsized":"2024-04-26T11:47:22.164532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":429,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.464119+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:23.464119+0000","last_peered":"2024-04-26T11:47:23.464119+0000","last_clean":"2024-04-26T11:47:23.464119+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:23.464119+0000","last_undegraded":"2024-04-26T11:47:23.464119+0000","last_fullsized":"2024-04-26T11:47:23.464119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166865+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:22.166865+0000","last_peered":"2024-04-26T11:47:22.166865+0000","last_clean":"2024-04-26T11:47:22.166865+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:22.166865+0000","last_undegraded":"2024-04-26T11:47:22.166865+0000","last_fullsized":"2024-04-26T11:47:22.166865+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165952+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:22.165952+0000","last_peered":"2024-04-26T11:47:22.165952+0000","last_clean":"2024-04-26T11:47:22.165952+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:22.165952+0000","last_undegraded":"2024-04-26T11:47:22.165952+0000","last_fullsized":"2024-04-26T11:47:22.165952+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":466,"reported_epoch":86,"state":"peering","last_fresh":"2024-04-26T11:47:24.431184+0000","last_change":"2024-04-26T11:47:24.430841+0000","last_active":"2024-04-26T11:47:24.430841+0000","last_peered":"2024-04-26T11:47:12.387493+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255779+0000","last_became_peered":"2024-04-26T11:47:12.255779+0000","last_unstale":"2024-04-26T11:47:24.431184+0000","last_undegraded":"2024-04-26T11:47:24.431184+0000","last_fullsized":"2024-04-26T11:47:24.431184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:26.975695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":615,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167676+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:22.167676+0000","last_peered":"2024-04-26T11:47:22.167676+0000","last_clean":"2024-04-26T11:47:22.167676+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:22.167676+0000","last_undegraded":"2024-04-26T11:47:22.167676+0000","last_fullsized":"2024-04-26T11:47:22.167676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463226+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:23.463226+0000","last_peered":"2024-04-26T11:47:23.463226+0000","last_clean":"2024-04-26T11:47:23.463226+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:23.463226+0000","last_undegraded":"2024-04-26T11:47:23.463226+0000","last_fullsized":"2024-04-26T11:47:23.463226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":456,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165365+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:22.165365+0000","last_peered":"2024-04-26T11:47:22.165365+0000","last_clean":"2024-04-26T11:47:22.165365+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:22.165365+0000","last_undegraded":"2024-04-26T11:47:22.165365+0000","last_fullsized":"2024-04-26T11:47:22.165365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463617+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:23.463617+0000","last_peered":"2024-04-26T11:47:23.463617+0000","last_clean":"2024-04-26T11:47:23.463617+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:23.463617+0000","last_undegraded":"2024-04-26T11:47:23.463617+0000","last_fullsized":"2024-04-26T11:47:23.463617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167864+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:22.167864+0000","last_peered":"2024-04-26T11:47:22.167864+0000","last_clean":"2024-04-26T11:47:22.167864+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:22.167864+0000","last_undegraded":"2024-04-26T11:47:22.167864+0000","last_fullsized":"2024-04-26T11:47:22.167864+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":497,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165991+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:22.165991+0000","last_peered":"2024-04-26T11:47:22.165991+0000","last_clean":"2024-04-26T11:47:22.165991+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:22.165991+0000","last_undegraded":"2024-04-26T11:47:22.165991+0000","last_fullsized":"2024-04-26T11:47:22.165991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463343+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:23.463343+0000","last_peered":"2024-04-26T11:47:23.463343+0000","last_clean":"2024-04-26T11:47:23.463343+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:23.463343+0000","last_undegraded":"2024-04-26T11:47:23.463343+0000","last_fullsized":"2024-04-26T11:47:23.463343+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463075+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:23.463075+0000","last_peered":"2024-04-26T11:47:23.463075+0000","last_clean":"2024-04-26T11:47:23.463075+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:23.463075+0000","last_undegraded":"2024-04-26T11:47:23.463075+0000","last_fullsized":"2024-04-26T11:47:23.463075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":475,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.163908+0000","last_change":"2024-04-26T11:47:12.265335+0000","last_active":"2024-04-26T11:47:22.163908+0000","last_peered":"2024-04-26T11:47:22.163908+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:22.163908+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463300+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:23.463300+0000","last_peered":"2024-04-26T11:47:23.463300+0000","last_clean":"2024-04-26T11:47:23.463300+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:23.463300+0000","last_undegraded":"2024-04-26T11:47:23.463300+0000","last_fullsized":"2024-04-26T11:47:23.463300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166575+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:22.166575+0000","last_peered":"2024-04-26T11:47:22.166575+0000","last_clean":"2024-04-26T11:47:22.166575+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:22.166575+0000","last_undegraded":"2024-04-26T11:47:22.166575+0000","last_fullsized":"2024-04-26T11:47:22.166575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":530,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164649+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:22.164649+0000","last_peered":"2024-04-26T11:47:22.164649+0000","last_clean":"2024-04-26T11:47:22.164649+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:22.164649+0000","last_undegraded":"2024-04-26T11:47:22.164649+0000","last_fullsized":"2024-04-26T11:47:22.164649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164996+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:22.164996+0000","last_peered":"2024-04-26T11:47:22.164996+0000","last_clean":"2024-04-26T11:47:22.164996+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:22.164996+0000","last_undegraded":"2024-04-26T11:47:22.164996+0000","last_fullsized":"2024-04-26T11:47:22.164996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":489,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167248+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:22.167248+0000","last_peered":"2024-04-26T11:47:22.167248+0000","last_clean":"2024-04-26T11:47:22.167248+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:22.167248+0000","last_undegraded":"2024-04-26T11:47:22.167248+0000","last_fullsized":"2024-04-26T11:47:22.167248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":535,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164390+0000","last_change":"2024-04-26T11:47:12.261430+0000","last_active":"2024-04-26T11:47:22.164390+0000","last_peered":"2024-04-26T11:47:22.164390+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259639+0000","last_became_peered":"2024-04-26T11:47:12.259639+0000","last_unstale":"2024-04-26T11:47:22.164390+0000","last_undegraded":"2024-04-26T11:47:12.167836+0000","last_fullsized":"2024-04-26T11:47:12.160846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:57.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":181,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167645+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:22.167645+0000","last_peered":"2024-04-26T11:47:22.167645+0000","last_clean":"2024-04-26T11:47:22.167645+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:22.167645+0000","last_undegraded":"2024-04-26T11:47:22.167645+0000","last_fullsized":"2024-04-26T11:47:22.167645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":436,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.168011+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:22.168011+0000","last_peered":"2024-04-26T11:47:22.168011+0000","last_clean":"2024-04-26T11:47:22.168011+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:22.168011+0000","last_undegraded":"2024-04-26T11:47:22.168011+0000","last_fullsized":"2024-04-26T11:47:22.168011+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":597,"reported_epoch":85,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:24.047588+0000","last_change":"2024-04-26T11:47:23.970642+0000","last_active":"2024-04-26T11:47:24.047588+0000","last_peered":"2024-04-26T11:47:24.047588+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251682+0000","last_became_peered":"2024-04-26T11:47:12.251682+0000","last_unstale":"2024-04-26T11:47:24.047588+0000","last_undegraded":"2024-04-26T11:47:12.157689+0000","last_fullsized":"2024-04-26T11:47:12.143256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:13.489428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":11,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463891+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:23.463891+0000","last_peered":"2024-04-26T11:47:23.463891+0000","last_clean":"2024-04-26T11:47:23.463891+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:23.463891+0000","last_undegraded":"2024-04-26T11:47:23.463891+0000","last_fullsized":"2024-04-26T11:47:23.463891+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":571,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.163867+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:22.163867+0000","last_peered":"2024-04-26T11:47:22.163867+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:22.163867+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":488,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166999+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:22.166999+0000","last_peered":"2024-04-26T11:47:22.166999+0000","last_clean":"2024-04-26T11:47:22.166999+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:22.166999+0000","last_undegraded":"2024-04-26T11:47:22.166999+0000","last_fullsized":"2024-04-26T11:47:22.166999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":846,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.461615+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:23.461615+0000","last_peered":"2024-04-26T11:47:23.461615+0000","last_clean":"2024-04-26T11:47:23.461615+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:23.461615+0000","last_undegraded":"2024-04-26T11:47:23.461615+0000","last_fullsized":"2024-04-26T11:47:23.461615+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":485,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166847+0000","last_change":"2024-04-26T11:47:12.262558+0000","last_active":"2024-04-26T11:47:22.166847+0000","last_peered":"2024-04-26T11:47:22.166847+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.260513+0000","last_became_peered":"2024-04-26T11:47:12.260513+0000","last_unstale":"2024-04-26T11:47:22.166847+0000","last_undegraded":"2024-04-26T11:47:12.161322+0000","last_fullsized":"2024-04-26T11:47:12.156833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:46.502879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":403,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.461875+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:23.461875+0000","last_peered":"2024-04-26T11:47:23.461875+0000","last_clean":"2024-04-26T11:47:23.461875+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:23.461875+0000","last_undegraded":"2024-04-26T11:47:23.461875+0000","last_fullsized":"2024-04-26T11:47:23.461875+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":509,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167163+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:22.167163+0000","last_peered":"2024-04-26T11:47:22.167163+0000","last_clean":"2024-04-26T11:47:22.167163+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:22.167163+0000","last_undegraded":"2024-04-26T11:47:22.167163+0000","last_fullsized":"2024-04-26T11:47:22.167163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":458,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165860+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:22.165860+0000","last_peered":"2024-04-26T11:47:22.165860+0000","last_clean":"2024-04-26T11:47:22.165860+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:22.165860+0000","last_undegraded":"2024-04-26T11:47:22.165860+0000","last_fullsized":"2024-04-26T11:47:22.165860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":824,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165503+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:22.165503+0000","last_peered":"2024-04-26T11:47:22.165503+0000","last_clean":"2024-04-26T11:47:22.165503+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:22.165503+0000","last_undegraded":"2024-04-26T11:47:22.165503+0000","last_fullsized":"2024-04-26T11:47:22.165503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":135,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166781+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:22.166781+0000","last_peered":"2024-04-26T11:47:22.166781+0000","last_clean":"2024-04-26T11:47:22.166781+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:22.166781+0000","last_undegraded":"2024-04-26T11:47:22.166781+0000","last_fullsized":"2024-04-26T11:47:22.166781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":516,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164972+0000","last_change":"2024-04-26T11:47:12.259550+0000","last_active":"2024-04-26T11:47:22.164972+0000","last_peered":"2024-04-26T11:47:22.164972+0000","last_clean":"2024-04-26T11:44:50.722361+0000","last_became_active":"2024-04-26T11:47:12.256906+0000","last_became_peered":"2024-04-26T11:47:12.256906+0000","last_unstale":"2024-04-26T11:47:22.164972+0000","last_undegraded":"2024-04-26T11:47:12.156736+0000","last_fullsized":"2024-04-26T11:47:12.144812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:25.280569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":378,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167167+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:22.167167+0000","last_peered":"2024-04-26T11:47:22.167167+0000","last_clean":"2024-04-26T11:47:22.167167+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:22.167167+0000","last_undegraded":"2024-04-26T11:47:22.167167+0000","last_fullsized":"2024-04-26T11:47:22.167167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":863,"reported_epoch":85,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:23.348883+0000","last_change":"2024-04-26T11:47:23.349220+0000","last_active":"2024-04-26T11:47:23.348883+0000","last_peered":"2024-04-26T11:47:23.348883+0000","last_clean":"2024-04-26T11:44:50.722199+0000","last_became_active":"2024-04-26T11:47:12.251646+0000","last_became_peered":"2024-04-26T11:47:12.251646+0000","last_unstale":"2024-04-26T11:47:23.348883+0000","last_undegraded":"2024-04-26T11:47:12.161281+0000","last_fullsized":"2024-04-26T11:47:12.156381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:20.045697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":407,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167422+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:22.167422+0000","last_peered":"2024-04-26T11:47:22.167422+0000","last_clean":"2024-04-26T11:47:22.167422+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:22.167422+0000","last_undegraded":"2024-04-26T11:47:22.167422+0000","last_fullsized":"2024-04-26T11:47:22.167422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":922,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.183469+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:23.183469+0000","last_peered":"2024-04-26T11:47:23.183469+0000","last_clean":"2024-04-26T11:47:23.183469+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:23.183469+0000","last_undegraded":"2024-04-26T11:47:23.183469+0000","last_fullsized":"2024-04-26T11:47:23.183469+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.464145+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:23.464145+0000","last_peered":"2024-04-26T11:47:23.464145+0000","last_clean":"2024-04-26T11:47:23.464145+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:23.464145+0000","last_undegraded":"2024-04-26T11:47:23.464145+0000","last_fullsized":"2024-04-26T11:47:23.464145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":554,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165887+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:22.165887+0000","last_peered":"2024-04-26T11:47:22.165887+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:22.165887+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.462759+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:23.462759+0000","last_peered":"2024-04-26T11:47:23.462759+0000","last_clean":"2024-04-26T11:47:23.462759+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:23.462759+0000","last_undegraded":"2024-04-26T11:47:23.462759+0000","last_fullsized":"2024-04-26T11:47:23.462759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4957,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2858,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":99,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738411,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200200,"kb_used_data":88756,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171640,"statfs":{"total":96636764160,"available":96431759360,"internally_reserved":0,"allocated":90886144,"data_stored":90449492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":1,"up_from":72,"seq":309237645316,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115452,"kb_used_data":79732,"kb_used_omap":6,"kb_used_meta":35705,"kb_avail":94256388,"statfs":{"total":96636764160,"available":96518541312,"internally_reserved":0,"allocated":81645568,"data_stored":81230637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":36562176},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738410,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190368,"kb_used_data":83024,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181472,"statfs":{"total":96636764160,"available":96441827328,"internally_reserved":0,"allocated":85016576,"data_stored":84591535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:26.110 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:47:26.473 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:26.474 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 4957/108 objects degraded (4589.815%), 28 pgs degraded","count":28},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":207,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":88,"num_osds":3,"num_up_osds":3,"osd_up_since":1714132030,"num_in_osds":3,"osd_in_since":1714131840,"num_remapped_pgs":25},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":74},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":27},{"state_name":"peering","count":2},{"state_name":"active+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127603811,"bytes_used":518164480,"bytes_avail":289392128000,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":4957,"degraded_total":108,"degraded_ratio":45.898148148148145,"recovering_objects_per_sec":286,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1147,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4213}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T11:45:27.979634+0000","services":{}},"progress_events":{}} 2024-04-26T11:47:26.492 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:47:26.493 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:26.805 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:26.808 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-04-26T11:47:26.132396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4957,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2879,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":181,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":506020,"kb_used_data":251512,"kb_used_omap":9,"kb_used_meta":254454,"kb_avail":282609500,"statfs":{"total":289910292480,"available":289392128000,"internally_reserved":0,"allocated":257548288,"data_stored":256271664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":260561036},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1459,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.974439"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":931,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166648+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:22.166648+0000","last_peered":"2024-04-26T11:47:22.166648+0000","last_clean":"2024-04-26T11:47:22.166648+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:22.166648+0000","last_undegraded":"2024-04-26T11:47:22.166648+0000","last_fullsized":"2024-04-26T11:47:22.166648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":598,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165401+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:22.165401+0000","last_peered":"2024-04-26T11:47:22.165401+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:22.165401+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":494,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167276+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:22.167276+0000","last_peered":"2024-04-26T11:47:22.167276+0000","last_clean":"2024-04-26T11:47:22.167276+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:22.167276+0000","last_undegraded":"2024-04-26T11:47:22.167276+0000","last_fullsized":"2024-04-26T11:47:22.167276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":809,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165501+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:22.165501+0000","last_peered":"2024-04-26T11:47:22.165501+0000","last_clean":"2024-04-26T11:47:22.165501+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:22.165501+0000","last_undegraded":"2024-04-26T11:47:22.165501+0000","last_fullsized":"2024-04-26T11:47:22.165501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":517,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166356+0000","last_change":"2024-04-26T11:47:12.258595+0000","last_active":"2024-04-26T11:47:22.166356+0000","last_peered":"2024-04-26T11:47:22.166356+0000","last_clean":"2024-04-26T11:44:49.186299+0000","last_became_active":"2024-04-26T11:47:12.256827+0000","last_became_peered":"2024-04-26T11:47:12.256827+0000","last_unstale":"2024-04-26T11:47:22.166356+0000","last_undegraded":"2024-04-26T11:47:12.160500+0000","last_fullsized":"2024-04-26T11:47:12.146275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:42.419089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":815,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164614+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:22.164614+0000","last_peered":"2024-04-26T11:47:22.164614+0000","last_clean":"2024-04-26T11:47:22.164614+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:22.164614+0000","last_undegraded":"2024-04-26T11:47:22.164614+0000","last_fullsized":"2024-04-26T11:47:22.164614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":615,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165659+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:22.165659+0000","last_peered":"2024-04-26T11:47:22.165659+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:22.165659+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":492,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164247+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:22.164247+0000","last_peered":"2024-04-26T11:47:22.164247+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:22.164247+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":513,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463824+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:23.463824+0000","last_peered":"2024-04-26T11:47:23.463824+0000","last_clean":"2024-04-26T11:47:23.463824+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:23.463824+0000","last_undegraded":"2024-04-26T11:47:23.463824+0000","last_fullsized":"2024-04-26T11:47:23.463824+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":572,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165621+0000","last_change":"2024-04-26T11:47:12.262968+0000","last_active":"2024-04-26T11:47:22.165621+0000","last_peered":"2024-04-26T11:47:22.165621+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:22.165621+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":843,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165750+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:22.165750+0000","last_peered":"2024-04-26T11:47:22.165750+0000","last_clean":"2024-04-26T11:47:22.165750+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:22.165750+0000","last_undegraded":"2024-04-26T11:47:22.165750+0000","last_fullsized":"2024-04-26T11:47:22.165750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":461,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165532+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:22.165532+0000","last_peered":"2024-04-26T11:47:22.165532+0000","last_clean":"2024-04-26T11:47:22.165532+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:22.165532+0000","last_undegraded":"2024-04-26T11:47:22.165532+0000","last_fullsized":"2024-04-26T11:47:22.165532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":863,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165820+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:22.165820+0000","last_peered":"2024-04-26T11:47:22.165820+0000","last_clean":"2024-04-26T11:47:22.165820+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:22.165820+0000","last_undegraded":"2024-04-26T11:47:22.165820+0000","last_fullsized":"2024-04-26T11:47:22.165820+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":533,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165694+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:22.165694+0000","last_peered":"2024-04-26T11:47:22.165694+0000","last_clean":"2024-04-26T11:47:22.165694+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:22.165694+0000","last_undegraded":"2024-04-26T11:47:22.165694+0000","last_fullsized":"2024-04-26T11:47:22.165694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":575,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165165+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:22.165165+0000","last_peered":"2024-04-26T11:47:22.165165+0000","last_clean":"2024-04-26T11:47:22.165165+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:22.165165+0000","last_undegraded":"2024-04-26T11:47:22.165165+0000","last_fullsized":"2024-04-26T11:47:22.165165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":630,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164423+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:22.164423+0000","last_peered":"2024-04-26T11:47:22.164423+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:22.164423+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":481,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463596+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:23.463596+0000","last_peered":"2024-04-26T11:47:23.463596+0000","last_clean":"2024-04-26T11:47:23.463596+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:23.463596+0000","last_undegraded":"2024-04-26T11:47:23.463596+0000","last_fullsized":"2024-04-26T11:47:23.463596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":531,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166092+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:22.166092+0000","last_peered":"2024-04-26T11:47:22.166092+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:22.166092+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":531,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166994+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:22.166994+0000","last_peered":"2024-04-26T11:47:22.166994+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:22.166994+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":984,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166872+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:22.166872+0000","last_peered":"2024-04-26T11:47:22.166872+0000","last_clean":"2024-04-26T11:47:22.166872+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:22.166872+0000","last_undegraded":"2024-04-26T11:47:22.166872+0000","last_fullsized":"2024-04-26T11:47:22.166872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":546,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.167888+0000","last_change":"2024-04-26T11:47:12.265247+0000","last_active":"2024-04-26T11:47:22.167888+0000","last_peered":"2024-04-26T11:47:22.167888+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:22.167888+0000","last_undegraded":"2024-04-26T11:47:12.167328+0000","last_fullsized":"2024-04-26T11:47:12.157724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:35.162556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-13}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":547,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165123+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:22.165123+0000","last_peered":"2024-04-26T11:47:22.165123+0000","last_clean":"2024-04-26T11:47:22.165123+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:22.165123+0000","last_undegraded":"2024-04-26T11:47:22.165123+0000","last_fullsized":"2024-04-26T11:47:22.165123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":498,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164118+0000","last_change":"2024-04-26T11:47:12.255039+0000","last_active":"2024-04-26T11:47:22.164118+0000","last_peered":"2024-04-26T11:47:22.164118+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251782+0000","last_became_peered":"2024-04-26T11:47:12.251782+0000","last_unstale":"2024-04-26T11:47:22.164118+0000","last_undegraded":"2024-04-26T11:47:12.160070+0000","last_fullsized":"2024-04-26T11:47:12.143241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":592,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164050+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:22.164050+0000","last_peered":"2024-04-26T11:47:22.164050+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:22.164050+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166762+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:22.166762+0000","last_peered":"2024-04-26T11:47:22.166762+0000","last_clean":"2024-04-26T11:47:22.166762+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:22.166762+0000","last_undegraded":"2024-04-26T11:47:22.166762+0000","last_fullsized":"2024-04-26T11:47:22.166762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":627,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.168043+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:22.168043+0000","last_peered":"2024-04-26T11:47:22.168043+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:22.168043+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":485,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166917+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:22.166917+0000","last_peered":"2024-04-26T11:47:22.166917+0000","last_clean":"2024-04-26T11:47:22.166917+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:22.166917+0000","last_undegraded":"2024-04-26T11:47:22.166917+0000","last_fullsized":"2024-04-26T11:47:22.166917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":566,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165805+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:22.165805+0000","last_peered":"2024-04-26T11:47:22.165805+0000","last_clean":"2024-04-26T11:47:22.165805+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:22.165805+0000","last_undegraded":"2024-04-26T11:47:22.165805+0000","last_fullsized":"2024-04-26T11:47:22.165805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":491,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165525+0000","last_change":"2024-04-26T11:47:12.258316+0000","last_active":"2024-04-26T11:47:22.165525+0000","last_peered":"2024-04-26T11:47:22.165525+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.256893+0000","last_became_peered":"2024-04-26T11:47:12.256893+0000","last_unstale":"2024-04-26T11:47:22.165525+0000","last_undegraded":"2024-04-26T11:47:12.163546+0000","last_fullsized":"2024-04-26T11:47:12.157883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:48.825981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":595,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165605+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:22.165605+0000","last_peered":"2024-04-26T11:47:22.165605+0000","last_clean":"2024-04-26T11:47:22.165605+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:22.165605+0000","last_undegraded":"2024-04-26T11:47:22.165605+0000","last_fullsized":"2024-04-26T11:47:22.165605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":566,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164183+0000","last_change":"2024-04-26T11:47:12.262325+0000","last_active":"2024-04-26T11:47:22.164183+0000","last_peered":"2024-04-26T11:47:22.164183+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259636+0000","last_became_peered":"2024-04-26T11:47:12.259636+0000","last_unstale":"2024-04-26T11:47:22.164183+0000","last_undegraded":"2024-04-26T11:47:12.166109+0000","last_fullsized":"2024-04-26T11:47:12.158494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:27.521969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":528,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165628+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:22.165628+0000","last_peered":"2024-04-26T11:47:22.165628+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:22.165628+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":474,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.167895+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:22.167895+0000","last_peered":"2024-04-26T11:47:22.167895+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:22.167895+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":593,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165501+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:22.165501+0000","last_peered":"2024-04-26T11:47:22.165501+0000","last_clean":"2024-04-26T11:47:22.165501+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:22.165501+0000","last_undegraded":"2024-04-26T11:47:22.165501+0000","last_fullsized":"2024-04-26T11:47:22.165501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":585,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.167344+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:22.167344+0000","last_peered":"2024-04-26T11:47:22.167344+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:22.167344+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.462329+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:23.462329+0000","last_peered":"2024-04-26T11:47:23.462329+0000","last_clean":"2024-04-26T11:47:23.462329+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:23.462329+0000","last_undegraded":"2024-04-26T11:47:23.462329+0000","last_fullsized":"2024-04-26T11:47:23.462329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":506,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166193+0000","last_change":"2024-04-26T11:47:12.262102+0000","last_active":"2024-04-26T11:47:22.166193+0000","last_peered":"2024-04-26T11:47:22.166193+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259702+0000","last_became_peered":"2024-04-26T11:47:12.259702+0000","last_unstale":"2024-04-26T11:47:22.166193+0000","last_undegraded":"2024-04-26T11:47:12.156439+0000","last_fullsized":"2024-04-26T11:47:12.146012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164809+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:22.164809+0000","last_peered":"2024-04-26T11:47:22.164809+0000","last_clean":"2024-04-26T11:47:22.164809+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:22.164809+0000","last_undegraded":"2024-04-26T11:47:22.164809+0000","last_fullsized":"2024-04-26T11:47:22.164809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":521,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463050+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:23.463050+0000","last_peered":"2024-04-26T11:47:23.463050+0000","last_clean":"2024-04-26T11:47:23.463050+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:23.463050+0000","last_undegraded":"2024-04-26T11:47:23.463050+0000","last_fullsized":"2024-04-26T11:47:23.463050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":145,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164910+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:22.164910+0000","last_peered":"2024-04-26T11:47:22.164910+0000","last_clean":"2024-04-26T11:47:22.164910+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:22.164910+0000","last_undegraded":"2024-04-26T11:47:22.164910+0000","last_fullsized":"2024-04-26T11:47:22.164910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166611+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:22.166611+0000","last_peered":"2024-04-26T11:47:22.166611+0000","last_clean":"2024-04-26T11:47:22.166611+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:22.166611+0000","last_undegraded":"2024-04-26T11:47:22.166611+0000","last_fullsized":"2024-04-26T11:47:22.166611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":510,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164253+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:22.164253+0000","last_peered":"2024-04-26T11:47:22.164253+0000","last_clean":"2024-04-26T11:47:22.164253+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:22.164253+0000","last_undegraded":"2024-04-26T11:47:22.164253+0000","last_fullsized":"2024-04-26T11:47:22.164253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":470,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166486+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:22.166486+0000","last_peered":"2024-04-26T11:47:22.166486+0000","last_clean":"2024-04-26T11:47:22.166486+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:22.166486+0000","last_undegraded":"2024-04-26T11:47:22.166486+0000","last_fullsized":"2024-04-26T11:47:22.166486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":994,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-26T11:47:23.175176+0000","last_change":"2024-04-26T11:47:23.175607+0000","last_active":"2024-04-26T11:47:23.175176+0000","last_peered":"2024-04-26T11:47:22.724258+0000","last_clean":"2024-04-26T11:44:49.185565+0000","last_became_active":"2024-04-26T11:47:12.252329+0000","last_became_peered":"2024-04-26T11:47:12.252329+0000","last_unstale":"2024-04-26T11:47:23.175176+0000","last_undegraded":"2024-04-26T11:47:23.175176+0000","last_fullsized":"2024-04-26T11:47:23.175176+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":664,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167579+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:22.167579+0000","last_peered":"2024-04-26T11:47:22.167579+0000","last_clean":"2024-04-26T11:47:22.167579+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:22.167579+0000","last_undegraded":"2024-04-26T11:47:22.167579+0000","last_fullsized":"2024-04-26T11:47:22.167579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":985,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.181778+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:23.181778+0000","last_peered":"2024-04-26T11:47:23.181778+0000","last_clean":"2024-04-26T11:47:23.181778+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:23.181778+0000","last_undegraded":"2024-04-26T11:47:23.181778+0000","last_fullsized":"2024-04-26T11:47:23.181778+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":153,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167321+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:22.167321+0000","last_peered":"2024-04-26T11:47:22.167321+0000","last_clean":"2024-04-26T11:47:22.167321+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:22.167321+0000","last_undegraded":"2024-04-26T11:47:22.167321+0000","last_fullsized":"2024-04-26T11:47:22.167321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":591,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463543+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:23.463543+0000","last_peered":"2024-04-26T11:47:23.463543+0000","last_clean":"2024-04-26T11:47:23.463543+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:23.463543+0000","last_undegraded":"2024-04-26T11:47:23.463543+0000","last_fullsized":"2024-04-26T11:47:23.463543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":343,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.462868+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:23.462868+0000","last_peered":"2024-04-26T11:47:23.462868+0000","last_clean":"2024-04-26T11:47:23.462868+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:23.462868+0000","last_undegraded":"2024-04-26T11:47:23.462868+0000","last_fullsized":"2024-04-26T11:47:23.462868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":534,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166930+0000","last_change":"2024-04-26T11:47:12.257450+0000","last_active":"2024-04-26T11:47:22.166930+0000","last_peered":"2024-04-26T11:47:22.166930+0000","last_clean":"2024-04-26T11:44:50.722159+0000","last_became_active":"2024-04-26T11:47:12.255880+0000","last_became_peered":"2024-04-26T11:47:12.255880+0000","last_unstale":"2024-04-26T11:47:22.166930+0000","last_undegraded":"2024-04-26T11:47:12.165276+0000","last_fullsized":"2024-04-26T11:47:12.156834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.490162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-16}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":253,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166603+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:22.166603+0000","last_peered":"2024-04-26T11:47:22.166603+0000","last_clean":"2024-04-26T11:47:22.166603+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:22.166603+0000","last_undegraded":"2024-04-26T11:47:22.166603+0000","last_fullsized":"2024-04-26T11:47:22.166603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167357+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:22.167357+0000","last_peered":"2024-04-26T11:47:22.167357+0000","last_clean":"2024-04-26T11:47:22.167357+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:22.167357+0000","last_undegraded":"2024-04-26T11:47:22.167357+0000","last_fullsized":"2024-04-26T11:47:22.167357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164965+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:22.164965+0000","last_peered":"2024-04-26T11:47:22.164965+0000","last_clean":"2024-04-26T11:47:22.164965+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:22.164965+0000","last_undegraded":"2024-04-26T11:47:22.164965+0000","last_fullsized":"2024-04-26T11:47:22.164965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":456,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167794+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:22.167794+0000","last_peered":"2024-04-26T11:47:22.167794+0000","last_clean":"2024-04-26T11:47:22.167794+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:22.167794+0000","last_undegraded":"2024-04-26T11:47:22.167794+0000","last_fullsized":"2024-04-26T11:47:22.167794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":604,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164545+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:22.164545+0000","last_peered":"2024-04-26T11:47:22.164545+0000","last_clean":"2024-04-26T11:47:22.164545+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:22.164545+0000","last_undegraded":"2024-04-26T11:47:22.164545+0000","last_fullsized":"2024-04-26T11:47:22.164545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":509,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166262+0000","last_change":"2024-04-26T11:47:12.257493+0000","last_active":"2024-04-26T11:47:22.166262+0000","last_peered":"2024-04-26T11:47:22.166262+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255726+0000","last_became_peered":"2024-04-26T11:47:12.255726+0000","last_unstale":"2024-04-26T11:47:22.166262+0000","last_undegraded":"2024-04-26T11:47:12.167230+0000","last_fullsized":"2024-04-26T11:47:12.165520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:41.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":280,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166294+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:22.166294+0000","last_peered":"2024-04-26T11:47:22.166294+0000","last_clean":"2024-04-26T11:47:22.166294+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:22.166294+0000","last_undegraded":"2024-04-26T11:47:22.166294+0000","last_fullsized":"2024-04-26T11:47:22.166294+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166158+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:22.166158+0000","last_peered":"2024-04-26T11:47:22.166158+0000","last_clean":"2024-04-26T11:47:22.166158+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:22.166158+0000","last_undegraded":"2024-04-26T11:47:22.166158+0000","last_fullsized":"2024-04-26T11:47:22.166158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":585,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.462921+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:23.462921+0000","last_peered":"2024-04-26T11:47:23.462921+0000","last_clean":"2024-04-26T11:47:23.462921+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:23.462921+0000","last_undegraded":"2024-04-26T11:47:23.462921+0000","last_fullsized":"2024-04-26T11:47:23.462921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":544,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167521+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:22.167521+0000","last_peered":"2024-04-26T11:47:22.167521+0000","last_clean":"2024-04-26T11:47:22.167521+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:22.167521+0000","last_undegraded":"2024-04-26T11:47:22.167521+0000","last_fullsized":"2024-04-26T11:47:22.167521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166601+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:22.166601+0000","last_peered":"2024-04-26T11:47:22.166601+0000","last_clean":"2024-04-26T11:47:22.166601+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:22.166601+0000","last_undegraded":"2024-04-26T11:47:22.166601+0000","last_fullsized":"2024-04-26T11:47:22.166601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":337,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.461845+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:23.461845+0000","last_peered":"2024-04-26T11:47:23.461845+0000","last_clean":"2024-04-26T11:47:23.461845+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:23.461845+0000","last_undegraded":"2024-04-26T11:47:23.461845+0000","last_fullsized":"2024-04-26T11:47:23.461845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":572,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.168004+0000","last_change":"2024-04-26T11:47:12.262868+0000","last_active":"2024-04-26T11:47:22.168004+0000","last_peered":"2024-04-26T11:47:22.168004+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:22.168004+0000","last_undegraded":"2024-04-26T11:47:12.156540+0000","last_fullsized":"2024-04-26T11:47:12.146571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:45.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.462506+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:23.462506+0000","last_peered":"2024-04-26T11:47:23.462506+0000","last_clean":"2024-04-26T11:47:23.462506+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:23.462506+0000","last_undegraded":"2024-04-26T11:47:23.462506+0000","last_fullsized":"2024-04-26T11:47:23.462506+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":501,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164532+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:22.164532+0000","last_peered":"2024-04-26T11:47:22.164532+0000","last_clean":"2024-04-26T11:47:22.164532+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:22.164532+0000","last_undegraded":"2024-04-26T11:47:22.164532+0000","last_fullsized":"2024-04-26T11:47:22.164532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":429,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.464119+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:23.464119+0000","last_peered":"2024-04-26T11:47:23.464119+0000","last_clean":"2024-04-26T11:47:23.464119+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:23.464119+0000","last_undegraded":"2024-04-26T11:47:23.464119+0000","last_fullsized":"2024-04-26T11:47:23.464119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166865+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:22.166865+0000","last_peered":"2024-04-26T11:47:22.166865+0000","last_clean":"2024-04-26T11:47:22.166865+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:22.166865+0000","last_undegraded":"2024-04-26T11:47:22.166865+0000","last_fullsized":"2024-04-26T11:47:22.166865+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165952+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:22.165952+0000","last_peered":"2024-04-26T11:47:22.165952+0000","last_clean":"2024-04-26T11:47:22.165952+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:22.165952+0000","last_undegraded":"2024-04-26T11:47:22.165952+0000","last_fullsized":"2024-04-26T11:47:22.165952+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":466,"reported_epoch":86,"state":"peering","last_fresh":"2024-04-26T11:47:24.431184+0000","last_change":"2024-04-26T11:47:24.430841+0000","last_active":"2024-04-26T11:47:24.430841+0000","last_peered":"2024-04-26T11:47:12.387493+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.255779+0000","last_became_peered":"2024-04-26T11:47:12.255779+0000","last_unstale":"2024-04-26T11:47:24.431184+0000","last_undegraded":"2024-04-26T11:47:24.431184+0000","last_fullsized":"2024-04-26T11:47:24.431184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:26.975695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":615,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167676+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:22.167676+0000","last_peered":"2024-04-26T11:47:22.167676+0000","last_clean":"2024-04-26T11:47:22.167676+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:22.167676+0000","last_undegraded":"2024-04-26T11:47:22.167676+0000","last_fullsized":"2024-04-26T11:47:22.167676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463226+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:23.463226+0000","last_peered":"2024-04-26T11:47:23.463226+0000","last_clean":"2024-04-26T11:47:23.463226+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:23.463226+0000","last_undegraded":"2024-04-26T11:47:23.463226+0000","last_fullsized":"2024-04-26T11:47:23.463226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":456,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165365+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:22.165365+0000","last_peered":"2024-04-26T11:47:22.165365+0000","last_clean":"2024-04-26T11:47:22.165365+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:22.165365+0000","last_undegraded":"2024-04-26T11:47:22.165365+0000","last_fullsized":"2024-04-26T11:47:22.165365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463617+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:23.463617+0000","last_peered":"2024-04-26T11:47:23.463617+0000","last_clean":"2024-04-26T11:47:23.463617+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:23.463617+0000","last_undegraded":"2024-04-26T11:47:23.463617+0000","last_fullsized":"2024-04-26T11:47:23.463617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":94,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167864+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:22.167864+0000","last_peered":"2024-04-26T11:47:22.167864+0000","last_clean":"2024-04-26T11:47:22.167864+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:22.167864+0000","last_undegraded":"2024-04-26T11:47:22.167864+0000","last_fullsized":"2024-04-26T11:47:22.167864+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":497,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165991+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:22.165991+0000","last_peered":"2024-04-26T11:47:22.165991+0000","last_clean":"2024-04-26T11:47:22.165991+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:22.165991+0000","last_undegraded":"2024-04-26T11:47:22.165991+0000","last_fullsized":"2024-04-26T11:47:22.165991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463343+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:23.463343+0000","last_peered":"2024-04-26T11:47:23.463343+0000","last_clean":"2024-04-26T11:47:23.463343+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:23.463343+0000","last_undegraded":"2024-04-26T11:47:23.463343+0000","last_fullsized":"2024-04-26T11:47:23.463343+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463075+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:23.463075+0000","last_peered":"2024-04-26T11:47:23.463075+0000","last_clean":"2024-04-26T11:47:23.463075+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:23.463075+0000","last_undegraded":"2024-04-26T11:47:23.463075+0000","last_fullsized":"2024-04-26T11:47:23.463075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":475,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.163908+0000","last_change":"2024-04-26T11:47:12.265335+0000","last_active":"2024-04-26T11:47:22.163908+0000","last_peered":"2024-04-26T11:47:22.163908+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:22.163908+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463300+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:23.463300+0000","last_peered":"2024-04-26T11:47:23.463300+0000","last_clean":"2024-04-26T11:47:23.463300+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:23.463300+0000","last_undegraded":"2024-04-26T11:47:23.463300+0000","last_fullsized":"2024-04-26T11:47:23.463300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166575+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:22.166575+0000","last_peered":"2024-04-26T11:47:22.166575+0000","last_clean":"2024-04-26T11:47:22.166575+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:22.166575+0000","last_undegraded":"2024-04-26T11:47:22.166575+0000","last_fullsized":"2024-04-26T11:47:22.166575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":530,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164649+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:22.164649+0000","last_peered":"2024-04-26T11:47:22.164649+0000","last_clean":"2024-04-26T11:47:22.164649+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:22.164649+0000","last_undegraded":"2024-04-26T11:47:22.164649+0000","last_fullsized":"2024-04-26T11:47:22.164649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.164996+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:22.164996+0000","last_peered":"2024-04-26T11:47:22.164996+0000","last_clean":"2024-04-26T11:47:22.164996+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:22.164996+0000","last_undegraded":"2024-04-26T11:47:22.164996+0000","last_fullsized":"2024-04-26T11:47:22.164996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":489,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167248+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:22.167248+0000","last_peered":"2024-04-26T11:47:22.167248+0000","last_clean":"2024-04-26T11:47:22.167248+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:22.167248+0000","last_undegraded":"2024-04-26T11:47:22.167248+0000","last_fullsized":"2024-04-26T11:47:22.167248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":535,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164390+0000","last_change":"2024-04-26T11:47:12.261430+0000","last_active":"2024-04-26T11:47:22.164390+0000","last_peered":"2024-04-26T11:47:22.164390+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259639+0000","last_became_peered":"2024-04-26T11:47:12.259639+0000","last_unstale":"2024-04-26T11:47:22.164390+0000","last_undegraded":"2024-04-26T11:47:12.167836+0000","last_fullsized":"2024-04-26T11:47:12.160846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:57.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":181,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167645+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:22.167645+0000","last_peered":"2024-04-26T11:47:22.167645+0000","last_clean":"2024-04-26T11:47:22.167645+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:22.167645+0000","last_undegraded":"2024-04-26T11:47:22.167645+0000","last_fullsized":"2024-04-26T11:47:22.167645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":436,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.168011+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:22.168011+0000","last_peered":"2024-04-26T11:47:22.168011+0000","last_clean":"2024-04-26T11:47:22.168011+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:22.168011+0000","last_undegraded":"2024-04-26T11:47:22.168011+0000","last_fullsized":"2024-04-26T11:47:22.168011+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":597,"reported_epoch":85,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:24.047588+0000","last_change":"2024-04-26T11:47:23.970642+0000","last_active":"2024-04-26T11:47:24.047588+0000","last_peered":"2024-04-26T11:47:24.047588+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.251682+0000","last_became_peered":"2024-04-26T11:47:12.251682+0000","last_unstale":"2024-04-26T11:47:24.047588+0000","last_undegraded":"2024-04-26T11:47:12.157689+0000","last_fullsized":"2024-04-26T11:47:12.143256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:13.489428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":11,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.463891+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:23.463891+0000","last_peered":"2024-04-26T11:47:23.463891+0000","last_clean":"2024-04-26T11:47:23.463891+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:23.463891+0000","last_undegraded":"2024-04-26T11:47:23.463891+0000","last_fullsized":"2024-04-26T11:47:23.463891+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":571,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.163867+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:22.163867+0000","last_peered":"2024-04-26T11:47:22.163867+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:22.163867+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":488,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166999+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:22.166999+0000","last_peered":"2024-04-26T11:47:22.166999+0000","last_clean":"2024-04-26T11:47:22.166999+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:22.166999+0000","last_undegraded":"2024-04-26T11:47:22.166999+0000","last_fullsized":"2024-04-26T11:47:22.166999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":846,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.461615+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:23.461615+0000","last_peered":"2024-04-26T11:47:23.461615+0000","last_clean":"2024-04-26T11:47:23.461615+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:23.461615+0000","last_undegraded":"2024-04-26T11:47:23.461615+0000","last_fullsized":"2024-04-26T11:47:23.461615+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":485,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.166847+0000","last_change":"2024-04-26T11:47:12.262558+0000","last_active":"2024-04-26T11:47:22.166847+0000","last_peered":"2024-04-26T11:47:22.166847+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.260513+0000","last_became_peered":"2024-04-26T11:47:12.260513+0000","last_unstale":"2024-04-26T11:47:22.166847+0000","last_undegraded":"2024-04-26T11:47:12.161322+0000","last_fullsized":"2024-04-26T11:47:12.156833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:46.502879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":403,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.461875+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:23.461875+0000","last_peered":"2024-04-26T11:47:23.461875+0000","last_clean":"2024-04-26T11:47:23.461875+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:23.461875+0000","last_undegraded":"2024-04-26T11:47:23.461875+0000","last_fullsized":"2024-04-26T11:47:23.461875+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":509,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167163+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:22.167163+0000","last_peered":"2024-04-26T11:47:22.167163+0000","last_clean":"2024-04-26T11:47:22.167163+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:22.167163+0000","last_undegraded":"2024-04-26T11:47:22.167163+0000","last_fullsized":"2024-04-26T11:47:22.167163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":458,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165860+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:22.165860+0000","last_peered":"2024-04-26T11:47:22.165860+0000","last_clean":"2024-04-26T11:47:22.165860+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:22.165860+0000","last_undegraded":"2024-04-26T11:47:22.165860+0000","last_fullsized":"2024-04-26T11:47:22.165860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":824,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.165503+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:22.165503+0000","last_peered":"2024-04-26T11:47:22.165503+0000","last_clean":"2024-04-26T11:47:22.165503+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:22.165503+0000","last_undegraded":"2024-04-26T11:47:22.165503+0000","last_fullsized":"2024-04-26T11:47:22.165503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":135,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.166781+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:22.166781+0000","last_peered":"2024-04-26T11:47:22.166781+0000","last_clean":"2024-04-26T11:47:22.166781+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:22.166781+0000","last_undegraded":"2024-04-26T11:47:22.166781+0000","last_fullsized":"2024-04-26T11:47:22.166781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":516,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.164972+0000","last_change":"2024-04-26T11:47:12.259550+0000","last_active":"2024-04-26T11:47:22.164972+0000","last_peered":"2024-04-26T11:47:22.164972+0000","last_clean":"2024-04-26T11:44:50.722361+0000","last_became_active":"2024-04-26T11:47:12.256906+0000","last_became_peered":"2024-04-26T11:47:12.256906+0000","last_unstale":"2024-04-26T11:47:22.164972+0000","last_undegraded":"2024-04-26T11:47:12.156736+0000","last_fullsized":"2024-04-26T11:47:12.144812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:25.280569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-11}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":378,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167167+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:22.167167+0000","last_peered":"2024-04-26T11:47:22.167167+0000","last_clean":"2024-04-26T11:47:22.167167+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:22.167167+0000","last_undegraded":"2024-04-26T11:47:22.167167+0000","last_fullsized":"2024-04-26T11:47:22.167167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":863,"reported_epoch":85,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:23.348883+0000","last_change":"2024-04-26T11:47:23.349220+0000","last_active":"2024-04-26T11:47:23.348883+0000","last_peered":"2024-04-26T11:47:23.348883+0000","last_clean":"2024-04-26T11:44:50.722199+0000","last_became_active":"2024-04-26T11:47:12.251646+0000","last_became_peered":"2024-04-26T11:47:12.251646+0000","last_unstale":"2024-04-26T11:47:23.348883+0000","last_undegraded":"2024-04-26T11:47:12.161281+0000","last_fullsized":"2024-04-26T11:47:12.156381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:20.045697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":407,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T11:47:22.167422+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:22.167422+0000","last_peered":"2024-04-26T11:47:22.167422+0000","last_clean":"2024-04-26T11:47:22.167422+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:22.167422+0000","last_undegraded":"2024-04-26T11:47:22.167422+0000","last_fullsized":"2024-04-26T11:47:22.167422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":922,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.183469+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:23.183469+0000","last_peered":"2024-04-26T11:47:23.183469+0000","last_clean":"2024-04-26T11:47:23.183469+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:23.183469+0000","last_undegraded":"2024-04-26T11:47:23.183469+0000","last_fullsized":"2024-04-26T11:47:23.183469+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.464145+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:23.464145+0000","last_peered":"2024-04-26T11:47:23.464145+0000","last_clean":"2024-04-26T11:47:23.464145+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:23.464145+0000","last_undegraded":"2024-04-26T11:47:23.464145+0000","last_fullsized":"2024-04-26T11:47:23.464145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":554,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:22.165887+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:22.165887+0000","last_peered":"2024-04-26T11:47:22.165887+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:22.165887+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T11:47:23.462759+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:23.462759+0000","last_peered":"2024-04-26T11:47:23.462759+0000","last_clean":"2024-04-26T11:47:23.462759+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:23.462759+0000","last_undegraded":"2024-04-26T11:47:23.462759+0000","last_fullsized":"2024-04-26T11:47:23.462759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4957,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2858,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":99,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738411,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200200,"kb_used_data":88756,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171640,"statfs":{"total":96636764160,"available":96431759360,"internally_reserved":0,"allocated":90886144,"data_stored":90449492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":1,"up_from":72,"seq":309237645316,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115452,"kb_used_data":79732,"kb_used_omap":6,"kb_used_meta":35705,"kb_avail":94256388,"statfs":{"total":96636764160,"available":96518541312,"internally_reserved":0,"allocated":81645568,"data_stored":81230637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":36562176},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738410,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190368,"kb_used_data":83024,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181472,"statfs":{"total":96636764160,"available":96441827328,"internally_reserved":0,"allocated":85016576,"data_stored":84591535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:29.827 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:30.164 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:30.166 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:30.180 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-04-26T11:47:30.127602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3714,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4357,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":502104,"kb_used_data":251692,"kb_used_omap":9,"kb_used_meta":250358,"kb_avail":282613416,"statfs":{"total":289910292480,"available":289396137984,"internally_reserved":0,"allocated":257732608,"data_stored":256345086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":256366732},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1243,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1478,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.995206"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":936,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145094+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:27.145094+0000","last_peered":"2024-04-26T11:47:27.145094+0000","last_clean":"2024-04-26T11:47:27.145094+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:27.145094+0000","last_undegraded":"2024-04-26T11:47:27.145094+0000","last_fullsized":"2024-04-26T11:47:27.145094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":603,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144268+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:27.144268+0000","last_peered":"2024-04-26T11:47:27.144268+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:27.144268+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":499,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143921+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:27.143921+0000","last_peered":"2024-04-26T11:47:27.143921+0000","last_clean":"2024-04-26T11:47:27.143921+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:27.143921+0000","last_undegraded":"2024-04-26T11:47:27.143921+0000","last_fullsized":"2024-04-26T11:47:27.143921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":814,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143828+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:27.143828+0000","last_peered":"2024-04-26T11:47:27.143828+0000","last_clean":"2024-04-26T11:47:27.143828+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:27.143828+0000","last_undegraded":"2024-04-26T11:47:27.143828+0000","last_fullsized":"2024-04-26T11:47:27.143828+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":885,"reported_epoch":90,"state":"peering","last_fresh":"2024-04-26T11:47:28.161219+0000","last_change":"2024-04-26T11:47:28.161458+0000","last_active":"2024-04-26T11:47:28.161219+0000","last_peered":"2024-04-26T11:47:28.134777+0000","last_clean":"2024-04-26T11:44:49.186299+0000","last_became_active":"2024-04-26T11:47:12.256827+0000","last_became_peered":"2024-04-26T11:47:12.256827+0000","last_unstale":"2024-04-26T11:47:28.161219+0000","last_undegraded":"2024-04-26T11:47:28.161219+0000","last_fullsized":"2024-04-26T11:47:28.161219+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:19.864776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":820,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142368+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:27.142368+0000","last_peered":"2024-04-26T11:47:27.142368+0000","last_clean":"2024-04-26T11:47:27.142368+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:27.142368+0000","last_undegraded":"2024-04-26T11:47:27.142368+0000","last_fullsized":"2024-04-26T11:47:27.142368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":620,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142534+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:27.142534+0000","last_peered":"2024-04-26T11:47:27.142534+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:27.142534+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":497,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.141860+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:27.141860+0000","last_peered":"2024-04-26T11:47:27.141860+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:27.141860+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":518,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460079+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:28.460079+0000","last_peered":"2024-04-26T11:47:28.460079+0000","last_clean":"2024-04-26T11:47:28.460079+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:28.460079+0000","last_undegraded":"2024-04-26T11:47:28.460079+0000","last_fullsized":"2024-04-26T11:47:28.460079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":577,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144675+0000","last_change":"2024-04-26T11:47:12.262968+0000","last_active":"2024-04-26T11:47:27.144675+0000","last_peered":"2024-04-26T11:47:27.144675+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:27.144675+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":848,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143937+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:27.143937+0000","last_peered":"2024-04-26T11:47:27.143937+0000","last_clean":"2024-04-26T11:47:27.143937+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:27.143937+0000","last_undegraded":"2024-04-26T11:47:27.143937+0000","last_fullsized":"2024-04-26T11:47:27.143937+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":466,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143172+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:27.143172+0000","last_peered":"2024-04-26T11:47:27.143172+0000","last_clean":"2024-04-26T11:47:27.143172+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:27.143172+0000","last_undegraded":"2024-04-26T11:47:27.143172+0000","last_fullsized":"2024-04-26T11:47:27.143172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":868,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144031+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:27.144031+0000","last_peered":"2024-04-26T11:47:27.144031+0000","last_clean":"2024-04-26T11:47:27.144031+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:27.144031+0000","last_undegraded":"2024-04-26T11:47:27.144031+0000","last_fullsized":"2024-04-26T11:47:27.144031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":538,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142508+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:27.142508+0000","last_peered":"2024-04-26T11:47:27.142508+0000","last_clean":"2024-04-26T11:47:27.142508+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:27.142508+0000","last_undegraded":"2024-04-26T11:47:27.142508+0000","last_fullsized":"2024-04-26T11:47:27.142508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":580,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142922+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:27.142922+0000","last_peered":"2024-04-26T11:47:27.142922+0000","last_clean":"2024-04-26T11:47:27.142922+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:27.142922+0000","last_undegraded":"2024-04-26T11:47:27.142922+0000","last_fullsized":"2024-04-26T11:47:27.142922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":635,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.141937+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:27.141937+0000","last_peered":"2024-04-26T11:47:27.141937+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:27.141937+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":486,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459993+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:28.459993+0000","last_peered":"2024-04-26T11:47:28.459993+0000","last_clean":"2024-04-26T11:47:28.459993+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:28.459993+0000","last_undegraded":"2024-04-26T11:47:28.459993+0000","last_fullsized":"2024-04-26T11:47:28.459993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":536,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.145420+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:27.145420+0000","last_peered":"2024-04-26T11:47:27.145420+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:27.145420+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":536,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.143040+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:27.143040+0000","last_peered":"2024-04-26T11:47:27.143040+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:27.143040+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":989,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143958+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:27.143958+0000","last_peered":"2024-04-26T11:47:27.143958+0000","last_clean":"2024-04-26T11:47:27.143958+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:27.143958+0000","last_undegraded":"2024-04-26T11:47:27.143958+0000","last_fullsized":"2024-04-26T11:47:27.143958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":551,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.143815+0000","last_change":"2024-04-26T11:47:12.265247+0000","last_active":"2024-04-26T11:47:27.143815+0000","last_peered":"2024-04-26T11:47:27.143815+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:27.143815+0000","last_undegraded":"2024-04-26T11:47:12.167328+0000","last_fullsized":"2024-04-26T11:47:12.157724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:35.162556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-13}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":552,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142837+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:27.142837+0000","last_peered":"2024-04-26T11:47:27.142837+0000","last_clean":"2024-04-26T11:47:27.142837+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:27.142837+0000","last_undegraded":"2024-04-26T11:47:27.142837+0000","last_fullsized":"2024-04-26T11:47:27.142837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":491,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457274+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:47:28.457274+0000","last_peered":"2024-04-26T11:47:28.457274+0000","last_clean":"2024-04-26T11:47:28.457274+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:47:28.457274+0000","last_undegraded":"2024-04-26T11:47:28.457274+0000","last_fullsized":"2024-04-26T11:47:28.457274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":597,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142298+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:27.142298+0000","last_peered":"2024-04-26T11:47:27.142298+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:27.142298+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":488,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145220+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:27.145220+0000","last_peered":"2024-04-26T11:47:27.145220+0000","last_clean":"2024-04-26T11:47:27.145220+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:27.145220+0000","last_undegraded":"2024-04-26T11:47:27.145220+0000","last_fullsized":"2024-04-26T11:47:27.145220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":632,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.145320+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:27.145320+0000","last_peered":"2024-04-26T11:47:27.145320+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:27.145320+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":490,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145202+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:27.145202+0000","last_peered":"2024-04-26T11:47:27.145202+0000","last_clean":"2024-04-26T11:47:27.145202+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:27.145202+0000","last_undegraded":"2024-04-26T11:47:27.145202+0000","last_fullsized":"2024-04-26T11:47:27.145202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143711+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:27.143711+0000","last_peered":"2024-04-26T11:47:27.143711+0000","last_clean":"2024-04-26T11:47:27.143711+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:27.143711+0000","last_undegraded":"2024-04-26T11:47:27.143711+0000","last_fullsized":"2024-04-26T11:47:27.143711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":484,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.468973+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:47:28.468973+0000","last_peered":"2024-04-26T11:47:28.468973+0000","last_clean":"2024-04-26T11:47:28.468973+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:47:28.468973+0000","last_undegraded":"2024-04-26T11:47:28.468973+0000","last_fullsized":"2024-04-26T11:47:28.468973+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":600,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143063+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:27.143063+0000","last_peered":"2024-04-26T11:47:27.143063+0000","last_clean":"2024-04-26T11:47:27.143063+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:27.143063+0000","last_undegraded":"2024-04-26T11:47:27.143063+0000","last_fullsized":"2024-04-26T11:47:27.143063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":571,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142275+0000","last_change":"2024-04-26T11:47:12.262325+0000","last_active":"2024-04-26T11:47:27.142275+0000","last_peered":"2024-04-26T11:47:27.142275+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259636+0000","last_became_peered":"2024-04-26T11:47:12.259636+0000","last_unstale":"2024-04-26T11:47:27.142275+0000","last_undegraded":"2024-04-26T11:47:12.166109+0000","last_fullsized":"2024-04-26T11:47:12.158494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:27.521969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":533,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142238+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:27.142238+0000","last_peered":"2024-04-26T11:47:27.142238+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:27.142238+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":479,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144034+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:27.144034+0000","last_peered":"2024-04-26T11:47:27.144034+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:27.144034+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":598,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143788+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:27.143788+0000","last_peered":"2024-04-26T11:47:27.143788+0000","last_clean":"2024-04-26T11:47:27.143788+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:27.143788+0000","last_undegraded":"2024-04-26T11:47:27.143788+0000","last_fullsized":"2024-04-26T11:47:27.143788+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":590,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144067+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:27.144067+0000","last_peered":"2024-04-26T11:47:27.144067+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:27.144067+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458042+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:28.458042+0000","last_peered":"2024-04-26T11:47:28.458042+0000","last_clean":"2024-04-26T11:47:28.458042+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:28.458042+0000","last_undegraded":"2024-04-26T11:47:28.458042+0000","last_fullsized":"2024-04-26T11:47:28.458042+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":511,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144528+0000","last_change":"2024-04-26T11:47:12.262102+0000","last_active":"2024-04-26T11:47:27.144528+0000","last_peered":"2024-04-26T11:47:27.144528+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259702+0000","last_became_peered":"2024-04-26T11:47:12.259702+0000","last_unstale":"2024-04-26T11:47:27.144528+0000","last_undegraded":"2024-04-26T11:47:12.156439+0000","last_fullsized":"2024-04-26T11:47:12.146012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142984+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:27.142984+0000","last_peered":"2024-04-26T11:47:27.142984+0000","last_clean":"2024-04-26T11:47:27.142984+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:27.142984+0000","last_undegraded":"2024-04-26T11:47:27.142984+0000","last_fullsized":"2024-04-26T11:47:27.142984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":526,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459779+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:28.459779+0000","last_peered":"2024-04-26T11:47:28.459779+0000","last_clean":"2024-04-26T11:47:28.459779+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:28.459779+0000","last_undegraded":"2024-04-26T11:47:28.459779+0000","last_fullsized":"2024-04-26T11:47:28.459779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142283+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:27.142283+0000","last_peered":"2024-04-26T11:47:27.142283+0000","last_clean":"2024-04-26T11:47:27.142283+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:27.142283+0000","last_undegraded":"2024-04-26T11:47:27.142283+0000","last_fullsized":"2024-04-26T11:47:27.142283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":297,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145084+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:27.145084+0000","last_peered":"2024-04-26T11:47:27.145084+0000","last_clean":"2024-04-26T11:47:27.145084+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:27.145084+0000","last_undegraded":"2024-04-26T11:47:27.145084+0000","last_fullsized":"2024-04-26T11:47:27.145084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":515,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142529+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:27.142529+0000","last_peered":"2024-04-26T11:47:27.142529+0000","last_clean":"2024-04-26T11:47:27.142529+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:27.142529+0000","last_undegraded":"2024-04-26T11:47:27.142529+0000","last_fullsized":"2024-04-26T11:47:27.142529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":475,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145755+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:27.145755+0000","last_peered":"2024-04-26T11:47:27.145755+0000","last_clean":"2024-04-26T11:47:27.145755+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:27.145755+0000","last_undegraded":"2024-04-26T11:47:27.145755+0000","last_fullsized":"2024-04-26T11:47:27.145755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1006,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142351+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:47:27.142351+0000","last_peered":"2024-04-26T11:47:27.142351+0000","last_clean":"2024-04-26T11:47:27.142351+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:47:27.142351+0000","last_undegraded":"2024-04-26T11:47:27.142351+0000","last_fullsized":"2024-04-26T11:47:27.142351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":669,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144661+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:27.144661+0000","last_peered":"2024-04-26T11:47:27.144661+0000","last_clean":"2024-04-26T11:47:27.144661+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:27.144661+0000","last_undegraded":"2024-04-26T11:47:27.144661+0000","last_fullsized":"2024-04-26T11:47:27.144661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":990,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142666+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:27.142666+0000","last_peered":"2024-04-26T11:47:27.142666+0000","last_clean":"2024-04-26T11:47:27.142666+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:27.142666+0000","last_undegraded":"2024-04-26T11:47:27.142666+0000","last_fullsized":"2024-04-26T11:47:27.142666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144568+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:27.144568+0000","last_peered":"2024-04-26T11:47:27.144568+0000","last_clean":"2024-04-26T11:47:27.144568+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:27.144568+0000","last_undegraded":"2024-04-26T11:47:27.144568+0000","last_fullsized":"2024-04-26T11:47:27.144568+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":596,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459216+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:28.459216+0000","last_peered":"2024-04-26T11:47:28.459216+0000","last_clean":"2024-04-26T11:47:28.459216+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:28.459216+0000","last_undegraded":"2024-04-26T11:47:28.459216+0000","last_fullsized":"2024-04-26T11:47:28.459216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":348,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458860+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:28.458860+0000","last_peered":"2024-04-26T11:47:28.458860+0000","last_clean":"2024-04-26T11:47:28.458860+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:28.458860+0000","last_undegraded":"2024-04-26T11:47:28.458860+0000","last_fullsized":"2024-04-26T11:47:28.458860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":930,"reported_epoch":90,"state":"peering","last_fresh":"2024-04-26T11:47:28.162565+0000","last_change":"2024-04-26T11:47:28.162775+0000","last_active":"2024-04-26T11:47:28.162565+0000","last_peered":"2024-04-26T11:47:27.430813+0000","last_clean":"2024-04-26T11:44:50.722159+0000","last_became_active":"2024-04-26T11:47:12.255880+0000","last_became_peered":"2024-04-26T11:47:12.255880+0000","last_unstale":"2024-04-26T11:47:28.162565+0000","last_undegraded":"2024-04-26T11:47:28.162565+0000","last_fullsized":"2024-04-26T11:47:28.162565+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:48.085883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":258,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142982+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:27.142982+0000","last_peered":"2024-04-26T11:47:27.142982+0000","last_clean":"2024-04-26T11:47:27.142982+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:27.142982+0000","last_undegraded":"2024-04-26T11:47:27.142982+0000","last_fullsized":"2024-04-26T11:47:27.142982+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":523,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144331+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:27.144331+0000","last_peered":"2024-04-26T11:47:27.144331+0000","last_clean":"2024-04-26T11:47:27.144331+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:27.144331+0000","last_undegraded":"2024-04-26T11:47:27.144331+0000","last_fullsized":"2024-04-26T11:47:27.144331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143214+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:27.143214+0000","last_peered":"2024-04-26T11:47:27.143214+0000","last_clean":"2024-04-26T11:47:27.143214+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:27.143214+0000","last_undegraded":"2024-04-26T11:47:27.143214+0000","last_fullsized":"2024-04-26T11:47:27.143214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":461,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145203+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:27.145203+0000","last_peered":"2024-04-26T11:47:27.145203+0000","last_clean":"2024-04-26T11:47:27.145203+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:27.145203+0000","last_undegraded":"2024-04-26T11:47:27.145203+0000","last_fullsized":"2024-04-26T11:47:27.145203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142722+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:27.142722+0000","last_peered":"2024-04-26T11:47:27.142722+0000","last_clean":"2024-04-26T11:47:27.142722+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:27.142722+0000","last_undegraded":"2024-04-26T11:47:27.142722+0000","last_fullsized":"2024-04-26T11:47:27.142722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":501,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460455+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:47:28.460455+0000","last_peered":"2024-04-26T11:47:28.460455+0000","last_clean":"2024-04-26T11:47:28.460455+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:47:28.460455+0000","last_undegraded":"2024-04-26T11:47:28.460455+0000","last_fullsized":"2024-04-26T11:47:28.460455+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":285,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142594+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:27.142594+0000","last_peered":"2024-04-26T11:47:27.142594+0000","last_clean":"2024-04-26T11:47:27.142594+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:27.142594+0000","last_undegraded":"2024-04-26T11:47:27.142594+0000","last_fullsized":"2024-04-26T11:47:27.142594+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144203+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:27.144203+0000","last_peered":"2024-04-26T11:47:27.144203+0000","last_clean":"2024-04-26T11:47:27.144203+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:27.144203+0000","last_undegraded":"2024-04-26T11:47:27.144203+0000","last_fullsized":"2024-04-26T11:47:27.144203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":590,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458394+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:28.458394+0000","last_peered":"2024-04-26T11:47:28.458394+0000","last_clean":"2024-04-26T11:47:28.458394+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:28.458394+0000","last_undegraded":"2024-04-26T11:47:28.458394+0000","last_fullsized":"2024-04-26T11:47:28.458394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":549,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144464+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:27.144464+0000","last_peered":"2024-04-26T11:47:27.144464+0000","last_clean":"2024-04-26T11:47:27.144464+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:27.144464+0000","last_undegraded":"2024-04-26T11:47:27.144464+0000","last_fullsized":"2024-04-26T11:47:27.144464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142469+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:27.142469+0000","last_peered":"2024-04-26T11:47:27.142469+0000","last_clean":"2024-04-26T11:47:27.142469+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:27.142469+0000","last_undegraded":"2024-04-26T11:47:27.142469+0000","last_fullsized":"2024-04-26T11:47:27.142469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":342,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.456814+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:28.456814+0000","last_peered":"2024-04-26T11:47:28.456814+0000","last_clean":"2024-04-26T11:47:28.456814+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:28.456814+0000","last_undegraded":"2024-04-26T11:47:28.456814+0000","last_fullsized":"2024-04-26T11:47:28.456814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":577,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.145665+0000","last_change":"2024-04-26T11:47:12.262868+0000","last_active":"2024-04-26T11:47:27.145665+0000","last_peered":"2024-04-26T11:47:27.145665+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:27.145665+0000","last_undegraded":"2024-04-26T11:47:12.156540+0000","last_fullsized":"2024-04-26T11:47:12.146571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:45.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457465+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:28.457465+0000","last_peered":"2024-04-26T11:47:28.457465+0000","last_clean":"2024-04-26T11:47:28.457465+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:28.457465+0000","last_undegraded":"2024-04-26T11:47:28.457465+0000","last_fullsized":"2024-04-26T11:47:28.457465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":506,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142780+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:27.142780+0000","last_peered":"2024-04-26T11:47:27.142780+0000","last_clean":"2024-04-26T11:47:27.142780+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:27.142780+0000","last_undegraded":"2024-04-26T11:47:27.142780+0000","last_fullsized":"2024-04-26T11:47:27.142780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":434,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460408+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:28.460408+0000","last_peered":"2024-04-26T11:47:28.460408+0000","last_clean":"2024-04-26T11:47:28.460408+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:28.460408+0000","last_undegraded":"2024-04-26T11:47:28.460408+0000","last_fullsized":"2024-04-26T11:47:28.460408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143077+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:27.143077+0000","last_peered":"2024-04-26T11:47:27.143077+0000","last_clean":"2024-04-26T11:47:27.143077+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:27.143077+0000","last_undegraded":"2024-04-26T11:47:27.143077+0000","last_fullsized":"2024-04-26T11:47:27.143077+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":161,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144025+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:27.144025+0000","last_peered":"2024-04-26T11:47:27.144025+0000","last_clean":"2024-04-26T11:47:27.144025+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:27.144025+0000","last_undegraded":"2024-04-26T11:47:27.144025+0000","last_fullsized":"2024-04-26T11:47:27.144025+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":478,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458596+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:47:28.458596+0000","last_peered":"2024-04-26T11:47:28.458596+0000","last_clean":"2024-04-26T11:47:28.458596+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:47:28.458596+0000","last_undegraded":"2024-04-26T11:47:28.458596+0000","last_fullsized":"2024-04-26T11:47:28.458596+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":620,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144791+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:27.144791+0000","last_peered":"2024-04-26T11:47:27.144791+0000","last_clean":"2024-04-26T11:47:27.144791+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:27.144791+0000","last_undegraded":"2024-04-26T11:47:27.144791+0000","last_fullsized":"2024-04-26T11:47:27.144791+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458367+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:28.458367+0000","last_peered":"2024-04-26T11:47:28.458367+0000","last_clean":"2024-04-26T11:47:28.458367+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:28.458367+0000","last_undegraded":"2024-04-26T11:47:28.458367+0000","last_fullsized":"2024-04-26T11:47:28.458367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":461,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142997+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:27.142997+0000","last_peered":"2024-04-26T11:47:27.142997+0000","last_clean":"2024-04-26T11:47:27.142997+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:27.142997+0000","last_undegraded":"2024-04-26T11:47:27.142997+0000","last_fullsized":"2024-04-26T11:47:27.142997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458765+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:28.458765+0000","last_peered":"2024-04-26T11:47:28.458765+0000","last_clean":"2024-04-26T11:47:28.458765+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:28.458765+0000","last_undegraded":"2024-04-26T11:47:28.458765+0000","last_fullsized":"2024-04-26T11:47:28.458765+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144745+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:27.144745+0000","last_peered":"2024-04-26T11:47:27.144745+0000","last_clean":"2024-04-26T11:47:27.144745+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:27.144745+0000","last_undegraded":"2024-04-26T11:47:27.144745+0000","last_fullsized":"2024-04-26T11:47:27.144745+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":502,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144310+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:27.144310+0000","last_peered":"2024-04-26T11:47:27.144310+0000","last_clean":"2024-04-26T11:47:27.144310+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:27.144310+0000","last_undegraded":"2024-04-26T11:47:27.144310+0000","last_fullsized":"2024-04-26T11:47:27.144310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459850+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:28.459850+0000","last_peered":"2024-04-26T11:47:28.459850+0000","last_clean":"2024-04-26T11:47:28.459850+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:28.459850+0000","last_undegraded":"2024-04-26T11:47:28.459850+0000","last_fullsized":"2024-04-26T11:47:28.459850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459357+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:28.459357+0000","last_peered":"2024-04-26T11:47:28.459357+0000","last_clean":"2024-04-26T11:47:28.459357+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:28.459357+0000","last_undegraded":"2024-04-26T11:47:28.459357+0000","last_fullsized":"2024-04-26T11:47:28.459357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":480,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.141451+0000","last_change":"2024-04-26T11:47:12.265335+0000","last_active":"2024-04-26T11:47:27.141451+0000","last_peered":"2024-04-26T11:47:27.141451+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:27.141451+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459435+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:28.459435+0000","last_peered":"2024-04-26T11:47:28.459435+0000","last_clean":"2024-04-26T11:47:28.459435+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:28.459435+0000","last_undegraded":"2024-04-26T11:47:28.459435+0000","last_fullsized":"2024-04-26T11:47:28.459435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145021+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:27.145021+0000","last_peered":"2024-04-26T11:47:27.145021+0000","last_clean":"2024-04-26T11:47:27.145021+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:27.145021+0000","last_undegraded":"2024-04-26T11:47:27.145021+0000","last_fullsized":"2024-04-26T11:47:27.145021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":535,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142750+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:27.142750+0000","last_peered":"2024-04-26T11:47:27.142750+0000","last_clean":"2024-04-26T11:47:27.142750+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:27.142750+0000","last_undegraded":"2024-04-26T11:47:27.142750+0000","last_fullsized":"2024-04-26T11:47:27.142750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":547,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143469+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:27.143469+0000","last_peered":"2024-04-26T11:47:27.143469+0000","last_clean":"2024-04-26T11:47:27.143469+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:27.143469+0000","last_undegraded":"2024-04-26T11:47:27.143469+0000","last_fullsized":"2024-04-26T11:47:27.143469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144509+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:27.144509+0000","last_peered":"2024-04-26T11:47:27.144509+0000","last_clean":"2024-04-26T11:47:27.144509+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:27.144509+0000","last_undegraded":"2024-04-26T11:47:27.144509+0000","last_fullsized":"2024-04-26T11:47:27.144509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":683,"reported_epoch":90,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:29.051732+0000","last_change":"2024-04-26T11:47:28.777491+0000","last_active":"2024-04-26T11:47:29.051732+0000","last_peered":"2024-04-26T11:47:29.051732+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259639+0000","last_became_peered":"2024-04-26T11:47:12.259639+0000","last_unstale":"2024-04-26T11:47:29.051732+0000","last_undegraded":"2024-04-26T11:47:12.167836+0000","last_fullsized":"2024-04-26T11:47:12.160846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:57.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":186,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144591+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:27.144591+0000","last_peered":"2024-04-26T11:47:27.144591+0000","last_clean":"2024-04-26T11:47:27.144591+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:27.144591+0000","last_undegraded":"2024-04-26T11:47:27.144591+0000","last_fullsized":"2024-04-26T11:47:27.144591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":441,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145353+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:27.145353+0000","last_peered":"2024-04-26T11:47:27.145353+0000","last_clean":"2024-04-26T11:47:27.145353+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:27.145353+0000","last_undegraded":"2024-04-26T11:47:27.145353+0000","last_fullsized":"2024-04-26T11:47:27.145353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":555,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457459+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:47:28.457459+0000","last_peered":"2024-04-26T11:47:28.457459+0000","last_clean":"2024-04-26T11:47:28.457459+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:47:28.457459+0000","last_undegraded":"2024-04-26T11:47:28.457459+0000","last_fullsized":"2024-04-26T11:47:28.457459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460205+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:28.460205+0000","last_peered":"2024-04-26T11:47:28.460205+0000","last_clean":"2024-04-26T11:47:28.460205+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:28.460205+0000","last_undegraded":"2024-04-26T11:47:28.460205+0000","last_fullsized":"2024-04-26T11:47:28.460205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":576,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142060+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:27.142060+0000","last_peered":"2024-04-26T11:47:27.142060+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:27.142060+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":493,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145314+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:27.145314+0000","last_peered":"2024-04-26T11:47:27.145314+0000","last_clean":"2024-04-26T11:47:27.145314+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:27.145314+0000","last_undegraded":"2024-04-26T11:47:27.145314+0000","last_fullsized":"2024-04-26T11:47:27.145314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":851,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.456335+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:28.456335+0000","last_peered":"2024-04-26T11:47:28.456335+0000","last_clean":"2024-04-26T11:47:28.456335+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:28.456335+0000","last_undegraded":"2024-04-26T11:47:28.456335+0000","last_fullsized":"2024-04-26T11:47:28.456335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":490,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144989+0000","last_change":"2024-04-26T11:47:12.262558+0000","last_active":"2024-04-26T11:47:27.144989+0000","last_peered":"2024-04-26T11:47:27.144989+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.260513+0000","last_became_peered":"2024-04-26T11:47:12.260513+0000","last_unstale":"2024-04-26T11:47:27.144989+0000","last_undegraded":"2024-04-26T11:47:12.161322+0000","last_fullsized":"2024-04-26T11:47:12.156833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:46.502879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":408,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457004+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:28.457004+0000","last_peered":"2024-04-26T11:47:28.457004+0000","last_clean":"2024-04-26T11:47:28.457004+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:28.457004+0000","last_undegraded":"2024-04-26T11:47:28.457004+0000","last_fullsized":"2024-04-26T11:47:28.457004+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":514,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143905+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:27.143905+0000","last_peered":"2024-04-26T11:47:27.143905+0000","last_clean":"2024-04-26T11:47:27.143905+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:27.143905+0000","last_undegraded":"2024-04-26T11:47:27.143905+0000","last_fullsized":"2024-04-26T11:47:27.143905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":463,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143219+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:27.143219+0000","last_peered":"2024-04-26T11:47:27.143219+0000","last_clean":"2024-04-26T11:47:27.143219+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:27.143219+0000","last_undegraded":"2024-04-26T11:47:27.143219+0000","last_fullsized":"2024-04-26T11:47:27.143219+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":829,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143453+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:27.143453+0000","last_peered":"2024-04-26T11:47:27.143453+0000","last_clean":"2024-04-26T11:47:27.143453+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:27.143453+0000","last_undegraded":"2024-04-26T11:47:27.143453+0000","last_fullsized":"2024-04-26T11:47:27.143453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145062+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:27.145062+0000","last_peered":"2024-04-26T11:47:27.145062+0000","last_clean":"2024-04-26T11:47:27.145062+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:27.145062+0000","last_undegraded":"2024-04-26T11:47:27.145062+0000","last_fullsized":"2024-04-26T11:47:27.145062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":851,"reported_epoch":90,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:28.776208+0000","last_change":"2024-04-26T11:47:28.776621+0000","last_active":"2024-04-26T11:47:28.776208+0000","last_peered":"2024-04-26T11:47:28.776208+0000","last_clean":"2024-04-26T11:44:50.722361+0000","last_became_active":"2024-04-26T11:47:12.256906+0000","last_became_peered":"2024-04-26T11:47:12.256906+0000","last_unstale":"2024-04-26T11:47:28.776208+0000","last_undegraded":"2024-04-26T11:47:12.156736+0000","last_fullsized":"2024-04-26T11:47:12.144812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:25.280569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":383,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144267+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:27.144267+0000","last_peered":"2024-04-26T11:47:27.144267+0000","last_clean":"2024-04-26T11:47:27.144267+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:27.144267+0000","last_undegraded":"2024-04-26T11:47:27.144267+0000","last_fullsized":"2024-04-26T11:47:27.144267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":876,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142873+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:47:27.142873+0000","last_peered":"2024-04-26T11:47:27.142873+0000","last_clean":"2024-04-26T11:47:27.142873+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:47:27.142873+0000","last_undegraded":"2024-04-26T11:47:27.142873+0000","last_fullsized":"2024-04-26T11:47:27.142873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":412,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144132+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:27.144132+0000","last_peered":"2024-04-26T11:47:27.144132+0000","last_clean":"2024-04-26T11:47:27.144132+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:27.144132+0000","last_undegraded":"2024-04-26T11:47:27.144132+0000","last_fullsized":"2024-04-26T11:47:27.144132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":927,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143459+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:27.143459+0000","last_peered":"2024-04-26T11:47:27.143459+0000","last_clean":"2024-04-26T11:47:27.143459+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:27.143459+0000","last_undegraded":"2024-04-26T11:47:27.143459+0000","last_fullsized":"2024-04-26T11:47:27.143459+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460033+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:28.460033+0000","last_peered":"2024-04-26T11:47:28.460033+0000","last_clean":"2024-04-26T11:47:28.460033+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:28.460033+0000","last_undegraded":"2024-04-26T11:47:28.460033+0000","last_fullsized":"2024-04-26T11:47:28.460033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":559,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142559+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:27.142559+0000","last_peered":"2024-04-26T11:47:27.142559+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:27.142559+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459618+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:28.459618+0000","last_peered":"2024-04-26T11:47:28.459618+0000","last_clean":"2024-04-26T11:47:28.459618+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:28.459618+0000","last_undegraded":"2024-04-26T11:47:28.459618+0000","last_fullsized":"2024-04-26T11:47:28.459618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3714,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4336,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":106,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738412,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200256,"kb_used_data":88816,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171584,"statfs":{"total":96636764160,"available":96431702016,"internally_reserved":0,"allocated":90947584,"data_stored":90473966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":1,"up_from":72,"seq":309237645317,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111424,"kb_used_data":79792,"kb_used_omap":6,"kb_used_meta":31609,"kb_avail":94260416,"statfs":{"total":96636764160,"available":96522665984,"internally_reserved":0,"allocated":81707008,"data_stored":81255111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":32367872},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738411,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190424,"kb_used_data":83084,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181416,"statfs":{"total":96636764160,"available":96441769984,"internally_reserved":0,"allocated":85078016,"data_stored":84616009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:30.185 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:47:30.546 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:30.547 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 3714/108 objects degraded (3438.889%), 21 pgs degraded","count":21},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":211,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":92,"num_osds":3,"num_up_osds":3,"osd_up_since":1714132030,"num_in_osds":3,"osd_in_since":1714131840,"num_remapped_pgs":20},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":81},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":20},{"state_name":"peering","count":2},{"state_name":"active+recovering+undersized+degraded+remapped","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127603811,"bytes_used":514154496,"bytes_avail":289396137984,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":3714,"degraded_total":108,"degraded_ratio":34.388888888888886,"recovering_objects_per_sec":369,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1478,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4213}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T11:45:27.979634+0000","services":{}},"progress_events":{}} 2024-04-26T11:47:30.562 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:47:30.562 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:30.869 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:30.872 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:30.884 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-04-26T11:47:30.127602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3714,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4357,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":502104,"kb_used_data":251692,"kb_used_omap":9,"kb_used_meta":250358,"kb_avail":282613416,"statfs":{"total":289910292480,"available":289396137984,"internally_reserved":0,"allocated":257732608,"data_stored":256345086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":256366732},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1243,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1478,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.995206"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":936,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145094+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:27.145094+0000","last_peered":"2024-04-26T11:47:27.145094+0000","last_clean":"2024-04-26T11:47:27.145094+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:27.145094+0000","last_undegraded":"2024-04-26T11:47:27.145094+0000","last_fullsized":"2024-04-26T11:47:27.145094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":603,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144268+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:27.144268+0000","last_peered":"2024-04-26T11:47:27.144268+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:27.144268+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":499,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143921+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:27.143921+0000","last_peered":"2024-04-26T11:47:27.143921+0000","last_clean":"2024-04-26T11:47:27.143921+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:27.143921+0000","last_undegraded":"2024-04-26T11:47:27.143921+0000","last_fullsized":"2024-04-26T11:47:27.143921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":814,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143828+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:27.143828+0000","last_peered":"2024-04-26T11:47:27.143828+0000","last_clean":"2024-04-26T11:47:27.143828+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:27.143828+0000","last_undegraded":"2024-04-26T11:47:27.143828+0000","last_fullsized":"2024-04-26T11:47:27.143828+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":885,"reported_epoch":90,"state":"peering","last_fresh":"2024-04-26T11:47:28.161219+0000","last_change":"2024-04-26T11:47:28.161458+0000","last_active":"2024-04-26T11:47:28.161219+0000","last_peered":"2024-04-26T11:47:28.134777+0000","last_clean":"2024-04-26T11:44:49.186299+0000","last_became_active":"2024-04-26T11:47:12.256827+0000","last_became_peered":"2024-04-26T11:47:12.256827+0000","last_unstale":"2024-04-26T11:47:28.161219+0000","last_undegraded":"2024-04-26T11:47:28.161219+0000","last_fullsized":"2024-04-26T11:47:28.161219+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:19.864776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":820,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142368+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:27.142368+0000","last_peered":"2024-04-26T11:47:27.142368+0000","last_clean":"2024-04-26T11:47:27.142368+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:27.142368+0000","last_undegraded":"2024-04-26T11:47:27.142368+0000","last_fullsized":"2024-04-26T11:47:27.142368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":620,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142534+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:27.142534+0000","last_peered":"2024-04-26T11:47:27.142534+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:27.142534+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":497,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.141860+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:27.141860+0000","last_peered":"2024-04-26T11:47:27.141860+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:27.141860+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":518,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460079+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:28.460079+0000","last_peered":"2024-04-26T11:47:28.460079+0000","last_clean":"2024-04-26T11:47:28.460079+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:28.460079+0000","last_undegraded":"2024-04-26T11:47:28.460079+0000","last_fullsized":"2024-04-26T11:47:28.460079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":577,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144675+0000","last_change":"2024-04-26T11:47:12.262968+0000","last_active":"2024-04-26T11:47:27.144675+0000","last_peered":"2024-04-26T11:47:27.144675+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:27.144675+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":848,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143937+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:27.143937+0000","last_peered":"2024-04-26T11:47:27.143937+0000","last_clean":"2024-04-26T11:47:27.143937+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:27.143937+0000","last_undegraded":"2024-04-26T11:47:27.143937+0000","last_fullsized":"2024-04-26T11:47:27.143937+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":466,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143172+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:27.143172+0000","last_peered":"2024-04-26T11:47:27.143172+0000","last_clean":"2024-04-26T11:47:27.143172+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:27.143172+0000","last_undegraded":"2024-04-26T11:47:27.143172+0000","last_fullsized":"2024-04-26T11:47:27.143172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":868,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144031+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:27.144031+0000","last_peered":"2024-04-26T11:47:27.144031+0000","last_clean":"2024-04-26T11:47:27.144031+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:27.144031+0000","last_undegraded":"2024-04-26T11:47:27.144031+0000","last_fullsized":"2024-04-26T11:47:27.144031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":538,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142508+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:27.142508+0000","last_peered":"2024-04-26T11:47:27.142508+0000","last_clean":"2024-04-26T11:47:27.142508+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:27.142508+0000","last_undegraded":"2024-04-26T11:47:27.142508+0000","last_fullsized":"2024-04-26T11:47:27.142508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":580,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142922+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:27.142922+0000","last_peered":"2024-04-26T11:47:27.142922+0000","last_clean":"2024-04-26T11:47:27.142922+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:27.142922+0000","last_undegraded":"2024-04-26T11:47:27.142922+0000","last_fullsized":"2024-04-26T11:47:27.142922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":635,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.141937+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:27.141937+0000","last_peered":"2024-04-26T11:47:27.141937+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:27.141937+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":486,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459993+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:28.459993+0000","last_peered":"2024-04-26T11:47:28.459993+0000","last_clean":"2024-04-26T11:47:28.459993+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:28.459993+0000","last_undegraded":"2024-04-26T11:47:28.459993+0000","last_fullsized":"2024-04-26T11:47:28.459993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":536,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.145420+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:27.145420+0000","last_peered":"2024-04-26T11:47:27.145420+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:27.145420+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":536,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.143040+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:27.143040+0000","last_peered":"2024-04-26T11:47:27.143040+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:27.143040+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":989,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143958+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:27.143958+0000","last_peered":"2024-04-26T11:47:27.143958+0000","last_clean":"2024-04-26T11:47:27.143958+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:27.143958+0000","last_undegraded":"2024-04-26T11:47:27.143958+0000","last_fullsized":"2024-04-26T11:47:27.143958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":551,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.143815+0000","last_change":"2024-04-26T11:47:12.265247+0000","last_active":"2024-04-26T11:47:27.143815+0000","last_peered":"2024-04-26T11:47:27.143815+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:27.143815+0000","last_undegraded":"2024-04-26T11:47:12.167328+0000","last_fullsized":"2024-04-26T11:47:12.157724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:35.162556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-13}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":552,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142837+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:27.142837+0000","last_peered":"2024-04-26T11:47:27.142837+0000","last_clean":"2024-04-26T11:47:27.142837+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:27.142837+0000","last_undegraded":"2024-04-26T11:47:27.142837+0000","last_fullsized":"2024-04-26T11:47:27.142837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":491,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457274+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:47:28.457274+0000","last_peered":"2024-04-26T11:47:28.457274+0000","last_clean":"2024-04-26T11:47:28.457274+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:47:28.457274+0000","last_undegraded":"2024-04-26T11:47:28.457274+0000","last_fullsized":"2024-04-26T11:47:28.457274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":597,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142298+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:27.142298+0000","last_peered":"2024-04-26T11:47:27.142298+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:27.142298+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":488,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145220+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:27.145220+0000","last_peered":"2024-04-26T11:47:27.145220+0000","last_clean":"2024-04-26T11:47:27.145220+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:27.145220+0000","last_undegraded":"2024-04-26T11:47:27.145220+0000","last_fullsized":"2024-04-26T11:47:27.145220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":632,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.145320+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:27.145320+0000","last_peered":"2024-04-26T11:47:27.145320+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:27.145320+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":490,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145202+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:27.145202+0000","last_peered":"2024-04-26T11:47:27.145202+0000","last_clean":"2024-04-26T11:47:27.145202+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:27.145202+0000","last_undegraded":"2024-04-26T11:47:27.145202+0000","last_fullsized":"2024-04-26T11:47:27.145202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143711+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:27.143711+0000","last_peered":"2024-04-26T11:47:27.143711+0000","last_clean":"2024-04-26T11:47:27.143711+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:27.143711+0000","last_undegraded":"2024-04-26T11:47:27.143711+0000","last_fullsized":"2024-04-26T11:47:27.143711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":484,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.468973+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:47:28.468973+0000","last_peered":"2024-04-26T11:47:28.468973+0000","last_clean":"2024-04-26T11:47:28.468973+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:47:28.468973+0000","last_undegraded":"2024-04-26T11:47:28.468973+0000","last_fullsized":"2024-04-26T11:47:28.468973+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":600,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143063+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:27.143063+0000","last_peered":"2024-04-26T11:47:27.143063+0000","last_clean":"2024-04-26T11:47:27.143063+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:27.143063+0000","last_undegraded":"2024-04-26T11:47:27.143063+0000","last_fullsized":"2024-04-26T11:47:27.143063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":571,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142275+0000","last_change":"2024-04-26T11:47:12.262325+0000","last_active":"2024-04-26T11:47:27.142275+0000","last_peered":"2024-04-26T11:47:27.142275+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259636+0000","last_became_peered":"2024-04-26T11:47:12.259636+0000","last_unstale":"2024-04-26T11:47:27.142275+0000","last_undegraded":"2024-04-26T11:47:12.166109+0000","last_fullsized":"2024-04-26T11:47:12.158494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:27.521969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":533,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142238+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:27.142238+0000","last_peered":"2024-04-26T11:47:27.142238+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:27.142238+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":479,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144034+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:27.144034+0000","last_peered":"2024-04-26T11:47:27.144034+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:27.144034+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":598,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143788+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:27.143788+0000","last_peered":"2024-04-26T11:47:27.143788+0000","last_clean":"2024-04-26T11:47:27.143788+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:27.143788+0000","last_undegraded":"2024-04-26T11:47:27.143788+0000","last_fullsized":"2024-04-26T11:47:27.143788+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":590,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144067+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:27.144067+0000","last_peered":"2024-04-26T11:47:27.144067+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:27.144067+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458042+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:28.458042+0000","last_peered":"2024-04-26T11:47:28.458042+0000","last_clean":"2024-04-26T11:47:28.458042+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:28.458042+0000","last_undegraded":"2024-04-26T11:47:28.458042+0000","last_fullsized":"2024-04-26T11:47:28.458042+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":511,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144528+0000","last_change":"2024-04-26T11:47:12.262102+0000","last_active":"2024-04-26T11:47:27.144528+0000","last_peered":"2024-04-26T11:47:27.144528+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259702+0000","last_became_peered":"2024-04-26T11:47:12.259702+0000","last_unstale":"2024-04-26T11:47:27.144528+0000","last_undegraded":"2024-04-26T11:47:12.156439+0000","last_fullsized":"2024-04-26T11:47:12.146012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142984+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:27.142984+0000","last_peered":"2024-04-26T11:47:27.142984+0000","last_clean":"2024-04-26T11:47:27.142984+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:27.142984+0000","last_undegraded":"2024-04-26T11:47:27.142984+0000","last_fullsized":"2024-04-26T11:47:27.142984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":526,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459779+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:28.459779+0000","last_peered":"2024-04-26T11:47:28.459779+0000","last_clean":"2024-04-26T11:47:28.459779+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:28.459779+0000","last_undegraded":"2024-04-26T11:47:28.459779+0000","last_fullsized":"2024-04-26T11:47:28.459779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142283+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:27.142283+0000","last_peered":"2024-04-26T11:47:27.142283+0000","last_clean":"2024-04-26T11:47:27.142283+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:27.142283+0000","last_undegraded":"2024-04-26T11:47:27.142283+0000","last_fullsized":"2024-04-26T11:47:27.142283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":297,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145084+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:27.145084+0000","last_peered":"2024-04-26T11:47:27.145084+0000","last_clean":"2024-04-26T11:47:27.145084+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:27.145084+0000","last_undegraded":"2024-04-26T11:47:27.145084+0000","last_fullsized":"2024-04-26T11:47:27.145084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":515,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142529+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:27.142529+0000","last_peered":"2024-04-26T11:47:27.142529+0000","last_clean":"2024-04-26T11:47:27.142529+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:27.142529+0000","last_undegraded":"2024-04-26T11:47:27.142529+0000","last_fullsized":"2024-04-26T11:47:27.142529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":475,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145755+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:27.145755+0000","last_peered":"2024-04-26T11:47:27.145755+0000","last_clean":"2024-04-26T11:47:27.145755+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:27.145755+0000","last_undegraded":"2024-04-26T11:47:27.145755+0000","last_fullsized":"2024-04-26T11:47:27.145755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1006,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142351+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:47:27.142351+0000","last_peered":"2024-04-26T11:47:27.142351+0000","last_clean":"2024-04-26T11:47:27.142351+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:47:27.142351+0000","last_undegraded":"2024-04-26T11:47:27.142351+0000","last_fullsized":"2024-04-26T11:47:27.142351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":669,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144661+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:27.144661+0000","last_peered":"2024-04-26T11:47:27.144661+0000","last_clean":"2024-04-26T11:47:27.144661+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:27.144661+0000","last_undegraded":"2024-04-26T11:47:27.144661+0000","last_fullsized":"2024-04-26T11:47:27.144661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":990,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142666+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:27.142666+0000","last_peered":"2024-04-26T11:47:27.142666+0000","last_clean":"2024-04-26T11:47:27.142666+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:27.142666+0000","last_undegraded":"2024-04-26T11:47:27.142666+0000","last_fullsized":"2024-04-26T11:47:27.142666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144568+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:27.144568+0000","last_peered":"2024-04-26T11:47:27.144568+0000","last_clean":"2024-04-26T11:47:27.144568+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:27.144568+0000","last_undegraded":"2024-04-26T11:47:27.144568+0000","last_fullsized":"2024-04-26T11:47:27.144568+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":596,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459216+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:28.459216+0000","last_peered":"2024-04-26T11:47:28.459216+0000","last_clean":"2024-04-26T11:47:28.459216+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:28.459216+0000","last_undegraded":"2024-04-26T11:47:28.459216+0000","last_fullsized":"2024-04-26T11:47:28.459216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":348,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458860+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:28.458860+0000","last_peered":"2024-04-26T11:47:28.458860+0000","last_clean":"2024-04-26T11:47:28.458860+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:28.458860+0000","last_undegraded":"2024-04-26T11:47:28.458860+0000","last_fullsized":"2024-04-26T11:47:28.458860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":930,"reported_epoch":90,"state":"peering","last_fresh":"2024-04-26T11:47:28.162565+0000","last_change":"2024-04-26T11:47:28.162775+0000","last_active":"2024-04-26T11:47:28.162565+0000","last_peered":"2024-04-26T11:47:27.430813+0000","last_clean":"2024-04-26T11:44:50.722159+0000","last_became_active":"2024-04-26T11:47:12.255880+0000","last_became_peered":"2024-04-26T11:47:12.255880+0000","last_unstale":"2024-04-26T11:47:28.162565+0000","last_undegraded":"2024-04-26T11:47:28.162565+0000","last_fullsized":"2024-04-26T11:47:28.162565+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:48.085883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":258,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142982+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:27.142982+0000","last_peered":"2024-04-26T11:47:27.142982+0000","last_clean":"2024-04-26T11:47:27.142982+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:27.142982+0000","last_undegraded":"2024-04-26T11:47:27.142982+0000","last_fullsized":"2024-04-26T11:47:27.142982+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":523,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144331+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:27.144331+0000","last_peered":"2024-04-26T11:47:27.144331+0000","last_clean":"2024-04-26T11:47:27.144331+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:27.144331+0000","last_undegraded":"2024-04-26T11:47:27.144331+0000","last_fullsized":"2024-04-26T11:47:27.144331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143214+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:27.143214+0000","last_peered":"2024-04-26T11:47:27.143214+0000","last_clean":"2024-04-26T11:47:27.143214+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:27.143214+0000","last_undegraded":"2024-04-26T11:47:27.143214+0000","last_fullsized":"2024-04-26T11:47:27.143214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":461,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145203+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:27.145203+0000","last_peered":"2024-04-26T11:47:27.145203+0000","last_clean":"2024-04-26T11:47:27.145203+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:27.145203+0000","last_undegraded":"2024-04-26T11:47:27.145203+0000","last_fullsized":"2024-04-26T11:47:27.145203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142722+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:27.142722+0000","last_peered":"2024-04-26T11:47:27.142722+0000","last_clean":"2024-04-26T11:47:27.142722+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:27.142722+0000","last_undegraded":"2024-04-26T11:47:27.142722+0000","last_fullsized":"2024-04-26T11:47:27.142722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":501,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460455+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:47:28.460455+0000","last_peered":"2024-04-26T11:47:28.460455+0000","last_clean":"2024-04-26T11:47:28.460455+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:47:28.460455+0000","last_undegraded":"2024-04-26T11:47:28.460455+0000","last_fullsized":"2024-04-26T11:47:28.460455+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":285,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142594+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:27.142594+0000","last_peered":"2024-04-26T11:47:27.142594+0000","last_clean":"2024-04-26T11:47:27.142594+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:27.142594+0000","last_undegraded":"2024-04-26T11:47:27.142594+0000","last_fullsized":"2024-04-26T11:47:27.142594+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144203+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:27.144203+0000","last_peered":"2024-04-26T11:47:27.144203+0000","last_clean":"2024-04-26T11:47:27.144203+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:27.144203+0000","last_undegraded":"2024-04-26T11:47:27.144203+0000","last_fullsized":"2024-04-26T11:47:27.144203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":590,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458394+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:28.458394+0000","last_peered":"2024-04-26T11:47:28.458394+0000","last_clean":"2024-04-26T11:47:28.458394+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:28.458394+0000","last_undegraded":"2024-04-26T11:47:28.458394+0000","last_fullsized":"2024-04-26T11:47:28.458394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":549,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144464+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:27.144464+0000","last_peered":"2024-04-26T11:47:27.144464+0000","last_clean":"2024-04-26T11:47:27.144464+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:27.144464+0000","last_undegraded":"2024-04-26T11:47:27.144464+0000","last_fullsized":"2024-04-26T11:47:27.144464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142469+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:27.142469+0000","last_peered":"2024-04-26T11:47:27.142469+0000","last_clean":"2024-04-26T11:47:27.142469+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:27.142469+0000","last_undegraded":"2024-04-26T11:47:27.142469+0000","last_fullsized":"2024-04-26T11:47:27.142469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":342,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.456814+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:28.456814+0000","last_peered":"2024-04-26T11:47:28.456814+0000","last_clean":"2024-04-26T11:47:28.456814+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:28.456814+0000","last_undegraded":"2024-04-26T11:47:28.456814+0000","last_fullsized":"2024-04-26T11:47:28.456814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":577,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.145665+0000","last_change":"2024-04-26T11:47:12.262868+0000","last_active":"2024-04-26T11:47:27.145665+0000","last_peered":"2024-04-26T11:47:27.145665+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:27.145665+0000","last_undegraded":"2024-04-26T11:47:12.156540+0000","last_fullsized":"2024-04-26T11:47:12.146571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:45.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457465+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:28.457465+0000","last_peered":"2024-04-26T11:47:28.457465+0000","last_clean":"2024-04-26T11:47:28.457465+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:28.457465+0000","last_undegraded":"2024-04-26T11:47:28.457465+0000","last_fullsized":"2024-04-26T11:47:28.457465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":506,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142780+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:27.142780+0000","last_peered":"2024-04-26T11:47:27.142780+0000","last_clean":"2024-04-26T11:47:27.142780+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:27.142780+0000","last_undegraded":"2024-04-26T11:47:27.142780+0000","last_fullsized":"2024-04-26T11:47:27.142780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":434,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460408+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:28.460408+0000","last_peered":"2024-04-26T11:47:28.460408+0000","last_clean":"2024-04-26T11:47:28.460408+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:28.460408+0000","last_undegraded":"2024-04-26T11:47:28.460408+0000","last_fullsized":"2024-04-26T11:47:28.460408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143077+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:27.143077+0000","last_peered":"2024-04-26T11:47:27.143077+0000","last_clean":"2024-04-26T11:47:27.143077+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:27.143077+0000","last_undegraded":"2024-04-26T11:47:27.143077+0000","last_fullsized":"2024-04-26T11:47:27.143077+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":161,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144025+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:27.144025+0000","last_peered":"2024-04-26T11:47:27.144025+0000","last_clean":"2024-04-26T11:47:27.144025+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:27.144025+0000","last_undegraded":"2024-04-26T11:47:27.144025+0000","last_fullsized":"2024-04-26T11:47:27.144025+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":478,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458596+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:47:28.458596+0000","last_peered":"2024-04-26T11:47:28.458596+0000","last_clean":"2024-04-26T11:47:28.458596+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:47:28.458596+0000","last_undegraded":"2024-04-26T11:47:28.458596+0000","last_fullsized":"2024-04-26T11:47:28.458596+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":620,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144791+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:27.144791+0000","last_peered":"2024-04-26T11:47:27.144791+0000","last_clean":"2024-04-26T11:47:27.144791+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:27.144791+0000","last_undegraded":"2024-04-26T11:47:27.144791+0000","last_fullsized":"2024-04-26T11:47:27.144791+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458367+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:28.458367+0000","last_peered":"2024-04-26T11:47:28.458367+0000","last_clean":"2024-04-26T11:47:28.458367+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:28.458367+0000","last_undegraded":"2024-04-26T11:47:28.458367+0000","last_fullsized":"2024-04-26T11:47:28.458367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":461,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142997+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:27.142997+0000","last_peered":"2024-04-26T11:47:27.142997+0000","last_clean":"2024-04-26T11:47:27.142997+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:27.142997+0000","last_undegraded":"2024-04-26T11:47:27.142997+0000","last_fullsized":"2024-04-26T11:47:27.142997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458765+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:28.458765+0000","last_peered":"2024-04-26T11:47:28.458765+0000","last_clean":"2024-04-26T11:47:28.458765+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:28.458765+0000","last_undegraded":"2024-04-26T11:47:28.458765+0000","last_fullsized":"2024-04-26T11:47:28.458765+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144745+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:27.144745+0000","last_peered":"2024-04-26T11:47:27.144745+0000","last_clean":"2024-04-26T11:47:27.144745+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:27.144745+0000","last_undegraded":"2024-04-26T11:47:27.144745+0000","last_fullsized":"2024-04-26T11:47:27.144745+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":502,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144310+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:27.144310+0000","last_peered":"2024-04-26T11:47:27.144310+0000","last_clean":"2024-04-26T11:47:27.144310+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:27.144310+0000","last_undegraded":"2024-04-26T11:47:27.144310+0000","last_fullsized":"2024-04-26T11:47:27.144310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459850+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:28.459850+0000","last_peered":"2024-04-26T11:47:28.459850+0000","last_clean":"2024-04-26T11:47:28.459850+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:28.459850+0000","last_undegraded":"2024-04-26T11:47:28.459850+0000","last_fullsized":"2024-04-26T11:47:28.459850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459357+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:28.459357+0000","last_peered":"2024-04-26T11:47:28.459357+0000","last_clean":"2024-04-26T11:47:28.459357+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:28.459357+0000","last_undegraded":"2024-04-26T11:47:28.459357+0000","last_fullsized":"2024-04-26T11:47:28.459357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":480,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.141451+0000","last_change":"2024-04-26T11:47:12.265335+0000","last_active":"2024-04-26T11:47:27.141451+0000","last_peered":"2024-04-26T11:47:27.141451+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:27.141451+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459435+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:28.459435+0000","last_peered":"2024-04-26T11:47:28.459435+0000","last_clean":"2024-04-26T11:47:28.459435+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:28.459435+0000","last_undegraded":"2024-04-26T11:47:28.459435+0000","last_fullsized":"2024-04-26T11:47:28.459435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145021+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:27.145021+0000","last_peered":"2024-04-26T11:47:27.145021+0000","last_clean":"2024-04-26T11:47:27.145021+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:27.145021+0000","last_undegraded":"2024-04-26T11:47:27.145021+0000","last_fullsized":"2024-04-26T11:47:27.145021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":535,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142750+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:27.142750+0000","last_peered":"2024-04-26T11:47:27.142750+0000","last_clean":"2024-04-26T11:47:27.142750+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:27.142750+0000","last_undegraded":"2024-04-26T11:47:27.142750+0000","last_fullsized":"2024-04-26T11:47:27.142750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":547,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143469+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:27.143469+0000","last_peered":"2024-04-26T11:47:27.143469+0000","last_clean":"2024-04-26T11:47:27.143469+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:27.143469+0000","last_undegraded":"2024-04-26T11:47:27.143469+0000","last_fullsized":"2024-04-26T11:47:27.143469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144509+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:27.144509+0000","last_peered":"2024-04-26T11:47:27.144509+0000","last_clean":"2024-04-26T11:47:27.144509+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:27.144509+0000","last_undegraded":"2024-04-26T11:47:27.144509+0000","last_fullsized":"2024-04-26T11:47:27.144509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":683,"reported_epoch":90,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:29.051732+0000","last_change":"2024-04-26T11:47:28.777491+0000","last_active":"2024-04-26T11:47:29.051732+0000","last_peered":"2024-04-26T11:47:29.051732+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259639+0000","last_became_peered":"2024-04-26T11:47:12.259639+0000","last_unstale":"2024-04-26T11:47:29.051732+0000","last_undegraded":"2024-04-26T11:47:12.167836+0000","last_fullsized":"2024-04-26T11:47:12.160846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:57.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":186,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144591+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:27.144591+0000","last_peered":"2024-04-26T11:47:27.144591+0000","last_clean":"2024-04-26T11:47:27.144591+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:27.144591+0000","last_undegraded":"2024-04-26T11:47:27.144591+0000","last_fullsized":"2024-04-26T11:47:27.144591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":441,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145353+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:27.145353+0000","last_peered":"2024-04-26T11:47:27.145353+0000","last_clean":"2024-04-26T11:47:27.145353+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:27.145353+0000","last_undegraded":"2024-04-26T11:47:27.145353+0000","last_fullsized":"2024-04-26T11:47:27.145353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":555,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457459+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:47:28.457459+0000","last_peered":"2024-04-26T11:47:28.457459+0000","last_clean":"2024-04-26T11:47:28.457459+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:47:28.457459+0000","last_undegraded":"2024-04-26T11:47:28.457459+0000","last_fullsized":"2024-04-26T11:47:28.457459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460205+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:28.460205+0000","last_peered":"2024-04-26T11:47:28.460205+0000","last_clean":"2024-04-26T11:47:28.460205+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:28.460205+0000","last_undegraded":"2024-04-26T11:47:28.460205+0000","last_fullsized":"2024-04-26T11:47:28.460205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":576,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142060+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:27.142060+0000","last_peered":"2024-04-26T11:47:27.142060+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:27.142060+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":493,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145314+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:27.145314+0000","last_peered":"2024-04-26T11:47:27.145314+0000","last_clean":"2024-04-26T11:47:27.145314+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:27.145314+0000","last_undegraded":"2024-04-26T11:47:27.145314+0000","last_fullsized":"2024-04-26T11:47:27.145314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":851,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.456335+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:28.456335+0000","last_peered":"2024-04-26T11:47:28.456335+0000","last_clean":"2024-04-26T11:47:28.456335+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:28.456335+0000","last_undegraded":"2024-04-26T11:47:28.456335+0000","last_fullsized":"2024-04-26T11:47:28.456335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":490,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144989+0000","last_change":"2024-04-26T11:47:12.262558+0000","last_active":"2024-04-26T11:47:27.144989+0000","last_peered":"2024-04-26T11:47:27.144989+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.260513+0000","last_became_peered":"2024-04-26T11:47:12.260513+0000","last_unstale":"2024-04-26T11:47:27.144989+0000","last_undegraded":"2024-04-26T11:47:12.161322+0000","last_fullsized":"2024-04-26T11:47:12.156833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:46.502879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":408,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457004+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:28.457004+0000","last_peered":"2024-04-26T11:47:28.457004+0000","last_clean":"2024-04-26T11:47:28.457004+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:28.457004+0000","last_undegraded":"2024-04-26T11:47:28.457004+0000","last_fullsized":"2024-04-26T11:47:28.457004+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":514,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143905+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:27.143905+0000","last_peered":"2024-04-26T11:47:27.143905+0000","last_clean":"2024-04-26T11:47:27.143905+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:27.143905+0000","last_undegraded":"2024-04-26T11:47:27.143905+0000","last_fullsized":"2024-04-26T11:47:27.143905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":463,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143219+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:27.143219+0000","last_peered":"2024-04-26T11:47:27.143219+0000","last_clean":"2024-04-26T11:47:27.143219+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:27.143219+0000","last_undegraded":"2024-04-26T11:47:27.143219+0000","last_fullsized":"2024-04-26T11:47:27.143219+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":829,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143453+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:27.143453+0000","last_peered":"2024-04-26T11:47:27.143453+0000","last_clean":"2024-04-26T11:47:27.143453+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:27.143453+0000","last_undegraded":"2024-04-26T11:47:27.143453+0000","last_fullsized":"2024-04-26T11:47:27.143453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.145062+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:27.145062+0000","last_peered":"2024-04-26T11:47:27.145062+0000","last_clean":"2024-04-26T11:47:27.145062+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:27.145062+0000","last_undegraded":"2024-04-26T11:47:27.145062+0000","last_fullsized":"2024-04-26T11:47:27.145062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":851,"reported_epoch":90,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:28.776208+0000","last_change":"2024-04-26T11:47:28.776621+0000","last_active":"2024-04-26T11:47:28.776208+0000","last_peered":"2024-04-26T11:47:28.776208+0000","last_clean":"2024-04-26T11:44:50.722361+0000","last_became_active":"2024-04-26T11:47:12.256906+0000","last_became_peered":"2024-04-26T11:47:12.256906+0000","last_unstale":"2024-04-26T11:47:28.776208+0000","last_undegraded":"2024-04-26T11:47:12.156736+0000","last_fullsized":"2024-04-26T11:47:12.144812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:25.280569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":383,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144267+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:27.144267+0000","last_peered":"2024-04-26T11:47:27.144267+0000","last_clean":"2024-04-26T11:47:27.144267+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:27.144267+0000","last_undegraded":"2024-04-26T11:47:27.144267+0000","last_fullsized":"2024-04-26T11:47:27.144267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":876,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.142873+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:47:27.142873+0000","last_peered":"2024-04-26T11:47:27.142873+0000","last_clean":"2024-04-26T11:47:27.142873+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:47:27.142873+0000","last_undegraded":"2024-04-26T11:47:27.142873+0000","last_fullsized":"2024-04-26T11:47:27.142873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":412,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.144132+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:27.144132+0000","last_peered":"2024-04-26T11:47:27.144132+0000","last_clean":"2024-04-26T11:47:27.144132+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:27.144132+0000","last_undegraded":"2024-04-26T11:47:27.144132+0000","last_fullsized":"2024-04-26T11:47:27.144132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":927,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:47:27.143459+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:27.143459+0000","last_peered":"2024-04-26T11:47:27.143459+0000","last_clean":"2024-04-26T11:47:27.143459+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:27.143459+0000","last_undegraded":"2024-04-26T11:47:27.143459+0000","last_fullsized":"2024-04-26T11:47:27.143459+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460033+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:28.460033+0000","last_peered":"2024-04-26T11:47:28.460033+0000","last_clean":"2024-04-26T11:47:28.460033+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:28.460033+0000","last_undegraded":"2024-04-26T11:47:28.460033+0000","last_fullsized":"2024-04-26T11:47:28.460033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":559,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142559+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:27.142559+0000","last_peered":"2024-04-26T11:47:27.142559+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:27.142559+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459618+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:28.459618+0000","last_peered":"2024-04-26T11:47:28.459618+0000","last_clean":"2024-04-26T11:47:28.459618+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:28.459618+0000","last_undegraded":"2024-04-26T11:47:28.459618+0000","last_fullsized":"2024-04-26T11:47:28.459618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3714,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4336,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":106,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738412,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200256,"kb_used_data":88816,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171584,"statfs":{"total":96636764160,"available":96431702016,"internally_reserved":0,"allocated":90947584,"data_stored":90473966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":1,"up_from":72,"seq":309237645317,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111424,"kb_used_data":79792,"kb_used_omap":6,"kb_used_meta":31609,"kb_avail":94260416,"statfs":{"total":96636764160,"available":96522665984,"internally_reserved":0,"allocated":81707008,"data_stored":81255111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":32367872},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738411,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190424,"kb_used_data":83084,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181416,"statfs":{"total":96636764160,"available":96441769984,"internally_reserved":0,"allocated":85078016,"data_stored":84616009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:33.889 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:34.213 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:34.216 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:34.228 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-04-26T11:47:34.131233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3007,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4959,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":191,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":502228,"kb_used_data":251812,"kb_used_omap":9,"kb_used_meta":250358,"kb_avail":282613292,"statfs":{"total":289910292480,"available":289396011008,"internally_reserved":0,"allocated":257855488,"data_stored":256392242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":256366732},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-707,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":602,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.003631"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":941,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154777+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:32.154777+0000","last_peered":"2024-04-26T11:47:32.154777+0000","last_clean":"2024-04-26T11:47:32.154777+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:32.154777+0000","last_undegraded":"2024-04-26T11:47:32.154777+0000","last_fullsized":"2024-04-26T11:47:32.154777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":608,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.153888+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:32.153888+0000","last_peered":"2024-04-26T11:47:32.153888+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:32.153888+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":504,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148035+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:32.148035+0000","last_peered":"2024-04-26T11:47:32.148035+0000","last_clean":"2024-04-26T11:47:32.148035+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:32.148035+0000","last_undegraded":"2024-04-26T11:47:32.148035+0000","last_fullsized":"2024-04-26T11:47:32.148035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":819,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147110+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:32.147110+0000","last_peered":"2024-04-26T11:47:32.147110+0000","last_clean":"2024-04-26T11:47:32.147110+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:32.147110+0000","last_undegraded":"2024-04-26T11:47:32.147110+0000","last_fullsized":"2024-04-26T11:47:32.147110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":897,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153340+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:47:32.153340+0000","last_peered":"2024-04-26T11:47:32.153340+0000","last_clean":"2024-04-26T11:47:32.153340+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:47:32.153340+0000","last_undegraded":"2024-04-26T11:47:32.153340+0000","last_fullsized":"2024-04-26T11:47:32.153340+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":825,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146402+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:32.146402+0000","last_peered":"2024-04-26T11:47:32.146402+0000","last_clean":"2024-04-26T11:47:32.146402+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:32.146402+0000","last_undegraded":"2024-04-26T11:47:32.146402+0000","last_fullsized":"2024-04-26T11:47:32.146402+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":625,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146513+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:32.146513+0000","last_peered":"2024-04-26T11:47:32.146513+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:32.146513+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":502,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146006+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:32.146006+0000","last_peered":"2024-04-26T11:47:32.146006+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:32.146006+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":518,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460079+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:28.460079+0000","last_peered":"2024-04-26T11:47:28.460079+0000","last_clean":"2024-04-26T11:47:28.460079+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:28.460079+0000","last_undegraded":"2024-04-26T11:47:28.460079+0000","last_fullsized":"2024-04-26T11:47:28.460079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":932,"reported_epoch":95,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:33.770303+0000","last_change":"2024-04-26T11:47:33.770711+0000","last_active":"2024-04-26T11:47:33.770303+0000","last_peered":"2024-04-26T11:47:33.770303+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:33.770303+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":853,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148020+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:32.148020+0000","last_peered":"2024-04-26T11:47:32.148020+0000","last_clean":"2024-04-26T11:47:32.148020+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:32.148020+0000","last_undegraded":"2024-04-26T11:47:32.148020+0000","last_fullsized":"2024-04-26T11:47:32.148020+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":471,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153526+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:32.153526+0000","last_peered":"2024-04-26T11:47:32.153526+0000","last_clean":"2024-04-26T11:47:32.153526+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:32.153526+0000","last_undegraded":"2024-04-26T11:47:32.153526+0000","last_fullsized":"2024-04-26T11:47:32.153526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":873,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153039+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:32.153039+0000","last_peered":"2024-04-26T11:47:32.153039+0000","last_clean":"2024-04-26T11:47:32.153039+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:32.153039+0000","last_undegraded":"2024-04-26T11:47:32.153039+0000","last_fullsized":"2024-04-26T11:47:32.153039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":543,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146411+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:32.146411+0000","last_peered":"2024-04-26T11:47:32.146411+0000","last_clean":"2024-04-26T11:47:32.146411+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:32.146411+0000","last_undegraded":"2024-04-26T11:47:32.146411+0000","last_fullsized":"2024-04-26T11:47:32.146411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":585,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146795+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:32.146795+0000","last_peered":"2024-04-26T11:47:32.146795+0000","last_clean":"2024-04-26T11:47:32.146795+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:32.146795+0000","last_undegraded":"2024-04-26T11:47:32.146795+0000","last_fullsized":"2024-04-26T11:47:32.146795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":640,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146412+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:32.146412+0000","last_peered":"2024-04-26T11:47:32.146412+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:32.146412+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":486,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459993+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:28.459993+0000","last_peered":"2024-04-26T11:47:28.459993+0000","last_clean":"2024-04-26T11:47:28.459993+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:28.459993+0000","last_undegraded":"2024-04-26T11:47:28.459993+0000","last_fullsized":"2024-04-26T11:47:28.459993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":541,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154656+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:32.154656+0000","last_peered":"2024-04-26T11:47:32.154656+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:32.154656+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":541,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.153782+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:32.153782+0000","last_peered":"2024-04-26T11:47:32.153782+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:32.153782+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":994,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147168+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:32.147168+0000","last_peered":"2024-04-26T11:47:32.147168+0000","last_clean":"2024-04-26T11:47:32.147168+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:32.147168+0000","last_undegraded":"2024-04-26T11:47:32.147168+0000","last_fullsized":"2024-04-26T11:47:32.147168+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":901,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-26T11:47:33.157959+0000","last_change":"2024-04-26T11:47:33.158169+0000","last_active":"2024-04-26T11:47:33.157959+0000","last_peered":"2024-04-26T11:47:33.086395+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:33.157959+0000","last_undegraded":"2024-04-26T11:47:33.157959+0000","last_fullsized":"2024-04-26T11:47:33.157959+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:30.870862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":557,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152740+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:32.152740+0000","last_peered":"2024-04-26T11:47:32.152740+0000","last_clean":"2024-04-26T11:47:32.152740+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:32.152740+0000","last_undegraded":"2024-04-26T11:47:32.152740+0000","last_fullsized":"2024-04-26T11:47:32.152740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":491,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457274+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:47:28.457274+0000","last_peered":"2024-04-26T11:47:28.457274+0000","last_clean":"2024-04-26T11:47:28.457274+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:47:28.457274+0000","last_undegraded":"2024-04-26T11:47:28.457274+0000","last_fullsized":"2024-04-26T11:47:28.457274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":602,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.152433+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:32.152433+0000","last_peered":"2024-04-26T11:47:32.152433+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:32.152433+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":493,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154776+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:32.154776+0000","last_peered":"2024-04-26T11:47:32.154776+0000","last_clean":"2024-04-26T11:47:32.154776+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:32.154776+0000","last_undegraded":"2024-04-26T11:47:32.154776+0000","last_fullsized":"2024-04-26T11:47:32.154776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":637,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.149001+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:32.149001+0000","last_peered":"2024-04-26T11:47:32.149001+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:32.149001+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":495,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148378+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:32.148378+0000","last_peered":"2024-04-26T11:47:32.148378+0000","last_clean":"2024-04-26T11:47:32.148378+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:32.148378+0000","last_undegraded":"2024-04-26T11:47:32.148378+0000","last_fullsized":"2024-04-26T11:47:32.148378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":576,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154245+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:32.154245+0000","last_peered":"2024-04-26T11:47:32.154245+0000","last_clean":"2024-04-26T11:47:32.154245+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:32.154245+0000","last_undegraded":"2024-04-26T11:47:32.154245+0000","last_fullsized":"2024-04-26T11:47:32.154245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":484,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.468973+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:47:28.468973+0000","last_peered":"2024-04-26T11:47:28.468973+0000","last_clean":"2024-04-26T11:47:28.468973+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:47:28.468973+0000","last_undegraded":"2024-04-26T11:47:28.468973+0000","last_fullsized":"2024-04-26T11:47:28.468973+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":605,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153019+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:32.153019+0000","last_peered":"2024-04-26T11:47:32.153019+0000","last_clean":"2024-04-26T11:47:32.153019+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:32.153019+0000","last_undegraded":"2024-04-26T11:47:32.153019+0000","last_fullsized":"2024-04-26T11:47:32.153019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":571,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142275+0000","last_change":"2024-04-26T11:47:12.262325+0000","last_active":"2024-04-26T11:47:27.142275+0000","last_peered":"2024-04-26T11:47:27.142275+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259636+0000","last_became_peered":"2024-04-26T11:47:12.259636+0000","last_unstale":"2024-04-26T11:47:27.142275+0000","last_undegraded":"2024-04-26T11:47:12.166109+0000","last_fullsized":"2024-04-26T11:47:12.158494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:27.521969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":538,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146536+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:32.146536+0000","last_peered":"2024-04-26T11:47:32.146536+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:32.146536+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":484,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154054+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:32.154054+0000","last_peered":"2024-04-26T11:47:32.154054+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:32.154054+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":603,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147575+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:32.147575+0000","last_peered":"2024-04-26T11:47:32.147575+0000","last_clean":"2024-04-26T11:47:32.147575+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:32.147575+0000","last_undegraded":"2024-04-26T11:47:32.147575+0000","last_fullsized":"2024-04-26T11:47:32.147575+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":595,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154721+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:32.154721+0000","last_peered":"2024-04-26T11:47:32.154721+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:32.154721+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458042+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:28.458042+0000","last_peered":"2024-04-26T11:47:28.458042+0000","last_clean":"2024-04-26T11:47:28.458042+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:28.458042+0000","last_undegraded":"2024-04-26T11:47:28.458042+0000","last_fullsized":"2024-04-26T11:47:28.458042+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":511,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144528+0000","last_change":"2024-04-26T11:47:12.262102+0000","last_active":"2024-04-26T11:47:27.144528+0000","last_peered":"2024-04-26T11:47:27.144528+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259702+0000","last_became_peered":"2024-04-26T11:47:12.259702+0000","last_unstale":"2024-04-26T11:47:27.144528+0000","last_undegraded":"2024-04-26T11:47:12.156439+0000","last_fullsized":"2024-04-26T11:47:12.146012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154746+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:32.154746+0000","last_peered":"2024-04-26T11:47:32.154746+0000","last_clean":"2024-04-26T11:47:32.154746+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:32.154746+0000","last_undegraded":"2024-04-26T11:47:32.154746+0000","last_fullsized":"2024-04-26T11:47:32.154746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":526,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459779+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:28.459779+0000","last_peered":"2024-04-26T11:47:28.459779+0000","last_clean":"2024-04-26T11:47:28.459779+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:28.459779+0000","last_undegraded":"2024-04-26T11:47:28.459779+0000","last_fullsized":"2024-04-26T11:47:28.459779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146794+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:32.146794+0000","last_peered":"2024-04-26T11:47:32.146794+0000","last_clean":"2024-04-26T11:47:32.146794+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:32.146794+0000","last_undegraded":"2024-04-26T11:47:32.146794+0000","last_fullsized":"2024-04-26T11:47:32.146794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":302,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148703+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:32.148703+0000","last_peered":"2024-04-26T11:47:32.148703+0000","last_clean":"2024-04-26T11:47:32.148703+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:32.148703+0000","last_undegraded":"2024-04-26T11:47:32.148703+0000","last_fullsized":"2024-04-26T11:47:32.148703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":520,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152440+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:32.152440+0000","last_peered":"2024-04-26T11:47:32.152440+0000","last_clean":"2024-04-26T11:47:32.152440+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:32.152440+0000","last_undegraded":"2024-04-26T11:47:32.152440+0000","last_fullsized":"2024-04-26T11:47:32.152440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":480,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155054+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:32.155054+0000","last_peered":"2024-04-26T11:47:32.155054+0000","last_clean":"2024-04-26T11:47:32.155054+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:32.155054+0000","last_undegraded":"2024-04-26T11:47:32.155054+0000","last_fullsized":"2024-04-26T11:47:32.155054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1011,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153391+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:47:32.153391+0000","last_peered":"2024-04-26T11:47:32.153391+0000","last_clean":"2024-04-26T11:47:32.153391+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:47:32.153391+0000","last_undegraded":"2024-04-26T11:47:32.153391+0000","last_fullsized":"2024-04-26T11:47:32.153391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":674,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148977+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:32.148977+0000","last_peered":"2024-04-26T11:47:32.148977+0000","last_clean":"2024-04-26T11:47:32.148977+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:32.148977+0000","last_undegraded":"2024-04-26T11:47:32.148977+0000","last_fullsized":"2024-04-26T11:47:32.148977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":995,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146636+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:32.146636+0000","last_peered":"2024-04-26T11:47:32.146636+0000","last_clean":"2024-04-26T11:47:32.146636+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:32.146636+0000","last_undegraded":"2024-04-26T11:47:32.146636+0000","last_fullsized":"2024-04-26T11:47:32.146636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147715+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:32.147715+0000","last_peered":"2024-04-26T11:47:32.147715+0000","last_clean":"2024-04-26T11:47:32.147715+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:32.147715+0000","last_undegraded":"2024-04-26T11:47:32.147715+0000","last_fullsized":"2024-04-26T11:47:32.147715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":596,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459216+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:28.459216+0000","last_peered":"2024-04-26T11:47:28.459216+0000","last_clean":"2024-04-26T11:47:28.459216+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:28.459216+0000","last_undegraded":"2024-04-26T11:47:28.459216+0000","last_fullsized":"2024-04-26T11:47:28.459216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":348,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458860+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:28.458860+0000","last_peered":"2024-04-26T11:47:28.458860+0000","last_clean":"2024-04-26T11:47:28.458860+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:28.458860+0000","last_undegraded":"2024-04-26T11:47:28.458860+0000","last_fullsized":"2024-04-26T11:47:28.458860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":942,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147452+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:47:32.147452+0000","last_peered":"2024-04-26T11:47:32.147452+0000","last_clean":"2024-04-26T11:47:32.147452+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:47:32.147452+0000","last_undegraded":"2024-04-26T11:47:32.147452+0000","last_fullsized":"2024-04-26T11:47:32.147452+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":263,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147127+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:32.147127+0000","last_peered":"2024-04-26T11:47:32.147127+0000","last_clean":"2024-04-26T11:47:32.147127+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:32.147127+0000","last_undegraded":"2024-04-26T11:47:32.147127+0000","last_fullsized":"2024-04-26T11:47:32.147127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":528,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148619+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:32.148619+0000","last_peered":"2024-04-26T11:47:32.148619+0000","last_clean":"2024-04-26T11:47:32.148619+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:32.148619+0000","last_undegraded":"2024-04-26T11:47:32.148619+0000","last_fullsized":"2024-04-26T11:47:32.148619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154059+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:32.154059+0000","last_peered":"2024-04-26T11:47:32.154059+0000","last_clean":"2024-04-26T11:47:32.154059+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:32.154059+0000","last_undegraded":"2024-04-26T11:47:32.154059+0000","last_fullsized":"2024-04-26T11:47:32.154059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":466,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148665+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:32.148665+0000","last_peered":"2024-04-26T11:47:32.148665+0000","last_clean":"2024-04-26T11:47:32.148665+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:32.148665+0000","last_undegraded":"2024-04-26T11:47:32.148665+0000","last_fullsized":"2024-04-26T11:47:32.148665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":614,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152665+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:32.152665+0000","last_peered":"2024-04-26T11:47:32.152665+0000","last_clean":"2024-04-26T11:47:32.152665+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:32.152665+0000","last_undegraded":"2024-04-26T11:47:32.152665+0000","last_fullsized":"2024-04-26T11:47:32.152665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":501,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460455+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:47:28.460455+0000","last_peered":"2024-04-26T11:47:28.460455+0000","last_clean":"2024-04-26T11:47:28.460455+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:47:28.460455+0000","last_undegraded":"2024-04-26T11:47:28.460455+0000","last_fullsized":"2024-04-26T11:47:28.460455+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":290,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147265+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:32.147265+0000","last_peered":"2024-04-26T11:47:32.147265+0000","last_clean":"2024-04-26T11:47:32.147265+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:32.147265+0000","last_undegraded":"2024-04-26T11:47:32.147265+0000","last_fullsized":"2024-04-26T11:47:32.147265+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147733+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:32.147733+0000","last_peered":"2024-04-26T11:47:32.147733+0000","last_clean":"2024-04-26T11:47:32.147733+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:32.147733+0000","last_undegraded":"2024-04-26T11:47:32.147733+0000","last_fullsized":"2024-04-26T11:47:32.147733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":590,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458394+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:28.458394+0000","last_peered":"2024-04-26T11:47:28.458394+0000","last_clean":"2024-04-26T11:47:28.458394+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:28.458394+0000","last_undegraded":"2024-04-26T11:47:28.458394+0000","last_fullsized":"2024-04-26T11:47:28.458394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":554,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148864+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:32.148864+0000","last_peered":"2024-04-26T11:47:32.148864+0000","last_clean":"2024-04-26T11:47:32.148864+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:32.148864+0000","last_undegraded":"2024-04-26T11:47:32.148864+0000","last_fullsized":"2024-04-26T11:47:32.148864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147042+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:32.147042+0000","last_peered":"2024-04-26T11:47:32.147042+0000","last_clean":"2024-04-26T11:47:32.147042+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:32.147042+0000","last_undegraded":"2024-04-26T11:47:32.147042+0000","last_fullsized":"2024-04-26T11:47:32.147042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":342,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.456814+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:28.456814+0000","last_peered":"2024-04-26T11:47:28.456814+0000","last_clean":"2024-04-26T11:47:28.456814+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:28.456814+0000","last_undegraded":"2024-04-26T11:47:28.456814+0000","last_fullsized":"2024-04-26T11:47:28.456814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":971,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-26T11:47:33.157498+0000","last_change":"2024-04-26T11:47:33.157764+0000","last_active":"2024-04-26T11:47:33.157498+0000","last_peered":"2024-04-26T11:47:32.421623+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:33.157498+0000","last_undegraded":"2024-04-26T11:47:33.157498+0000","last_fullsized":"2024-04-26T11:47:33.157498+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:34.390258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457465+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:28.457465+0000","last_peered":"2024-04-26T11:47:28.457465+0000","last_clean":"2024-04-26T11:47:28.457465+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:28.457465+0000","last_undegraded":"2024-04-26T11:47:28.457465+0000","last_fullsized":"2024-04-26T11:47:28.457465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":511,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152934+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:32.152934+0000","last_peered":"2024-04-26T11:47:32.152934+0000","last_clean":"2024-04-26T11:47:32.152934+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:32.152934+0000","last_undegraded":"2024-04-26T11:47:32.152934+0000","last_fullsized":"2024-04-26T11:47:32.152934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":434,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460408+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:28.460408+0000","last_peered":"2024-04-26T11:47:28.460408+0000","last_clean":"2024-04-26T11:47:28.460408+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:28.460408+0000","last_undegraded":"2024-04-26T11:47:28.460408+0000","last_fullsized":"2024-04-26T11:47:28.460408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147338+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:32.147338+0000","last_peered":"2024-04-26T11:47:32.147338+0000","last_clean":"2024-04-26T11:47:32.147338+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:32.147338+0000","last_undegraded":"2024-04-26T11:47:32.147338+0000","last_fullsized":"2024-04-26T11:47:32.147338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147619+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:32.147619+0000","last_peered":"2024-04-26T11:47:32.147619+0000","last_clean":"2024-04-26T11:47:32.147619+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:32.147619+0000","last_undegraded":"2024-04-26T11:47:32.147619+0000","last_fullsized":"2024-04-26T11:47:32.147619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":478,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458596+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:47:28.458596+0000","last_peered":"2024-04-26T11:47:28.458596+0000","last_clean":"2024-04-26T11:47:28.458596+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:47:28.458596+0000","last_undegraded":"2024-04-26T11:47:28.458596+0000","last_fullsized":"2024-04-26T11:47:28.458596+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":625,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148987+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:32.148987+0000","last_peered":"2024-04-26T11:47:32.148987+0000","last_clean":"2024-04-26T11:47:32.148987+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:32.148987+0000","last_undegraded":"2024-04-26T11:47:32.148987+0000","last_fullsized":"2024-04-26T11:47:32.148987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458367+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:28.458367+0000","last_peered":"2024-04-26T11:47:28.458367+0000","last_clean":"2024-04-26T11:47:28.458367+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:28.458367+0000","last_undegraded":"2024-04-26T11:47:28.458367+0000","last_fullsized":"2024-04-26T11:47:28.458367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":466,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152885+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:32.152885+0000","last_peered":"2024-04-26T11:47:32.152885+0000","last_clean":"2024-04-26T11:47:32.152885+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:32.152885+0000","last_undegraded":"2024-04-26T11:47:32.152885+0000","last_fullsized":"2024-04-26T11:47:32.152885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458765+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:28.458765+0000","last_peered":"2024-04-26T11:47:28.458765+0000","last_clean":"2024-04-26T11:47:28.458765+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:28.458765+0000","last_undegraded":"2024-04-26T11:47:28.458765+0000","last_fullsized":"2024-04-26T11:47:28.458765+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155396+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:32.155396+0000","last_peered":"2024-04-26T11:47:32.155396+0000","last_clean":"2024-04-26T11:47:32.155396+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:32.155396+0000","last_undegraded":"2024-04-26T11:47:32.155396+0000","last_fullsized":"2024-04-26T11:47:32.155396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":507,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153251+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:32.153251+0000","last_peered":"2024-04-26T11:47:32.153251+0000","last_clean":"2024-04-26T11:47:32.153251+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:32.153251+0000","last_undegraded":"2024-04-26T11:47:32.153251+0000","last_fullsized":"2024-04-26T11:47:32.153251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459850+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:28.459850+0000","last_peered":"2024-04-26T11:47:28.459850+0000","last_clean":"2024-04-26T11:47:28.459850+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:28.459850+0000","last_undegraded":"2024-04-26T11:47:28.459850+0000","last_fullsized":"2024-04-26T11:47:28.459850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459357+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:28.459357+0000","last_peered":"2024-04-26T11:47:28.459357+0000","last_clean":"2024-04-26T11:47:28.459357+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:28.459357+0000","last_undegraded":"2024-04-26T11:47:28.459357+0000","last_fullsized":"2024-04-26T11:47:28.459357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":614,"reported_epoch":95,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:34.049479+0000","last_change":"2024-04-26T11:47:33.771421+0000","last_active":"2024-04-26T11:47:34.049479+0000","last_peered":"2024-04-26T11:47:34.049479+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:34.049479+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459435+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:28.459435+0000","last_peered":"2024-04-26T11:47:28.459435+0000","last_clean":"2024-04-26T11:47:28.459435+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:28.459435+0000","last_undegraded":"2024-04-26T11:47:28.459435+0000","last_fullsized":"2024-04-26T11:47:28.459435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148792+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:32.148792+0000","last_peered":"2024-04-26T11:47:32.148792+0000","last_clean":"2024-04-26T11:47:32.148792+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:32.148792+0000","last_undegraded":"2024-04-26T11:47:32.148792+0000","last_fullsized":"2024-04-26T11:47:32.148792+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":540,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153626+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:32.153626+0000","last_peered":"2024-04-26T11:47:32.153626+0000","last_clean":"2024-04-26T11:47:32.153626+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:32.153626+0000","last_undegraded":"2024-04-26T11:47:32.153626+0000","last_fullsized":"2024-04-26T11:47:32.153626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":552,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146650+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:32.146650+0000","last_peered":"2024-04-26T11:47:32.146650+0000","last_clean":"2024-04-26T11:47:32.146650+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:32.146650+0000","last_undegraded":"2024-04-26T11:47:32.146650+0000","last_fullsized":"2024-04-26T11:47:32.146650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":499,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147881+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:32.147881+0000","last_peered":"2024-04-26T11:47:32.147881+0000","last_clean":"2024-04-26T11:47:32.147881+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:32.147881+0000","last_undegraded":"2024-04-26T11:47:32.147881+0000","last_fullsized":"2024-04-26T11:47:32.147881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":683,"reported_epoch":90,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:29.051732+0000","last_change":"2024-04-26T11:47:28.777491+0000","last_active":"2024-04-26T11:47:29.051732+0000","last_peered":"2024-04-26T11:47:29.051732+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259639+0000","last_became_peered":"2024-04-26T11:47:12.259639+0000","last_unstale":"2024-04-26T11:47:29.051732+0000","last_undegraded":"2024-04-26T11:47:12.167836+0000","last_fullsized":"2024-04-26T11:47:12.160846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:57.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155196+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:32.155196+0000","last_peered":"2024-04-26T11:47:32.155196+0000","last_clean":"2024-04-26T11:47:32.155196+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:32.155196+0000","last_undegraded":"2024-04-26T11:47:32.155196+0000","last_fullsized":"2024-04-26T11:47:32.155196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":446,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.149359+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:32.149359+0000","last_peered":"2024-04-26T11:47:32.149359+0000","last_clean":"2024-04-26T11:47:32.149359+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:32.149359+0000","last_undegraded":"2024-04-26T11:47:32.149359+0000","last_fullsized":"2024-04-26T11:47:32.149359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":555,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457459+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:47:28.457459+0000","last_peered":"2024-04-26T11:47:28.457459+0000","last_clean":"2024-04-26T11:47:28.457459+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:47:28.457459+0000","last_undegraded":"2024-04-26T11:47:28.457459+0000","last_fullsized":"2024-04-26T11:47:28.457459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460205+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:28.460205+0000","last_peered":"2024-04-26T11:47:28.460205+0000","last_clean":"2024-04-26T11:47:28.460205+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:28.460205+0000","last_undegraded":"2024-04-26T11:47:28.460205+0000","last_fullsized":"2024-04-26T11:47:28.460205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":581,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.152119+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:32.152119+0000","last_peered":"2024-04-26T11:47:32.152119+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:32.152119+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":498,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155046+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:32.155046+0000","last_peered":"2024-04-26T11:47:32.155046+0000","last_clean":"2024-04-26T11:47:32.155046+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:32.155046+0000","last_undegraded":"2024-04-26T11:47:32.155046+0000","last_fullsized":"2024-04-26T11:47:32.155046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":851,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.456335+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:28.456335+0000","last_peered":"2024-04-26T11:47:28.456335+0000","last_clean":"2024-04-26T11:47:28.456335+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:28.456335+0000","last_undegraded":"2024-04-26T11:47:28.456335+0000","last_fullsized":"2024-04-26T11:47:28.456335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":490,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144989+0000","last_change":"2024-04-26T11:47:12.262558+0000","last_active":"2024-04-26T11:47:27.144989+0000","last_peered":"2024-04-26T11:47:27.144989+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.260513+0000","last_became_peered":"2024-04-26T11:47:12.260513+0000","last_unstale":"2024-04-26T11:47:27.144989+0000","last_undegraded":"2024-04-26T11:47:12.161322+0000","last_fullsized":"2024-04-26T11:47:12.156833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:46.502879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":408,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457004+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:28.457004+0000","last_peered":"2024-04-26T11:47:28.457004+0000","last_clean":"2024-04-26T11:47:28.457004+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:28.457004+0000","last_undegraded":"2024-04-26T11:47:28.457004+0000","last_fullsized":"2024-04-26T11:47:28.457004+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":519,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154439+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:32.154439+0000","last_peered":"2024-04-26T11:47:32.154439+0000","last_clean":"2024-04-26T11:47:32.154439+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:32.154439+0000","last_undegraded":"2024-04-26T11:47:32.154439+0000","last_fullsized":"2024-04-26T11:47:32.154439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":468,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154215+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:32.154215+0000","last_peered":"2024-04-26T11:47:32.154215+0000","last_clean":"2024-04-26T11:47:32.154215+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:32.154215+0000","last_undegraded":"2024-04-26T11:47:32.154215+0000","last_fullsized":"2024-04-26T11:47:32.154215+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":834,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153751+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:32.153751+0000","last_peered":"2024-04-26T11:47:32.153751+0000","last_clean":"2024-04-26T11:47:32.153751+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:32.153751+0000","last_undegraded":"2024-04-26T11:47:32.153751+0000","last_fullsized":"2024-04-26T11:47:32.153751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153445+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:32.153445+0000","last_peered":"2024-04-26T11:47:32.153445+0000","last_clean":"2024-04-26T11:47:32.153445+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:32.153445+0000","last_undegraded":"2024-04-26T11:47:32.153445+0000","last_fullsized":"2024-04-26T11:47:32.153445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":864,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147378+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:47:32.147378+0000","last_peered":"2024-04-26T11:47:32.147378+0000","last_clean":"2024-04-26T11:47:32.147378+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:47:32.147378+0000","last_undegraded":"2024-04-26T11:47:32.147378+0000","last_fullsized":"2024-04-26T11:47:32.147378+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":388,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147479+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:32.147479+0000","last_peered":"2024-04-26T11:47:32.147479+0000","last_clean":"2024-04-26T11:47:32.147479+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:32.147479+0000","last_undegraded":"2024-04-26T11:47:32.147479+0000","last_fullsized":"2024-04-26T11:47:32.147479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":881,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147120+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:47:32.147120+0000","last_peered":"2024-04-26T11:47:32.147120+0000","last_clean":"2024-04-26T11:47:32.147120+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:47:32.147120+0000","last_undegraded":"2024-04-26T11:47:32.147120+0000","last_fullsized":"2024-04-26T11:47:32.147120+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":417,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155131+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:32.155131+0000","last_peered":"2024-04-26T11:47:32.155131+0000","last_clean":"2024-04-26T11:47:32.155131+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:32.155131+0000","last_undegraded":"2024-04-26T11:47:32.155131+0000","last_fullsized":"2024-04-26T11:47:32.155131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":932,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154540+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:32.154540+0000","last_peered":"2024-04-26T11:47:32.154540+0000","last_clean":"2024-04-26T11:47:32.154540+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:32.154540+0000","last_undegraded":"2024-04-26T11:47:32.154540+0000","last_fullsized":"2024-04-26T11:47:32.154540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460033+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:28.460033+0000","last_peered":"2024-04-26T11:47:28.460033+0000","last_clean":"2024-04-26T11:47:28.460033+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:28.460033+0000","last_undegraded":"2024-04-26T11:47:28.460033+0000","last_fullsized":"2024-04-26T11:47:28.460033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":564,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.147014+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:32.147014+0000","last_peered":"2024-04-26T11:47:32.147014+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:32.147014+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459618+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:28.459618+0000","last_peered":"2024-04-26T11:47:28.459618+0000","last_clean":"2024-04-26T11:47:28.459618+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:28.459618+0000","last_undegraded":"2024-04-26T11:47:28.459618+0000","last_fullsized":"2024-04-26T11:47:28.459618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3007,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4938,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":109,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738413,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200312,"kb_used_data":88876,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171528,"statfs":{"total":96636764160,"available":96431644672,"internally_reserved":0,"allocated":91009024,"data_stored":90497544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":1,"up_from":72,"seq":309237645317,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111424,"kb_used_data":79792,"kb_used_omap":6,"kb_used_meta":31609,"kb_avail":94260416,"statfs":{"total":96636764160,"available":96522665984,"internally_reserved":0,"allocated":81707008,"data_stored":81255111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":32367872},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190492,"kb_used_data":83144,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181348,"statfs":{"total":96636764160,"available":96441700352,"internally_reserved":0,"allocated":85139456,"data_stored":84639587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:34.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:47:34.595 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:34.595 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 3714/108 objects degraded (3438.889%), 21 pgs degraded","count":21},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":215,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":96,"num_osds":3,"num_up_osds":3,"osd_up_since":1714132030,"num_in_osds":3,"osd_in_since":1714131840,"num_remapped_pgs":14},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":81},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":20},{"state_name":"peering","count":2},{"state_name":"active+recovering+undersized+degraded+remapped","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127603811,"bytes_used":514154496,"bytes_avail":289396137984,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":3714,"degraded_total":108,"degraded_ratio":34.388888888888886},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4213}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T11:45:27.979634+0000","services":{}},"progress_events":{}} 2024-04-26T11:47:34.610 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-26T11:47:34.611 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:34.927 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:34.929 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:34.943 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-04-26T11:47:34.131233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3007,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4959,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":191,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":502228,"kb_used_data":251812,"kb_used_omap":9,"kb_used_meta":250358,"kb_avail":282613292,"statfs":{"total":289910292480,"available":289396011008,"internally_reserved":0,"allocated":257855488,"data_stored":256392242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":256366732},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-707,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":602,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.003631"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":941,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154777+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:32.154777+0000","last_peered":"2024-04-26T11:47:32.154777+0000","last_clean":"2024-04-26T11:47:32.154777+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:32.154777+0000","last_undegraded":"2024-04-26T11:47:32.154777+0000","last_fullsized":"2024-04-26T11:47:32.154777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":608,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.153888+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:32.153888+0000","last_peered":"2024-04-26T11:47:32.153888+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:32.153888+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":504,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148035+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:32.148035+0000","last_peered":"2024-04-26T11:47:32.148035+0000","last_clean":"2024-04-26T11:47:32.148035+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:32.148035+0000","last_undegraded":"2024-04-26T11:47:32.148035+0000","last_fullsized":"2024-04-26T11:47:32.148035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":819,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147110+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:32.147110+0000","last_peered":"2024-04-26T11:47:32.147110+0000","last_clean":"2024-04-26T11:47:32.147110+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:32.147110+0000","last_undegraded":"2024-04-26T11:47:32.147110+0000","last_fullsized":"2024-04-26T11:47:32.147110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":897,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153340+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:47:32.153340+0000","last_peered":"2024-04-26T11:47:32.153340+0000","last_clean":"2024-04-26T11:47:32.153340+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:47:32.153340+0000","last_undegraded":"2024-04-26T11:47:32.153340+0000","last_fullsized":"2024-04-26T11:47:32.153340+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":825,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146402+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:32.146402+0000","last_peered":"2024-04-26T11:47:32.146402+0000","last_clean":"2024-04-26T11:47:32.146402+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:32.146402+0000","last_undegraded":"2024-04-26T11:47:32.146402+0000","last_fullsized":"2024-04-26T11:47:32.146402+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":625,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146513+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:32.146513+0000","last_peered":"2024-04-26T11:47:32.146513+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:32.146513+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":502,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146006+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:32.146006+0000","last_peered":"2024-04-26T11:47:32.146006+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:32.146006+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":518,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460079+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:28.460079+0000","last_peered":"2024-04-26T11:47:28.460079+0000","last_clean":"2024-04-26T11:47:28.460079+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:28.460079+0000","last_undegraded":"2024-04-26T11:47:28.460079+0000","last_fullsized":"2024-04-26T11:47:28.460079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":932,"reported_epoch":95,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:33.770303+0000","last_change":"2024-04-26T11:47:33.770711+0000","last_active":"2024-04-26T11:47:33.770303+0000","last_peered":"2024-04-26T11:47:33.770303+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:33.770303+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":853,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148020+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:32.148020+0000","last_peered":"2024-04-26T11:47:32.148020+0000","last_clean":"2024-04-26T11:47:32.148020+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:32.148020+0000","last_undegraded":"2024-04-26T11:47:32.148020+0000","last_fullsized":"2024-04-26T11:47:32.148020+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":471,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153526+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:32.153526+0000","last_peered":"2024-04-26T11:47:32.153526+0000","last_clean":"2024-04-26T11:47:32.153526+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:32.153526+0000","last_undegraded":"2024-04-26T11:47:32.153526+0000","last_fullsized":"2024-04-26T11:47:32.153526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":873,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153039+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:32.153039+0000","last_peered":"2024-04-26T11:47:32.153039+0000","last_clean":"2024-04-26T11:47:32.153039+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:32.153039+0000","last_undegraded":"2024-04-26T11:47:32.153039+0000","last_fullsized":"2024-04-26T11:47:32.153039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":543,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146411+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:32.146411+0000","last_peered":"2024-04-26T11:47:32.146411+0000","last_clean":"2024-04-26T11:47:32.146411+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:32.146411+0000","last_undegraded":"2024-04-26T11:47:32.146411+0000","last_fullsized":"2024-04-26T11:47:32.146411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":585,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146795+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:32.146795+0000","last_peered":"2024-04-26T11:47:32.146795+0000","last_clean":"2024-04-26T11:47:32.146795+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:32.146795+0000","last_undegraded":"2024-04-26T11:47:32.146795+0000","last_fullsized":"2024-04-26T11:47:32.146795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":640,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146412+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:32.146412+0000","last_peered":"2024-04-26T11:47:32.146412+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:32.146412+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":486,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459993+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:28.459993+0000","last_peered":"2024-04-26T11:47:28.459993+0000","last_clean":"2024-04-26T11:47:28.459993+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:28.459993+0000","last_undegraded":"2024-04-26T11:47:28.459993+0000","last_fullsized":"2024-04-26T11:47:28.459993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":541,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154656+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:32.154656+0000","last_peered":"2024-04-26T11:47:32.154656+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:32.154656+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":541,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.153782+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:32.153782+0000","last_peered":"2024-04-26T11:47:32.153782+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:32.153782+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":994,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147168+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:32.147168+0000","last_peered":"2024-04-26T11:47:32.147168+0000","last_clean":"2024-04-26T11:47:32.147168+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:32.147168+0000","last_undegraded":"2024-04-26T11:47:32.147168+0000","last_fullsized":"2024-04-26T11:47:32.147168+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":901,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-26T11:47:33.157959+0000","last_change":"2024-04-26T11:47:33.158169+0000","last_active":"2024-04-26T11:47:33.157959+0000","last_peered":"2024-04-26T11:47:33.086395+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:33.157959+0000","last_undegraded":"2024-04-26T11:47:33.157959+0000","last_fullsized":"2024-04-26T11:47:33.157959+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:30.870862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":557,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152740+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:32.152740+0000","last_peered":"2024-04-26T11:47:32.152740+0000","last_clean":"2024-04-26T11:47:32.152740+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:32.152740+0000","last_undegraded":"2024-04-26T11:47:32.152740+0000","last_fullsized":"2024-04-26T11:47:32.152740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":491,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457274+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:47:28.457274+0000","last_peered":"2024-04-26T11:47:28.457274+0000","last_clean":"2024-04-26T11:47:28.457274+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:47:28.457274+0000","last_undegraded":"2024-04-26T11:47:28.457274+0000","last_fullsized":"2024-04-26T11:47:28.457274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":602,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.152433+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:32.152433+0000","last_peered":"2024-04-26T11:47:32.152433+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:32.152433+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":493,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154776+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:32.154776+0000","last_peered":"2024-04-26T11:47:32.154776+0000","last_clean":"2024-04-26T11:47:32.154776+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:32.154776+0000","last_undegraded":"2024-04-26T11:47:32.154776+0000","last_fullsized":"2024-04-26T11:47:32.154776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":637,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.149001+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:32.149001+0000","last_peered":"2024-04-26T11:47:32.149001+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:32.149001+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":495,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148378+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:32.148378+0000","last_peered":"2024-04-26T11:47:32.148378+0000","last_clean":"2024-04-26T11:47:32.148378+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:32.148378+0000","last_undegraded":"2024-04-26T11:47:32.148378+0000","last_fullsized":"2024-04-26T11:47:32.148378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":576,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154245+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:32.154245+0000","last_peered":"2024-04-26T11:47:32.154245+0000","last_clean":"2024-04-26T11:47:32.154245+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:32.154245+0000","last_undegraded":"2024-04-26T11:47:32.154245+0000","last_fullsized":"2024-04-26T11:47:32.154245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":484,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.468973+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:47:28.468973+0000","last_peered":"2024-04-26T11:47:28.468973+0000","last_clean":"2024-04-26T11:47:28.468973+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:47:28.468973+0000","last_undegraded":"2024-04-26T11:47:28.468973+0000","last_fullsized":"2024-04-26T11:47:28.468973+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":605,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153019+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:32.153019+0000","last_peered":"2024-04-26T11:47:32.153019+0000","last_clean":"2024-04-26T11:47:32.153019+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:32.153019+0000","last_undegraded":"2024-04-26T11:47:32.153019+0000","last_fullsized":"2024-04-26T11:47:32.153019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":571,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.142275+0000","last_change":"2024-04-26T11:47:12.262325+0000","last_active":"2024-04-26T11:47:27.142275+0000","last_peered":"2024-04-26T11:47:27.142275+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259636+0000","last_became_peered":"2024-04-26T11:47:12.259636+0000","last_unstale":"2024-04-26T11:47:27.142275+0000","last_undegraded":"2024-04-26T11:47:12.166109+0000","last_fullsized":"2024-04-26T11:47:12.158494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:27.521969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":538,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146536+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:32.146536+0000","last_peered":"2024-04-26T11:47:32.146536+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:32.146536+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":484,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154054+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:32.154054+0000","last_peered":"2024-04-26T11:47:32.154054+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:32.154054+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":603,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147575+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:32.147575+0000","last_peered":"2024-04-26T11:47:32.147575+0000","last_clean":"2024-04-26T11:47:32.147575+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:32.147575+0000","last_undegraded":"2024-04-26T11:47:32.147575+0000","last_fullsized":"2024-04-26T11:47:32.147575+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":595,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154721+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:32.154721+0000","last_peered":"2024-04-26T11:47:32.154721+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:32.154721+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458042+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:28.458042+0000","last_peered":"2024-04-26T11:47:28.458042+0000","last_clean":"2024-04-26T11:47:28.458042+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:28.458042+0000","last_undegraded":"2024-04-26T11:47:28.458042+0000","last_fullsized":"2024-04-26T11:47:28.458042+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":511,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144528+0000","last_change":"2024-04-26T11:47:12.262102+0000","last_active":"2024-04-26T11:47:27.144528+0000","last_peered":"2024-04-26T11:47:27.144528+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259702+0000","last_became_peered":"2024-04-26T11:47:12.259702+0000","last_unstale":"2024-04-26T11:47:27.144528+0000","last_undegraded":"2024-04-26T11:47:12.156439+0000","last_fullsized":"2024-04-26T11:47:12.146012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:42.316709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-6}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154746+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:32.154746+0000","last_peered":"2024-04-26T11:47:32.154746+0000","last_clean":"2024-04-26T11:47:32.154746+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:32.154746+0000","last_undegraded":"2024-04-26T11:47:32.154746+0000","last_fullsized":"2024-04-26T11:47:32.154746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":526,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459779+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:28.459779+0000","last_peered":"2024-04-26T11:47:28.459779+0000","last_clean":"2024-04-26T11:47:28.459779+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:28.459779+0000","last_undegraded":"2024-04-26T11:47:28.459779+0000","last_fullsized":"2024-04-26T11:47:28.459779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146794+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:32.146794+0000","last_peered":"2024-04-26T11:47:32.146794+0000","last_clean":"2024-04-26T11:47:32.146794+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:32.146794+0000","last_undegraded":"2024-04-26T11:47:32.146794+0000","last_fullsized":"2024-04-26T11:47:32.146794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":302,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148703+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:32.148703+0000","last_peered":"2024-04-26T11:47:32.148703+0000","last_clean":"2024-04-26T11:47:32.148703+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:32.148703+0000","last_undegraded":"2024-04-26T11:47:32.148703+0000","last_fullsized":"2024-04-26T11:47:32.148703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":520,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152440+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:32.152440+0000","last_peered":"2024-04-26T11:47:32.152440+0000","last_clean":"2024-04-26T11:47:32.152440+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:32.152440+0000","last_undegraded":"2024-04-26T11:47:32.152440+0000","last_fullsized":"2024-04-26T11:47:32.152440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":480,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155054+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:32.155054+0000","last_peered":"2024-04-26T11:47:32.155054+0000","last_clean":"2024-04-26T11:47:32.155054+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:32.155054+0000","last_undegraded":"2024-04-26T11:47:32.155054+0000","last_fullsized":"2024-04-26T11:47:32.155054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1011,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153391+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:47:32.153391+0000","last_peered":"2024-04-26T11:47:32.153391+0000","last_clean":"2024-04-26T11:47:32.153391+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:47:32.153391+0000","last_undegraded":"2024-04-26T11:47:32.153391+0000","last_fullsized":"2024-04-26T11:47:32.153391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":674,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148977+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:32.148977+0000","last_peered":"2024-04-26T11:47:32.148977+0000","last_clean":"2024-04-26T11:47:32.148977+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:32.148977+0000","last_undegraded":"2024-04-26T11:47:32.148977+0000","last_fullsized":"2024-04-26T11:47:32.148977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":995,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146636+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:32.146636+0000","last_peered":"2024-04-26T11:47:32.146636+0000","last_clean":"2024-04-26T11:47:32.146636+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:32.146636+0000","last_undegraded":"2024-04-26T11:47:32.146636+0000","last_fullsized":"2024-04-26T11:47:32.146636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147715+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:32.147715+0000","last_peered":"2024-04-26T11:47:32.147715+0000","last_clean":"2024-04-26T11:47:32.147715+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:32.147715+0000","last_undegraded":"2024-04-26T11:47:32.147715+0000","last_fullsized":"2024-04-26T11:47:32.147715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":596,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459216+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:28.459216+0000","last_peered":"2024-04-26T11:47:28.459216+0000","last_clean":"2024-04-26T11:47:28.459216+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:28.459216+0000","last_undegraded":"2024-04-26T11:47:28.459216+0000","last_fullsized":"2024-04-26T11:47:28.459216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":348,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458860+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:28.458860+0000","last_peered":"2024-04-26T11:47:28.458860+0000","last_clean":"2024-04-26T11:47:28.458860+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:28.458860+0000","last_undegraded":"2024-04-26T11:47:28.458860+0000","last_fullsized":"2024-04-26T11:47:28.458860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":942,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147452+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:47:32.147452+0000","last_peered":"2024-04-26T11:47:32.147452+0000","last_clean":"2024-04-26T11:47:32.147452+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:47:32.147452+0000","last_undegraded":"2024-04-26T11:47:32.147452+0000","last_fullsized":"2024-04-26T11:47:32.147452+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":263,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147127+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:32.147127+0000","last_peered":"2024-04-26T11:47:32.147127+0000","last_clean":"2024-04-26T11:47:32.147127+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:32.147127+0000","last_undegraded":"2024-04-26T11:47:32.147127+0000","last_fullsized":"2024-04-26T11:47:32.147127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":528,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148619+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:32.148619+0000","last_peered":"2024-04-26T11:47:32.148619+0000","last_clean":"2024-04-26T11:47:32.148619+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:32.148619+0000","last_undegraded":"2024-04-26T11:47:32.148619+0000","last_fullsized":"2024-04-26T11:47:32.148619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154059+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:32.154059+0000","last_peered":"2024-04-26T11:47:32.154059+0000","last_clean":"2024-04-26T11:47:32.154059+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:32.154059+0000","last_undegraded":"2024-04-26T11:47:32.154059+0000","last_fullsized":"2024-04-26T11:47:32.154059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":466,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148665+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:32.148665+0000","last_peered":"2024-04-26T11:47:32.148665+0000","last_clean":"2024-04-26T11:47:32.148665+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:32.148665+0000","last_undegraded":"2024-04-26T11:47:32.148665+0000","last_fullsized":"2024-04-26T11:47:32.148665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":614,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152665+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:32.152665+0000","last_peered":"2024-04-26T11:47:32.152665+0000","last_clean":"2024-04-26T11:47:32.152665+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:32.152665+0000","last_undegraded":"2024-04-26T11:47:32.152665+0000","last_fullsized":"2024-04-26T11:47:32.152665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":501,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460455+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:47:28.460455+0000","last_peered":"2024-04-26T11:47:28.460455+0000","last_clean":"2024-04-26T11:47:28.460455+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:47:28.460455+0000","last_undegraded":"2024-04-26T11:47:28.460455+0000","last_fullsized":"2024-04-26T11:47:28.460455+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":290,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147265+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:32.147265+0000","last_peered":"2024-04-26T11:47:32.147265+0000","last_clean":"2024-04-26T11:47:32.147265+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:32.147265+0000","last_undegraded":"2024-04-26T11:47:32.147265+0000","last_fullsized":"2024-04-26T11:47:32.147265+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147733+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:32.147733+0000","last_peered":"2024-04-26T11:47:32.147733+0000","last_clean":"2024-04-26T11:47:32.147733+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:32.147733+0000","last_undegraded":"2024-04-26T11:47:32.147733+0000","last_fullsized":"2024-04-26T11:47:32.147733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":590,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458394+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:28.458394+0000","last_peered":"2024-04-26T11:47:28.458394+0000","last_clean":"2024-04-26T11:47:28.458394+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:28.458394+0000","last_undegraded":"2024-04-26T11:47:28.458394+0000","last_fullsized":"2024-04-26T11:47:28.458394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":554,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148864+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:32.148864+0000","last_peered":"2024-04-26T11:47:32.148864+0000","last_clean":"2024-04-26T11:47:32.148864+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:32.148864+0000","last_undegraded":"2024-04-26T11:47:32.148864+0000","last_fullsized":"2024-04-26T11:47:32.148864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147042+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:32.147042+0000","last_peered":"2024-04-26T11:47:32.147042+0000","last_clean":"2024-04-26T11:47:32.147042+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:32.147042+0000","last_undegraded":"2024-04-26T11:47:32.147042+0000","last_fullsized":"2024-04-26T11:47:32.147042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":342,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.456814+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:28.456814+0000","last_peered":"2024-04-26T11:47:28.456814+0000","last_clean":"2024-04-26T11:47:28.456814+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:28.456814+0000","last_undegraded":"2024-04-26T11:47:28.456814+0000","last_fullsized":"2024-04-26T11:47:28.456814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":971,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-26T11:47:33.157498+0000","last_change":"2024-04-26T11:47:33.157764+0000","last_active":"2024-04-26T11:47:33.157498+0000","last_peered":"2024-04-26T11:47:32.421623+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:33.157498+0000","last_undegraded":"2024-04-26T11:47:33.157498+0000","last_fullsized":"2024-04-26T11:47:33.157498+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:34.390258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457465+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:28.457465+0000","last_peered":"2024-04-26T11:47:28.457465+0000","last_clean":"2024-04-26T11:47:28.457465+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:28.457465+0000","last_undegraded":"2024-04-26T11:47:28.457465+0000","last_fullsized":"2024-04-26T11:47:28.457465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":511,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152934+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:32.152934+0000","last_peered":"2024-04-26T11:47:32.152934+0000","last_clean":"2024-04-26T11:47:32.152934+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:32.152934+0000","last_undegraded":"2024-04-26T11:47:32.152934+0000","last_fullsized":"2024-04-26T11:47:32.152934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":434,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460408+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:28.460408+0000","last_peered":"2024-04-26T11:47:28.460408+0000","last_clean":"2024-04-26T11:47:28.460408+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:28.460408+0000","last_undegraded":"2024-04-26T11:47:28.460408+0000","last_fullsized":"2024-04-26T11:47:28.460408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147338+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:32.147338+0000","last_peered":"2024-04-26T11:47:32.147338+0000","last_clean":"2024-04-26T11:47:32.147338+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:32.147338+0000","last_undegraded":"2024-04-26T11:47:32.147338+0000","last_fullsized":"2024-04-26T11:47:32.147338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147619+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:32.147619+0000","last_peered":"2024-04-26T11:47:32.147619+0000","last_clean":"2024-04-26T11:47:32.147619+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:32.147619+0000","last_undegraded":"2024-04-26T11:47:32.147619+0000","last_fullsized":"2024-04-26T11:47:32.147619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":478,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458596+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:47:28.458596+0000","last_peered":"2024-04-26T11:47:28.458596+0000","last_clean":"2024-04-26T11:47:28.458596+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:47:28.458596+0000","last_undegraded":"2024-04-26T11:47:28.458596+0000","last_fullsized":"2024-04-26T11:47:28.458596+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":625,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148987+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:32.148987+0000","last_peered":"2024-04-26T11:47:32.148987+0000","last_clean":"2024-04-26T11:47:32.148987+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:32.148987+0000","last_undegraded":"2024-04-26T11:47:32.148987+0000","last_fullsized":"2024-04-26T11:47:32.148987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458367+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:28.458367+0000","last_peered":"2024-04-26T11:47:28.458367+0000","last_clean":"2024-04-26T11:47:28.458367+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:28.458367+0000","last_undegraded":"2024-04-26T11:47:28.458367+0000","last_fullsized":"2024-04-26T11:47:28.458367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":466,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152885+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:32.152885+0000","last_peered":"2024-04-26T11:47:32.152885+0000","last_clean":"2024-04-26T11:47:32.152885+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:32.152885+0000","last_undegraded":"2024-04-26T11:47:32.152885+0000","last_fullsized":"2024-04-26T11:47:32.152885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.458765+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:28.458765+0000","last_peered":"2024-04-26T11:47:28.458765+0000","last_clean":"2024-04-26T11:47:28.458765+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:28.458765+0000","last_undegraded":"2024-04-26T11:47:28.458765+0000","last_fullsized":"2024-04-26T11:47:28.458765+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155396+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:32.155396+0000","last_peered":"2024-04-26T11:47:32.155396+0000","last_clean":"2024-04-26T11:47:32.155396+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:32.155396+0000","last_undegraded":"2024-04-26T11:47:32.155396+0000","last_fullsized":"2024-04-26T11:47:32.155396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":507,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153251+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:32.153251+0000","last_peered":"2024-04-26T11:47:32.153251+0000","last_clean":"2024-04-26T11:47:32.153251+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:32.153251+0000","last_undegraded":"2024-04-26T11:47:32.153251+0000","last_fullsized":"2024-04-26T11:47:32.153251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459850+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:28.459850+0000","last_peered":"2024-04-26T11:47:28.459850+0000","last_clean":"2024-04-26T11:47:28.459850+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:28.459850+0000","last_undegraded":"2024-04-26T11:47:28.459850+0000","last_fullsized":"2024-04-26T11:47:28.459850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459357+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:28.459357+0000","last_peered":"2024-04-26T11:47:28.459357+0000","last_clean":"2024-04-26T11:47:28.459357+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:28.459357+0000","last_undegraded":"2024-04-26T11:47:28.459357+0000","last_fullsized":"2024-04-26T11:47:28.459357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":614,"reported_epoch":95,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:34.049479+0000","last_change":"2024-04-26T11:47:33.771421+0000","last_active":"2024-04-26T11:47:34.049479+0000","last_peered":"2024-04-26T11:47:34.049479+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:34.049479+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459435+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:28.459435+0000","last_peered":"2024-04-26T11:47:28.459435+0000","last_clean":"2024-04-26T11:47:28.459435+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:28.459435+0000","last_undegraded":"2024-04-26T11:47:28.459435+0000","last_fullsized":"2024-04-26T11:47:28.459435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148792+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:32.148792+0000","last_peered":"2024-04-26T11:47:32.148792+0000","last_clean":"2024-04-26T11:47:32.148792+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:32.148792+0000","last_undegraded":"2024-04-26T11:47:32.148792+0000","last_fullsized":"2024-04-26T11:47:32.148792+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":540,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153626+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:32.153626+0000","last_peered":"2024-04-26T11:47:32.153626+0000","last_clean":"2024-04-26T11:47:32.153626+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:32.153626+0000","last_undegraded":"2024-04-26T11:47:32.153626+0000","last_fullsized":"2024-04-26T11:47:32.153626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":552,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146650+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:32.146650+0000","last_peered":"2024-04-26T11:47:32.146650+0000","last_clean":"2024-04-26T11:47:32.146650+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:32.146650+0000","last_undegraded":"2024-04-26T11:47:32.146650+0000","last_fullsized":"2024-04-26T11:47:32.146650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":499,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147881+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:32.147881+0000","last_peered":"2024-04-26T11:47:32.147881+0000","last_clean":"2024-04-26T11:47:32.147881+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:32.147881+0000","last_undegraded":"2024-04-26T11:47:32.147881+0000","last_fullsized":"2024-04-26T11:47:32.147881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":683,"reported_epoch":90,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:29.051732+0000","last_change":"2024-04-26T11:47:28.777491+0000","last_active":"2024-04-26T11:47:29.051732+0000","last_peered":"2024-04-26T11:47:29.051732+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.259639+0000","last_became_peered":"2024-04-26T11:47:12.259639+0000","last_unstale":"2024-04-26T11:47:29.051732+0000","last_undegraded":"2024-04-26T11:47:12.167836+0000","last_fullsized":"2024-04-26T11:47:12.160846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:57.744992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-13}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155196+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:32.155196+0000","last_peered":"2024-04-26T11:47:32.155196+0000","last_clean":"2024-04-26T11:47:32.155196+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:32.155196+0000","last_undegraded":"2024-04-26T11:47:32.155196+0000","last_fullsized":"2024-04-26T11:47:32.155196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":446,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.149359+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:32.149359+0000","last_peered":"2024-04-26T11:47:32.149359+0000","last_clean":"2024-04-26T11:47:32.149359+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:32.149359+0000","last_undegraded":"2024-04-26T11:47:32.149359+0000","last_fullsized":"2024-04-26T11:47:32.149359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":555,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457459+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:47:28.457459+0000","last_peered":"2024-04-26T11:47:28.457459+0000","last_clean":"2024-04-26T11:47:28.457459+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:47:28.457459+0000","last_undegraded":"2024-04-26T11:47:28.457459+0000","last_fullsized":"2024-04-26T11:47:28.457459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460205+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:28.460205+0000","last_peered":"2024-04-26T11:47:28.460205+0000","last_clean":"2024-04-26T11:47:28.460205+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:28.460205+0000","last_undegraded":"2024-04-26T11:47:28.460205+0000","last_fullsized":"2024-04-26T11:47:28.460205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":581,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.152119+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:32.152119+0000","last_peered":"2024-04-26T11:47:32.152119+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:32.152119+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":498,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155046+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:32.155046+0000","last_peered":"2024-04-26T11:47:32.155046+0000","last_clean":"2024-04-26T11:47:32.155046+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:32.155046+0000","last_undegraded":"2024-04-26T11:47:32.155046+0000","last_fullsized":"2024-04-26T11:47:32.155046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":851,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.456335+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:28.456335+0000","last_peered":"2024-04-26T11:47:28.456335+0000","last_clean":"2024-04-26T11:47:28.456335+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:28.456335+0000","last_undegraded":"2024-04-26T11:47:28.456335+0000","last_fullsized":"2024-04-26T11:47:28.456335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":490,"reported_epoch":89,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:27.144989+0000","last_change":"2024-04-26T11:47:12.262558+0000","last_active":"2024-04-26T11:47:27.144989+0000","last_peered":"2024-04-26T11:47:27.144989+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.260513+0000","last_became_peered":"2024-04-26T11:47:12.260513+0000","last_unstale":"2024-04-26T11:47:27.144989+0000","last_undegraded":"2024-04-26T11:47:12.161322+0000","last_fullsized":"2024-04-26T11:47:12.156833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:46.502879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":408,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.457004+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:28.457004+0000","last_peered":"2024-04-26T11:47:28.457004+0000","last_clean":"2024-04-26T11:47:28.457004+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:28.457004+0000","last_undegraded":"2024-04-26T11:47:28.457004+0000","last_fullsized":"2024-04-26T11:47:28.457004+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":519,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154439+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:32.154439+0000","last_peered":"2024-04-26T11:47:32.154439+0000","last_clean":"2024-04-26T11:47:32.154439+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:32.154439+0000","last_undegraded":"2024-04-26T11:47:32.154439+0000","last_fullsized":"2024-04-26T11:47:32.154439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":468,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154215+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:32.154215+0000","last_peered":"2024-04-26T11:47:32.154215+0000","last_clean":"2024-04-26T11:47:32.154215+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:32.154215+0000","last_undegraded":"2024-04-26T11:47:32.154215+0000","last_fullsized":"2024-04-26T11:47:32.154215+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":834,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153751+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:32.153751+0000","last_peered":"2024-04-26T11:47:32.153751+0000","last_clean":"2024-04-26T11:47:32.153751+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:32.153751+0000","last_undegraded":"2024-04-26T11:47:32.153751+0000","last_fullsized":"2024-04-26T11:47:32.153751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153445+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:32.153445+0000","last_peered":"2024-04-26T11:47:32.153445+0000","last_clean":"2024-04-26T11:47:32.153445+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:32.153445+0000","last_undegraded":"2024-04-26T11:47:32.153445+0000","last_fullsized":"2024-04-26T11:47:32.153445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":864,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147378+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:47:32.147378+0000","last_peered":"2024-04-26T11:47:32.147378+0000","last_clean":"2024-04-26T11:47:32.147378+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:47:32.147378+0000","last_undegraded":"2024-04-26T11:47:32.147378+0000","last_fullsized":"2024-04-26T11:47:32.147378+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":388,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147479+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:32.147479+0000","last_peered":"2024-04-26T11:47:32.147479+0000","last_clean":"2024-04-26T11:47:32.147479+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:32.147479+0000","last_undegraded":"2024-04-26T11:47:32.147479+0000","last_fullsized":"2024-04-26T11:47:32.147479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":881,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147120+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:47:32.147120+0000","last_peered":"2024-04-26T11:47:32.147120+0000","last_clean":"2024-04-26T11:47:32.147120+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:47:32.147120+0000","last_undegraded":"2024-04-26T11:47:32.147120+0000","last_fullsized":"2024-04-26T11:47:32.147120+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":417,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155131+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:32.155131+0000","last_peered":"2024-04-26T11:47:32.155131+0000","last_clean":"2024-04-26T11:47:32.155131+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:32.155131+0000","last_undegraded":"2024-04-26T11:47:32.155131+0000","last_fullsized":"2024-04-26T11:47:32.155131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":932,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154540+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:32.154540+0000","last_peered":"2024-04-26T11:47:32.154540+0000","last_clean":"2024-04-26T11:47:32.154540+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:32.154540+0000","last_undegraded":"2024-04-26T11:47:32.154540+0000","last_fullsized":"2024-04-26T11:47:32.154540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.460033+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:28.460033+0000","last_peered":"2024-04-26T11:47:28.460033+0000","last_clean":"2024-04-26T11:47:28.460033+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:28.460033+0000","last_undegraded":"2024-04-26T11:47:28.460033+0000","last_fullsized":"2024-04-26T11:47:28.460033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":564,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.147014+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:32.147014+0000","last_peered":"2024-04-26T11:47:32.147014+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:32.147014+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:47:28.459618+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:28.459618+0000","last_peered":"2024-04-26T11:47:28.459618+0000","last_clean":"2024-04-26T11:47:28.459618+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:28.459618+0000","last_undegraded":"2024-04-26T11:47:28.459618+0000","last_fullsized":"2024-04-26T11:47:28.459618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3007,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4938,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":109,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738413,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200312,"kb_used_data":88876,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171528,"statfs":{"total":96636764160,"available":96431644672,"internally_reserved":0,"allocated":91009024,"data_stored":90497544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":1,"up_from":72,"seq":309237645317,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111424,"kb_used_data":79792,"kb_used_omap":6,"kb_used_meta":31609,"kb_avail":94260416,"statfs":{"total":96636764160,"available":96522665984,"internally_reserved":0,"allocated":81707008,"data_stored":81255111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":32367872},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190492,"kb_used_data":83144,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181348,"statfs":{"total":96636764160,"available":96441700352,"internally_reserved":0,"allocated":85139456,"data_stored":84639587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:37.948 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:38.273 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:38.276 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:38.287 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-26T11:47:38.136367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2445,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5622,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":195,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":528524,"kb_used_data":251872,"kb_used_omap":9,"kb_used_meta":276598,"kb_avail":282586996,"statfs":{"total":289910292480,"available":289369083904,"internally_reserved":0,"allocated":257916928,"data_stored":256415820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":283236492},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-562,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":663,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.005134"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":941,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154777+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:32.154777+0000","last_peered":"2024-04-26T11:47:32.154777+0000","last_clean":"2024-04-26T11:47:32.154777+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:32.154777+0000","last_undegraded":"2024-04-26T11:47:32.154777+0000","last_fullsized":"2024-04-26T11:47:32.154777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":608,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.153888+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:32.153888+0000","last_peered":"2024-04-26T11:47:32.153888+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:32.153888+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":504,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148035+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:32.148035+0000","last_peered":"2024-04-26T11:47:32.148035+0000","last_clean":"2024-04-26T11:47:32.148035+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:32.148035+0000","last_undegraded":"2024-04-26T11:47:32.148035+0000","last_fullsized":"2024-04-26T11:47:32.148035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":819,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147110+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:32.147110+0000","last_peered":"2024-04-26T11:47:32.147110+0000","last_clean":"2024-04-26T11:47:32.147110+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:32.147110+0000","last_undegraded":"2024-04-26T11:47:32.147110+0000","last_fullsized":"2024-04-26T11:47:32.147110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":897,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153340+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:47:32.153340+0000","last_peered":"2024-04-26T11:47:32.153340+0000","last_clean":"2024-04-26T11:47:32.153340+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:47:32.153340+0000","last_undegraded":"2024-04-26T11:47:32.153340+0000","last_fullsized":"2024-04-26T11:47:32.153340+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":825,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146402+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:32.146402+0000","last_peered":"2024-04-26T11:47:32.146402+0000","last_clean":"2024-04-26T11:47:32.146402+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:32.146402+0000","last_undegraded":"2024-04-26T11:47:32.146402+0000","last_fullsized":"2024-04-26T11:47:32.146402+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":625,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146513+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:32.146513+0000","last_peered":"2024-04-26T11:47:32.146513+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:32.146513+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":502,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146006+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:32.146006+0000","last_peered":"2024-04-26T11:47:32.146006+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:32.146006+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":523,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453916+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:33.453916+0000","last_peered":"2024-04-26T11:47:33.453916+0000","last_clean":"2024-04-26T11:47:33.453916+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:33.453916+0000","last_undegraded":"2024-04-26T11:47:33.453916+0000","last_fullsized":"2024-04-26T11:47:33.453916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":932,"reported_epoch":95,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:33.770303+0000","last_change":"2024-04-26T11:47:33.770711+0000","last_active":"2024-04-26T11:47:33.770303+0000","last_peered":"2024-04-26T11:47:33.770303+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:33.770303+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":853,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148020+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:32.148020+0000","last_peered":"2024-04-26T11:47:32.148020+0000","last_clean":"2024-04-26T11:47:32.148020+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:32.148020+0000","last_undegraded":"2024-04-26T11:47:32.148020+0000","last_fullsized":"2024-04-26T11:47:32.148020+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":471,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153526+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:32.153526+0000","last_peered":"2024-04-26T11:47:32.153526+0000","last_clean":"2024-04-26T11:47:32.153526+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:32.153526+0000","last_undegraded":"2024-04-26T11:47:32.153526+0000","last_fullsized":"2024-04-26T11:47:32.153526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":873,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153039+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:32.153039+0000","last_peered":"2024-04-26T11:47:32.153039+0000","last_clean":"2024-04-26T11:47:32.153039+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:32.153039+0000","last_undegraded":"2024-04-26T11:47:32.153039+0000","last_fullsized":"2024-04-26T11:47:32.153039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":543,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146411+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:32.146411+0000","last_peered":"2024-04-26T11:47:32.146411+0000","last_clean":"2024-04-26T11:47:32.146411+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:32.146411+0000","last_undegraded":"2024-04-26T11:47:32.146411+0000","last_fullsized":"2024-04-26T11:47:32.146411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":585,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146795+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:32.146795+0000","last_peered":"2024-04-26T11:47:32.146795+0000","last_clean":"2024-04-26T11:47:32.146795+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:32.146795+0000","last_undegraded":"2024-04-26T11:47:32.146795+0000","last_fullsized":"2024-04-26T11:47:32.146795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":640,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146412+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:32.146412+0000","last_peered":"2024-04-26T11:47:32.146412+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:32.146412+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":491,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453901+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:33.453901+0000","last_peered":"2024-04-26T11:47:33.453901+0000","last_clean":"2024-04-26T11:47:33.453901+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:33.453901+0000","last_undegraded":"2024-04-26T11:47:33.453901+0000","last_fullsized":"2024-04-26T11:47:33.453901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":541,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154656+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:32.154656+0000","last_peered":"2024-04-26T11:47:32.154656+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:32.154656+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":541,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.153782+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:32.153782+0000","last_peered":"2024-04-26T11:47:32.153782+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:32.153782+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":994,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147168+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:32.147168+0000","last_peered":"2024-04-26T11:47:32.147168+0000","last_clean":"2024-04-26T11:47:32.147168+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:32.147168+0000","last_undegraded":"2024-04-26T11:47:32.147168+0000","last_fullsized":"2024-04-26T11:47:32.147168+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":901,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-26T11:47:33.157959+0000","last_change":"2024-04-26T11:47:33.158169+0000","last_active":"2024-04-26T11:47:33.157959+0000","last_peered":"2024-04-26T11:47:33.086395+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:33.157959+0000","last_undegraded":"2024-04-26T11:47:33.157959+0000","last_fullsized":"2024-04-26T11:47:33.157959+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:30.870862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":557,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152740+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:32.152740+0000","last_peered":"2024-04-26T11:47:32.152740+0000","last_clean":"2024-04-26T11:47:32.152740+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:32.152740+0000","last_undegraded":"2024-04-26T11:47:32.152740+0000","last_fullsized":"2024-04-26T11:47:32.152740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":496,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451415+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:47:33.451415+0000","last_peered":"2024-04-26T11:47:33.451415+0000","last_clean":"2024-04-26T11:47:33.451415+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:47:33.451415+0000","last_undegraded":"2024-04-26T11:47:33.451415+0000","last_fullsized":"2024-04-26T11:47:33.451415+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":602,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.152433+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:32.152433+0000","last_peered":"2024-04-26T11:47:32.152433+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:32.152433+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":493,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154776+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:32.154776+0000","last_peered":"2024-04-26T11:47:32.154776+0000","last_clean":"2024-04-26T11:47:32.154776+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:32.154776+0000","last_undegraded":"2024-04-26T11:47:32.154776+0000","last_fullsized":"2024-04-26T11:47:32.154776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":637,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.149001+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:32.149001+0000","last_peered":"2024-04-26T11:47:32.149001+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:32.149001+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":495,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148378+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:32.148378+0000","last_peered":"2024-04-26T11:47:32.148378+0000","last_clean":"2024-04-26T11:47:32.148378+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:32.148378+0000","last_undegraded":"2024-04-26T11:47:32.148378+0000","last_fullsized":"2024-04-26T11:47:32.148378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":576,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154245+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:32.154245+0000","last_peered":"2024-04-26T11:47:32.154245+0000","last_clean":"2024-04-26T11:47:32.154245+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:32.154245+0000","last_undegraded":"2024-04-26T11:47:32.154245+0000","last_fullsized":"2024-04-26T11:47:32.154245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":489,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.452395+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:47:33.452395+0000","last_peered":"2024-04-26T11:47:33.452395+0000","last_clean":"2024-04-26T11:47:33.452395+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:47:33.452395+0000","last_undegraded":"2024-04-26T11:47:33.452395+0000","last_fullsized":"2024-04-26T11:47:33.452395+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":605,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153019+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:32.153019+0000","last_peered":"2024-04-26T11:47:32.153019+0000","last_clean":"2024-04-26T11:47:32.153019+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:32.153019+0000","last_undegraded":"2024-04-26T11:47:32.153019+0000","last_fullsized":"2024-04-26T11:47:32.153019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":554,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.452016+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:47:33.452016+0000","last_peered":"2024-04-26T11:47:33.452016+0000","last_clean":"2024-04-26T11:47:33.452016+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:47:33.452016+0000","last_undegraded":"2024-04-26T11:47:33.452016+0000","last_fullsized":"2024-04-26T11:47:33.452016+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":538,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146536+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:32.146536+0000","last_peered":"2024-04-26T11:47:32.146536+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:32.146536+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":484,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154054+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:32.154054+0000","last_peered":"2024-04-26T11:47:32.154054+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:32.154054+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":603,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147575+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:32.147575+0000","last_peered":"2024-04-26T11:47:32.147575+0000","last_clean":"2024-04-26T11:47:32.147575+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:32.147575+0000","last_undegraded":"2024-04-26T11:47:32.147575+0000","last_fullsized":"2024-04-26T11:47:32.147575+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":595,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154721+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:32.154721+0000","last_peered":"2024-04-26T11:47:32.154721+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:32.154721+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451570+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:33.451570+0000","last_peered":"2024-04-26T11:47:33.451570+0000","last_clean":"2024-04-26T11:47:33.451570+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:33.451570+0000","last_undegraded":"2024-04-26T11:47:33.451570+0000","last_fullsized":"2024-04-26T11:47:33.451570+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":496,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453629+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:47:33.453629+0000","last_peered":"2024-04-26T11:47:33.453629+0000","last_clean":"2024-04-26T11:47:33.453629+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:47:33.453629+0000","last_undegraded":"2024-04-26T11:47:33.453629+0000","last_fullsized":"2024-04-26T11:47:33.453629+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154746+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:32.154746+0000","last_peered":"2024-04-26T11:47:32.154746+0000","last_clean":"2024-04-26T11:47:32.154746+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:32.154746+0000","last_undegraded":"2024-04-26T11:47:32.154746+0000","last_fullsized":"2024-04-26T11:47:32.154746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":531,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453590+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:33.453590+0000","last_peered":"2024-04-26T11:47:33.453590+0000","last_clean":"2024-04-26T11:47:33.453590+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:33.453590+0000","last_undegraded":"2024-04-26T11:47:33.453590+0000","last_fullsized":"2024-04-26T11:47:33.453590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146794+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:32.146794+0000","last_peered":"2024-04-26T11:47:32.146794+0000","last_clean":"2024-04-26T11:47:32.146794+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:32.146794+0000","last_undegraded":"2024-04-26T11:47:32.146794+0000","last_fullsized":"2024-04-26T11:47:32.146794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":302,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148703+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:32.148703+0000","last_peered":"2024-04-26T11:47:32.148703+0000","last_clean":"2024-04-26T11:47:32.148703+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:32.148703+0000","last_undegraded":"2024-04-26T11:47:32.148703+0000","last_fullsized":"2024-04-26T11:47:32.148703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":520,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152440+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:32.152440+0000","last_peered":"2024-04-26T11:47:32.152440+0000","last_clean":"2024-04-26T11:47:32.152440+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:32.152440+0000","last_undegraded":"2024-04-26T11:47:32.152440+0000","last_fullsized":"2024-04-26T11:47:32.152440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":480,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155054+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:32.155054+0000","last_peered":"2024-04-26T11:47:32.155054+0000","last_clean":"2024-04-26T11:47:32.155054+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:32.155054+0000","last_undegraded":"2024-04-26T11:47:32.155054+0000","last_fullsized":"2024-04-26T11:47:32.155054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1011,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153391+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:47:32.153391+0000","last_peered":"2024-04-26T11:47:32.153391+0000","last_clean":"2024-04-26T11:47:32.153391+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:47:32.153391+0000","last_undegraded":"2024-04-26T11:47:32.153391+0000","last_fullsized":"2024-04-26T11:47:32.153391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":674,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148977+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:32.148977+0000","last_peered":"2024-04-26T11:47:32.148977+0000","last_clean":"2024-04-26T11:47:32.148977+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:32.148977+0000","last_undegraded":"2024-04-26T11:47:32.148977+0000","last_fullsized":"2024-04-26T11:47:32.148977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":995,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146636+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:32.146636+0000","last_peered":"2024-04-26T11:47:32.146636+0000","last_clean":"2024-04-26T11:47:32.146636+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:32.146636+0000","last_undegraded":"2024-04-26T11:47:32.146636+0000","last_fullsized":"2024-04-26T11:47:32.146636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147715+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:32.147715+0000","last_peered":"2024-04-26T11:47:32.147715+0000","last_clean":"2024-04-26T11:47:32.147715+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:32.147715+0000","last_undegraded":"2024-04-26T11:47:32.147715+0000","last_fullsized":"2024-04-26T11:47:32.147715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":601,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453563+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:33.453563+0000","last_peered":"2024-04-26T11:47:33.453563+0000","last_clean":"2024-04-26T11:47:33.453563+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:33.453563+0000","last_undegraded":"2024-04-26T11:47:33.453563+0000","last_fullsized":"2024-04-26T11:47:33.453563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":353,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453132+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:33.453132+0000","last_peered":"2024-04-26T11:47:33.453132+0000","last_clean":"2024-04-26T11:47:33.453132+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:33.453132+0000","last_undegraded":"2024-04-26T11:47:33.453132+0000","last_fullsized":"2024-04-26T11:47:33.453132+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":942,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147452+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:47:32.147452+0000","last_peered":"2024-04-26T11:47:32.147452+0000","last_clean":"2024-04-26T11:47:32.147452+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:47:32.147452+0000","last_undegraded":"2024-04-26T11:47:32.147452+0000","last_fullsized":"2024-04-26T11:47:32.147452+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":263,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147127+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:32.147127+0000","last_peered":"2024-04-26T11:47:32.147127+0000","last_clean":"2024-04-26T11:47:32.147127+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:32.147127+0000","last_undegraded":"2024-04-26T11:47:32.147127+0000","last_fullsized":"2024-04-26T11:47:32.147127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":528,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148619+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:32.148619+0000","last_peered":"2024-04-26T11:47:32.148619+0000","last_clean":"2024-04-26T11:47:32.148619+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:32.148619+0000","last_undegraded":"2024-04-26T11:47:32.148619+0000","last_fullsized":"2024-04-26T11:47:32.148619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154059+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:32.154059+0000","last_peered":"2024-04-26T11:47:32.154059+0000","last_clean":"2024-04-26T11:47:32.154059+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:32.154059+0000","last_undegraded":"2024-04-26T11:47:32.154059+0000","last_fullsized":"2024-04-26T11:47:32.154059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":466,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148665+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:32.148665+0000","last_peered":"2024-04-26T11:47:32.148665+0000","last_clean":"2024-04-26T11:47:32.148665+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:32.148665+0000","last_undegraded":"2024-04-26T11:47:32.148665+0000","last_fullsized":"2024-04-26T11:47:32.148665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":614,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152665+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:32.152665+0000","last_peered":"2024-04-26T11:47:32.152665+0000","last_clean":"2024-04-26T11:47:32.152665+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:32.152665+0000","last_undegraded":"2024-04-26T11:47:32.152665+0000","last_fullsized":"2024-04-26T11:47:32.152665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":506,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.454434+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:47:33.454434+0000","last_peered":"2024-04-26T11:47:33.454434+0000","last_clean":"2024-04-26T11:47:33.454434+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:47:33.454434+0000","last_undegraded":"2024-04-26T11:47:33.454434+0000","last_fullsized":"2024-04-26T11:47:33.454434+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":290,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147265+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:32.147265+0000","last_peered":"2024-04-26T11:47:32.147265+0000","last_clean":"2024-04-26T11:47:32.147265+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:32.147265+0000","last_undegraded":"2024-04-26T11:47:32.147265+0000","last_fullsized":"2024-04-26T11:47:32.147265+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147733+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:32.147733+0000","last_peered":"2024-04-26T11:47:32.147733+0000","last_clean":"2024-04-26T11:47:32.147733+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:32.147733+0000","last_undegraded":"2024-04-26T11:47:32.147733+0000","last_fullsized":"2024-04-26T11:47:32.147733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":595,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.452045+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:33.452045+0000","last_peered":"2024-04-26T11:47:33.452045+0000","last_clean":"2024-04-26T11:47:33.452045+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:33.452045+0000","last_undegraded":"2024-04-26T11:47:33.452045+0000","last_fullsized":"2024-04-26T11:47:33.452045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":554,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148864+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:32.148864+0000","last_peered":"2024-04-26T11:47:32.148864+0000","last_clean":"2024-04-26T11:47:32.148864+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:32.148864+0000","last_undegraded":"2024-04-26T11:47:32.148864+0000","last_fullsized":"2024-04-26T11:47:32.148864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147042+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:32.147042+0000","last_peered":"2024-04-26T11:47:32.147042+0000","last_clean":"2024-04-26T11:47:32.147042+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:32.147042+0000","last_undegraded":"2024-04-26T11:47:32.147042+0000","last_fullsized":"2024-04-26T11:47:32.147042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":347,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451018+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:33.451018+0000","last_peered":"2024-04-26T11:47:33.451018+0000","last_clean":"2024-04-26T11:47:33.451018+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:33.451018+0000","last_undegraded":"2024-04-26T11:47:33.451018+0000","last_fullsized":"2024-04-26T11:47:33.451018+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":971,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-26T11:47:33.157498+0000","last_change":"2024-04-26T11:47:33.157764+0000","last_active":"2024-04-26T11:47:33.157498+0000","last_peered":"2024-04-26T11:47:32.421623+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:33.157498+0000","last_undegraded":"2024-04-26T11:47:33.157498+0000","last_fullsized":"2024-04-26T11:47:33.157498+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:34.390258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451711+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:33.451711+0000","last_peered":"2024-04-26T11:47:33.451711+0000","last_clean":"2024-04-26T11:47:33.451711+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:33.451711+0000","last_undegraded":"2024-04-26T11:47:33.451711+0000","last_fullsized":"2024-04-26T11:47:33.451711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":511,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152934+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:32.152934+0000","last_peered":"2024-04-26T11:47:32.152934+0000","last_clean":"2024-04-26T11:47:32.152934+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:32.152934+0000","last_undegraded":"2024-04-26T11:47:32.152934+0000","last_fullsized":"2024-04-26T11:47:32.152934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":439,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.454260+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:33.454260+0000","last_peered":"2024-04-26T11:47:33.454260+0000","last_clean":"2024-04-26T11:47:33.454260+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:33.454260+0000","last_undegraded":"2024-04-26T11:47:33.454260+0000","last_fullsized":"2024-04-26T11:47:33.454260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147338+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:32.147338+0000","last_peered":"2024-04-26T11:47:32.147338+0000","last_clean":"2024-04-26T11:47:32.147338+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:32.147338+0000","last_undegraded":"2024-04-26T11:47:32.147338+0000","last_fullsized":"2024-04-26T11:47:32.147338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147619+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:32.147619+0000","last_peered":"2024-04-26T11:47:32.147619+0000","last_clean":"2024-04-26T11:47:32.147619+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:32.147619+0000","last_undegraded":"2024-04-26T11:47:32.147619+0000","last_fullsized":"2024-04-26T11:47:32.147619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":483,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.452283+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:47:33.452283+0000","last_peered":"2024-04-26T11:47:33.452283+0000","last_clean":"2024-04-26T11:47:33.452283+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:47:33.452283+0000","last_undegraded":"2024-04-26T11:47:33.452283+0000","last_fullsized":"2024-04-26T11:47:33.452283+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":625,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148987+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:32.148987+0000","last_peered":"2024-04-26T11:47:32.148987+0000","last_clean":"2024-04-26T11:47:32.148987+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:32.148987+0000","last_undegraded":"2024-04-26T11:47:32.148987+0000","last_fullsized":"2024-04-26T11:47:32.148987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451403+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:33.451403+0000","last_peered":"2024-04-26T11:47:33.451403+0000","last_clean":"2024-04-26T11:47:33.451403+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:33.451403+0000","last_undegraded":"2024-04-26T11:47:33.451403+0000","last_fullsized":"2024-04-26T11:47:33.451403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":466,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152885+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:32.152885+0000","last_peered":"2024-04-26T11:47:32.152885+0000","last_clean":"2024-04-26T11:47:32.152885+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:32.152885+0000","last_undegraded":"2024-04-26T11:47:32.152885+0000","last_fullsized":"2024-04-26T11:47:32.152885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.452579+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:33.452579+0000","last_peered":"2024-04-26T11:47:33.452579+0000","last_clean":"2024-04-26T11:47:33.452579+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:33.452579+0000","last_undegraded":"2024-04-26T11:47:33.452579+0000","last_fullsized":"2024-04-26T11:47:33.452579+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155396+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:32.155396+0000","last_peered":"2024-04-26T11:47:32.155396+0000","last_clean":"2024-04-26T11:47:32.155396+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:32.155396+0000","last_undegraded":"2024-04-26T11:47:32.155396+0000","last_fullsized":"2024-04-26T11:47:32.155396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":507,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153251+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:32.153251+0000","last_peered":"2024-04-26T11:47:32.153251+0000","last_clean":"2024-04-26T11:47:32.153251+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:32.153251+0000","last_undegraded":"2024-04-26T11:47:32.153251+0000","last_fullsized":"2024-04-26T11:47:32.153251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453755+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:33.453755+0000","last_peered":"2024-04-26T11:47:33.453755+0000","last_clean":"2024-04-26T11:47:33.453755+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:33.453755+0000","last_undegraded":"2024-04-26T11:47:33.453755+0000","last_fullsized":"2024-04-26T11:47:33.453755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453332+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:33.453332+0000","last_peered":"2024-04-26T11:47:33.453332+0000","last_clean":"2024-04-26T11:47:33.453332+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:33.453332+0000","last_undegraded":"2024-04-26T11:47:33.453332+0000","last_fullsized":"2024-04-26T11:47:33.453332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":614,"reported_epoch":95,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:34.049479+0000","last_change":"2024-04-26T11:47:33.771421+0000","last_active":"2024-04-26T11:47:34.049479+0000","last_peered":"2024-04-26T11:47:34.049479+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:34.049479+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453497+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:33.453497+0000","last_peered":"2024-04-26T11:47:33.453497+0000","last_clean":"2024-04-26T11:47:33.453497+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:33.453497+0000","last_undegraded":"2024-04-26T11:47:33.453497+0000","last_fullsized":"2024-04-26T11:47:33.453497+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148792+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:32.148792+0000","last_peered":"2024-04-26T11:47:32.148792+0000","last_clean":"2024-04-26T11:47:32.148792+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:32.148792+0000","last_undegraded":"2024-04-26T11:47:32.148792+0000","last_fullsized":"2024-04-26T11:47:32.148792+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":540,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153626+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:32.153626+0000","last_peered":"2024-04-26T11:47:32.153626+0000","last_clean":"2024-04-26T11:47:32.153626+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:32.153626+0000","last_undegraded":"2024-04-26T11:47:32.153626+0000","last_fullsized":"2024-04-26T11:47:32.153626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":552,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146650+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:32.146650+0000","last_peered":"2024-04-26T11:47:32.146650+0000","last_clean":"2024-04-26T11:47:32.146650+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:32.146650+0000","last_undegraded":"2024-04-26T11:47:32.146650+0000","last_fullsized":"2024-04-26T11:47:32.146650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":499,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147881+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:32.147881+0000","last_peered":"2024-04-26T11:47:32.147881+0000","last_clean":"2024-04-26T11:47:32.147881+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:32.147881+0000","last_undegraded":"2024-04-26T11:47:32.147881+0000","last_fullsized":"2024-04-26T11:47:32.147881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":527,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451971+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:47:33.451971+0000","last_peered":"2024-04-26T11:47:33.451971+0000","last_clean":"2024-04-26T11:47:33.451971+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:47:33.451971+0000","last_undegraded":"2024-04-26T11:47:33.451971+0000","last_fullsized":"2024-04-26T11:47:33.451971+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155196+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:32.155196+0000","last_peered":"2024-04-26T11:47:32.155196+0000","last_clean":"2024-04-26T11:47:32.155196+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:32.155196+0000","last_undegraded":"2024-04-26T11:47:32.155196+0000","last_fullsized":"2024-04-26T11:47:32.155196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":446,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.149359+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:32.149359+0000","last_peered":"2024-04-26T11:47:32.149359+0000","last_clean":"2024-04-26T11:47:32.149359+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:32.149359+0000","last_undegraded":"2024-04-26T11:47:32.149359+0000","last_fullsized":"2024-04-26T11:47:32.149359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":560,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451719+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:47:33.451719+0000","last_peered":"2024-04-26T11:47:33.451719+0000","last_clean":"2024-04-26T11:47:33.451719+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:47:33.451719+0000","last_undegraded":"2024-04-26T11:47:33.451719+0000","last_fullsized":"2024-04-26T11:47:33.451719+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.454192+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:33.454192+0000","last_peered":"2024-04-26T11:47:33.454192+0000","last_clean":"2024-04-26T11:47:33.454192+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:33.454192+0000","last_undegraded":"2024-04-26T11:47:33.454192+0000","last_fullsized":"2024-04-26T11:47:33.454192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":581,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.152119+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:32.152119+0000","last_peered":"2024-04-26T11:47:32.152119+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:32.152119+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":498,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155046+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:32.155046+0000","last_peered":"2024-04-26T11:47:32.155046+0000","last_clean":"2024-04-26T11:47:32.155046+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:32.155046+0000","last_undegraded":"2024-04-26T11:47:32.155046+0000","last_fullsized":"2024-04-26T11:47:32.155046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":856,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451166+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:33.451166+0000","last_peered":"2024-04-26T11:47:33.451166+0000","last_clean":"2024-04-26T11:47:33.451166+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:33.451166+0000","last_undegraded":"2024-04-26T11:47:33.451166+0000","last_fullsized":"2024-04-26T11:47:33.451166+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":479,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.462385+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:47:33.462385+0000","last_peered":"2024-04-26T11:47:33.462385+0000","last_clean":"2024-04-26T11:47:33.462385+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:47:33.462385+0000","last_undegraded":"2024-04-26T11:47:33.462385+0000","last_fullsized":"2024-04-26T11:47:33.462385+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":413,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451157+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:33.451157+0000","last_peered":"2024-04-26T11:47:33.451157+0000","last_clean":"2024-04-26T11:47:33.451157+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:33.451157+0000","last_undegraded":"2024-04-26T11:47:33.451157+0000","last_fullsized":"2024-04-26T11:47:33.451157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":519,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154439+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:32.154439+0000","last_peered":"2024-04-26T11:47:32.154439+0000","last_clean":"2024-04-26T11:47:32.154439+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:32.154439+0000","last_undegraded":"2024-04-26T11:47:32.154439+0000","last_fullsized":"2024-04-26T11:47:32.154439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":468,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154215+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:32.154215+0000","last_peered":"2024-04-26T11:47:32.154215+0000","last_clean":"2024-04-26T11:47:32.154215+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:32.154215+0000","last_undegraded":"2024-04-26T11:47:32.154215+0000","last_fullsized":"2024-04-26T11:47:32.154215+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":834,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153751+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:32.153751+0000","last_peered":"2024-04-26T11:47:32.153751+0000","last_clean":"2024-04-26T11:47:32.153751+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:32.153751+0000","last_undegraded":"2024-04-26T11:47:32.153751+0000","last_fullsized":"2024-04-26T11:47:32.153751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153445+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:32.153445+0000","last_peered":"2024-04-26T11:47:32.153445+0000","last_clean":"2024-04-26T11:47:32.153445+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:32.153445+0000","last_undegraded":"2024-04-26T11:47:32.153445+0000","last_fullsized":"2024-04-26T11:47:32.153445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":864,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147378+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:47:32.147378+0000","last_peered":"2024-04-26T11:47:32.147378+0000","last_clean":"2024-04-26T11:47:32.147378+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:47:32.147378+0000","last_undegraded":"2024-04-26T11:47:32.147378+0000","last_fullsized":"2024-04-26T11:47:32.147378+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":388,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147479+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:32.147479+0000","last_peered":"2024-04-26T11:47:32.147479+0000","last_clean":"2024-04-26T11:47:32.147479+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:32.147479+0000","last_undegraded":"2024-04-26T11:47:32.147479+0000","last_fullsized":"2024-04-26T11:47:32.147479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":881,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147120+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:47:32.147120+0000","last_peered":"2024-04-26T11:47:32.147120+0000","last_clean":"2024-04-26T11:47:32.147120+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:47:32.147120+0000","last_undegraded":"2024-04-26T11:47:32.147120+0000","last_fullsized":"2024-04-26T11:47:32.147120+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":417,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155131+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:32.155131+0000","last_peered":"2024-04-26T11:47:32.155131+0000","last_clean":"2024-04-26T11:47:32.155131+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:32.155131+0000","last_undegraded":"2024-04-26T11:47:32.155131+0000","last_fullsized":"2024-04-26T11:47:32.155131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":932,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154540+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:32.154540+0000","last_peered":"2024-04-26T11:47:32.154540+0000","last_clean":"2024-04-26T11:47:32.154540+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:32.154540+0000","last_undegraded":"2024-04-26T11:47:32.154540+0000","last_fullsized":"2024-04-26T11:47:32.154540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453898+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:33.453898+0000","last_peered":"2024-04-26T11:47:33.453898+0000","last_clean":"2024-04-26T11:47:33.453898+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:33.453898+0000","last_undegraded":"2024-04-26T11:47:33.453898+0000","last_fullsized":"2024-04-26T11:47:33.453898+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":564,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.147014+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:32.147014+0000","last_peered":"2024-04-26T11:47:32.147014+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:32.147014+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453648+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:33.453648+0000","last_peered":"2024-04-26T11:47:33.453648+0000","last_clean":"2024-04-26T11:47:33.453648+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:33.453648+0000","last_undegraded":"2024-04-26T11:47:33.453648+0000","last_fullsized":"2024-04-26T11:47:33.453648+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2445,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5601,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":113,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738413,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200312,"kb_used_data":88876,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171528,"statfs":{"total":96636764160,"available":96431644672,"internally_reserved":0,"allocated":91009024,"data_stored":90497544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":1,"up_from":72,"seq":309237645318,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137720,"kb_used_data":79852,"kb_used_omap":6,"kb_used_meta":57849,"kb_avail":94234120,"statfs":{"total":96636764160,"available":96495738880,"internally_reserved":0,"allocated":81768448,"data_stored":81278689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":59237632},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190492,"kb_used_data":83144,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181348,"statfs":{"total":96636764160,"available":96441700352,"internally_reserved":0,"allocated":85139456,"data_stored":84639587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:38.292 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:47:38.656 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:38.656 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2445/108 objects degraded (2263.889%), 14 pgs degraded","count":14},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":219,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":100,"num_osds":3,"num_up_osds":3,"osd_up_since":1714132030,"num_in_osds":3,"osd_in_since":1714131840,"num_remapped_pgs":8},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":88},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":13},{"state_name":"peering","count":2},{"state_name":"active+recovering+undersized+degraded+remapped","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127603811,"bytes_used":541208576,"bytes_avail":289369083904,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":2445,"degraded_total":108,"degraded_ratio":22.638888888888893,"recovering_objects_per_sec":316,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1265,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4213}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T11:45:27.979634+0000","services":{}},"progress_events":{}} 2024-04-26T11:47:38.671 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:47:38.671 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:38.986 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:38.988 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:39.001 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-26T11:47:38.136367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2445,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5622,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":195,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":528524,"kb_used_data":251872,"kb_used_omap":9,"kb_used_meta":276598,"kb_avail":282586996,"statfs":{"total":289910292480,"available":289369083904,"internally_reserved":0,"allocated":257916928,"data_stored":256415820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":283236492},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-562,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":663,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.005134"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":941,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154777+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:32.154777+0000","last_peered":"2024-04-26T11:47:32.154777+0000","last_clean":"2024-04-26T11:47:32.154777+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:32.154777+0000","last_undegraded":"2024-04-26T11:47:32.154777+0000","last_fullsized":"2024-04-26T11:47:32.154777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":608,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.153888+0000","last_change":"2024-04-26T11:47:12.268328+0000","last_active":"2024-04-26T11:47:32.153888+0000","last_peered":"2024-04-26T11:47:32.153888+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:32.153888+0000","last_undegraded":"2024-04-26T11:47:12.166380+0000","last_fullsized":"2024-04-26T11:47:12.162123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:24.935298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":504,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148035+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:32.148035+0000","last_peered":"2024-04-26T11:47:32.148035+0000","last_clean":"2024-04-26T11:47:32.148035+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:32.148035+0000","last_undegraded":"2024-04-26T11:47:32.148035+0000","last_fullsized":"2024-04-26T11:47:32.148035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":819,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147110+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:32.147110+0000","last_peered":"2024-04-26T11:47:32.147110+0000","last_clean":"2024-04-26T11:47:32.147110+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:32.147110+0000","last_undegraded":"2024-04-26T11:47:32.147110+0000","last_fullsized":"2024-04-26T11:47:32.147110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":897,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153340+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:47:32.153340+0000","last_peered":"2024-04-26T11:47:32.153340+0000","last_clean":"2024-04-26T11:47:32.153340+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:47:32.153340+0000","last_undegraded":"2024-04-26T11:47:32.153340+0000","last_fullsized":"2024-04-26T11:47:32.153340+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":825,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146402+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:32.146402+0000","last_peered":"2024-04-26T11:47:32.146402+0000","last_clean":"2024-04-26T11:47:32.146402+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:32.146402+0000","last_undegraded":"2024-04-26T11:47:32.146402+0000","last_fullsized":"2024-04-26T11:47:32.146402+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":625,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146513+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:32.146513+0000","last_peered":"2024-04-26T11:47:32.146513+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:32.146513+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":502,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146006+0000","last_change":"2024-04-26T11:47:12.265554+0000","last_active":"2024-04-26T11:47:32.146006+0000","last_peered":"2024-04-26T11:47:32.146006+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:32.146006+0000","last_undegraded":"2024-04-26T11:47:12.159306+0000","last_fullsized":"2024-04-26T11:47:12.153368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":523,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453916+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:33.453916+0000","last_peered":"2024-04-26T11:47:33.453916+0000","last_clean":"2024-04-26T11:47:33.453916+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:33.453916+0000","last_undegraded":"2024-04-26T11:47:33.453916+0000","last_fullsized":"2024-04-26T11:47:33.453916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":932,"reported_epoch":95,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:33.770303+0000","last_change":"2024-04-26T11:47:33.770711+0000","last_active":"2024-04-26T11:47:33.770303+0000","last_peered":"2024-04-26T11:47:33.770303+0000","last_clean":"2024-04-26T11:44:49.186884+0000","last_became_active":"2024-04-26T11:47:12.260643+0000","last_became_peered":"2024-04-26T11:47:12.260643+0000","last_unstale":"2024-04-26T11:47:33.770303+0000","last_undegraded":"2024-04-26T11:47:12.161154+0000","last_fullsized":"2024-04-26T11:47:12.156950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:36.385642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":853,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148020+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:32.148020+0000","last_peered":"2024-04-26T11:47:32.148020+0000","last_clean":"2024-04-26T11:47:32.148020+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:32.148020+0000","last_undegraded":"2024-04-26T11:47:32.148020+0000","last_fullsized":"2024-04-26T11:47:32.148020+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":471,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153526+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:32.153526+0000","last_peered":"2024-04-26T11:47:32.153526+0000","last_clean":"2024-04-26T11:47:32.153526+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:32.153526+0000","last_undegraded":"2024-04-26T11:47:32.153526+0000","last_fullsized":"2024-04-26T11:47:32.153526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":873,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153039+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:32.153039+0000","last_peered":"2024-04-26T11:47:32.153039+0000","last_clean":"2024-04-26T11:47:32.153039+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:32.153039+0000","last_undegraded":"2024-04-26T11:47:32.153039+0000","last_fullsized":"2024-04-26T11:47:32.153039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":543,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146411+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:32.146411+0000","last_peered":"2024-04-26T11:47:32.146411+0000","last_clean":"2024-04-26T11:47:32.146411+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:32.146411+0000","last_undegraded":"2024-04-26T11:47:32.146411+0000","last_fullsized":"2024-04-26T11:47:32.146411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":585,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146795+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:32.146795+0000","last_peered":"2024-04-26T11:47:32.146795+0000","last_clean":"2024-04-26T11:47:32.146795+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:32.146795+0000","last_undegraded":"2024-04-26T11:47:32.146795+0000","last_fullsized":"2024-04-26T11:47:32.146795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":640,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146412+0000","last_change":"2024-04-26T11:47:12.265725+0000","last_active":"2024-04-26T11:47:32.146412+0000","last_peered":"2024-04-26T11:47:32.146412+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:32.146412+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-14}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":491,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453901+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:33.453901+0000","last_peered":"2024-04-26T11:47:33.453901+0000","last_clean":"2024-04-26T11:47:33.453901+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:33.453901+0000","last_undegraded":"2024-04-26T11:47:33.453901+0000","last_fullsized":"2024-04-26T11:47:33.453901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":541,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154656+0000","last_change":"2024-04-26T11:47:12.264591+0000","last_active":"2024-04-26T11:47:32.154656+0000","last_peered":"2024-04-26T11:47:32.154656+0000","last_clean":"2024-04-26T11:44:49.187082+0000","last_became_active":"2024-04-26T11:47:12.262272+0000","last_became_peered":"2024-04-26T11:47:12.262272+0000","last_unstale":"2024-04-26T11:47:32.154656+0000","last_undegraded":"2024-04-26T11:47:12.165813+0000","last_fullsized":"2024-04-26T11:47:12.154360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:51.067786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":541,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.153782+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:32.153782+0000","last_peered":"2024-04-26T11:47:32.153782+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:32.153782+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":994,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147168+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:32.147168+0000","last_peered":"2024-04-26T11:47:32.147168+0000","last_clean":"2024-04-26T11:47:32.147168+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:32.147168+0000","last_undegraded":"2024-04-26T11:47:32.147168+0000","last_fullsized":"2024-04-26T11:47:32.147168+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":901,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-26T11:47:33.157959+0000","last_change":"2024-04-26T11:47:33.158169+0000","last_active":"2024-04-26T11:47:33.157959+0000","last_peered":"2024-04-26T11:47:33.086395+0000","last_clean":"2024-04-26T11:44:50.722716+0000","last_became_active":"2024-04-26T11:47:12.263974+0000","last_became_peered":"2024-04-26T11:47:12.263974+0000","last_unstale":"2024-04-26T11:47:33.157959+0000","last_undegraded":"2024-04-26T11:47:33.157959+0000","last_fullsized":"2024-04-26T11:47:33.157959+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:30.870862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":557,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152740+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:32.152740+0000","last_peered":"2024-04-26T11:47:32.152740+0000","last_clean":"2024-04-26T11:47:32.152740+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:32.152740+0000","last_undegraded":"2024-04-26T11:47:32.152740+0000","last_fullsized":"2024-04-26T11:47:32.152740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":496,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451415+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:47:33.451415+0000","last_peered":"2024-04-26T11:47:33.451415+0000","last_clean":"2024-04-26T11:47:33.451415+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:47:33.451415+0000","last_undegraded":"2024-04-26T11:47:33.451415+0000","last_fullsized":"2024-04-26T11:47:33.451415+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":602,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.152433+0000","last_change":"2024-04-26T11:47:12.263527+0000","last_active":"2024-04-26T11:47:32.152433+0000","last_peered":"2024-04-26T11:47:32.152433+0000","last_clean":"2024-04-26T11:44:49.185433+0000","last_became_active":"2024-04-26T11:47:12.262057+0000","last_became_peered":"2024-04-26T11:47:12.262057+0000","last_unstale":"2024-04-26T11:47:32.152433+0000","last_undegraded":"2024-04-26T11:47:12.164423+0000","last_fullsized":"2024-04-26T11:47:12.158528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:56.928773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-18}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":493,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154776+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:32.154776+0000","last_peered":"2024-04-26T11:47:32.154776+0000","last_clean":"2024-04-26T11:47:32.154776+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:32.154776+0000","last_undegraded":"2024-04-26T11:47:32.154776+0000","last_fullsized":"2024-04-26T11:47:32.154776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":637,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.149001+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:32.149001+0000","last_peered":"2024-04-26T11:47:32.149001+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:32.149001+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":495,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148378+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:32.148378+0000","last_peered":"2024-04-26T11:47:32.148378+0000","last_clean":"2024-04-26T11:47:32.148378+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:32.148378+0000","last_undegraded":"2024-04-26T11:47:32.148378+0000","last_fullsized":"2024-04-26T11:47:32.148378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":576,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154245+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:32.154245+0000","last_peered":"2024-04-26T11:47:32.154245+0000","last_clean":"2024-04-26T11:47:32.154245+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:32.154245+0000","last_undegraded":"2024-04-26T11:47:32.154245+0000","last_fullsized":"2024-04-26T11:47:32.154245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":489,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.452395+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:47:33.452395+0000","last_peered":"2024-04-26T11:47:33.452395+0000","last_clean":"2024-04-26T11:47:33.452395+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:47:33.452395+0000","last_undegraded":"2024-04-26T11:47:33.452395+0000","last_fullsized":"2024-04-26T11:47:33.452395+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":605,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153019+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:32.153019+0000","last_peered":"2024-04-26T11:47:32.153019+0000","last_clean":"2024-04-26T11:47:32.153019+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:32.153019+0000","last_undegraded":"2024-04-26T11:47:32.153019+0000","last_fullsized":"2024-04-26T11:47:32.153019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":554,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.452016+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:47:33.452016+0000","last_peered":"2024-04-26T11:47:33.452016+0000","last_clean":"2024-04-26T11:47:33.452016+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:47:33.452016+0000","last_undegraded":"2024-04-26T11:47:33.452016+0000","last_fullsized":"2024-04-26T11:47:33.452016+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":538,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.146536+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:32.146536+0000","last_peered":"2024-04-26T11:47:32.146536+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:32.146536+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":484,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154054+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:32.154054+0000","last_peered":"2024-04-26T11:47:32.154054+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:32.154054+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":603,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147575+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:32.147575+0000","last_peered":"2024-04-26T11:47:32.147575+0000","last_clean":"2024-04-26T11:47:32.147575+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:32.147575+0000","last_undegraded":"2024-04-26T11:47:32.147575+0000","last_fullsized":"2024-04-26T11:47:32.147575+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":595,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.154721+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:32.154721+0000","last_peered":"2024-04-26T11:47:32.154721+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:32.154721+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451570+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:33.451570+0000","last_peered":"2024-04-26T11:47:33.451570+0000","last_clean":"2024-04-26T11:47:33.451570+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:33.451570+0000","last_undegraded":"2024-04-26T11:47:33.451570+0000","last_fullsized":"2024-04-26T11:47:33.451570+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":496,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453629+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:47:33.453629+0000","last_peered":"2024-04-26T11:47:33.453629+0000","last_clean":"2024-04-26T11:47:33.453629+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:47:33.453629+0000","last_undegraded":"2024-04-26T11:47:33.453629+0000","last_fullsized":"2024-04-26T11:47:33.453629+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154746+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:32.154746+0000","last_peered":"2024-04-26T11:47:32.154746+0000","last_clean":"2024-04-26T11:47:32.154746+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:32.154746+0000","last_undegraded":"2024-04-26T11:47:32.154746+0000","last_fullsized":"2024-04-26T11:47:32.154746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":531,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453590+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:33.453590+0000","last_peered":"2024-04-26T11:47:33.453590+0000","last_clean":"2024-04-26T11:47:33.453590+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:33.453590+0000","last_undegraded":"2024-04-26T11:47:33.453590+0000","last_fullsized":"2024-04-26T11:47:33.453590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146794+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:32.146794+0000","last_peered":"2024-04-26T11:47:32.146794+0000","last_clean":"2024-04-26T11:47:32.146794+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:32.146794+0000","last_undegraded":"2024-04-26T11:47:32.146794+0000","last_fullsized":"2024-04-26T11:47:32.146794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":302,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148703+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:32.148703+0000","last_peered":"2024-04-26T11:47:32.148703+0000","last_clean":"2024-04-26T11:47:32.148703+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:32.148703+0000","last_undegraded":"2024-04-26T11:47:32.148703+0000","last_fullsized":"2024-04-26T11:47:32.148703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":520,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152440+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:32.152440+0000","last_peered":"2024-04-26T11:47:32.152440+0000","last_clean":"2024-04-26T11:47:32.152440+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:32.152440+0000","last_undegraded":"2024-04-26T11:47:32.152440+0000","last_fullsized":"2024-04-26T11:47:32.152440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":480,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155054+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:32.155054+0000","last_peered":"2024-04-26T11:47:32.155054+0000","last_clean":"2024-04-26T11:47:32.155054+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:32.155054+0000","last_undegraded":"2024-04-26T11:47:32.155054+0000","last_fullsized":"2024-04-26T11:47:32.155054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1011,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153391+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:47:32.153391+0000","last_peered":"2024-04-26T11:47:32.153391+0000","last_clean":"2024-04-26T11:47:32.153391+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:47:32.153391+0000","last_undegraded":"2024-04-26T11:47:32.153391+0000","last_fullsized":"2024-04-26T11:47:32.153391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":674,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148977+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:32.148977+0000","last_peered":"2024-04-26T11:47:32.148977+0000","last_clean":"2024-04-26T11:47:32.148977+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:32.148977+0000","last_undegraded":"2024-04-26T11:47:32.148977+0000","last_fullsized":"2024-04-26T11:47:32.148977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":995,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146636+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:32.146636+0000","last_peered":"2024-04-26T11:47:32.146636+0000","last_clean":"2024-04-26T11:47:32.146636+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:32.146636+0000","last_undegraded":"2024-04-26T11:47:32.146636+0000","last_fullsized":"2024-04-26T11:47:32.146636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147715+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:32.147715+0000","last_peered":"2024-04-26T11:47:32.147715+0000","last_clean":"2024-04-26T11:47:32.147715+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:32.147715+0000","last_undegraded":"2024-04-26T11:47:32.147715+0000","last_fullsized":"2024-04-26T11:47:32.147715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":601,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453563+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:33.453563+0000","last_peered":"2024-04-26T11:47:33.453563+0000","last_clean":"2024-04-26T11:47:33.453563+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:33.453563+0000","last_undegraded":"2024-04-26T11:47:33.453563+0000","last_fullsized":"2024-04-26T11:47:33.453563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":353,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453132+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:33.453132+0000","last_peered":"2024-04-26T11:47:33.453132+0000","last_clean":"2024-04-26T11:47:33.453132+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:33.453132+0000","last_undegraded":"2024-04-26T11:47:33.453132+0000","last_fullsized":"2024-04-26T11:47:33.453132+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":942,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147452+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:47:32.147452+0000","last_peered":"2024-04-26T11:47:32.147452+0000","last_clean":"2024-04-26T11:47:32.147452+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:47:32.147452+0000","last_undegraded":"2024-04-26T11:47:32.147452+0000","last_fullsized":"2024-04-26T11:47:32.147452+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":263,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147127+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:32.147127+0000","last_peered":"2024-04-26T11:47:32.147127+0000","last_clean":"2024-04-26T11:47:32.147127+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:32.147127+0000","last_undegraded":"2024-04-26T11:47:32.147127+0000","last_fullsized":"2024-04-26T11:47:32.147127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":528,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148619+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:32.148619+0000","last_peered":"2024-04-26T11:47:32.148619+0000","last_clean":"2024-04-26T11:47:32.148619+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:32.148619+0000","last_undegraded":"2024-04-26T11:47:32.148619+0000","last_fullsized":"2024-04-26T11:47:32.148619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154059+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:32.154059+0000","last_peered":"2024-04-26T11:47:32.154059+0000","last_clean":"2024-04-26T11:47:32.154059+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:32.154059+0000","last_undegraded":"2024-04-26T11:47:32.154059+0000","last_fullsized":"2024-04-26T11:47:32.154059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":466,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148665+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:32.148665+0000","last_peered":"2024-04-26T11:47:32.148665+0000","last_clean":"2024-04-26T11:47:32.148665+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:32.148665+0000","last_undegraded":"2024-04-26T11:47:32.148665+0000","last_fullsized":"2024-04-26T11:47:32.148665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":614,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152665+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:32.152665+0000","last_peered":"2024-04-26T11:47:32.152665+0000","last_clean":"2024-04-26T11:47:32.152665+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:32.152665+0000","last_undegraded":"2024-04-26T11:47:32.152665+0000","last_fullsized":"2024-04-26T11:47:32.152665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":506,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.454434+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:47:33.454434+0000","last_peered":"2024-04-26T11:47:33.454434+0000","last_clean":"2024-04-26T11:47:33.454434+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:47:33.454434+0000","last_undegraded":"2024-04-26T11:47:33.454434+0000","last_fullsized":"2024-04-26T11:47:33.454434+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":290,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147265+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:32.147265+0000","last_peered":"2024-04-26T11:47:32.147265+0000","last_clean":"2024-04-26T11:47:32.147265+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:32.147265+0000","last_undegraded":"2024-04-26T11:47:32.147265+0000","last_fullsized":"2024-04-26T11:47:32.147265+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147733+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:32.147733+0000","last_peered":"2024-04-26T11:47:32.147733+0000","last_clean":"2024-04-26T11:47:32.147733+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:32.147733+0000","last_undegraded":"2024-04-26T11:47:32.147733+0000","last_fullsized":"2024-04-26T11:47:32.147733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":595,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.452045+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:33.452045+0000","last_peered":"2024-04-26T11:47:33.452045+0000","last_clean":"2024-04-26T11:47:33.452045+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:33.452045+0000","last_undegraded":"2024-04-26T11:47:33.452045+0000","last_fullsized":"2024-04-26T11:47:33.452045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":554,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148864+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:32.148864+0000","last_peered":"2024-04-26T11:47:32.148864+0000","last_clean":"2024-04-26T11:47:32.148864+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:32.148864+0000","last_undegraded":"2024-04-26T11:47:32.148864+0000","last_fullsized":"2024-04-26T11:47:32.148864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147042+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:32.147042+0000","last_peered":"2024-04-26T11:47:32.147042+0000","last_clean":"2024-04-26T11:47:32.147042+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:32.147042+0000","last_undegraded":"2024-04-26T11:47:32.147042+0000","last_fullsized":"2024-04-26T11:47:32.147042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":347,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451018+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:33.451018+0000","last_peered":"2024-04-26T11:47:33.451018+0000","last_clean":"2024-04-26T11:47:33.451018+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:33.451018+0000","last_undegraded":"2024-04-26T11:47:33.451018+0000","last_fullsized":"2024-04-26T11:47:33.451018+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":971,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-26T11:47:33.157498+0000","last_change":"2024-04-26T11:47:33.157764+0000","last_active":"2024-04-26T11:47:33.157498+0000","last_peered":"2024-04-26T11:47:32.421623+0000","last_clean":"2024-04-26T11:44:49.187031+0000","last_became_active":"2024-04-26T11:47:12.259759+0000","last_became_peered":"2024-04-26T11:47:12.259759+0000","last_unstale":"2024-04-26T11:47:33.157498+0000","last_undegraded":"2024-04-26T11:47:33.157498+0000","last_fullsized":"2024-04-26T11:47:33.157498+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:34.390258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451711+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:33.451711+0000","last_peered":"2024-04-26T11:47:33.451711+0000","last_clean":"2024-04-26T11:47:33.451711+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:33.451711+0000","last_undegraded":"2024-04-26T11:47:33.451711+0000","last_fullsized":"2024-04-26T11:47:33.451711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":511,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152934+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:32.152934+0000","last_peered":"2024-04-26T11:47:32.152934+0000","last_clean":"2024-04-26T11:47:32.152934+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:32.152934+0000","last_undegraded":"2024-04-26T11:47:32.152934+0000","last_fullsized":"2024-04-26T11:47:32.152934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":439,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.454260+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:33.454260+0000","last_peered":"2024-04-26T11:47:33.454260+0000","last_clean":"2024-04-26T11:47:33.454260+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:33.454260+0000","last_undegraded":"2024-04-26T11:47:33.454260+0000","last_fullsized":"2024-04-26T11:47:33.454260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147338+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:32.147338+0000","last_peered":"2024-04-26T11:47:32.147338+0000","last_clean":"2024-04-26T11:47:32.147338+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:32.147338+0000","last_undegraded":"2024-04-26T11:47:32.147338+0000","last_fullsized":"2024-04-26T11:47:32.147338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147619+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:32.147619+0000","last_peered":"2024-04-26T11:47:32.147619+0000","last_clean":"2024-04-26T11:47:32.147619+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:32.147619+0000","last_undegraded":"2024-04-26T11:47:32.147619+0000","last_fullsized":"2024-04-26T11:47:32.147619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":483,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.452283+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:47:33.452283+0000","last_peered":"2024-04-26T11:47:33.452283+0000","last_clean":"2024-04-26T11:47:33.452283+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:47:33.452283+0000","last_undegraded":"2024-04-26T11:47:33.452283+0000","last_fullsized":"2024-04-26T11:47:33.452283+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":625,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148987+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:32.148987+0000","last_peered":"2024-04-26T11:47:32.148987+0000","last_clean":"2024-04-26T11:47:32.148987+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:32.148987+0000","last_undegraded":"2024-04-26T11:47:32.148987+0000","last_fullsized":"2024-04-26T11:47:32.148987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451403+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:33.451403+0000","last_peered":"2024-04-26T11:47:33.451403+0000","last_clean":"2024-04-26T11:47:33.451403+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:33.451403+0000","last_undegraded":"2024-04-26T11:47:33.451403+0000","last_fullsized":"2024-04-26T11:47:33.451403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":466,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.152885+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:32.152885+0000","last_peered":"2024-04-26T11:47:32.152885+0000","last_clean":"2024-04-26T11:47:32.152885+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:32.152885+0000","last_undegraded":"2024-04-26T11:47:32.152885+0000","last_fullsized":"2024-04-26T11:47:32.152885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.452579+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:33.452579+0000","last_peered":"2024-04-26T11:47:33.452579+0000","last_clean":"2024-04-26T11:47:33.452579+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:33.452579+0000","last_undegraded":"2024-04-26T11:47:33.452579+0000","last_fullsized":"2024-04-26T11:47:33.452579+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155396+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:32.155396+0000","last_peered":"2024-04-26T11:47:32.155396+0000","last_clean":"2024-04-26T11:47:32.155396+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:32.155396+0000","last_undegraded":"2024-04-26T11:47:32.155396+0000","last_fullsized":"2024-04-26T11:47:32.155396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":507,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153251+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:32.153251+0000","last_peered":"2024-04-26T11:47:32.153251+0000","last_clean":"2024-04-26T11:47:32.153251+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:32.153251+0000","last_undegraded":"2024-04-26T11:47:32.153251+0000","last_fullsized":"2024-04-26T11:47:32.153251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453755+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:33.453755+0000","last_peered":"2024-04-26T11:47:33.453755+0000","last_clean":"2024-04-26T11:47:33.453755+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:33.453755+0000","last_undegraded":"2024-04-26T11:47:33.453755+0000","last_fullsized":"2024-04-26T11:47:33.453755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453332+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:33.453332+0000","last_peered":"2024-04-26T11:47:33.453332+0000","last_clean":"2024-04-26T11:47:33.453332+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:33.453332+0000","last_undegraded":"2024-04-26T11:47:33.453332+0000","last_fullsized":"2024-04-26T11:47:33.453332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":614,"reported_epoch":95,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:34.049479+0000","last_change":"2024-04-26T11:47:33.771421+0000","last_active":"2024-04-26T11:47:34.049479+0000","last_peered":"2024-04-26T11:47:34.049479+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.261154+0000","last_became_peered":"2024-04-26T11:47:12.261154+0000","last_unstale":"2024-04-26T11:47:34.049479+0000","last_undegraded":"2024-04-26T11:47:12.150938+0000","last_fullsized":"2024-04-26T11:47:12.142966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:48.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453497+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:33.453497+0000","last_peered":"2024-04-26T11:47:33.453497+0000","last_clean":"2024-04-26T11:47:33.453497+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:33.453497+0000","last_undegraded":"2024-04-26T11:47:33.453497+0000","last_fullsized":"2024-04-26T11:47:33.453497+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.148792+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:32.148792+0000","last_peered":"2024-04-26T11:47:32.148792+0000","last_clean":"2024-04-26T11:47:32.148792+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:32.148792+0000","last_undegraded":"2024-04-26T11:47:32.148792+0000","last_fullsized":"2024-04-26T11:47:32.148792+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":540,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153626+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:32.153626+0000","last_peered":"2024-04-26T11:47:32.153626+0000","last_clean":"2024-04-26T11:47:32.153626+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:32.153626+0000","last_undegraded":"2024-04-26T11:47:32.153626+0000","last_fullsized":"2024-04-26T11:47:32.153626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":552,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.146650+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:32.146650+0000","last_peered":"2024-04-26T11:47:32.146650+0000","last_clean":"2024-04-26T11:47:32.146650+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:32.146650+0000","last_undegraded":"2024-04-26T11:47:32.146650+0000","last_fullsized":"2024-04-26T11:47:32.146650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":499,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147881+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:32.147881+0000","last_peered":"2024-04-26T11:47:32.147881+0000","last_clean":"2024-04-26T11:47:32.147881+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:32.147881+0000","last_undegraded":"2024-04-26T11:47:32.147881+0000","last_fullsized":"2024-04-26T11:47:32.147881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":527,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451971+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:47:33.451971+0000","last_peered":"2024-04-26T11:47:33.451971+0000","last_clean":"2024-04-26T11:47:33.451971+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:47:33.451971+0000","last_undegraded":"2024-04-26T11:47:33.451971+0000","last_fullsized":"2024-04-26T11:47:33.451971+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155196+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:32.155196+0000","last_peered":"2024-04-26T11:47:32.155196+0000","last_clean":"2024-04-26T11:47:32.155196+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:32.155196+0000","last_undegraded":"2024-04-26T11:47:32.155196+0000","last_fullsized":"2024-04-26T11:47:32.155196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":446,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.149359+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:32.149359+0000","last_peered":"2024-04-26T11:47:32.149359+0000","last_clean":"2024-04-26T11:47:32.149359+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:32.149359+0000","last_undegraded":"2024-04-26T11:47:32.149359+0000","last_fullsized":"2024-04-26T11:47:32.149359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":560,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451719+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:47:33.451719+0000","last_peered":"2024-04-26T11:47:33.451719+0000","last_clean":"2024-04-26T11:47:33.451719+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:47:33.451719+0000","last_undegraded":"2024-04-26T11:47:33.451719+0000","last_fullsized":"2024-04-26T11:47:33.451719+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.454192+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:33.454192+0000","last_peered":"2024-04-26T11:47:33.454192+0000","last_clean":"2024-04-26T11:47:33.454192+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:33.454192+0000","last_undegraded":"2024-04-26T11:47:33.454192+0000","last_fullsized":"2024-04-26T11:47:33.454192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":581,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.152119+0000","last_change":"2024-04-26T11:47:12.274049+0000","last_active":"2024-04-26T11:47:32.152119+0000","last_peered":"2024-04-26T11:47:32.152119+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:32.152119+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":498,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155046+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:32.155046+0000","last_peered":"2024-04-26T11:47:32.155046+0000","last_clean":"2024-04-26T11:47:32.155046+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:32.155046+0000","last_undegraded":"2024-04-26T11:47:32.155046+0000","last_fullsized":"2024-04-26T11:47:32.155046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":856,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451166+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:33.451166+0000","last_peered":"2024-04-26T11:47:33.451166+0000","last_clean":"2024-04-26T11:47:33.451166+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:33.451166+0000","last_undegraded":"2024-04-26T11:47:33.451166+0000","last_fullsized":"2024-04-26T11:47:33.451166+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":479,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.462385+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:47:33.462385+0000","last_peered":"2024-04-26T11:47:33.462385+0000","last_clean":"2024-04-26T11:47:33.462385+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:47:33.462385+0000","last_undegraded":"2024-04-26T11:47:33.462385+0000","last_fullsized":"2024-04-26T11:47:33.462385+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":413,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.451157+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:33.451157+0000","last_peered":"2024-04-26T11:47:33.451157+0000","last_clean":"2024-04-26T11:47:33.451157+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:33.451157+0000","last_undegraded":"2024-04-26T11:47:33.451157+0000","last_fullsized":"2024-04-26T11:47:33.451157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":519,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154439+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:32.154439+0000","last_peered":"2024-04-26T11:47:32.154439+0000","last_clean":"2024-04-26T11:47:32.154439+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:32.154439+0000","last_undegraded":"2024-04-26T11:47:32.154439+0000","last_fullsized":"2024-04-26T11:47:32.154439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":468,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154215+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:32.154215+0000","last_peered":"2024-04-26T11:47:32.154215+0000","last_clean":"2024-04-26T11:47:32.154215+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:32.154215+0000","last_undegraded":"2024-04-26T11:47:32.154215+0000","last_fullsized":"2024-04-26T11:47:32.154215+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":834,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153751+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:32.153751+0000","last_peered":"2024-04-26T11:47:32.153751+0000","last_clean":"2024-04-26T11:47:32.153751+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:32.153751+0000","last_undegraded":"2024-04-26T11:47:32.153751+0000","last_fullsized":"2024-04-26T11:47:32.153751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.153445+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:32.153445+0000","last_peered":"2024-04-26T11:47:32.153445+0000","last_clean":"2024-04-26T11:47:32.153445+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:32.153445+0000","last_undegraded":"2024-04-26T11:47:32.153445+0000","last_fullsized":"2024-04-26T11:47:32.153445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":864,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147378+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:47:32.147378+0000","last_peered":"2024-04-26T11:47:32.147378+0000","last_clean":"2024-04-26T11:47:32.147378+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:47:32.147378+0000","last_undegraded":"2024-04-26T11:47:32.147378+0000","last_fullsized":"2024-04-26T11:47:32.147378+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":388,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147479+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:32.147479+0000","last_peered":"2024-04-26T11:47:32.147479+0000","last_clean":"2024-04-26T11:47:32.147479+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:32.147479+0000","last_undegraded":"2024-04-26T11:47:32.147479+0000","last_fullsized":"2024-04-26T11:47:32.147479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":881,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.147120+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:47:32.147120+0000","last_peered":"2024-04-26T11:47:32.147120+0000","last_clean":"2024-04-26T11:47:32.147120+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:47:32.147120+0000","last_undegraded":"2024-04-26T11:47:32.147120+0000","last_fullsized":"2024-04-26T11:47:32.147120+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":417,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.155131+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:32.155131+0000","last_peered":"2024-04-26T11:47:32.155131+0000","last_clean":"2024-04-26T11:47:32.155131+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:32.155131+0000","last_undegraded":"2024-04-26T11:47:32.155131+0000","last_fullsized":"2024-04-26T11:47:32.155131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":932,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:47:32.154540+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:32.154540+0000","last_peered":"2024-04-26T11:47:32.154540+0000","last_clean":"2024-04-26T11:47:32.154540+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:32.154540+0000","last_undegraded":"2024-04-26T11:47:32.154540+0000","last_fullsized":"2024-04-26T11:47:32.154540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453898+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:33.453898+0000","last_peered":"2024-04-26T11:47:33.453898+0000","last_clean":"2024-04-26T11:47:33.453898+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:33.453898+0000","last_undegraded":"2024-04-26T11:47:33.453898+0000","last_fullsized":"2024-04-26T11:47:33.453898+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":564,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:32.147014+0000","last_change":"2024-04-26T11:47:12.265445+0000","last_active":"2024-04-26T11:47:32.147014+0000","last_peered":"2024-04-26T11:47:32.147014+0000","last_clean":"2024-04-26T11:44:50.721643+0000","last_became_active":"2024-04-26T11:47:12.261192+0000","last_became_peered":"2024-04-26T11:47:12.261192+0000","last_unstale":"2024-04-26T11:47:32.147014+0000","last_undegraded":"2024-04-26T11:47:12.153385+0000","last_fullsized":"2024-04-26T11:47:12.142841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:56.736265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:47:33.453648+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:33.453648+0000","last_peered":"2024-04-26T11:47:33.453648+0000","last_clean":"2024-04-26T11:47:33.453648+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:33.453648+0000","last_undegraded":"2024-04-26T11:47:33.453648+0000","last_fullsized":"2024-04-26T11:47:33.453648+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2445,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5601,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":113,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738413,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200312,"kb_used_data":88876,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171528,"statfs":{"total":96636764160,"available":96431644672,"internally_reserved":0,"allocated":91009024,"data_stored":90497544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":1,"up_from":72,"seq":309237645318,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137720,"kb_used_data":79852,"kb_used_omap":6,"kb_used_meta":57849,"kb_avail":94234120,"statfs":{"total":96636764160,"available":96495738880,"internally_reserved":0,"allocated":81768448,"data_stored":81278689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":59237632},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190492,"kb_used_data":83144,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181348,"statfs":{"total":96636764160,"available":96441700352,"internally_reserved":0,"allocated":85139456,"data_stored":84639587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:42.005 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:42.340 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:42.355 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-26T11:47:42.158017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1133,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6919,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":524608,"kb_used_data":252052,"kb_used_omap":9,"kb_used_meta":272502,"kb_avail":282590912,"statfs":{"total":289910292480,"available":289373093888,"internally_reserved":0,"allocated":258101248,"data_stored":256483905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":279042188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1312,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1297,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.021649"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":946,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.144027+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:37.144027+0000","last_peered":"2024-04-26T11:47:37.144027+0000","last_clean":"2024-04-26T11:47:37.144027+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:37.144027+0000","last_undegraded":"2024-04-26T11:47:37.144027+0000","last_fullsized":"2024-04-26T11:47:37.144027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":996,"reported_epoch":100,"state":"peering","last_fresh":"2024-04-26T11:47:38.145967+0000","last_change":"2024-04-26T11:47:38.146318+0000","last_active":"2024-04-26T11:47:38.145967+0000","last_peered":"2024-04-26T11:47:37.975880+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:38.145967+0000","last_undegraded":"2024-04-26T11:47:38.145967+0000","last_fullsized":"2024-04-26T11:47:38.145967+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:32.408332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":509,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143498+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:37.143498+0000","last_peered":"2024-04-26T11:47:37.143498+0000","last_clean":"2024-04-26T11:47:37.143498+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:37.143498+0000","last_undegraded":"2024-04-26T11:47:37.143498+0000","last_fullsized":"2024-04-26T11:47:37.143498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":824,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142676+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:37.142676+0000","last_peered":"2024-04-26T11:47:37.142676+0000","last_clean":"2024-04-26T11:47:37.142676+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:37.142676+0000","last_undegraded":"2024-04-26T11:47:37.142676+0000","last_fullsized":"2024-04-26T11:47:37.142676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":902,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142138+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:47:37.142138+0000","last_peered":"2024-04-26T11:47:37.142138+0000","last_clean":"2024-04-26T11:47:37.142138+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:47:37.142138+0000","last_undegraded":"2024-04-26T11:47:37.142138+0000","last_fullsized":"2024-04-26T11:47:37.142138+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":830,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141449+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:37.141449+0000","last_peered":"2024-04-26T11:47:37.141449+0000","last_clean":"2024-04-26T11:47:37.141449+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:37.141449+0000","last_undegraded":"2024-04-26T11:47:37.141449+0000","last_fullsized":"2024-04-26T11:47:37.141449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":630,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.141607+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:37.141607+0000","last_peered":"2024-04-26T11:47:37.141607+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:37.141607+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":824,"reported_epoch":100,"state":"peering","last_fresh":"2024-04-26T11:47:38.144846+0000","last_change":"2024-04-26T11:47:38.145256+0000","last_active":"2024-04-26T11:47:38.144846+0000","last_peered":"2024-04-26T11:47:37.209791+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:38.144846+0000","last_undegraded":"2024-04-26T11:47:38.144846+0000","last_fullsized":"2024-04-26T11:47:38.144846+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:37.492663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":528,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444579+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:38.444579+0000","last_peered":"2024-04-26T11:47:38.444579+0000","last_clean":"2024-04-26T11:47:38.444579+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:38.444579+0000","last_undegraded":"2024-04-26T11:47:38.444579+0000","last_fullsized":"2024-04-26T11:47:38.444579+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":945,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142851+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:47:37.142851+0000","last_peered":"2024-04-26T11:47:37.142851+0000","last_clean":"2024-04-26T11:47:37.142851+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:47:37.142851+0000","last_undegraded":"2024-04-26T11:47:37.142851+0000","last_fullsized":"2024-04-26T11:47:37.142851+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:32.091133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":858,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143022+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:37.143022+0000","last_peered":"2024-04-26T11:47:37.143022+0000","last_clean":"2024-04-26T11:47:37.143022+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:37.143022+0000","last_undegraded":"2024-04-26T11:47:37.143022+0000","last_fullsized":"2024-04-26T11:47:37.143022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":476,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142090+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:37.142090+0000","last_peered":"2024-04-26T11:47:37.142090+0000","last_clean":"2024-04-26T11:47:37.142090+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:37.142090+0000","last_undegraded":"2024-04-26T11:47:37.142090+0000","last_fullsized":"2024-04-26T11:47:37.142090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":878,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141646+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:37.141646+0000","last_peered":"2024-04-26T11:47:37.141646+0000","last_clean":"2024-04-26T11:47:37.141646+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:37.141646+0000","last_undegraded":"2024-04-26T11:47:37.141646+0000","last_fullsized":"2024-04-26T11:47:37.141646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":548,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141464+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:37.141464+0000","last_peered":"2024-04-26T11:47:37.141464+0000","last_clean":"2024-04-26T11:47:37.141464+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:37.141464+0000","last_undegraded":"2024-04-26T11:47:37.141464+0000","last_fullsized":"2024-04-26T11:47:37.141464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":590,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141517+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:37.141517+0000","last_peered":"2024-04-26T11:47:37.141517+0000","last_clean":"2024-04-26T11:47:37.141517+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:37.141517+0000","last_undegraded":"2024-04-26T11:47:37.141517+0000","last_fullsized":"2024-04-26T11:47:37.141517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1037,"reported_epoch":100,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:38.755976+0000","last_change":"2024-04-26T11:47:38.756418+0000","last_active":"2024-04-26T11:47:38.755976+0000","last_peered":"2024-04-26T11:47:38.755976+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:38.755976+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":496,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444392+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:38.444392+0000","last_peered":"2024-04-26T11:47:38.444392+0000","last_clean":"2024-04-26T11:47:38.444392+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:38.444392+0000","last_undegraded":"2024-04-26T11:47:38.444392+0000","last_fullsized":"2024-04-26T11:47:38.444392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":910,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.156085+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:47:38.156085+0000","last_peered":"2024-04-26T11:47:38.156085+0000","last_clean":"2024-04-26T11:47:38.156085+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:47:38.156085+0000","last_undegraded":"2024-04-26T11:47:38.156085+0000","last_fullsized":"2024-04-26T11:47:38.156085+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:10.908191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":546,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.142309+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:37.142309+0000","last_peered":"2024-04-26T11:47:37.142309+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:37.142309+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":999,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142842+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:37.142842+0000","last_peered":"2024-04-26T11:47:37.142842+0000","last_clean":"2024-04-26T11:47:37.142842+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:37.142842+0000","last_undegraded":"2024-04-26T11:47:37.142842+0000","last_fullsized":"2024-04-26T11:47:37.142842+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":913,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142020+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:47:37.142020+0000","last_peered":"2024-04-26T11:47:37.142020+0000","last_clean":"2024-04-26T11:47:37.142020+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:47:37.142020+0000","last_undegraded":"2024-04-26T11:47:37.142020+0000","last_fullsized":"2024-04-26T11:47:37.142020+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:16.863281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":562,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141457+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:37.141457+0000","last_peered":"2024-04-26T11:47:37.141457+0000","last_clean":"2024-04-26T11:47:37.141457+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:37.141457+0000","last_undegraded":"2024-04-26T11:47:37.141457+0000","last_fullsized":"2024-04-26T11:47:37.141457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":501,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441774+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:47:38.441774+0000","last_peered":"2024-04-26T11:47:38.441774+0000","last_clean":"2024-04-26T11:47:38.441774+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:47:38.441774+0000","last_undegraded":"2024-04-26T11:47:38.441774+0000","last_fullsized":"2024-04-26T11:47:38.441774+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1017,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.159937+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:47:37.159937+0000","last_peered":"2024-04-26T11:47:37.159937+0000","last_clean":"2024-04-26T11:47:37.159937+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:47:37.159937+0000","last_undegraded":"2024-04-26T11:47:37.159937+0000","last_fullsized":"2024-04-26T11:47:37.159937+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":498,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.144099+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:37.144099+0000","last_peered":"2024-04-26T11:47:37.144099+0000","last_clean":"2024-04-26T11:47:37.144099+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:37.144099+0000","last_undegraded":"2024-04-26T11:47:37.144099+0000","last_fullsized":"2024-04-26T11:47:37.144099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":642,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.143553+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:37.143553+0000","last_peered":"2024-04-26T11:47:37.143553+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:37.143553+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":500,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143248+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:37.143248+0000","last_peered":"2024-04-26T11:47:37.143248+0000","last_clean":"2024-04-26T11:47:37.143248+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:37.143248+0000","last_undegraded":"2024-04-26T11:47:37.143248+0000","last_fullsized":"2024-04-26T11:47:37.143248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":581,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142412+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:37.142412+0000","last_peered":"2024-04-26T11:47:37.142412+0000","last_clean":"2024-04-26T11:47:37.142412+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:37.142412+0000","last_undegraded":"2024-04-26T11:47:37.142412+0000","last_fullsized":"2024-04-26T11:47:37.142412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":494,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442885+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:47:38.442885+0000","last_peered":"2024-04-26T11:47:38.442885+0000","last_clean":"2024-04-26T11:47:38.442885+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:47:38.442885+0000","last_undegraded":"2024-04-26T11:47:38.442885+0000","last_fullsized":"2024-04-26T11:47:38.442885+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":610,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141920+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:37.141920+0000","last_peered":"2024-04-26T11:47:37.141920+0000","last_clean":"2024-04-26T11:47:37.141920+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:37.141920+0000","last_undegraded":"2024-04-26T11:47:37.141920+0000","last_fullsized":"2024-04-26T11:47:37.141920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":559,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442195+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:47:38.442195+0000","last_peered":"2024-04-26T11:47:38.442195+0000","last_clean":"2024-04-26T11:47:38.442195+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:47:38.442195+0000","last_undegraded":"2024-04-26T11:47:38.442195+0000","last_fullsized":"2024-04-26T11:47:38.442195+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":543,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.141587+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:37.141587+0000","last_peered":"2024-04-26T11:47:37.141587+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:37.141587+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":489,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.142435+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:37.142435+0000","last_peered":"2024-04-26T11:47:37.142435+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:37.142435+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":608,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142280+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:37.142280+0000","last_peered":"2024-04-26T11:47:37.142280+0000","last_clean":"2024-04-26T11:47:37.142280+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:37.142280+0000","last_undegraded":"2024-04-26T11:47:37.142280+0000","last_fullsized":"2024-04-26T11:47:37.142280+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":600,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.142924+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:37.142924+0000","last_peered":"2024-04-26T11:47:37.142924+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:37.142924+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442696+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:38.442696+0000","last_peered":"2024-04-26T11:47:38.442696+0000","last_clean":"2024-04-26T11:47:38.442696+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:38.442696+0000","last_undegraded":"2024-04-26T11:47:38.442696+0000","last_fullsized":"2024-04-26T11:47:38.442696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":501,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443985+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:47:38.443985+0000","last_peered":"2024-04-26T11:47:38.443985+0000","last_clean":"2024-04-26T11:47:38.443985+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:47:38.443985+0000","last_undegraded":"2024-04-26T11:47:38.443985+0000","last_fullsized":"2024-04-26T11:47:38.443985+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":153,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141644+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:37.141644+0000","last_peered":"2024-04-26T11:47:37.141644+0000","last_clean":"2024-04-26T11:47:37.141644+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:37.141644+0000","last_undegraded":"2024-04-26T11:47:37.141644+0000","last_fullsized":"2024-04-26T11:47:37.141644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":536,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444027+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:38.444027+0000","last_peered":"2024-04-26T11:47:38.444027+0000","last_clean":"2024-04-26T11:47:38.444027+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:38.444027+0000","last_undegraded":"2024-04-26T11:47:38.444027+0000","last_fullsized":"2024-04-26T11:47:38.444027+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":160,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141393+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:37.141393+0000","last_peered":"2024-04-26T11:47:37.141393+0000","last_clean":"2024-04-26T11:47:37.141393+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:37.141393+0000","last_undegraded":"2024-04-26T11:47:37.141393+0000","last_fullsized":"2024-04-26T11:47:37.141393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":307,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143845+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:37.143845+0000","last_peered":"2024-04-26T11:47:37.143845+0000","last_clean":"2024-04-26T11:47:37.143845+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:37.143845+0000","last_undegraded":"2024-04-26T11:47:37.143845+0000","last_fullsized":"2024-04-26T11:47:37.143845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":525,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141095+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:37.141095+0000","last_peered":"2024-04-26T11:47:37.141095+0000","last_clean":"2024-04-26T11:47:37.141095+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:37.141095+0000","last_undegraded":"2024-04-26T11:47:37.141095+0000","last_fullsized":"2024-04-26T11:47:37.141095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":485,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143761+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:37.143761+0000","last_peered":"2024-04-26T11:47:37.143761+0000","last_clean":"2024-04-26T11:47:37.143761+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:37.143761+0000","last_undegraded":"2024-04-26T11:47:37.143761+0000","last_fullsized":"2024-04-26T11:47:37.143761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1016,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141179+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:47:37.141179+0000","last_peered":"2024-04-26T11:47:37.141179+0000","last_clean":"2024-04-26T11:47:37.141179+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:47:37.141179+0000","last_undegraded":"2024-04-26T11:47:37.141179+0000","last_fullsized":"2024-04-26T11:47:37.141179+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":679,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143895+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:37.143895+0000","last_peered":"2024-04-26T11:47:37.143895+0000","last_clean":"2024-04-26T11:47:37.143895+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:37.143895+0000","last_undegraded":"2024-04-26T11:47:37.143895+0000","last_fullsized":"2024-04-26T11:47:37.143895+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1000,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141727+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:37.141727+0000","last_peered":"2024-04-26T11:47:37.141727+0000","last_clean":"2024-04-26T11:47:37.141727+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:37.141727+0000","last_undegraded":"2024-04-26T11:47:37.141727+0000","last_fullsized":"2024-04-26T11:47:37.141727+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":168,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143379+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:37.143379+0000","last_peered":"2024-04-26T11:47:37.143379+0000","last_clean":"2024-04-26T11:47:37.143379+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:37.143379+0000","last_undegraded":"2024-04-26T11:47:37.143379+0000","last_fullsized":"2024-04-26T11:47:37.143379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":606,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443717+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:38.443717+0000","last_peered":"2024-04-26T11:47:38.443717+0000","last_clean":"2024-04-26T11:47:38.443717+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:38.443717+0000","last_undegraded":"2024-04-26T11:47:38.443717+0000","last_fullsized":"2024-04-26T11:47:38.443717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":358,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443138+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:38.443138+0000","last_peered":"2024-04-26T11:47:38.443138+0000","last_clean":"2024-04-26T11:47:38.443138+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:38.443138+0000","last_undegraded":"2024-04-26T11:47:38.443138+0000","last_fullsized":"2024-04-26T11:47:38.443138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":947,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142981+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:47:37.142981+0000","last_peered":"2024-04-26T11:47:37.142981+0000","last_clean":"2024-04-26T11:47:37.142981+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:47:37.142981+0000","last_undegraded":"2024-04-26T11:47:37.142981+0000","last_fullsized":"2024-04-26T11:47:37.142981+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":268,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142192+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:37.142192+0000","last_peered":"2024-04-26T11:47:37.142192+0000","last_clean":"2024-04-26T11:47:37.142192+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:37.142192+0000","last_undegraded":"2024-04-26T11:47:37.142192+0000","last_fullsized":"2024-04-26T11:47:37.142192+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":533,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143670+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:37.143670+0000","last_peered":"2024-04-26T11:47:37.143670+0000","last_clean":"2024-04-26T11:47:37.143670+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:37.143670+0000","last_undegraded":"2024-04-26T11:47:37.143670+0000","last_fullsized":"2024-04-26T11:47:37.143670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":147,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141537+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:37.141537+0000","last_peered":"2024-04-26T11:47:37.141537+0000","last_clean":"2024-04-26T11:47:37.141537+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:37.141537+0000","last_undegraded":"2024-04-26T11:47:37.141537+0000","last_fullsized":"2024-04-26T11:47:37.141537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":471,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143378+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:37.143378+0000","last_peered":"2024-04-26T11:47:37.143378+0000","last_clean":"2024-04-26T11:47:37.143378+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:37.143378+0000","last_undegraded":"2024-04-26T11:47:37.143378+0000","last_fullsized":"2024-04-26T11:47:37.143378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141414+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:37.141414+0000","last_peered":"2024-04-26T11:47:37.141414+0000","last_clean":"2024-04-26T11:47:37.141414+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:37.141414+0000","last_undegraded":"2024-04-26T11:47:37.141414+0000","last_fullsized":"2024-04-26T11:47:37.141414+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":511,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.445171+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:47:38.445171+0000","last_peered":"2024-04-26T11:47:38.445171+0000","last_clean":"2024-04-26T11:47:38.445171+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:47:38.445171+0000","last_undegraded":"2024-04-26T11:47:38.445171+0000","last_fullsized":"2024-04-26T11:47:38.445171+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":295,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142224+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:37.142224+0000","last_peered":"2024-04-26T11:47:37.142224+0000","last_clean":"2024-04-26T11:47:37.142224+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:37.142224+0000","last_undegraded":"2024-04-26T11:47:37.142224+0000","last_fullsized":"2024-04-26T11:47:37.142224+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142527+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:37.142527+0000","last_peered":"2024-04-26T11:47:37.142527+0000","last_clean":"2024-04-26T11:47:37.142527+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:37.142527+0000","last_undegraded":"2024-04-26T11:47:37.142527+0000","last_fullsized":"2024-04-26T11:47:37.142527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":600,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442942+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:38.442942+0000","last_peered":"2024-04-26T11:47:38.442942+0000","last_clean":"2024-04-26T11:47:38.442942+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:38.442942+0000","last_undegraded":"2024-04-26T11:47:38.442942+0000","last_fullsized":"2024-04-26T11:47:38.442942+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":559,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143743+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:37.143743+0000","last_peered":"2024-04-26T11:47:37.143743+0000","last_clean":"2024-04-26T11:47:37.143743+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:37.143743+0000","last_undegraded":"2024-04-26T11:47:37.143743+0000","last_fullsized":"2024-04-26T11:47:37.143743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141981+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:37.141981+0000","last_peered":"2024-04-26T11:47:37.141981+0000","last_clean":"2024-04-26T11:47:37.141981+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:37.141981+0000","last_undegraded":"2024-04-26T11:47:37.141981+0000","last_fullsized":"2024-04-26T11:47:37.141981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":352,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441461+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:38.441461+0000","last_peered":"2024-04-26T11:47:38.441461+0000","last_clean":"2024-04-26T11:47:38.441461+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:38.441461+0000","last_undegraded":"2024-04-26T11:47:38.441461+0000","last_fullsized":"2024-04-26T11:47:38.441461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":983,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143547+0000","last_change":"2024-04-26T11:47:34.145286+0000","last_active":"2024-04-26T11:47:37.143547+0000","last_peered":"2024-04-26T11:47:37.143547+0000","last_clean":"2024-04-26T11:47:37.143547+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:47:37.143547+0000","last_undegraded":"2024-04-26T11:47:37.143547+0000","last_fullsized":"2024-04-26T11:47:37.143547+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:13.918331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441974+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:38.441974+0000","last_peered":"2024-04-26T11:47:38.441974+0000","last_clean":"2024-04-26T11:47:38.441974+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:38.441974+0000","last_undegraded":"2024-04-26T11:47:38.441974+0000","last_fullsized":"2024-04-26T11:47:38.441974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":516,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141653+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:37.141653+0000","last_peered":"2024-04-26T11:47:37.141653+0000","last_clean":"2024-04-26T11:47:37.141653+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:37.141653+0000","last_undegraded":"2024-04-26T11:47:37.141653+0000","last_fullsized":"2024-04-26T11:47:37.141653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":444,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.445072+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:38.445072+0000","last_peered":"2024-04-26T11:47:38.445072+0000","last_clean":"2024-04-26T11:47:38.445072+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:38.445072+0000","last_undegraded":"2024-04-26T11:47:38.445072+0000","last_fullsized":"2024-04-26T11:47:38.445072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142419+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:37.142419+0000","last_peered":"2024-04-26T11:47:37.142419+0000","last_clean":"2024-04-26T11:47:37.142419+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:37.142419+0000","last_undegraded":"2024-04-26T11:47:37.142419+0000","last_fullsized":"2024-04-26T11:47:37.142419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142349+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:37.142349+0000","last_peered":"2024-04-26T11:47:37.142349+0000","last_clean":"2024-04-26T11:47:37.142349+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:37.142349+0000","last_undegraded":"2024-04-26T11:47:37.142349+0000","last_fullsized":"2024-04-26T11:47:37.142349+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":488,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443305+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:47:38.443305+0000","last_peered":"2024-04-26T11:47:38.443305+0000","last_clean":"2024-04-26T11:47:38.443305+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:47:38.443305+0000","last_undegraded":"2024-04-26T11:47:38.443305+0000","last_fullsized":"2024-04-26T11:47:38.443305+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":630,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143995+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:37.143995+0000","last_peered":"2024-04-26T11:47:37.143995+0000","last_clean":"2024-04-26T11:47:37.143995+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:37.143995+0000","last_undegraded":"2024-04-26T11:47:37.143995+0000","last_fullsized":"2024-04-26T11:47:37.143995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443047+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:38.443047+0000","last_peered":"2024-04-26T11:47:38.443047+0000","last_clean":"2024-04-26T11:47:38.443047+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:38.443047+0000","last_undegraded":"2024-04-26T11:47:38.443047+0000","last_fullsized":"2024-04-26T11:47:38.443047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":471,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141685+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:37.141685+0000","last_peered":"2024-04-26T11:47:37.141685+0000","last_clean":"2024-04-26T11:47:37.141685+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:37.141685+0000","last_undegraded":"2024-04-26T11:47:37.141685+0000","last_fullsized":"2024-04-26T11:47:37.141685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443559+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:38.443559+0000","last_peered":"2024-04-26T11:47:38.443559+0000","last_clean":"2024-04-26T11:47:38.443559+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:38.443559+0000","last_undegraded":"2024-04-26T11:47:38.443559+0000","last_fullsized":"2024-04-26T11:47:38.443559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143639+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:37.143639+0000","last_peered":"2024-04-26T11:47:37.143639+0000","last_clean":"2024-04-26T11:47:37.143639+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:37.143639+0000","last_undegraded":"2024-04-26T11:47:37.143639+0000","last_fullsized":"2024-04-26T11:47:37.143639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":512,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141879+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:37.141879+0000","last_peered":"2024-04-26T11:47:37.141879+0000","last_clean":"2024-04-26T11:47:37.141879+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:37.141879+0000","last_undegraded":"2024-04-26T11:47:37.141879+0000","last_fullsized":"2024-04-26T11:47:37.141879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444214+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:38.444214+0000","last_peered":"2024-04-26T11:47:38.444214+0000","last_clean":"2024-04-26T11:47:38.444214+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:38.444214+0000","last_undegraded":"2024-04-26T11:47:38.444214+0000","last_fullsized":"2024-04-26T11:47:38.444214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443516+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:38.443516+0000","last_peered":"2024-04-26T11:47:38.443516+0000","last_clean":"2024-04-26T11:47:38.443516+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:38.443516+0000","last_undegraded":"2024-04-26T11:47:38.443516+0000","last_fullsized":"2024-04-26T11:47:38.443516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":469,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442502+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:47:38.442502+0000","last_peered":"2024-04-26T11:47:38.442502+0000","last_clean":"2024-04-26T11:47:38.442502+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:47:38.442502+0000","last_undegraded":"2024-04-26T11:47:38.442502+0000","last_fullsized":"2024-04-26T11:47:38.442502+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:47.076399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":64,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443767+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:38.443767+0000","last_peered":"2024-04-26T11:47:38.443767+0000","last_clean":"2024-04-26T11:47:38.443767+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:38.443767+0000","last_undegraded":"2024-04-26T11:47:38.443767+0000","last_fullsized":"2024-04-26T11:47:38.443767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143996+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:37.143996+0000","last_peered":"2024-04-26T11:47:37.143996+0000","last_clean":"2024-04-26T11:47:37.143996+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:37.143996+0000","last_undegraded":"2024-04-26T11:47:37.143996+0000","last_fullsized":"2024-04-26T11:47:37.143996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":545,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141150+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:37.141150+0000","last_peered":"2024-04-26T11:47:37.141150+0000","last_clean":"2024-04-26T11:47:37.141150+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:37.141150+0000","last_undegraded":"2024-04-26T11:47:37.141150+0000","last_fullsized":"2024-04-26T11:47:37.141150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":557,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141867+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:37.141867+0000","last_peered":"2024-04-26T11:47:37.141867+0000","last_clean":"2024-04-26T11:47:37.141867+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:37.141867+0000","last_undegraded":"2024-04-26T11:47:37.141867+0000","last_fullsized":"2024-04-26T11:47:37.141867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":504,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143221+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:37.143221+0000","last_peered":"2024-04-26T11:47:37.143221+0000","last_clean":"2024-04-26T11:47:37.143221+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:37.143221+0000","last_undegraded":"2024-04-26T11:47:37.143221+0000","last_fullsized":"2024-04-26T11:47:37.143221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":532,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442329+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:47:38.442329+0000","last_peered":"2024-04-26T11:47:38.442329+0000","last_clean":"2024-04-26T11:47:38.442329+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:47:38.442329+0000","last_undegraded":"2024-04-26T11:47:38.442329+0000","last_fullsized":"2024-04-26T11:47:38.442329+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":196,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143471+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:37.143471+0000","last_peered":"2024-04-26T11:47:37.143471+0000","last_clean":"2024-04-26T11:47:37.143471+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:37.143471+0000","last_undegraded":"2024-04-26T11:47:37.143471+0000","last_fullsized":"2024-04-26T11:47:37.143471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":451,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143622+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:37.143622+0000","last_peered":"2024-04-26T11:47:37.143622+0000","last_clean":"2024-04-26T11:47:37.143622+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:37.143622+0000","last_undegraded":"2024-04-26T11:47:37.143622+0000","last_fullsized":"2024-04-26T11:47:37.143622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":565,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441780+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:47:38.441780+0000","last_peered":"2024-04-26T11:47:38.441780+0000","last_clean":"2024-04-26T11:47:38.441780+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:47:38.441780+0000","last_undegraded":"2024-04-26T11:47:38.441780+0000","last_fullsized":"2024-04-26T11:47:38.441780+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444767+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:38.444767+0000","last_peered":"2024-04-26T11:47:38.444767+0000","last_clean":"2024-04-26T11:47:38.444767+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:38.444767+0000","last_undegraded":"2024-04-26T11:47:38.444767+0000","last_fullsized":"2024-04-26T11:47:38.444767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":729,"reported_epoch":100,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:39.052613+0000","last_change":"2024-04-26T11:47:38.757381+0000","last_active":"2024-04-26T11:47:39.052613+0000","last_peered":"2024-04-26T11:47:39.052613+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:39.052613+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":503,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.144251+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:37.144251+0000","last_peered":"2024-04-26T11:47:37.144251+0000","last_clean":"2024-04-26T11:47:37.144251+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:37.144251+0000","last_undegraded":"2024-04-26T11:47:37.144251+0000","last_fullsized":"2024-04-26T11:47:37.144251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":861,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441406+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:38.441406+0000","last_peered":"2024-04-26T11:47:38.441406+0000","last_clean":"2024-04-26T11:47:38.441406+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:38.441406+0000","last_undegraded":"2024-04-26T11:47:38.441406+0000","last_fullsized":"2024-04-26T11:47:38.441406+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":484,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444314+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:47:38.444314+0000","last_peered":"2024-04-26T11:47:38.444314+0000","last_clean":"2024-04-26T11:47:38.444314+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:47:38.444314+0000","last_undegraded":"2024-04-26T11:47:38.444314+0000","last_fullsized":"2024-04-26T11:47:38.444314+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":418,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441505+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:38.441505+0000","last_peered":"2024-04-26T11:47:38.441505+0000","last_clean":"2024-04-26T11:47:38.441505+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:38.441505+0000","last_undegraded":"2024-04-26T11:47:38.441505+0000","last_fullsized":"2024-04-26T11:47:38.441505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":524,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142695+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:37.142695+0000","last_peered":"2024-04-26T11:47:37.142695+0000","last_clean":"2024-04-26T11:47:37.142695+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:37.142695+0000","last_undegraded":"2024-04-26T11:47:37.142695+0000","last_fullsized":"2024-04-26T11:47:37.142695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":473,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142315+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:37.142315+0000","last_peered":"2024-04-26T11:47:37.142315+0000","last_clean":"2024-04-26T11:47:37.142315+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:37.142315+0000","last_undegraded":"2024-04-26T11:47:37.142315+0000","last_fullsized":"2024-04-26T11:47:37.142315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":839,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142195+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:37.142195+0000","last_peered":"2024-04-26T11:47:37.142195+0000","last_clean":"2024-04-26T11:47:37.142195+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:37.142195+0000","last_undegraded":"2024-04-26T11:47:37.142195+0000","last_fullsized":"2024-04-26T11:47:37.142195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":150,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142580+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:37.142580+0000","last_peered":"2024-04-26T11:47:37.142580+0000","last_clean":"2024-04-26T11:47:37.142580+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:37.142580+0000","last_undegraded":"2024-04-26T11:47:37.142580+0000","last_fullsized":"2024-04-26T11:47:37.142580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":869,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141744+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:47:37.141744+0000","last_peered":"2024-04-26T11:47:37.141744+0000","last_clean":"2024-04-26T11:47:37.141744+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:47:37.141744+0000","last_undegraded":"2024-04-26T11:47:37.141744+0000","last_fullsized":"2024-04-26T11:47:37.141744+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":393,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143130+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:37.143130+0000","last_peered":"2024-04-26T11:47:37.143130+0000","last_clean":"2024-04-26T11:47:37.143130+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:37.143130+0000","last_undegraded":"2024-04-26T11:47:37.143130+0000","last_fullsized":"2024-04-26T11:47:37.143130+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":886,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142193+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:47:37.142193+0000","last_peered":"2024-04-26T11:47:37.142193+0000","last_clean":"2024-04-26T11:47:37.142193+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:47:37.142193+0000","last_undegraded":"2024-04-26T11:47:37.142193+0000","last_fullsized":"2024-04-26T11:47:37.142193+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":422,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142925+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:37.142925+0000","last_peered":"2024-04-26T11:47:37.142925+0000","last_clean":"2024-04-26T11:47:37.142925+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:37.142925+0000","last_undegraded":"2024-04-26T11:47:37.142925+0000","last_fullsized":"2024-04-26T11:47:37.142925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":937,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141908+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:37.141908+0000","last_peered":"2024-04-26T11:47:37.141908+0000","last_clean":"2024-04-26T11:47:37.141908+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:37.141908+0000","last_undegraded":"2024-04-26T11:47:37.141908+0000","last_fullsized":"2024-04-26T11:47:37.141908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":58,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444770+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:38.444770+0000","last_peered":"2024-04-26T11:47:38.444770+0000","last_clean":"2024-04-26T11:47:38.444770+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:38.444770+0000","last_undegraded":"2024-04-26T11:47:38.444770+0000","last_fullsized":"2024-04-26T11:47:38.444770+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":965,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.160436+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:47:37.160436+0000","last_peered":"2024-04-26T11:47:37.160436+0000","last_clean":"2024-04-26T11:47:37.160436+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:47:37.160436+0000","last_undegraded":"2024-04-26T11:47:37.160436+0000","last_fullsized":"2024-04-26T11:47:37.160436+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.430609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":56,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443823+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:38.443823+0000","last_peered":"2024-04-26T11:47:38.443823+0000","last_clean":"2024-04-26T11:47:38.443823+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:38.443823+0000","last_undegraded":"2024-04-26T11:47:38.443823+0000","last_fullsized":"2024-04-26T11:47:38.443823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1133,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6898,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":120,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738414,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200380,"kb_used_data":88936,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171460,"statfs":{"total":96636764160,"available":96431575040,"internally_reserved":0,"allocated":91070464,"data_stored":90520239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":1,"up_from":72,"seq":309237645319,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133680,"kb_used_data":79912,"kb_used_omap":6,"kb_used_meta":53753,"kb_avail":94238160,"statfs":{"total":96636764160,"available":96499875840,"internally_reserved":0,"allocated":81829888,"data_stored":81301384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":55043328},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190548,"kb_used_data":83204,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181292,"statfs":{"total":96636764160,"available":96441643008,"internally_reserved":0,"allocated":85200896,"data_stored":84662282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:42.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:47:42.725 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:42.725 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1133/108 objects degraded (1049.074%), 7 pgs degraded","count":7},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":223,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":104,"num_osds":3,"num_up_osds":3,"osd_up_since":1714132030,"num_in_osds":3,"osd_in_since":1714131840,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":95},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":6},{"state_name":"peering","count":2},{"state_name":"active+recovering+undersized+degraded+remapped","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127603811,"bytes_used":537198592,"bytes_avail":289373093888,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":1133,"degraded_total":108,"degraded_ratio":10.49074074074074,"recovering_objects_per_sec":324,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1297,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4213}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T11:45:27.979634+0000","services":{}},"progress_events":{}} 2024-04-26T11:47:42.740 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:47:42.741 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:43.050 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:43.051 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:43.065 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-26T11:47:42.158017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1133,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6919,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":524608,"kb_used_data":252052,"kb_used_omap":9,"kb_used_meta":272502,"kb_avail":282590912,"statfs":{"total":289910292480,"available":289373093888,"internally_reserved":0,"allocated":258101248,"data_stored":256483905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":279042188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1312,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1297,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.021649"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":946,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.144027+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:37.144027+0000","last_peered":"2024-04-26T11:47:37.144027+0000","last_clean":"2024-04-26T11:47:37.144027+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:37.144027+0000","last_undegraded":"2024-04-26T11:47:37.144027+0000","last_fullsized":"2024-04-26T11:47:37.144027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":996,"reported_epoch":100,"state":"peering","last_fresh":"2024-04-26T11:47:38.145967+0000","last_change":"2024-04-26T11:47:38.146318+0000","last_active":"2024-04-26T11:47:38.145967+0000","last_peered":"2024-04-26T11:47:37.975880+0000","last_clean":"2024-04-26T11:44:49.186881+0000","last_became_active":"2024-04-26T11:47:12.265845+0000","last_became_peered":"2024-04-26T11:47:12.265845+0000","last_unstale":"2024-04-26T11:47:38.145967+0000","last_undegraded":"2024-04-26T11:47:38.145967+0000","last_fullsized":"2024-04-26T11:47:38.145967+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:32.408332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":509,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143498+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:37.143498+0000","last_peered":"2024-04-26T11:47:37.143498+0000","last_clean":"2024-04-26T11:47:37.143498+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:37.143498+0000","last_undegraded":"2024-04-26T11:47:37.143498+0000","last_fullsized":"2024-04-26T11:47:37.143498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":824,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142676+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:37.142676+0000","last_peered":"2024-04-26T11:47:37.142676+0000","last_clean":"2024-04-26T11:47:37.142676+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:37.142676+0000","last_undegraded":"2024-04-26T11:47:37.142676+0000","last_fullsized":"2024-04-26T11:47:37.142676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":902,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142138+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:47:37.142138+0000","last_peered":"2024-04-26T11:47:37.142138+0000","last_clean":"2024-04-26T11:47:37.142138+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:47:37.142138+0000","last_undegraded":"2024-04-26T11:47:37.142138+0000","last_fullsized":"2024-04-26T11:47:37.142138+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":830,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141449+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:37.141449+0000","last_peered":"2024-04-26T11:47:37.141449+0000","last_clean":"2024-04-26T11:47:37.141449+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:37.141449+0000","last_undegraded":"2024-04-26T11:47:37.141449+0000","last_fullsized":"2024-04-26T11:47:37.141449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":630,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.141607+0000","last_change":"2024-04-26T11:47:12.267740+0000","last_active":"2024-04-26T11:47:37.141607+0000","last_peered":"2024-04-26T11:47:37.141607+0000","last_clean":"2024-04-26T11:44:50.721766+0000","last_became_active":"2024-04-26T11:47:12.266213+0000","last_became_peered":"2024-04-26T11:47:12.266213+0000","last_unstale":"2024-04-26T11:47:37.141607+0000","last_undegraded":"2024-04-26T11:47:12.166427+0000","last_fullsized":"2024-04-26T11:47:12.163681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:35.125096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":824,"reported_epoch":100,"state":"peering","last_fresh":"2024-04-26T11:47:38.144846+0000","last_change":"2024-04-26T11:47:38.145256+0000","last_active":"2024-04-26T11:47:38.144846+0000","last_peered":"2024-04-26T11:47:37.209791+0000","last_clean":"2024-04-26T11:44:50.721108+0000","last_became_active":"2024-04-26T11:47:12.263467+0000","last_became_peered":"2024-04-26T11:47:12.263467+0000","last_unstale":"2024-04-26T11:47:38.144846+0000","last_undegraded":"2024-04-26T11:47:38.144846+0000","last_fullsized":"2024-04-26T11:47:38.144846+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:37.492663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":528,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444579+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:38.444579+0000","last_peered":"2024-04-26T11:47:38.444579+0000","last_clean":"2024-04-26T11:47:38.444579+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:38.444579+0000","last_undegraded":"2024-04-26T11:47:38.444579+0000","last_fullsized":"2024-04-26T11:47:38.444579+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":945,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142851+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:47:37.142851+0000","last_peered":"2024-04-26T11:47:37.142851+0000","last_clean":"2024-04-26T11:47:37.142851+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:47:37.142851+0000","last_undegraded":"2024-04-26T11:47:37.142851+0000","last_fullsized":"2024-04-26T11:47:37.142851+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:32.091133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":858,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143022+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:37.143022+0000","last_peered":"2024-04-26T11:47:37.143022+0000","last_clean":"2024-04-26T11:47:37.143022+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:37.143022+0000","last_undegraded":"2024-04-26T11:47:37.143022+0000","last_fullsized":"2024-04-26T11:47:37.143022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":476,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142090+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:37.142090+0000","last_peered":"2024-04-26T11:47:37.142090+0000","last_clean":"2024-04-26T11:47:37.142090+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:37.142090+0000","last_undegraded":"2024-04-26T11:47:37.142090+0000","last_fullsized":"2024-04-26T11:47:37.142090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":878,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141646+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:37.141646+0000","last_peered":"2024-04-26T11:47:37.141646+0000","last_clean":"2024-04-26T11:47:37.141646+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:37.141646+0000","last_undegraded":"2024-04-26T11:47:37.141646+0000","last_fullsized":"2024-04-26T11:47:37.141646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":548,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141464+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:37.141464+0000","last_peered":"2024-04-26T11:47:37.141464+0000","last_clean":"2024-04-26T11:47:37.141464+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:37.141464+0000","last_undegraded":"2024-04-26T11:47:37.141464+0000","last_fullsized":"2024-04-26T11:47:37.141464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":590,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141517+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:37.141517+0000","last_peered":"2024-04-26T11:47:37.141517+0000","last_clean":"2024-04-26T11:47:37.141517+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:37.141517+0000","last_undegraded":"2024-04-26T11:47:37.141517+0000","last_fullsized":"2024-04-26T11:47:37.141517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1037,"reported_epoch":100,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:38.755976+0000","last_change":"2024-04-26T11:47:38.756418+0000","last_active":"2024-04-26T11:47:38.755976+0000","last_peered":"2024-04-26T11:47:38.755976+0000","last_clean":"2024-04-26T11:44:50.721219+0000","last_became_active":"2024-04-26T11:47:12.263490+0000","last_became_peered":"2024-04-26T11:47:12.263490+0000","last_unstale":"2024-04-26T11:47:38.755976+0000","last_undegraded":"2024-04-26T11:47:12.164745+0000","last_fullsized":"2024-04-26T11:47:12.156260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:01.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":496,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444392+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:38.444392+0000","last_peered":"2024-04-26T11:47:38.444392+0000","last_clean":"2024-04-26T11:47:38.444392+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:38.444392+0000","last_undegraded":"2024-04-26T11:47:38.444392+0000","last_fullsized":"2024-04-26T11:47:38.444392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":910,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.156085+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:47:38.156085+0000","last_peered":"2024-04-26T11:47:38.156085+0000","last_clean":"2024-04-26T11:47:38.156085+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:47:38.156085+0000","last_undegraded":"2024-04-26T11:47:38.156085+0000","last_fullsized":"2024-04-26T11:47:38.156085+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:10.908191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":546,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.142309+0000","last_change":"2024-04-26T11:47:12.693919+0000","last_active":"2024-04-26T11:47:37.142309+0000","last_peered":"2024-04-26T11:47:37.142309+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.229588+0000","last_became_peered":"2024-04-26T11:47:12.229588+0000","last_unstale":"2024-04-26T11:47:37.142309+0000","last_undegraded":"2024-04-26T11:47:12.159252+0000","last_fullsized":"2024-04-26T11:47:12.147119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:04.600089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-14}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":999,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142842+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:37.142842+0000","last_peered":"2024-04-26T11:47:37.142842+0000","last_clean":"2024-04-26T11:47:37.142842+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:37.142842+0000","last_undegraded":"2024-04-26T11:47:37.142842+0000","last_fullsized":"2024-04-26T11:47:37.142842+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":913,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142020+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:47:37.142020+0000","last_peered":"2024-04-26T11:47:37.142020+0000","last_clean":"2024-04-26T11:47:37.142020+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:47:37.142020+0000","last_undegraded":"2024-04-26T11:47:37.142020+0000","last_fullsized":"2024-04-26T11:47:37.142020+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:16.863281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":562,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141457+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:37.141457+0000","last_peered":"2024-04-26T11:47:37.141457+0000","last_clean":"2024-04-26T11:47:37.141457+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:37.141457+0000","last_undegraded":"2024-04-26T11:47:37.141457+0000","last_fullsized":"2024-04-26T11:47:37.141457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":501,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441774+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:47:38.441774+0000","last_peered":"2024-04-26T11:47:38.441774+0000","last_clean":"2024-04-26T11:47:38.441774+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:47:38.441774+0000","last_undegraded":"2024-04-26T11:47:38.441774+0000","last_fullsized":"2024-04-26T11:47:38.441774+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1017,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.159937+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:47:37.159937+0000","last_peered":"2024-04-26T11:47:37.159937+0000","last_clean":"2024-04-26T11:47:37.159937+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:47:37.159937+0000","last_undegraded":"2024-04-26T11:47:37.159937+0000","last_fullsized":"2024-04-26T11:47:37.159937+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":498,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.144099+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:37.144099+0000","last_peered":"2024-04-26T11:47:37.144099+0000","last_clean":"2024-04-26T11:47:37.144099+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:37.144099+0000","last_undegraded":"2024-04-26T11:47:37.144099+0000","last_fullsized":"2024-04-26T11:47:37.144099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":642,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.143553+0000","last_change":"2024-04-26T11:47:12.266735+0000","last_active":"2024-04-26T11:47:37.143553+0000","last_peered":"2024-04-26T11:47:37.143553+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.264258+0000","last_became_peered":"2024-04-26T11:47:12.264258+0000","last_unstale":"2024-04-26T11:47:37.143553+0000","last_undegraded":"2024-04-26T11:47:12.166698+0000","last_fullsized":"2024-04-26T11:47:12.157854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:36.205262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-12}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":500,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143248+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:37.143248+0000","last_peered":"2024-04-26T11:47:37.143248+0000","last_clean":"2024-04-26T11:47:37.143248+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:37.143248+0000","last_undegraded":"2024-04-26T11:47:37.143248+0000","last_fullsized":"2024-04-26T11:47:37.143248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":581,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142412+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:37.142412+0000","last_peered":"2024-04-26T11:47:37.142412+0000","last_clean":"2024-04-26T11:47:37.142412+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:37.142412+0000","last_undegraded":"2024-04-26T11:47:37.142412+0000","last_fullsized":"2024-04-26T11:47:37.142412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":494,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442885+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:47:38.442885+0000","last_peered":"2024-04-26T11:47:38.442885+0000","last_clean":"2024-04-26T11:47:38.442885+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:47:38.442885+0000","last_undegraded":"2024-04-26T11:47:38.442885+0000","last_fullsized":"2024-04-26T11:47:38.442885+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":610,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141920+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:37.141920+0000","last_peered":"2024-04-26T11:47:37.141920+0000","last_clean":"2024-04-26T11:47:37.141920+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:37.141920+0000","last_undegraded":"2024-04-26T11:47:37.141920+0000","last_fullsized":"2024-04-26T11:47:37.141920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":559,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442195+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:47:38.442195+0000","last_peered":"2024-04-26T11:47:38.442195+0000","last_clean":"2024-04-26T11:47:38.442195+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:47:38.442195+0000","last_undegraded":"2024-04-26T11:47:38.442195+0000","last_fullsized":"2024-04-26T11:47:38.442195+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":543,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.141587+0000","last_change":"2024-04-26T11:47:12.267820+0000","last_active":"2024-04-26T11:47:37.141587+0000","last_peered":"2024-04-26T11:47:37.141587+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:37.141587+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":489,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.142435+0000","last_change":"2024-04-26T11:47:12.834105+0000","last_active":"2024-04-26T11:47:37.142435+0000","last_peered":"2024-04-26T11:47:37.142435+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:37.142435+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":608,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142280+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:37.142280+0000","last_peered":"2024-04-26T11:47:37.142280+0000","last_clean":"2024-04-26T11:47:37.142280+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:37.142280+0000","last_undegraded":"2024-04-26T11:47:37.142280+0000","last_fullsized":"2024-04-26T11:47:37.142280+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":600,"reported_epoch":99,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:37.142924+0000","last_change":"2024-04-26T11:47:12.760651+0000","last_active":"2024-04-26T11:47:37.142924+0000","last_peered":"2024-04-26T11:47:37.142924+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:37.142924+0000","last_undegraded":"2024-04-26T11:47:12.159337+0000","last_fullsized":"2024-04-26T11:47:12.148329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:40.790358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442696+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:38.442696+0000","last_peered":"2024-04-26T11:47:38.442696+0000","last_clean":"2024-04-26T11:47:38.442696+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:38.442696+0000","last_undegraded":"2024-04-26T11:47:38.442696+0000","last_fullsized":"2024-04-26T11:47:38.442696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":501,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443985+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:47:38.443985+0000","last_peered":"2024-04-26T11:47:38.443985+0000","last_clean":"2024-04-26T11:47:38.443985+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:47:38.443985+0000","last_undegraded":"2024-04-26T11:47:38.443985+0000","last_fullsized":"2024-04-26T11:47:38.443985+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":153,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141644+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:37.141644+0000","last_peered":"2024-04-26T11:47:37.141644+0000","last_clean":"2024-04-26T11:47:37.141644+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:37.141644+0000","last_undegraded":"2024-04-26T11:47:37.141644+0000","last_fullsized":"2024-04-26T11:47:37.141644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":536,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444027+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:38.444027+0000","last_peered":"2024-04-26T11:47:38.444027+0000","last_clean":"2024-04-26T11:47:38.444027+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:38.444027+0000","last_undegraded":"2024-04-26T11:47:38.444027+0000","last_fullsized":"2024-04-26T11:47:38.444027+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":160,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141393+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:37.141393+0000","last_peered":"2024-04-26T11:47:37.141393+0000","last_clean":"2024-04-26T11:47:37.141393+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:37.141393+0000","last_undegraded":"2024-04-26T11:47:37.141393+0000","last_fullsized":"2024-04-26T11:47:37.141393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":307,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143845+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:37.143845+0000","last_peered":"2024-04-26T11:47:37.143845+0000","last_clean":"2024-04-26T11:47:37.143845+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:37.143845+0000","last_undegraded":"2024-04-26T11:47:37.143845+0000","last_fullsized":"2024-04-26T11:47:37.143845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":525,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141095+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:37.141095+0000","last_peered":"2024-04-26T11:47:37.141095+0000","last_clean":"2024-04-26T11:47:37.141095+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:37.141095+0000","last_undegraded":"2024-04-26T11:47:37.141095+0000","last_fullsized":"2024-04-26T11:47:37.141095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":485,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143761+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:37.143761+0000","last_peered":"2024-04-26T11:47:37.143761+0000","last_clean":"2024-04-26T11:47:37.143761+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:37.143761+0000","last_undegraded":"2024-04-26T11:47:37.143761+0000","last_fullsized":"2024-04-26T11:47:37.143761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1016,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141179+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:47:37.141179+0000","last_peered":"2024-04-26T11:47:37.141179+0000","last_clean":"2024-04-26T11:47:37.141179+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:47:37.141179+0000","last_undegraded":"2024-04-26T11:47:37.141179+0000","last_fullsized":"2024-04-26T11:47:37.141179+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":679,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143895+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:37.143895+0000","last_peered":"2024-04-26T11:47:37.143895+0000","last_clean":"2024-04-26T11:47:37.143895+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:37.143895+0000","last_undegraded":"2024-04-26T11:47:37.143895+0000","last_fullsized":"2024-04-26T11:47:37.143895+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1000,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141727+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:37.141727+0000","last_peered":"2024-04-26T11:47:37.141727+0000","last_clean":"2024-04-26T11:47:37.141727+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:37.141727+0000","last_undegraded":"2024-04-26T11:47:37.141727+0000","last_fullsized":"2024-04-26T11:47:37.141727+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":168,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143379+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:37.143379+0000","last_peered":"2024-04-26T11:47:37.143379+0000","last_clean":"2024-04-26T11:47:37.143379+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:37.143379+0000","last_undegraded":"2024-04-26T11:47:37.143379+0000","last_fullsized":"2024-04-26T11:47:37.143379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":606,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443717+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:38.443717+0000","last_peered":"2024-04-26T11:47:38.443717+0000","last_clean":"2024-04-26T11:47:38.443717+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:38.443717+0000","last_undegraded":"2024-04-26T11:47:38.443717+0000","last_fullsized":"2024-04-26T11:47:38.443717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":358,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443138+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:38.443138+0000","last_peered":"2024-04-26T11:47:38.443138+0000","last_clean":"2024-04-26T11:47:38.443138+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:38.443138+0000","last_undegraded":"2024-04-26T11:47:38.443138+0000","last_fullsized":"2024-04-26T11:47:38.443138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":947,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142981+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:47:37.142981+0000","last_peered":"2024-04-26T11:47:37.142981+0000","last_clean":"2024-04-26T11:47:37.142981+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:47:37.142981+0000","last_undegraded":"2024-04-26T11:47:37.142981+0000","last_fullsized":"2024-04-26T11:47:37.142981+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":268,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142192+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:37.142192+0000","last_peered":"2024-04-26T11:47:37.142192+0000","last_clean":"2024-04-26T11:47:37.142192+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:37.142192+0000","last_undegraded":"2024-04-26T11:47:37.142192+0000","last_fullsized":"2024-04-26T11:47:37.142192+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":533,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143670+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:37.143670+0000","last_peered":"2024-04-26T11:47:37.143670+0000","last_clean":"2024-04-26T11:47:37.143670+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:37.143670+0000","last_undegraded":"2024-04-26T11:47:37.143670+0000","last_fullsized":"2024-04-26T11:47:37.143670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":147,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141537+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:37.141537+0000","last_peered":"2024-04-26T11:47:37.141537+0000","last_clean":"2024-04-26T11:47:37.141537+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:37.141537+0000","last_undegraded":"2024-04-26T11:47:37.141537+0000","last_fullsized":"2024-04-26T11:47:37.141537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":471,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143378+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:37.143378+0000","last_peered":"2024-04-26T11:47:37.143378+0000","last_clean":"2024-04-26T11:47:37.143378+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:37.143378+0000","last_undegraded":"2024-04-26T11:47:37.143378+0000","last_fullsized":"2024-04-26T11:47:37.143378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141414+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:37.141414+0000","last_peered":"2024-04-26T11:47:37.141414+0000","last_clean":"2024-04-26T11:47:37.141414+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:37.141414+0000","last_undegraded":"2024-04-26T11:47:37.141414+0000","last_fullsized":"2024-04-26T11:47:37.141414+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":511,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.445171+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:47:38.445171+0000","last_peered":"2024-04-26T11:47:38.445171+0000","last_clean":"2024-04-26T11:47:38.445171+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:47:38.445171+0000","last_undegraded":"2024-04-26T11:47:38.445171+0000","last_fullsized":"2024-04-26T11:47:38.445171+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":295,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142224+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:37.142224+0000","last_peered":"2024-04-26T11:47:37.142224+0000","last_clean":"2024-04-26T11:47:37.142224+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:37.142224+0000","last_undegraded":"2024-04-26T11:47:37.142224+0000","last_fullsized":"2024-04-26T11:47:37.142224+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142527+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:37.142527+0000","last_peered":"2024-04-26T11:47:37.142527+0000","last_clean":"2024-04-26T11:47:37.142527+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:37.142527+0000","last_undegraded":"2024-04-26T11:47:37.142527+0000","last_fullsized":"2024-04-26T11:47:37.142527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":600,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442942+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:38.442942+0000","last_peered":"2024-04-26T11:47:38.442942+0000","last_clean":"2024-04-26T11:47:38.442942+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:38.442942+0000","last_undegraded":"2024-04-26T11:47:38.442942+0000","last_fullsized":"2024-04-26T11:47:38.442942+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":559,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143743+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:37.143743+0000","last_peered":"2024-04-26T11:47:37.143743+0000","last_clean":"2024-04-26T11:47:37.143743+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:37.143743+0000","last_undegraded":"2024-04-26T11:47:37.143743+0000","last_fullsized":"2024-04-26T11:47:37.143743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141981+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:37.141981+0000","last_peered":"2024-04-26T11:47:37.141981+0000","last_clean":"2024-04-26T11:47:37.141981+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:37.141981+0000","last_undegraded":"2024-04-26T11:47:37.141981+0000","last_fullsized":"2024-04-26T11:47:37.141981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":352,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441461+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:38.441461+0000","last_peered":"2024-04-26T11:47:38.441461+0000","last_clean":"2024-04-26T11:47:38.441461+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:38.441461+0000","last_undegraded":"2024-04-26T11:47:38.441461+0000","last_fullsized":"2024-04-26T11:47:38.441461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":983,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143547+0000","last_change":"2024-04-26T11:47:34.145286+0000","last_active":"2024-04-26T11:47:37.143547+0000","last_peered":"2024-04-26T11:47:37.143547+0000","last_clean":"2024-04-26T11:47:37.143547+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:47:37.143547+0000","last_undegraded":"2024-04-26T11:47:37.143547+0000","last_fullsized":"2024-04-26T11:47:37.143547+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:13.918331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441974+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:38.441974+0000","last_peered":"2024-04-26T11:47:38.441974+0000","last_clean":"2024-04-26T11:47:38.441974+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:38.441974+0000","last_undegraded":"2024-04-26T11:47:38.441974+0000","last_fullsized":"2024-04-26T11:47:38.441974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":516,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141653+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:37.141653+0000","last_peered":"2024-04-26T11:47:37.141653+0000","last_clean":"2024-04-26T11:47:37.141653+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:37.141653+0000","last_undegraded":"2024-04-26T11:47:37.141653+0000","last_fullsized":"2024-04-26T11:47:37.141653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":444,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.445072+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:38.445072+0000","last_peered":"2024-04-26T11:47:38.445072+0000","last_clean":"2024-04-26T11:47:38.445072+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:38.445072+0000","last_undegraded":"2024-04-26T11:47:38.445072+0000","last_fullsized":"2024-04-26T11:47:38.445072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142419+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:37.142419+0000","last_peered":"2024-04-26T11:47:37.142419+0000","last_clean":"2024-04-26T11:47:37.142419+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:37.142419+0000","last_undegraded":"2024-04-26T11:47:37.142419+0000","last_fullsized":"2024-04-26T11:47:37.142419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142349+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:37.142349+0000","last_peered":"2024-04-26T11:47:37.142349+0000","last_clean":"2024-04-26T11:47:37.142349+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:37.142349+0000","last_undegraded":"2024-04-26T11:47:37.142349+0000","last_fullsized":"2024-04-26T11:47:37.142349+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":488,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443305+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:47:38.443305+0000","last_peered":"2024-04-26T11:47:38.443305+0000","last_clean":"2024-04-26T11:47:38.443305+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:47:38.443305+0000","last_undegraded":"2024-04-26T11:47:38.443305+0000","last_fullsized":"2024-04-26T11:47:38.443305+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":630,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143995+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:37.143995+0000","last_peered":"2024-04-26T11:47:37.143995+0000","last_clean":"2024-04-26T11:47:37.143995+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:37.143995+0000","last_undegraded":"2024-04-26T11:47:37.143995+0000","last_fullsized":"2024-04-26T11:47:37.143995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443047+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:38.443047+0000","last_peered":"2024-04-26T11:47:38.443047+0000","last_clean":"2024-04-26T11:47:38.443047+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:38.443047+0000","last_undegraded":"2024-04-26T11:47:38.443047+0000","last_fullsized":"2024-04-26T11:47:38.443047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":471,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141685+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:37.141685+0000","last_peered":"2024-04-26T11:47:37.141685+0000","last_clean":"2024-04-26T11:47:37.141685+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:37.141685+0000","last_undegraded":"2024-04-26T11:47:37.141685+0000","last_fullsized":"2024-04-26T11:47:37.141685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443559+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:38.443559+0000","last_peered":"2024-04-26T11:47:38.443559+0000","last_clean":"2024-04-26T11:47:38.443559+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:38.443559+0000","last_undegraded":"2024-04-26T11:47:38.443559+0000","last_fullsized":"2024-04-26T11:47:38.443559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143639+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:37.143639+0000","last_peered":"2024-04-26T11:47:37.143639+0000","last_clean":"2024-04-26T11:47:37.143639+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:37.143639+0000","last_undegraded":"2024-04-26T11:47:37.143639+0000","last_fullsized":"2024-04-26T11:47:37.143639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":512,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141879+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:37.141879+0000","last_peered":"2024-04-26T11:47:37.141879+0000","last_clean":"2024-04-26T11:47:37.141879+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:37.141879+0000","last_undegraded":"2024-04-26T11:47:37.141879+0000","last_fullsized":"2024-04-26T11:47:37.141879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444214+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:38.444214+0000","last_peered":"2024-04-26T11:47:38.444214+0000","last_clean":"2024-04-26T11:47:38.444214+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:38.444214+0000","last_undegraded":"2024-04-26T11:47:38.444214+0000","last_fullsized":"2024-04-26T11:47:38.444214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443516+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:38.443516+0000","last_peered":"2024-04-26T11:47:38.443516+0000","last_clean":"2024-04-26T11:47:38.443516+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:38.443516+0000","last_undegraded":"2024-04-26T11:47:38.443516+0000","last_fullsized":"2024-04-26T11:47:38.443516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":469,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442502+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:47:38.442502+0000","last_peered":"2024-04-26T11:47:38.442502+0000","last_clean":"2024-04-26T11:47:38.442502+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:47:38.442502+0000","last_undegraded":"2024-04-26T11:47:38.442502+0000","last_fullsized":"2024-04-26T11:47:38.442502+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:47.076399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":64,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443767+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:38.443767+0000","last_peered":"2024-04-26T11:47:38.443767+0000","last_clean":"2024-04-26T11:47:38.443767+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:38.443767+0000","last_undegraded":"2024-04-26T11:47:38.443767+0000","last_fullsized":"2024-04-26T11:47:38.443767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143996+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:37.143996+0000","last_peered":"2024-04-26T11:47:37.143996+0000","last_clean":"2024-04-26T11:47:37.143996+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:37.143996+0000","last_undegraded":"2024-04-26T11:47:37.143996+0000","last_fullsized":"2024-04-26T11:47:37.143996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":545,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141150+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:37.141150+0000","last_peered":"2024-04-26T11:47:37.141150+0000","last_clean":"2024-04-26T11:47:37.141150+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:37.141150+0000","last_undegraded":"2024-04-26T11:47:37.141150+0000","last_fullsized":"2024-04-26T11:47:37.141150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":557,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141867+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:37.141867+0000","last_peered":"2024-04-26T11:47:37.141867+0000","last_clean":"2024-04-26T11:47:37.141867+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:37.141867+0000","last_undegraded":"2024-04-26T11:47:37.141867+0000","last_fullsized":"2024-04-26T11:47:37.141867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":504,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143221+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:37.143221+0000","last_peered":"2024-04-26T11:47:37.143221+0000","last_clean":"2024-04-26T11:47:37.143221+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:37.143221+0000","last_undegraded":"2024-04-26T11:47:37.143221+0000","last_fullsized":"2024-04-26T11:47:37.143221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":532,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.442329+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:47:38.442329+0000","last_peered":"2024-04-26T11:47:38.442329+0000","last_clean":"2024-04-26T11:47:38.442329+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:47:38.442329+0000","last_undegraded":"2024-04-26T11:47:38.442329+0000","last_fullsized":"2024-04-26T11:47:38.442329+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":196,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143471+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:37.143471+0000","last_peered":"2024-04-26T11:47:37.143471+0000","last_clean":"2024-04-26T11:47:37.143471+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:37.143471+0000","last_undegraded":"2024-04-26T11:47:37.143471+0000","last_fullsized":"2024-04-26T11:47:37.143471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":451,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143622+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:37.143622+0000","last_peered":"2024-04-26T11:47:37.143622+0000","last_clean":"2024-04-26T11:47:37.143622+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:37.143622+0000","last_undegraded":"2024-04-26T11:47:37.143622+0000","last_fullsized":"2024-04-26T11:47:37.143622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":565,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441780+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:47:38.441780+0000","last_peered":"2024-04-26T11:47:38.441780+0000","last_clean":"2024-04-26T11:47:38.441780+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:47:38.441780+0000","last_undegraded":"2024-04-26T11:47:38.441780+0000","last_fullsized":"2024-04-26T11:47:38.441780+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444767+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:38.444767+0000","last_peered":"2024-04-26T11:47:38.444767+0000","last_clean":"2024-04-26T11:47:38.444767+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:38.444767+0000","last_undegraded":"2024-04-26T11:47:38.444767+0000","last_fullsized":"2024-04-26T11:47:38.444767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":729,"reported_epoch":100,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T11:47:39.052613+0000","last_change":"2024-04-26T11:47:38.757381+0000","last_active":"2024-04-26T11:47:39.052613+0000","last_peered":"2024-04-26T11:47:39.052613+0000","last_clean":"2024-04-26T11:44:21.039002+0000","last_became_active":"2024-04-26T11:47:12.272048+0000","last_became_peered":"2024-04-26T11:47:12.272048+0000","last_unstale":"2024-04-26T11:47:39.052613+0000","last_undegraded":"2024-04-26T11:47:12.167802+0000","last_fullsized":"2024-04-26T11:47:12.164705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:40.489860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":-9}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":503,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.144251+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:37.144251+0000","last_peered":"2024-04-26T11:47:37.144251+0000","last_clean":"2024-04-26T11:47:37.144251+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:37.144251+0000","last_undegraded":"2024-04-26T11:47:37.144251+0000","last_fullsized":"2024-04-26T11:47:37.144251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":861,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441406+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:38.441406+0000","last_peered":"2024-04-26T11:47:38.441406+0000","last_clean":"2024-04-26T11:47:38.441406+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:38.441406+0000","last_undegraded":"2024-04-26T11:47:38.441406+0000","last_fullsized":"2024-04-26T11:47:38.441406+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":484,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444314+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:47:38.444314+0000","last_peered":"2024-04-26T11:47:38.444314+0000","last_clean":"2024-04-26T11:47:38.444314+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:47:38.444314+0000","last_undegraded":"2024-04-26T11:47:38.444314+0000","last_fullsized":"2024-04-26T11:47:38.444314+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":418,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.441505+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:38.441505+0000","last_peered":"2024-04-26T11:47:38.441505+0000","last_clean":"2024-04-26T11:47:38.441505+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:38.441505+0000","last_undegraded":"2024-04-26T11:47:38.441505+0000","last_fullsized":"2024-04-26T11:47:38.441505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":524,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142695+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:37.142695+0000","last_peered":"2024-04-26T11:47:37.142695+0000","last_clean":"2024-04-26T11:47:37.142695+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:37.142695+0000","last_undegraded":"2024-04-26T11:47:37.142695+0000","last_fullsized":"2024-04-26T11:47:37.142695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":473,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142315+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:37.142315+0000","last_peered":"2024-04-26T11:47:37.142315+0000","last_clean":"2024-04-26T11:47:37.142315+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:37.142315+0000","last_undegraded":"2024-04-26T11:47:37.142315+0000","last_fullsized":"2024-04-26T11:47:37.142315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":839,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142195+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:37.142195+0000","last_peered":"2024-04-26T11:47:37.142195+0000","last_clean":"2024-04-26T11:47:37.142195+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:37.142195+0000","last_undegraded":"2024-04-26T11:47:37.142195+0000","last_fullsized":"2024-04-26T11:47:37.142195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":150,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142580+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:37.142580+0000","last_peered":"2024-04-26T11:47:37.142580+0000","last_clean":"2024-04-26T11:47:37.142580+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:37.142580+0000","last_undegraded":"2024-04-26T11:47:37.142580+0000","last_fullsized":"2024-04-26T11:47:37.142580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":869,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141744+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:47:37.141744+0000","last_peered":"2024-04-26T11:47:37.141744+0000","last_clean":"2024-04-26T11:47:37.141744+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:47:37.141744+0000","last_undegraded":"2024-04-26T11:47:37.141744+0000","last_fullsized":"2024-04-26T11:47:37.141744+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":393,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.143130+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:37.143130+0000","last_peered":"2024-04-26T11:47:37.143130+0000","last_clean":"2024-04-26T11:47:37.143130+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:37.143130+0000","last_undegraded":"2024-04-26T11:47:37.143130+0000","last_fullsized":"2024-04-26T11:47:37.143130+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":886,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142193+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:47:37.142193+0000","last_peered":"2024-04-26T11:47:37.142193+0000","last_clean":"2024-04-26T11:47:37.142193+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:47:37.142193+0000","last_undegraded":"2024-04-26T11:47:37.142193+0000","last_fullsized":"2024-04-26T11:47:37.142193+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":422,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.142925+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:37.142925+0000","last_peered":"2024-04-26T11:47:37.142925+0000","last_clean":"2024-04-26T11:47:37.142925+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:37.142925+0000","last_undegraded":"2024-04-26T11:47:37.142925+0000","last_fullsized":"2024-04-26T11:47:37.142925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":937,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.141908+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:37.141908+0000","last_peered":"2024-04-26T11:47:37.141908+0000","last_clean":"2024-04-26T11:47:37.141908+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:37.141908+0000","last_undegraded":"2024-04-26T11:47:37.141908+0000","last_fullsized":"2024-04-26T11:47:37.141908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":58,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.444770+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:38.444770+0000","last_peered":"2024-04-26T11:47:38.444770+0000","last_clean":"2024-04-26T11:47:38.444770+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:38.444770+0000","last_undegraded":"2024-04-26T11:47:38.444770+0000","last_fullsized":"2024-04-26T11:47:38.444770+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":965,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:47:37.160436+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:47:37.160436+0000","last_peered":"2024-04-26T11:47:37.160436+0000","last_clean":"2024-04-26T11:47:37.160436+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:47:37.160436+0000","last_undegraded":"2024-04-26T11:47:37.160436+0000","last_fullsized":"2024-04-26T11:47:37.160436+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.430609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":56,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:47:38.443823+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:38.443823+0000","last_peered":"2024-04-26T11:47:38.443823+0000","last_clean":"2024-04-26T11:47:38.443823+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:38.443823+0000","last_undegraded":"2024-04-26T11:47:38.443823+0000","last_fullsized":"2024-04-26T11:47:38.443823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1133,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6898,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":120,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738414,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200380,"kb_used_data":88936,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171460,"statfs":{"total":96636764160,"available":96431575040,"internally_reserved":0,"allocated":91070464,"data_stored":90520239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":1,"up_from":72,"seq":309237645319,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133680,"kb_used_data":79912,"kb_used_omap":6,"kb_used_meta":53753,"kb_avail":94238160,"statfs":{"total":96636764160,"available":96499875840,"internally_reserved":0,"allocated":81829888,"data_stored":81301384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":55043328},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190548,"kb_used_data":83204,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181292,"statfs":{"total":96636764160,"available":96441643008,"internally_reserved":0,"allocated":85200896,"data_stored":84662282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:46.071 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:46.399 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:46.401 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:46.413 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-04-26T11:47:46.048543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516548,"kb_used_data":252188,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598972,"statfs":{"total":289910292480,"available":289381347328,"internally_reserved":0,"allocated":258240512,"data_stored":256545078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1133,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001395"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":951,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170243+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:42.170243+0000","last_peered":"2024-04-26T11:47:42.170243+0000","last_clean":"2024-04-26T11:47:42.170243+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:42.170243+0000","last_undegraded":"2024-04-26T11:47:42.170243+0000","last_fullsized":"2024-04-26T11:47:42.170243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1008,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169066+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:47:42.169066+0000","last_peered":"2024-04-26T11:47:42.169066+0000","last_clean":"2024-04-26T11:47:42.169066+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:47:42.169066+0000","last_undegraded":"2024-04-26T11:47:42.169066+0000","last_fullsized":"2024-04-26T11:47:42.169066+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:25.339699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":514,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165824+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:42.165824+0000","last_peered":"2024-04-26T11:47:42.165824+0000","last_clean":"2024-04-26T11:47:42.165824+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:42.165824+0000","last_undegraded":"2024-04-26T11:47:42.165824+0000","last_fullsized":"2024-04-26T11:47:42.165824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":829,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165621+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:42.165621+0000","last_peered":"2024-04-26T11:47:42.165621+0000","last_clean":"2024-04-26T11:47:42.165621+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:42.165621+0000","last_undegraded":"2024-04-26T11:47:42.165621+0000","last_fullsized":"2024-04-26T11:47:42.165621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":907,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170247+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:47:42.170247+0000","last_peered":"2024-04-26T11:47:42.170247+0000","last_clean":"2024-04-26T11:47:42.170247+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:47:42.170247+0000","last_undegraded":"2024-04-26T11:47:42.170247+0000","last_fullsized":"2024-04-26T11:47:42.170247+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":835,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164558+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:42.164558+0000","last_peered":"2024-04-26T11:47:42.164558+0000","last_clean":"2024-04-26T11:47:42.164558+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:42.164558+0000","last_undegraded":"2024-04-26T11:47:42.164558+0000","last_fullsized":"2024-04-26T11:47:42.164558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1027,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.186603+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:47:43.186603+0000","last_peered":"2024-04-26T11:47:43.186603+0000","last_clean":"2024-04-26T11:47:43.186603+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:47:43.186603+0000","last_undegraded":"2024-04-26T11:47:43.186603+0000","last_fullsized":"2024-04-26T11:47:43.186603+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:59.926464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":836,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164153+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:47:42.164153+0000","last_peered":"2024-04-26T11:47:42.164153+0000","last_clean":"2024-04-26T11:47:42.164153+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:47:42.164153+0000","last_undegraded":"2024-04-26T11:47:42.164153+0000","last_fullsized":"2024-04-26T11:47:42.164153+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:56.834748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":533,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474932+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:43.474932+0000","last_peered":"2024-04-26T11:47:43.474932+0000","last_clean":"2024-04-26T11:47:43.474932+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:43.474932+0000","last_undegraded":"2024-04-26T11:47:43.474932+0000","last_fullsized":"2024-04-26T11:47:43.474932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":950,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169365+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:47:42.169365+0000","last_peered":"2024-04-26T11:47:42.169365+0000","last_clean":"2024-04-26T11:47:42.169365+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:47:42.169365+0000","last_undegraded":"2024-04-26T11:47:42.169365+0000","last_fullsized":"2024-04-26T11:47:42.169365+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:32.091133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":863,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166003+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:42.166003+0000","last_peered":"2024-04-26T11:47:42.166003+0000","last_clean":"2024-04-26T11:47:42.166003+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:42.166003+0000","last_undegraded":"2024-04-26T11:47:42.166003+0000","last_fullsized":"2024-04-26T11:47:42.166003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":481,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168993+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:42.168993+0000","last_peered":"2024-04-26T11:47:42.168993+0000","last_clean":"2024-04-26T11:47:42.168993+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:42.168993+0000","last_undegraded":"2024-04-26T11:47:42.168993+0000","last_fullsized":"2024-04-26T11:47:42.168993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":883,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170098+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:42.170098+0000","last_peered":"2024-04-26T11:47:42.170098+0000","last_clean":"2024-04-26T11:47:42.170098+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:42.170098+0000","last_undegraded":"2024-04-26T11:47:42.170098+0000","last_fullsized":"2024-04-26T11:47:42.170098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":553,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164833+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:42.164833+0000","last_peered":"2024-04-26T11:47:42.164833+0000","last_clean":"2024-04-26T11:47:42.164833+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:42.164833+0000","last_undegraded":"2024-04-26T11:47:42.164833+0000","last_fullsized":"2024-04-26T11:47:42.164833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":595,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165134+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:42.165134+0000","last_peered":"2024-04-26T11:47:42.165134+0000","last_clean":"2024-04-26T11:47:42.165134+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:42.165134+0000","last_undegraded":"2024-04-26T11:47:42.165134+0000","last_fullsized":"2024-04-26T11:47:42.165134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1050,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164317+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:47:42.164317+0000","last_peered":"2024-04-26T11:47:42.164317+0000","last_clean":"2024-04-26T11:47:42.164317+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:47:42.164317+0000","last_undegraded":"2024-04-26T11:47:42.164317+0000","last_fullsized":"2024-04-26T11:47:42.164317+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:50.720876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":501,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474668+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:43.474668+0000","last_peered":"2024-04-26T11:47:43.474668+0000","last_clean":"2024-04-26T11:47:43.474668+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:43.474668+0000","last_undegraded":"2024-04-26T11:47:43.474668+0000","last_fullsized":"2024-04-26T11:47:43.474668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":915,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169799+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:47:42.169799+0000","last_peered":"2024-04-26T11:47:42.169799+0000","last_clean":"2024-04-26T11:47:42.169799+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:47:42.169799+0000","last_undegraded":"2024-04-26T11:47:42.169799+0000","last_fullsized":"2024-04-26T11:47:42.169799+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:10.908191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":522,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474086+0000","last_change":"2024-04-26T11:47:42.470100+0000","last_active":"2024-04-26T11:47:43.474086+0000","last_peered":"2024-04-26T11:47:43.474086+0000","last_clean":"2024-04-26T11:47:43.474086+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:47:43.474086+0000","last_undegraded":"2024-04-26T11:47:43.474086+0000","last_fullsized":"2024-04-26T11:47:43.474086+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:37.523362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1004,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165657+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:42.165657+0000","last_peered":"2024-04-26T11:47:42.165657+0000","last_clean":"2024-04-26T11:47:42.165657+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:42.165657+0000","last_undegraded":"2024-04-26T11:47:42.165657+0000","last_fullsized":"2024-04-26T11:47:42.165657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":918,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165853+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:47:42.165853+0000","last_peered":"2024-04-26T11:47:42.165853+0000","last_clean":"2024-04-26T11:47:42.165853+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:47:42.165853+0000","last_undegraded":"2024-04-26T11:47:42.165853+0000","last_fullsized":"2024-04-26T11:47:42.165853+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:16.863281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":567,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168649+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:42.168649+0000","last_peered":"2024-04-26T11:47:42.168649+0000","last_clean":"2024-04-26T11:47:42.168649+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:42.168649+0000","last_undegraded":"2024-04-26T11:47:42.168649+0000","last_fullsized":"2024-04-26T11:47:42.168649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":506,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472251+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:47:43.472251+0000","last_peered":"2024-04-26T11:47:43.472251+0000","last_clean":"2024-04-26T11:47:43.472251+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:47:43.472251+0000","last_undegraded":"2024-04-26T11:47:43.472251+0000","last_fullsized":"2024-04-26T11:47:43.472251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1022,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168161+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:47:42.168161+0000","last_peered":"2024-04-26T11:47:42.168161+0000","last_clean":"2024-04-26T11:47:42.168161+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:47:42.168161+0000","last_undegraded":"2024-04-26T11:47:42.168161+0000","last_fullsized":"2024-04-26T11:47:42.168161+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":503,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170380+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:42.170380+0000","last_peered":"2024-04-26T11:47:42.170380+0000","last_clean":"2024-04-26T11:47:42.170380+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:42.170380+0000","last_undegraded":"2024-04-26T11:47:42.170380+0000","last_fullsized":"2024-04-26T11:47:42.170380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":612,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474611+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:47:43.474611+0000","last_peered":"2024-04-26T11:47:43.474611+0000","last_clean":"2024-04-26T11:47:43.474611+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:47:43.474611+0000","last_undegraded":"2024-04-26T11:47:43.474611+0000","last_fullsized":"2024-04-26T11:47:43.474611+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:48.523722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":505,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166150+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:42.166150+0000","last_peered":"2024-04-26T11:47:42.166150+0000","last_clean":"2024-04-26T11:47:42.166150+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:42.166150+0000","last_undegraded":"2024-04-26T11:47:42.166150+0000","last_fullsized":"2024-04-26T11:47:42.166150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":586,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169347+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:42.169347+0000","last_peered":"2024-04-26T11:47:42.169347+0000","last_clean":"2024-04-26T11:47:42.169347+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:42.169347+0000","last_undegraded":"2024-04-26T11:47:42.169347+0000","last_fullsized":"2024-04-26T11:47:42.169347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":499,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472353+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:47:43.472353+0000","last_peered":"2024-04-26T11:47:43.472353+0000","last_clean":"2024-04-26T11:47:43.472353+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:47:43.472353+0000","last_undegraded":"2024-04-26T11:47:43.472353+0000","last_fullsized":"2024-04-26T11:47:43.472353+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":615,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169354+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:42.169354+0000","last_peered":"2024-04-26T11:47:42.169354+0000","last_clean":"2024-04-26T11:47:42.169354+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:42.169354+0000","last_undegraded":"2024-04-26T11:47:42.169354+0000","last_fullsized":"2024-04-26T11:47:42.169354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":564,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472730+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:47:43.472730+0000","last_peered":"2024-04-26T11:47:43.472730+0000","last_clean":"2024-04-26T11:47:43.472730+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:47:43.472730+0000","last_undegraded":"2024-04-26T11:47:43.472730+0000","last_fullsized":"2024-04-26T11:47:43.472730+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":932,"reported_epoch":105,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:43.212969+0000","last_change":"2024-04-26T11:47:43.213458+0000","last_active":"2024-04-26T11:47:43.212969+0000","last_peered":"2024-04-26T11:47:43.212969+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:43.212969+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":824,"reported_epoch":105,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:43.883570+0000","last_change":"2024-04-26T11:47:43.883941+0000","last_active":"2024-04-26T11:47:43.883570+0000","last_peered":"2024-04-26T11:47:43.883570+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:43.883570+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":613,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165208+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:42.165208+0000","last_peered":"2024-04-26T11:47:42.165208+0000","last_clean":"2024-04-26T11:47:42.165208+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:42.165208+0000","last_undegraded":"2024-04-26T11:47:42.165208+0000","last_fullsized":"2024-04-26T11:47:42.165208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":964,"reported_epoch":105,"state":"peering","last_fresh":"2024-04-26T11:47:43.176364+0000","last_change":"2024-04-26T11:47:43.176575+0000","last_active":"2024-04-26T11:47:43.176364+0000","last_peered":"2024-04-26T11:47:42.484830+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:43.176364+0000","last_undegraded":"2024-04-26T11:47:43.176364+0000","last_fullsized":"2024-04-26T11:47:43.176364+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":55,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472273+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:43.472273+0000","last_peered":"2024-04-26T11:47:43.472273+0000","last_clean":"2024-04-26T11:47:43.472273+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:43.472273+0000","last_undegraded":"2024-04-26T11:47:43.472273+0000","last_fullsized":"2024-04-26T11:47:43.472273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":506,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474903+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:47:43.474903+0000","last_peered":"2024-04-26T11:47:43.474903+0000","last_clean":"2024-04-26T11:47:43.474903+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:47:43.474903+0000","last_undegraded":"2024-04-26T11:47:43.474903+0000","last_fullsized":"2024-04-26T11:47:43.474903+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":158,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168637+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:42.168637+0000","last_peered":"2024-04-26T11:47:42.168637+0000","last_clean":"2024-04-26T11:47:42.168637+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:42.168637+0000","last_undegraded":"2024-04-26T11:47:42.168637+0000","last_fullsized":"2024-04-26T11:47:42.168637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":541,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474470+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:43.474470+0000","last_peered":"2024-04-26T11:47:43.474470+0000","last_clean":"2024-04-26T11:47:43.474470+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:43.474470+0000","last_undegraded":"2024-04-26T11:47:43.474470+0000","last_fullsized":"2024-04-26T11:47:43.474470+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164559+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:42.164559+0000","last_peered":"2024-04-26T11:47:42.164559+0000","last_clean":"2024-04-26T11:47:42.164559+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:42.164559+0000","last_undegraded":"2024-04-26T11:47:42.164559+0000","last_fullsized":"2024-04-26T11:47:42.164559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":312,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166727+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:42.166727+0000","last_peered":"2024-04-26T11:47:42.166727+0000","last_clean":"2024-04-26T11:47:42.166727+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:42.166727+0000","last_undegraded":"2024-04-26T11:47:42.166727+0000","last_fullsized":"2024-04-26T11:47:42.166727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":530,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168181+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:42.168181+0000","last_peered":"2024-04-26T11:47:42.168181+0000","last_clean":"2024-04-26T11:47:42.168181+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:42.168181+0000","last_undegraded":"2024-04-26T11:47:42.168181+0000","last_fullsized":"2024-04-26T11:47:42.168181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":490,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169978+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:42.169978+0000","last_peered":"2024-04-26T11:47:42.169978+0000","last_clean":"2024-04-26T11:47:42.169978+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:42.169978+0000","last_undegraded":"2024-04-26T11:47:42.169978+0000","last_fullsized":"2024-04-26T11:47:42.169978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1021,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168370+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:47:42.168370+0000","last_peered":"2024-04-26T11:47:42.168370+0000","last_clean":"2024-04-26T11:47:42.168370+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:47:42.168370+0000","last_undegraded":"2024-04-26T11:47:42.168370+0000","last_fullsized":"2024-04-26T11:47:42.168370+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":684,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166703+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:42.166703+0000","last_peered":"2024-04-26T11:47:42.166703+0000","last_clean":"2024-04-26T11:47:42.166703+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:42.166703+0000","last_undegraded":"2024-04-26T11:47:42.166703+0000","last_fullsized":"2024-04-26T11:47:42.166703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1005,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165047+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:42.165047+0000","last_peered":"2024-04-26T11:47:42.165047+0000","last_clean":"2024-04-26T11:47:42.165047+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:42.165047+0000","last_undegraded":"2024-04-26T11:47:42.165047+0000","last_fullsized":"2024-04-26T11:47:42.165047+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166165+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:42.166165+0000","last_peered":"2024-04-26T11:47:42.166165+0000","last_clean":"2024-04-26T11:47:42.166165+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:42.166165+0000","last_undegraded":"2024-04-26T11:47:42.166165+0000","last_fullsized":"2024-04-26T11:47:42.166165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":611,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.473806+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:43.473806+0000","last_peered":"2024-04-26T11:47:43.473806+0000","last_clean":"2024-04-26T11:47:43.473806+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:43.473806+0000","last_undegraded":"2024-04-26T11:47:43.473806+0000","last_fullsized":"2024-04-26T11:47:43.473806+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":363,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.473540+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:43.473540+0000","last_peered":"2024-04-26T11:47:43.473540+0000","last_clean":"2024-04-26T11:47:43.473540+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:43.473540+0000","last_undegraded":"2024-04-26T11:47:43.473540+0000","last_fullsized":"2024-04-26T11:47:43.473540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":952,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165860+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:47:42.165860+0000","last_peered":"2024-04-26T11:47:42.165860+0000","last_clean":"2024-04-26T11:47:42.165860+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:47:42.165860+0000","last_undegraded":"2024-04-26T11:47:42.165860+0000","last_fullsized":"2024-04-26T11:47:42.165860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":273,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165663+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:42.165663+0000","last_peered":"2024-04-26T11:47:42.165663+0000","last_clean":"2024-04-26T11:47:42.165663+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:42.165663+0000","last_undegraded":"2024-04-26T11:47:42.165663+0000","last_fullsized":"2024-04-26T11:47:42.165663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":538,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166981+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:42.166981+0000","last_peered":"2024-04-26T11:47:42.166981+0000","last_clean":"2024-04-26T11:47:42.166981+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:42.166981+0000","last_undegraded":"2024-04-26T11:47:42.166981+0000","last_fullsized":"2024-04-26T11:47:42.166981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":152,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168663+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:42.168663+0000","last_peered":"2024-04-26T11:47:42.168663+0000","last_clean":"2024-04-26T11:47:42.168663+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:42.168663+0000","last_undegraded":"2024-04-26T11:47:42.168663+0000","last_fullsized":"2024-04-26T11:47:42.168663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":476,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166464+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:42.166464+0000","last_peered":"2024-04-26T11:47:42.166464+0000","last_clean":"2024-04-26T11:47:42.166464+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:42.166464+0000","last_undegraded":"2024-04-26T11:47:42.166464+0000","last_fullsized":"2024-04-26T11:47:42.166464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":624,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168455+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:42.168455+0000","last_peered":"2024-04-26T11:47:42.168455+0000","last_clean":"2024-04-26T11:47:42.168455+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:42.168455+0000","last_undegraded":"2024-04-26T11:47:42.168455+0000","last_fullsized":"2024-04-26T11:47:42.168455+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":516,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.475266+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:47:43.475266+0000","last_peered":"2024-04-26T11:47:43.475266+0000","last_clean":"2024-04-26T11:47:43.475266+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:47:43.475266+0000","last_undegraded":"2024-04-26T11:47:43.475266+0000","last_fullsized":"2024-04-26T11:47:43.475266+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":300,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165064+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:42.165064+0000","last_peered":"2024-04-26T11:47:42.165064+0000","last_clean":"2024-04-26T11:47:42.165064+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:42.165064+0000","last_undegraded":"2024-04-26T11:47:42.165064+0000","last_fullsized":"2024-04-26T11:47:42.165064+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":114,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165503+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:42.165503+0000","last_peered":"2024-04-26T11:47:42.165503+0000","last_clean":"2024-04-26T11:47:42.165503+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:42.165503+0000","last_undegraded":"2024-04-26T11:47:42.165503+0000","last_fullsized":"2024-04-26T11:47:42.165503+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":605,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472619+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:43.472619+0000","last_peered":"2024-04-26T11:47:43.472619+0000","last_clean":"2024-04-26T11:47:43.472619+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:43.472619+0000","last_undegraded":"2024-04-26T11:47:43.472619+0000","last_fullsized":"2024-04-26T11:47:43.472619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":564,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166472+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:42.166472+0000","last_peered":"2024-04-26T11:47:42.166472+0000","last_clean":"2024-04-26T11:47:42.166472+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:42.166472+0000","last_undegraded":"2024-04-26T11:47:42.166472+0000","last_fullsized":"2024-04-26T11:47:42.166472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164827+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:42.164827+0000","last_peered":"2024-04-26T11:47:42.164827+0000","last_clean":"2024-04-26T11:47:42.164827+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:42.164827+0000","last_undegraded":"2024-04-26T11:47:42.164827+0000","last_fullsized":"2024-04-26T11:47:42.164827+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":357,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.471587+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:43.471587+0000","last_peered":"2024-04-26T11:47:43.471587+0000","last_clean":"2024-04-26T11:47:43.471587+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:43.471587+0000","last_undegraded":"2024-04-26T11:47:43.471587+0000","last_fullsized":"2024-04-26T11:47:43.471587+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":988,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169728+0000","last_change":"2024-04-26T11:47:34.145286+0000","last_active":"2024-04-26T11:47:42.169728+0000","last_peered":"2024-04-26T11:47:42.169728+0000","last_clean":"2024-04-26T11:47:42.169728+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:47:42.169728+0000","last_undegraded":"2024-04-26T11:47:42.169728+0000","last_fullsized":"2024-04-26T11:47:42.169728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:13.918331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472579+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:43.472579+0000","last_peered":"2024-04-26T11:47:43.472579+0000","last_clean":"2024-04-26T11:47:43.472579+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:43.472579+0000","last_undegraded":"2024-04-26T11:47:43.472579+0000","last_fullsized":"2024-04-26T11:47:43.472579+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":521,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168475+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:42.168475+0000","last_peered":"2024-04-26T11:47:42.168475+0000","last_clean":"2024-04-26T11:47:42.168475+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:42.168475+0000","last_undegraded":"2024-04-26T11:47:42.168475+0000","last_fullsized":"2024-04-26T11:47:42.168475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":449,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.475202+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:43.475202+0000","last_peered":"2024-04-26T11:47:43.475202+0000","last_clean":"2024-04-26T11:47:43.475202+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:43.475202+0000","last_undegraded":"2024-04-26T11:47:43.475202+0000","last_fullsized":"2024-04-26T11:47:43.475202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":114,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165508+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:42.165508+0000","last_peered":"2024-04-26T11:47:42.165508+0000","last_clean":"2024-04-26T11:47:42.165508+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:42.165508+0000","last_undegraded":"2024-04-26T11:47:42.165508+0000","last_fullsized":"2024-04-26T11:47:42.165508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":176,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165335+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:42.165335+0000","last_peered":"2024-04-26T11:47:42.165335+0000","last_clean":"2024-04-26T11:47:42.165335+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:42.165335+0000","last_undegraded":"2024-04-26T11:47:42.165335+0000","last_fullsized":"2024-04-26T11:47:42.165335+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":493,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472834+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:47:43.472834+0000","last_peered":"2024-04-26T11:47:43.472834+0000","last_clean":"2024-04-26T11:47:43.472834+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:47:43.472834+0000","last_undegraded":"2024-04-26T11:47:43.472834+0000","last_fullsized":"2024-04-26T11:47:43.472834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":635,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166922+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:42.166922+0000","last_peered":"2024-04-26T11:47:42.166922+0000","last_clean":"2024-04-26T11:47:42.166922+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:42.166922+0000","last_undegraded":"2024-04-26T11:47:42.166922+0000","last_fullsized":"2024-04-26T11:47:42.166922+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472729+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:43.472729+0000","last_peered":"2024-04-26T11:47:43.472729+0000","last_clean":"2024-04-26T11:47:43.472729+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:43.472729+0000","last_undegraded":"2024-04-26T11:47:43.472729+0000","last_fullsized":"2024-04-26T11:47:43.472729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":476,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169038+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:42.169038+0000","last_peered":"2024-04-26T11:47:42.169038+0000","last_clean":"2024-04-26T11:47:42.169038+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:42.169038+0000","last_undegraded":"2024-04-26T11:47:42.169038+0000","last_fullsized":"2024-04-26T11:47:42.169038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":58,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.473047+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:43.473047+0000","last_peered":"2024-04-26T11:47:43.473047+0000","last_clean":"2024-04-26T11:47:43.473047+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:43.473047+0000","last_undegraded":"2024-04-26T11:47:43.473047+0000","last_fullsized":"2024-04-26T11:47:43.473047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170526+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:42.170526+0000","last_peered":"2024-04-26T11:47:42.170526+0000","last_clean":"2024-04-26T11:47:42.170526+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:42.170526+0000","last_undegraded":"2024-04-26T11:47:42.170526+0000","last_fullsized":"2024-04-26T11:47:42.170526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":517,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170156+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:42.170156+0000","last_peered":"2024-04-26T11:47:42.170156+0000","last_clean":"2024-04-26T11:47:42.170156+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:42.170156+0000","last_undegraded":"2024-04-26T11:47:42.170156+0000","last_fullsized":"2024-04-26T11:47:42.170156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":58,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474577+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:43.474577+0000","last_peered":"2024-04-26T11:47:43.474577+0000","last_clean":"2024-04-26T11:47:43.474577+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:43.474577+0000","last_undegraded":"2024-04-26T11:47:43.474577+0000","last_fullsized":"2024-04-26T11:47:43.474577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474068+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:43.474068+0000","last_peered":"2024-04-26T11:47:43.474068+0000","last_clean":"2024-04-26T11:47:43.474068+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:43.474068+0000","last_undegraded":"2024-04-26T11:47:43.474068+0000","last_fullsized":"2024-04-26T11:47:43.474068+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":474,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472008+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:47:43.472008+0000","last_peered":"2024-04-26T11:47:43.472008+0000","last_clean":"2024-04-26T11:47:43.472008+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:47:43.472008+0000","last_undegraded":"2024-04-26T11:47:43.472008+0000","last_fullsized":"2024-04-26T11:47:43.472008+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:47.076399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":69,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474214+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:43.474214+0000","last_peered":"2024-04-26T11:47:43.474214+0000","last_clean":"2024-04-26T11:47:43.474214+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:43.474214+0000","last_undegraded":"2024-04-26T11:47:43.474214+0000","last_fullsized":"2024-04-26T11:47:43.474214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":101,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166794+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:42.166794+0000","last_peered":"2024-04-26T11:47:42.166794+0000","last_clean":"2024-04-26T11:47:42.166794+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:42.166794+0000","last_undegraded":"2024-04-26T11:47:42.166794+0000","last_fullsized":"2024-04-26T11:47:42.166794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":550,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168376+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:42.168376+0000","last_peered":"2024-04-26T11:47:42.168376+0000","last_clean":"2024-04-26T11:47:42.168376+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:42.168376+0000","last_undegraded":"2024-04-26T11:47:42.168376+0000","last_fullsized":"2024-04-26T11:47:42.168376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":562,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164857+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:42.164857+0000","last_peered":"2024-04-26T11:47:42.164857+0000","last_clean":"2024-04-26T11:47:42.164857+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:42.164857+0000","last_undegraded":"2024-04-26T11:47:42.164857+0000","last_fullsized":"2024-04-26T11:47:42.164857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":509,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166132+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:42.166132+0000","last_peered":"2024-04-26T11:47:42.166132+0000","last_clean":"2024-04-26T11:47:42.166132+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:42.166132+0000","last_undegraded":"2024-04-26T11:47:42.166132+0000","last_fullsized":"2024-04-26T11:47:42.166132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":537,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472042+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:47:43.472042+0000","last_peered":"2024-04-26T11:47:43.472042+0000","last_clean":"2024-04-26T11:47:43.472042+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:47:43.472042+0000","last_undegraded":"2024-04-26T11:47:43.472042+0000","last_fullsized":"2024-04-26T11:47:43.472042+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":201,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170323+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:42.170323+0000","last_peered":"2024-04-26T11:47:42.170323+0000","last_clean":"2024-04-26T11:47:42.170323+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:42.170323+0000","last_undegraded":"2024-04-26T11:47:42.170323+0000","last_fullsized":"2024-04-26T11:47:42.170323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":456,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166708+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:42.166708+0000","last_peered":"2024-04-26T11:47:42.166708+0000","last_clean":"2024-04-26T11:47:42.166708+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:42.166708+0000","last_undegraded":"2024-04-26T11:47:42.166708+0000","last_fullsized":"2024-04-26T11:47:42.166708+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472286+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:47:43.472286+0000","last_peered":"2024-04-26T11:47:43.472286+0000","last_clean":"2024-04-26T11:47:43.472286+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:47:43.472286+0000","last_undegraded":"2024-04-26T11:47:43.472286+0000","last_fullsized":"2024-04-26T11:47:43.472286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":54,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474990+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:43.474990+0000","last_peered":"2024-04-26T11:47:43.474990+0000","last_clean":"2024-04-26T11:47:43.474990+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:43.474990+0000","last_undegraded":"2024-04-26T11:47:43.474990+0000","last_fullsized":"2024-04-26T11:47:43.474990+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":566,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.471771+0000","last_change":"2024-04-26T11:47:41.467086+0000","last_active":"2024-04-26T11:47:43.471771+0000","last_peered":"2024-04-26T11:47:43.471771+0000","last_clean":"2024-04-26T11:47:43.471771+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:47:43.471771+0000","last_undegraded":"2024-04-26T11:47:43.471771+0000","last_fullsized":"2024-04-26T11:47:43.471771+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:45.011728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":508,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170458+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:42.170458+0000","last_peered":"2024-04-26T11:47:42.170458+0000","last_clean":"2024-04-26T11:47:42.170458+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:42.170458+0000","last_undegraded":"2024-04-26T11:47:42.170458+0000","last_fullsized":"2024-04-26T11:47:42.170458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":866,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.471462+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:43.471462+0000","last_peered":"2024-04-26T11:47:43.471462+0000","last_clean":"2024-04-26T11:47:43.471462+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:43.471462+0000","last_undegraded":"2024-04-26T11:47:43.471462+0000","last_fullsized":"2024-04-26T11:47:43.471462+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":489,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474415+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:47:43.474415+0000","last_peered":"2024-04-26T11:47:43.474415+0000","last_clean":"2024-04-26T11:47:43.474415+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:47:43.474415+0000","last_undegraded":"2024-04-26T11:47:43.474415+0000","last_fullsized":"2024-04-26T11:47:43.474415+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":423,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.471843+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:43.471843+0000","last_peered":"2024-04-26T11:47:43.471843+0000","last_clean":"2024-04-26T11:47:43.471843+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:43.471843+0000","last_undegraded":"2024-04-26T11:47:43.471843+0000","last_fullsized":"2024-04-26T11:47:43.471843+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":529,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169890+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:42.169890+0000","last_peered":"2024-04-26T11:47:42.169890+0000","last_clean":"2024-04-26T11:47:42.169890+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:42.169890+0000","last_undegraded":"2024-04-26T11:47:42.169890+0000","last_fullsized":"2024-04-26T11:47:42.169890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":478,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169638+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:42.169638+0000","last_peered":"2024-04-26T11:47:42.169638+0000","last_clean":"2024-04-26T11:47:42.169638+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:42.169638+0000","last_undegraded":"2024-04-26T11:47:42.169638+0000","last_fullsized":"2024-04-26T11:47:42.169638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":844,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169072+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:42.169072+0000","last_peered":"2024-04-26T11:47:42.169072+0000","last_clean":"2024-04-26T11:47:42.169072+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:42.169072+0000","last_undegraded":"2024-04-26T11:47:42.169072+0000","last_fullsized":"2024-04-26T11:47:42.169072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":155,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170399+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:42.170399+0000","last_peered":"2024-04-26T11:47:42.170399+0000","last_clean":"2024-04-26T11:47:42.170399+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:42.170399+0000","last_undegraded":"2024-04-26T11:47:42.170399+0000","last_fullsized":"2024-04-26T11:47:42.170399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":874,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164853+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:47:42.164853+0000","last_peered":"2024-04-26T11:47:42.164853+0000","last_clean":"2024-04-26T11:47:42.164853+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:47:42.164853+0000","last_undegraded":"2024-04-26T11:47:42.164853+0000","last_fullsized":"2024-04-26T11:47:42.164853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":398,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165889+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:42.165889+0000","last_peered":"2024-04-26T11:47:42.165889+0000","last_clean":"2024-04-26T11:47:42.165889+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:42.165889+0000","last_undegraded":"2024-04-26T11:47:42.165889+0000","last_fullsized":"2024-04-26T11:47:42.165889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":891,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165273+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:47:42.165273+0000","last_peered":"2024-04-26T11:47:42.165273+0000","last_clean":"2024-04-26T11:47:42.165273+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:47:42.165273+0000","last_undegraded":"2024-04-26T11:47:42.165273+0000","last_fullsized":"2024-04-26T11:47:42.165273+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":427,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170162+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:42.170162+0000","last_peered":"2024-04-26T11:47:42.170162+0000","last_clean":"2024-04-26T11:47:42.170162+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:42.170162+0000","last_undegraded":"2024-04-26T11:47:42.170162+0000","last_fullsized":"2024-04-26T11:47:42.170162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":942,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168889+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:42.168889+0000","last_peered":"2024-04-26T11:47:42.168889+0000","last_clean":"2024-04-26T11:47:42.168889+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:42.168889+0000","last_undegraded":"2024-04-26T11:47:42.168889+0000","last_fullsized":"2024-04-26T11:47:42.168889+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":63,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474766+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:43.474766+0000","last_peered":"2024-04-26T11:47:43.474766+0000","last_clean":"2024-04-26T11:47:43.474766+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:43.474766+0000","last_undegraded":"2024-04-26T11:47:43.474766+0000","last_fullsized":"2024-04-26T11:47:43.474766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":970,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164800+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:47:42.164800+0000","last_peered":"2024-04-26T11:47:42.164800+0000","last_clean":"2024-04-26T11:47:42.164800+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:47:42.164800+0000","last_undegraded":"2024-04-26T11:47:42.164800+0000","last_fullsized":"2024-04-26T11:47:42.164800+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.430609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474293+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:43.474293+0000","last_peered":"2024-04-26T11:47:43.474293+0000","last_clean":"2024-04-26T11:47:43.474293+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:43.474293+0000","last_undegraded":"2024-04-26T11:47:43.474293+0000","last_fullsized":"2024-04-26T11:47:43.474293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":126,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738415,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200412,"kb_used_data":88976,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171428,"statfs":{"total":96636764160,"available":96431542272,"internally_reserved":0,"allocated":91111424,"data_stored":90537764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":72,"seq":309237645320,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125544,"kb_used_data":79960,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246296,"statfs":{"total":96636764160,"available":96508207104,"internally_reserved":0,"allocated":81879040,"data_stored":81323208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738414,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190592,"kb_used_data":83252,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181248,"statfs":{"total":96636764160,"available":96441597952,"internally_reserved":0,"allocated":85250048,"data_stored":84684106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:46.420 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:47:46.778 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:46.779 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":227,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":107,"num_osds":3,"num_up_osds":3,"osd_up_since":1714132030,"num_in_osds":3,"osd_in_since":1714131840,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":102},{"state_name":"active+undersized+remapped","count":2},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127603811,"bytes_used":528945152,"bytes_avail":289381347328,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"recovering_objects_per_sec":313,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1253,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4213}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T11:45:27.979634+0000","services":{}},"progress_events":{}} 2024-04-26T11:47:46.793 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:47:46.794 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:47.107 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:47.116 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:47.128 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-04-26T11:47:46.048543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516548,"kb_used_data":252188,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598972,"statfs":{"total":289910292480,"available":289381347328,"internally_reserved":0,"allocated":258240512,"data_stored":256545078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1133,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001395"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":951,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170243+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:42.170243+0000","last_peered":"2024-04-26T11:47:42.170243+0000","last_clean":"2024-04-26T11:47:42.170243+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:42.170243+0000","last_undegraded":"2024-04-26T11:47:42.170243+0000","last_fullsized":"2024-04-26T11:47:42.170243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1008,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169066+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:47:42.169066+0000","last_peered":"2024-04-26T11:47:42.169066+0000","last_clean":"2024-04-26T11:47:42.169066+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:47:42.169066+0000","last_undegraded":"2024-04-26T11:47:42.169066+0000","last_fullsized":"2024-04-26T11:47:42.169066+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:25.339699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":514,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165824+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:42.165824+0000","last_peered":"2024-04-26T11:47:42.165824+0000","last_clean":"2024-04-26T11:47:42.165824+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:42.165824+0000","last_undegraded":"2024-04-26T11:47:42.165824+0000","last_fullsized":"2024-04-26T11:47:42.165824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":829,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165621+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:42.165621+0000","last_peered":"2024-04-26T11:47:42.165621+0000","last_clean":"2024-04-26T11:47:42.165621+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:42.165621+0000","last_undegraded":"2024-04-26T11:47:42.165621+0000","last_fullsized":"2024-04-26T11:47:42.165621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":907,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170247+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:47:42.170247+0000","last_peered":"2024-04-26T11:47:42.170247+0000","last_clean":"2024-04-26T11:47:42.170247+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:47:42.170247+0000","last_undegraded":"2024-04-26T11:47:42.170247+0000","last_fullsized":"2024-04-26T11:47:42.170247+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":835,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164558+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:42.164558+0000","last_peered":"2024-04-26T11:47:42.164558+0000","last_clean":"2024-04-26T11:47:42.164558+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:42.164558+0000","last_undegraded":"2024-04-26T11:47:42.164558+0000","last_fullsized":"2024-04-26T11:47:42.164558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1027,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.186603+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:47:43.186603+0000","last_peered":"2024-04-26T11:47:43.186603+0000","last_clean":"2024-04-26T11:47:43.186603+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:47:43.186603+0000","last_undegraded":"2024-04-26T11:47:43.186603+0000","last_fullsized":"2024-04-26T11:47:43.186603+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:59.926464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":836,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164153+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:47:42.164153+0000","last_peered":"2024-04-26T11:47:42.164153+0000","last_clean":"2024-04-26T11:47:42.164153+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:47:42.164153+0000","last_undegraded":"2024-04-26T11:47:42.164153+0000","last_fullsized":"2024-04-26T11:47:42.164153+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:56.834748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":533,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474932+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:43.474932+0000","last_peered":"2024-04-26T11:47:43.474932+0000","last_clean":"2024-04-26T11:47:43.474932+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:43.474932+0000","last_undegraded":"2024-04-26T11:47:43.474932+0000","last_fullsized":"2024-04-26T11:47:43.474932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":950,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169365+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:47:42.169365+0000","last_peered":"2024-04-26T11:47:42.169365+0000","last_clean":"2024-04-26T11:47:42.169365+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:47:42.169365+0000","last_undegraded":"2024-04-26T11:47:42.169365+0000","last_fullsized":"2024-04-26T11:47:42.169365+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:32.091133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":863,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166003+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:42.166003+0000","last_peered":"2024-04-26T11:47:42.166003+0000","last_clean":"2024-04-26T11:47:42.166003+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:42.166003+0000","last_undegraded":"2024-04-26T11:47:42.166003+0000","last_fullsized":"2024-04-26T11:47:42.166003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":481,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168993+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:42.168993+0000","last_peered":"2024-04-26T11:47:42.168993+0000","last_clean":"2024-04-26T11:47:42.168993+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:42.168993+0000","last_undegraded":"2024-04-26T11:47:42.168993+0000","last_fullsized":"2024-04-26T11:47:42.168993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":883,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170098+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:42.170098+0000","last_peered":"2024-04-26T11:47:42.170098+0000","last_clean":"2024-04-26T11:47:42.170098+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:42.170098+0000","last_undegraded":"2024-04-26T11:47:42.170098+0000","last_fullsized":"2024-04-26T11:47:42.170098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":553,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164833+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:42.164833+0000","last_peered":"2024-04-26T11:47:42.164833+0000","last_clean":"2024-04-26T11:47:42.164833+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:42.164833+0000","last_undegraded":"2024-04-26T11:47:42.164833+0000","last_fullsized":"2024-04-26T11:47:42.164833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":595,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165134+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:42.165134+0000","last_peered":"2024-04-26T11:47:42.165134+0000","last_clean":"2024-04-26T11:47:42.165134+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:42.165134+0000","last_undegraded":"2024-04-26T11:47:42.165134+0000","last_fullsized":"2024-04-26T11:47:42.165134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1050,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164317+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:47:42.164317+0000","last_peered":"2024-04-26T11:47:42.164317+0000","last_clean":"2024-04-26T11:47:42.164317+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:47:42.164317+0000","last_undegraded":"2024-04-26T11:47:42.164317+0000","last_fullsized":"2024-04-26T11:47:42.164317+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:50.720876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":501,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474668+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:43.474668+0000","last_peered":"2024-04-26T11:47:43.474668+0000","last_clean":"2024-04-26T11:47:43.474668+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:43.474668+0000","last_undegraded":"2024-04-26T11:47:43.474668+0000","last_fullsized":"2024-04-26T11:47:43.474668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":915,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169799+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:47:42.169799+0000","last_peered":"2024-04-26T11:47:42.169799+0000","last_clean":"2024-04-26T11:47:42.169799+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:47:42.169799+0000","last_undegraded":"2024-04-26T11:47:42.169799+0000","last_fullsized":"2024-04-26T11:47:42.169799+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:10.908191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":522,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474086+0000","last_change":"2024-04-26T11:47:42.470100+0000","last_active":"2024-04-26T11:47:43.474086+0000","last_peered":"2024-04-26T11:47:43.474086+0000","last_clean":"2024-04-26T11:47:43.474086+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:47:43.474086+0000","last_undegraded":"2024-04-26T11:47:43.474086+0000","last_fullsized":"2024-04-26T11:47:43.474086+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:37.523362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1004,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165657+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:42.165657+0000","last_peered":"2024-04-26T11:47:42.165657+0000","last_clean":"2024-04-26T11:47:42.165657+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:42.165657+0000","last_undegraded":"2024-04-26T11:47:42.165657+0000","last_fullsized":"2024-04-26T11:47:42.165657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":918,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165853+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:47:42.165853+0000","last_peered":"2024-04-26T11:47:42.165853+0000","last_clean":"2024-04-26T11:47:42.165853+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:47:42.165853+0000","last_undegraded":"2024-04-26T11:47:42.165853+0000","last_fullsized":"2024-04-26T11:47:42.165853+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:16.863281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":567,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168649+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:42.168649+0000","last_peered":"2024-04-26T11:47:42.168649+0000","last_clean":"2024-04-26T11:47:42.168649+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:42.168649+0000","last_undegraded":"2024-04-26T11:47:42.168649+0000","last_fullsized":"2024-04-26T11:47:42.168649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":506,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472251+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:47:43.472251+0000","last_peered":"2024-04-26T11:47:43.472251+0000","last_clean":"2024-04-26T11:47:43.472251+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:47:43.472251+0000","last_undegraded":"2024-04-26T11:47:43.472251+0000","last_fullsized":"2024-04-26T11:47:43.472251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1022,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168161+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:47:42.168161+0000","last_peered":"2024-04-26T11:47:42.168161+0000","last_clean":"2024-04-26T11:47:42.168161+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:47:42.168161+0000","last_undegraded":"2024-04-26T11:47:42.168161+0000","last_fullsized":"2024-04-26T11:47:42.168161+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":503,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170380+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:42.170380+0000","last_peered":"2024-04-26T11:47:42.170380+0000","last_clean":"2024-04-26T11:47:42.170380+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:42.170380+0000","last_undegraded":"2024-04-26T11:47:42.170380+0000","last_fullsized":"2024-04-26T11:47:42.170380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":612,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474611+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:47:43.474611+0000","last_peered":"2024-04-26T11:47:43.474611+0000","last_clean":"2024-04-26T11:47:43.474611+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:47:43.474611+0000","last_undegraded":"2024-04-26T11:47:43.474611+0000","last_fullsized":"2024-04-26T11:47:43.474611+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:48.523722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":505,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166150+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:42.166150+0000","last_peered":"2024-04-26T11:47:42.166150+0000","last_clean":"2024-04-26T11:47:42.166150+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:42.166150+0000","last_undegraded":"2024-04-26T11:47:42.166150+0000","last_fullsized":"2024-04-26T11:47:42.166150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":586,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169347+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:42.169347+0000","last_peered":"2024-04-26T11:47:42.169347+0000","last_clean":"2024-04-26T11:47:42.169347+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:42.169347+0000","last_undegraded":"2024-04-26T11:47:42.169347+0000","last_fullsized":"2024-04-26T11:47:42.169347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":499,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472353+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:47:43.472353+0000","last_peered":"2024-04-26T11:47:43.472353+0000","last_clean":"2024-04-26T11:47:43.472353+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:47:43.472353+0000","last_undegraded":"2024-04-26T11:47:43.472353+0000","last_fullsized":"2024-04-26T11:47:43.472353+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":615,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169354+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:42.169354+0000","last_peered":"2024-04-26T11:47:42.169354+0000","last_clean":"2024-04-26T11:47:42.169354+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:42.169354+0000","last_undegraded":"2024-04-26T11:47:42.169354+0000","last_fullsized":"2024-04-26T11:47:42.169354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":564,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472730+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:47:43.472730+0000","last_peered":"2024-04-26T11:47:43.472730+0000","last_clean":"2024-04-26T11:47:43.472730+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:47:43.472730+0000","last_undegraded":"2024-04-26T11:47:43.472730+0000","last_fullsized":"2024-04-26T11:47:43.472730+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":932,"reported_epoch":105,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:43.212969+0000","last_change":"2024-04-26T11:47:43.213458+0000","last_active":"2024-04-26T11:47:43.212969+0000","last_peered":"2024-04-26T11:47:43.212969+0000","last_clean":"2024-04-26T11:44:50.721354+0000","last_became_active":"2024-04-26T11:47:12.266216+0000","last_became_peered":"2024-04-26T11:47:12.266216+0000","last_unstale":"2024-04-26T11:47:43.212969+0000","last_undegraded":"2024-04-26T11:47:12.165258+0000","last_fullsized":"2024-04-26T11:47:12.160289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:40.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":824,"reported_epoch":105,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:47:43.883570+0000","last_change":"2024-04-26T11:47:43.883941+0000","last_active":"2024-04-26T11:47:43.883570+0000","last_peered":"2024-04-26T11:47:43.883570+0000","last_clean":"2024-04-26T11:44:49.186820+0000","last_became_active":"2024-04-26T11:47:12.245720+0000","last_became_peered":"2024-04-26T11:47:12.245720+0000","last_unstale":"2024-04-26T11:47:43.883570+0000","last_undegraded":"2024-04-26T11:47:12.153843+0000","last_fullsized":"2024-04-26T11:47:12.146346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:17.496369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":613,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165208+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:42.165208+0000","last_peered":"2024-04-26T11:47:42.165208+0000","last_clean":"2024-04-26T11:47:42.165208+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:42.165208+0000","last_undegraded":"2024-04-26T11:47:42.165208+0000","last_fullsized":"2024-04-26T11:47:42.165208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":964,"reported_epoch":105,"state":"peering","last_fresh":"2024-04-26T11:47:43.176364+0000","last_change":"2024-04-26T11:47:43.176575+0000","last_active":"2024-04-26T11:47:43.176364+0000","last_peered":"2024-04-26T11:47:42.484830+0000","last_clean":"2024-04-26T11:44:49.186765+0000","last_became_active":"2024-04-26T11:47:12.208184+0000","last_became_peered":"2024-04-26T11:47:12.208184+0000","last_unstale":"2024-04-26T11:47:43.176364+0000","last_undegraded":"2024-04-26T11:47:43.176364+0000","last_fullsized":"2024-04-26T11:47:43.176364+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":55,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472273+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:43.472273+0000","last_peered":"2024-04-26T11:47:43.472273+0000","last_clean":"2024-04-26T11:47:43.472273+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:43.472273+0000","last_undegraded":"2024-04-26T11:47:43.472273+0000","last_fullsized":"2024-04-26T11:47:43.472273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":506,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474903+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:47:43.474903+0000","last_peered":"2024-04-26T11:47:43.474903+0000","last_clean":"2024-04-26T11:47:43.474903+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:47:43.474903+0000","last_undegraded":"2024-04-26T11:47:43.474903+0000","last_fullsized":"2024-04-26T11:47:43.474903+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":158,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168637+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:42.168637+0000","last_peered":"2024-04-26T11:47:42.168637+0000","last_clean":"2024-04-26T11:47:42.168637+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:42.168637+0000","last_undegraded":"2024-04-26T11:47:42.168637+0000","last_fullsized":"2024-04-26T11:47:42.168637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":541,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474470+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:43.474470+0000","last_peered":"2024-04-26T11:47:43.474470+0000","last_clean":"2024-04-26T11:47:43.474470+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:43.474470+0000","last_undegraded":"2024-04-26T11:47:43.474470+0000","last_fullsized":"2024-04-26T11:47:43.474470+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164559+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:42.164559+0000","last_peered":"2024-04-26T11:47:42.164559+0000","last_clean":"2024-04-26T11:47:42.164559+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:42.164559+0000","last_undegraded":"2024-04-26T11:47:42.164559+0000","last_fullsized":"2024-04-26T11:47:42.164559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":312,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166727+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:42.166727+0000","last_peered":"2024-04-26T11:47:42.166727+0000","last_clean":"2024-04-26T11:47:42.166727+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:42.166727+0000","last_undegraded":"2024-04-26T11:47:42.166727+0000","last_fullsized":"2024-04-26T11:47:42.166727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":530,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168181+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:42.168181+0000","last_peered":"2024-04-26T11:47:42.168181+0000","last_clean":"2024-04-26T11:47:42.168181+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:42.168181+0000","last_undegraded":"2024-04-26T11:47:42.168181+0000","last_fullsized":"2024-04-26T11:47:42.168181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":490,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169978+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:42.169978+0000","last_peered":"2024-04-26T11:47:42.169978+0000","last_clean":"2024-04-26T11:47:42.169978+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:42.169978+0000","last_undegraded":"2024-04-26T11:47:42.169978+0000","last_fullsized":"2024-04-26T11:47:42.169978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1021,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168370+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:47:42.168370+0000","last_peered":"2024-04-26T11:47:42.168370+0000","last_clean":"2024-04-26T11:47:42.168370+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:47:42.168370+0000","last_undegraded":"2024-04-26T11:47:42.168370+0000","last_fullsized":"2024-04-26T11:47:42.168370+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":684,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166703+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:42.166703+0000","last_peered":"2024-04-26T11:47:42.166703+0000","last_clean":"2024-04-26T11:47:42.166703+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:42.166703+0000","last_undegraded":"2024-04-26T11:47:42.166703+0000","last_fullsized":"2024-04-26T11:47:42.166703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1005,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165047+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:42.165047+0000","last_peered":"2024-04-26T11:47:42.165047+0000","last_clean":"2024-04-26T11:47:42.165047+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:42.165047+0000","last_undegraded":"2024-04-26T11:47:42.165047+0000","last_fullsized":"2024-04-26T11:47:42.165047+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166165+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:42.166165+0000","last_peered":"2024-04-26T11:47:42.166165+0000","last_clean":"2024-04-26T11:47:42.166165+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:42.166165+0000","last_undegraded":"2024-04-26T11:47:42.166165+0000","last_fullsized":"2024-04-26T11:47:42.166165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":611,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.473806+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:43.473806+0000","last_peered":"2024-04-26T11:47:43.473806+0000","last_clean":"2024-04-26T11:47:43.473806+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:43.473806+0000","last_undegraded":"2024-04-26T11:47:43.473806+0000","last_fullsized":"2024-04-26T11:47:43.473806+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":363,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.473540+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:43.473540+0000","last_peered":"2024-04-26T11:47:43.473540+0000","last_clean":"2024-04-26T11:47:43.473540+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:43.473540+0000","last_undegraded":"2024-04-26T11:47:43.473540+0000","last_fullsized":"2024-04-26T11:47:43.473540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":952,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165860+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:47:42.165860+0000","last_peered":"2024-04-26T11:47:42.165860+0000","last_clean":"2024-04-26T11:47:42.165860+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:47:42.165860+0000","last_undegraded":"2024-04-26T11:47:42.165860+0000","last_fullsized":"2024-04-26T11:47:42.165860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":273,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165663+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:42.165663+0000","last_peered":"2024-04-26T11:47:42.165663+0000","last_clean":"2024-04-26T11:47:42.165663+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:42.165663+0000","last_undegraded":"2024-04-26T11:47:42.165663+0000","last_fullsized":"2024-04-26T11:47:42.165663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":538,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166981+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:42.166981+0000","last_peered":"2024-04-26T11:47:42.166981+0000","last_clean":"2024-04-26T11:47:42.166981+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:42.166981+0000","last_undegraded":"2024-04-26T11:47:42.166981+0000","last_fullsized":"2024-04-26T11:47:42.166981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":152,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168663+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:42.168663+0000","last_peered":"2024-04-26T11:47:42.168663+0000","last_clean":"2024-04-26T11:47:42.168663+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:42.168663+0000","last_undegraded":"2024-04-26T11:47:42.168663+0000","last_fullsized":"2024-04-26T11:47:42.168663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":476,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166464+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:42.166464+0000","last_peered":"2024-04-26T11:47:42.166464+0000","last_clean":"2024-04-26T11:47:42.166464+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:42.166464+0000","last_undegraded":"2024-04-26T11:47:42.166464+0000","last_fullsized":"2024-04-26T11:47:42.166464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":624,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168455+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:42.168455+0000","last_peered":"2024-04-26T11:47:42.168455+0000","last_clean":"2024-04-26T11:47:42.168455+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:42.168455+0000","last_undegraded":"2024-04-26T11:47:42.168455+0000","last_fullsized":"2024-04-26T11:47:42.168455+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":516,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.475266+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:47:43.475266+0000","last_peered":"2024-04-26T11:47:43.475266+0000","last_clean":"2024-04-26T11:47:43.475266+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:47:43.475266+0000","last_undegraded":"2024-04-26T11:47:43.475266+0000","last_fullsized":"2024-04-26T11:47:43.475266+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":300,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165064+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:42.165064+0000","last_peered":"2024-04-26T11:47:42.165064+0000","last_clean":"2024-04-26T11:47:42.165064+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:42.165064+0000","last_undegraded":"2024-04-26T11:47:42.165064+0000","last_fullsized":"2024-04-26T11:47:42.165064+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":114,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165503+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:42.165503+0000","last_peered":"2024-04-26T11:47:42.165503+0000","last_clean":"2024-04-26T11:47:42.165503+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:42.165503+0000","last_undegraded":"2024-04-26T11:47:42.165503+0000","last_fullsized":"2024-04-26T11:47:42.165503+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":605,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472619+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:43.472619+0000","last_peered":"2024-04-26T11:47:43.472619+0000","last_clean":"2024-04-26T11:47:43.472619+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:43.472619+0000","last_undegraded":"2024-04-26T11:47:43.472619+0000","last_fullsized":"2024-04-26T11:47:43.472619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":564,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166472+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:42.166472+0000","last_peered":"2024-04-26T11:47:42.166472+0000","last_clean":"2024-04-26T11:47:42.166472+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:42.166472+0000","last_undegraded":"2024-04-26T11:47:42.166472+0000","last_fullsized":"2024-04-26T11:47:42.166472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164827+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:42.164827+0000","last_peered":"2024-04-26T11:47:42.164827+0000","last_clean":"2024-04-26T11:47:42.164827+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:42.164827+0000","last_undegraded":"2024-04-26T11:47:42.164827+0000","last_fullsized":"2024-04-26T11:47:42.164827+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":357,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.471587+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:43.471587+0000","last_peered":"2024-04-26T11:47:43.471587+0000","last_clean":"2024-04-26T11:47:43.471587+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:43.471587+0000","last_undegraded":"2024-04-26T11:47:43.471587+0000","last_fullsized":"2024-04-26T11:47:43.471587+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":988,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169728+0000","last_change":"2024-04-26T11:47:34.145286+0000","last_active":"2024-04-26T11:47:42.169728+0000","last_peered":"2024-04-26T11:47:42.169728+0000","last_clean":"2024-04-26T11:47:42.169728+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:47:42.169728+0000","last_undegraded":"2024-04-26T11:47:42.169728+0000","last_fullsized":"2024-04-26T11:47:42.169728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:13.918331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472579+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:43.472579+0000","last_peered":"2024-04-26T11:47:43.472579+0000","last_clean":"2024-04-26T11:47:43.472579+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:43.472579+0000","last_undegraded":"2024-04-26T11:47:43.472579+0000","last_fullsized":"2024-04-26T11:47:43.472579+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":521,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168475+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:42.168475+0000","last_peered":"2024-04-26T11:47:42.168475+0000","last_clean":"2024-04-26T11:47:42.168475+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:42.168475+0000","last_undegraded":"2024-04-26T11:47:42.168475+0000","last_fullsized":"2024-04-26T11:47:42.168475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":449,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.475202+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:43.475202+0000","last_peered":"2024-04-26T11:47:43.475202+0000","last_clean":"2024-04-26T11:47:43.475202+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:43.475202+0000","last_undegraded":"2024-04-26T11:47:43.475202+0000","last_fullsized":"2024-04-26T11:47:43.475202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":114,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165508+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:42.165508+0000","last_peered":"2024-04-26T11:47:42.165508+0000","last_clean":"2024-04-26T11:47:42.165508+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:42.165508+0000","last_undegraded":"2024-04-26T11:47:42.165508+0000","last_fullsized":"2024-04-26T11:47:42.165508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":176,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165335+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:42.165335+0000","last_peered":"2024-04-26T11:47:42.165335+0000","last_clean":"2024-04-26T11:47:42.165335+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:42.165335+0000","last_undegraded":"2024-04-26T11:47:42.165335+0000","last_fullsized":"2024-04-26T11:47:42.165335+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":493,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472834+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:47:43.472834+0000","last_peered":"2024-04-26T11:47:43.472834+0000","last_clean":"2024-04-26T11:47:43.472834+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:47:43.472834+0000","last_undegraded":"2024-04-26T11:47:43.472834+0000","last_fullsized":"2024-04-26T11:47:43.472834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":635,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166922+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:42.166922+0000","last_peered":"2024-04-26T11:47:42.166922+0000","last_clean":"2024-04-26T11:47:42.166922+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:42.166922+0000","last_undegraded":"2024-04-26T11:47:42.166922+0000","last_fullsized":"2024-04-26T11:47:42.166922+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472729+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:43.472729+0000","last_peered":"2024-04-26T11:47:43.472729+0000","last_clean":"2024-04-26T11:47:43.472729+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:43.472729+0000","last_undegraded":"2024-04-26T11:47:43.472729+0000","last_fullsized":"2024-04-26T11:47:43.472729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":476,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169038+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:42.169038+0000","last_peered":"2024-04-26T11:47:42.169038+0000","last_clean":"2024-04-26T11:47:42.169038+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:42.169038+0000","last_undegraded":"2024-04-26T11:47:42.169038+0000","last_fullsized":"2024-04-26T11:47:42.169038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":58,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.473047+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:43.473047+0000","last_peered":"2024-04-26T11:47:43.473047+0000","last_clean":"2024-04-26T11:47:43.473047+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:43.473047+0000","last_undegraded":"2024-04-26T11:47:43.473047+0000","last_fullsized":"2024-04-26T11:47:43.473047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170526+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:42.170526+0000","last_peered":"2024-04-26T11:47:42.170526+0000","last_clean":"2024-04-26T11:47:42.170526+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:42.170526+0000","last_undegraded":"2024-04-26T11:47:42.170526+0000","last_fullsized":"2024-04-26T11:47:42.170526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":517,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170156+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:42.170156+0000","last_peered":"2024-04-26T11:47:42.170156+0000","last_clean":"2024-04-26T11:47:42.170156+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:42.170156+0000","last_undegraded":"2024-04-26T11:47:42.170156+0000","last_fullsized":"2024-04-26T11:47:42.170156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":58,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474577+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:43.474577+0000","last_peered":"2024-04-26T11:47:43.474577+0000","last_clean":"2024-04-26T11:47:43.474577+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:43.474577+0000","last_undegraded":"2024-04-26T11:47:43.474577+0000","last_fullsized":"2024-04-26T11:47:43.474577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474068+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:43.474068+0000","last_peered":"2024-04-26T11:47:43.474068+0000","last_clean":"2024-04-26T11:47:43.474068+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:43.474068+0000","last_undegraded":"2024-04-26T11:47:43.474068+0000","last_fullsized":"2024-04-26T11:47:43.474068+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":474,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472008+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:47:43.472008+0000","last_peered":"2024-04-26T11:47:43.472008+0000","last_clean":"2024-04-26T11:47:43.472008+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:47:43.472008+0000","last_undegraded":"2024-04-26T11:47:43.472008+0000","last_fullsized":"2024-04-26T11:47:43.472008+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:47.076399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":69,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474214+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:43.474214+0000","last_peered":"2024-04-26T11:47:43.474214+0000","last_clean":"2024-04-26T11:47:43.474214+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:43.474214+0000","last_undegraded":"2024-04-26T11:47:43.474214+0000","last_fullsized":"2024-04-26T11:47:43.474214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":101,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166794+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:42.166794+0000","last_peered":"2024-04-26T11:47:42.166794+0000","last_clean":"2024-04-26T11:47:42.166794+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:42.166794+0000","last_undegraded":"2024-04-26T11:47:42.166794+0000","last_fullsized":"2024-04-26T11:47:42.166794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":550,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168376+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:42.168376+0000","last_peered":"2024-04-26T11:47:42.168376+0000","last_clean":"2024-04-26T11:47:42.168376+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:42.168376+0000","last_undegraded":"2024-04-26T11:47:42.168376+0000","last_fullsized":"2024-04-26T11:47:42.168376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":562,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164857+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:42.164857+0000","last_peered":"2024-04-26T11:47:42.164857+0000","last_clean":"2024-04-26T11:47:42.164857+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:42.164857+0000","last_undegraded":"2024-04-26T11:47:42.164857+0000","last_fullsized":"2024-04-26T11:47:42.164857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":509,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166132+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:42.166132+0000","last_peered":"2024-04-26T11:47:42.166132+0000","last_clean":"2024-04-26T11:47:42.166132+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:42.166132+0000","last_undegraded":"2024-04-26T11:47:42.166132+0000","last_fullsized":"2024-04-26T11:47:42.166132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":537,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472042+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:47:43.472042+0000","last_peered":"2024-04-26T11:47:43.472042+0000","last_clean":"2024-04-26T11:47:43.472042+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:47:43.472042+0000","last_undegraded":"2024-04-26T11:47:43.472042+0000","last_fullsized":"2024-04-26T11:47:43.472042+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":201,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170323+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:42.170323+0000","last_peered":"2024-04-26T11:47:42.170323+0000","last_clean":"2024-04-26T11:47:42.170323+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:42.170323+0000","last_undegraded":"2024-04-26T11:47:42.170323+0000","last_fullsized":"2024-04-26T11:47:42.170323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":456,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.166708+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:42.166708+0000","last_peered":"2024-04-26T11:47:42.166708+0000","last_clean":"2024-04-26T11:47:42.166708+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:42.166708+0000","last_undegraded":"2024-04-26T11:47:42.166708+0000","last_fullsized":"2024-04-26T11:47:42.166708+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.472286+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:47:43.472286+0000","last_peered":"2024-04-26T11:47:43.472286+0000","last_clean":"2024-04-26T11:47:43.472286+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:47:43.472286+0000","last_undegraded":"2024-04-26T11:47:43.472286+0000","last_fullsized":"2024-04-26T11:47:43.472286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":54,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474990+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:43.474990+0000","last_peered":"2024-04-26T11:47:43.474990+0000","last_clean":"2024-04-26T11:47:43.474990+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:43.474990+0000","last_undegraded":"2024-04-26T11:47:43.474990+0000","last_fullsized":"2024-04-26T11:47:43.474990+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":566,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.471771+0000","last_change":"2024-04-26T11:47:41.467086+0000","last_active":"2024-04-26T11:47:43.471771+0000","last_peered":"2024-04-26T11:47:43.471771+0000","last_clean":"2024-04-26T11:47:43.471771+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:47:43.471771+0000","last_undegraded":"2024-04-26T11:47:43.471771+0000","last_fullsized":"2024-04-26T11:47:43.471771+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:45.011728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":508,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170458+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:42.170458+0000","last_peered":"2024-04-26T11:47:42.170458+0000","last_clean":"2024-04-26T11:47:42.170458+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:42.170458+0000","last_undegraded":"2024-04-26T11:47:42.170458+0000","last_fullsized":"2024-04-26T11:47:42.170458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":866,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.471462+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:43.471462+0000","last_peered":"2024-04-26T11:47:43.471462+0000","last_clean":"2024-04-26T11:47:43.471462+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:43.471462+0000","last_undegraded":"2024-04-26T11:47:43.471462+0000","last_fullsized":"2024-04-26T11:47:43.471462+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":489,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474415+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:47:43.474415+0000","last_peered":"2024-04-26T11:47:43.474415+0000","last_clean":"2024-04-26T11:47:43.474415+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:47:43.474415+0000","last_undegraded":"2024-04-26T11:47:43.474415+0000","last_fullsized":"2024-04-26T11:47:43.474415+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":423,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.471843+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:43.471843+0000","last_peered":"2024-04-26T11:47:43.471843+0000","last_clean":"2024-04-26T11:47:43.471843+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:43.471843+0000","last_undegraded":"2024-04-26T11:47:43.471843+0000","last_fullsized":"2024-04-26T11:47:43.471843+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":529,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169890+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:42.169890+0000","last_peered":"2024-04-26T11:47:42.169890+0000","last_clean":"2024-04-26T11:47:42.169890+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:42.169890+0000","last_undegraded":"2024-04-26T11:47:42.169890+0000","last_fullsized":"2024-04-26T11:47:42.169890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":478,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169638+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:42.169638+0000","last_peered":"2024-04-26T11:47:42.169638+0000","last_clean":"2024-04-26T11:47:42.169638+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:42.169638+0000","last_undegraded":"2024-04-26T11:47:42.169638+0000","last_fullsized":"2024-04-26T11:47:42.169638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":844,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.169072+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:42.169072+0000","last_peered":"2024-04-26T11:47:42.169072+0000","last_clean":"2024-04-26T11:47:42.169072+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:42.169072+0000","last_undegraded":"2024-04-26T11:47:42.169072+0000","last_fullsized":"2024-04-26T11:47:42.169072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":155,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170399+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:42.170399+0000","last_peered":"2024-04-26T11:47:42.170399+0000","last_clean":"2024-04-26T11:47:42.170399+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:42.170399+0000","last_undegraded":"2024-04-26T11:47:42.170399+0000","last_fullsized":"2024-04-26T11:47:42.170399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":874,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164853+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:47:42.164853+0000","last_peered":"2024-04-26T11:47:42.164853+0000","last_clean":"2024-04-26T11:47:42.164853+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:47:42.164853+0000","last_undegraded":"2024-04-26T11:47:42.164853+0000","last_fullsized":"2024-04-26T11:47:42.164853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":398,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165889+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:42.165889+0000","last_peered":"2024-04-26T11:47:42.165889+0000","last_clean":"2024-04-26T11:47:42.165889+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:42.165889+0000","last_undegraded":"2024-04-26T11:47:42.165889+0000","last_fullsized":"2024-04-26T11:47:42.165889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":891,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.165273+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:47:42.165273+0000","last_peered":"2024-04-26T11:47:42.165273+0000","last_clean":"2024-04-26T11:47:42.165273+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:47:42.165273+0000","last_undegraded":"2024-04-26T11:47:42.165273+0000","last_fullsized":"2024-04-26T11:47:42.165273+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":427,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.170162+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:42.170162+0000","last_peered":"2024-04-26T11:47:42.170162+0000","last_clean":"2024-04-26T11:47:42.170162+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:42.170162+0000","last_undegraded":"2024-04-26T11:47:42.170162+0000","last_fullsized":"2024-04-26T11:47:42.170162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":942,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.168889+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:42.168889+0000","last_peered":"2024-04-26T11:47:42.168889+0000","last_clean":"2024-04-26T11:47:42.168889+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:42.168889+0000","last_undegraded":"2024-04-26T11:47:42.168889+0000","last_fullsized":"2024-04-26T11:47:42.168889+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":63,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474766+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:43.474766+0000","last_peered":"2024-04-26T11:47:43.474766+0000","last_clean":"2024-04-26T11:47:43.474766+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:43.474766+0000","last_undegraded":"2024-04-26T11:47:43.474766+0000","last_fullsized":"2024-04-26T11:47:43.474766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":970,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:47:42.164800+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:47:42.164800+0000","last_peered":"2024-04-26T11:47:42.164800+0000","last_clean":"2024-04-26T11:47:42.164800+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:47:42.164800+0000","last_undegraded":"2024-04-26T11:47:42.164800+0000","last_fullsized":"2024-04-26T11:47:42.164800+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.430609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:47:43.474293+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:43.474293+0000","last_peered":"2024-04-26T11:47:43.474293+0000","last_clean":"2024-04-26T11:47:43.474293+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:43.474293+0000","last_undegraded":"2024-04-26T11:47:43.474293+0000","last_fullsized":"2024-04-26T11:47:43.474293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":126,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738415,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200412,"kb_used_data":88976,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171428,"statfs":{"total":96636764160,"available":96431542272,"internally_reserved":0,"allocated":91111424,"data_stored":90537764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":72,"seq":309237645320,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125544,"kb_used_data":79960,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246296,"statfs":{"total":96636764160,"available":96508207104,"internally_reserved":0,"allocated":81879040,"data_stored":81323208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738414,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190592,"kb_used_data":83252,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181248,"statfs":{"total":96636764160,"available":96441597952,"internally_reserved":0,"allocated":85250048,"data_stored":84684106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:50.133 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:47:50.462 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:47:50.472 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:47:50.472 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-04-26T11:47:50.049690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516608,"kb_used_data":252244,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598912,"statfs":{"total":289910292480,"available":289381285888,"internally_reserved":0,"allocated":258297856,"data_stored":256574871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1133,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.882059"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":953,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145689+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:47:44.145689+0000","last_peered":"2024-04-26T11:47:44.145689+0000","last_clean":"2024-04-26T11:47:44.145689+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:47:44.145689+0000","last_undegraded":"2024-04-26T11:47:44.145689+0000","last_fullsized":"2024-04-26T11:47:44.145689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1010,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145031+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:47:44.145031+0000","last_peered":"2024-04-26T11:47:44.145031+0000","last_clean":"2024-04-26T11:47:44.145031+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:47:44.145031+0000","last_undegraded":"2024-04-26T11:47:44.145031+0000","last_fullsized":"2024-04-26T11:47:44.145031+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:25.339699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":516,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138945+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:47:44.138945+0000","last_peered":"2024-04-26T11:47:44.138945+0000","last_clean":"2024-04-26T11:47:44.138945+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:47:44.138945+0000","last_undegraded":"2024-04-26T11:47:44.138945+0000","last_fullsized":"2024-04-26T11:47:44.138945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":831,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138683+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:47:44.138683+0000","last_peered":"2024-04-26T11:47:44.138683+0000","last_clean":"2024-04-26T11:47:44.138683+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:47:44.138683+0000","last_undegraded":"2024-04-26T11:47:44.138683+0000","last_fullsized":"2024-04-26T11:47:44.138683+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":909,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.144561+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:47:44.144561+0000","last_peered":"2024-04-26T11:47:44.144561+0000","last_clean":"2024-04-26T11:47:44.144561+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:47:44.144561+0000","last_undegraded":"2024-04-26T11:47:44.144561+0000","last_fullsized":"2024-04-26T11:47:44.144561+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":837,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138141+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:47:44.138141+0000","last_peered":"2024-04-26T11:47:44.138141+0000","last_clean":"2024-04-26T11:47:44.138141+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:47:44.138141+0000","last_undegraded":"2024-04-26T11:47:44.138141+0000","last_fullsized":"2024-04-26T11:47:44.138141+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1029,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138422+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:47:44.138422+0000","last_peered":"2024-04-26T11:47:44.138422+0000","last_clean":"2024-04-26T11:47:44.138422+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:47:44.138422+0000","last_undegraded":"2024-04-26T11:47:44.138422+0000","last_fullsized":"2024-04-26T11:47:44.138422+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:59.926464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":838,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.137715+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:47:44.137715+0000","last_peered":"2024-04-26T11:47:44.137715+0000","last_clean":"2024-04-26T11:47:44.137715+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:47:44.137715+0000","last_undegraded":"2024-04-26T11:47:44.137715+0000","last_fullsized":"2024-04-26T11:47:44.137715+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:56.834748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":534,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.434126+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:47:44.434126+0000","last_peered":"2024-04-26T11:47:44.434126+0000","last_clean":"2024-04-26T11:47:44.434126+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:47:44.434126+0000","last_undegraded":"2024-04-26T11:47:44.434126+0000","last_fullsized":"2024-04-26T11:47:44.434126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":952,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.144929+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:47:44.144929+0000","last_peered":"2024-04-26T11:47:44.144929+0000","last_clean":"2024-04-26T11:47:44.144929+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:47:44.144929+0000","last_undegraded":"2024-04-26T11:47:44.144929+0000","last_fullsized":"2024-04-26T11:47:44.144929+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:32.091133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":865,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139169+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:47:44.139169+0000","last_peered":"2024-04-26T11:47:44.139169+0000","last_clean":"2024-04-26T11:47:44.139169+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:47:44.139169+0000","last_undegraded":"2024-04-26T11:47:44.139169+0000","last_fullsized":"2024-04-26T11:47:44.139169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":483,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145227+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:47:44.145227+0000","last_peered":"2024-04-26T11:47:44.145227+0000","last_clean":"2024-04-26T11:47:44.145227+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:47:44.145227+0000","last_undegraded":"2024-04-26T11:47:44.145227+0000","last_fullsized":"2024-04-26T11:47:44.145227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":885,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.144299+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:47:44.144299+0000","last_peered":"2024-04-26T11:47:44.144299+0000","last_clean":"2024-04-26T11:47:44.144299+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:47:44.144299+0000","last_undegraded":"2024-04-26T11:47:44.144299+0000","last_fullsized":"2024-04-26T11:47:44.144299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":555,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138384+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:47:44.138384+0000","last_peered":"2024-04-26T11:47:44.138384+0000","last_clean":"2024-04-26T11:47:44.138384+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:47:44.138384+0000","last_undegraded":"2024-04-26T11:47:44.138384+0000","last_fullsized":"2024-04-26T11:47:44.138384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":597,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138695+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:47:44.138695+0000","last_peered":"2024-04-26T11:47:44.138695+0000","last_clean":"2024-04-26T11:47:44.138695+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:47:44.138695+0000","last_undegraded":"2024-04-26T11:47:44.138695+0000","last_fullsized":"2024-04-26T11:47:44.138695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1052,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.137763+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:47:44.137763+0000","last_peered":"2024-04-26T11:47:44.137763+0000","last_clean":"2024-04-26T11:47:44.137763+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:47:44.137763+0000","last_undegraded":"2024-04-26T11:47:44.137763+0000","last_fullsized":"2024-04-26T11:47:44.137763+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:50.720876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":502,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.434063+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:47:44.434063+0000","last_peered":"2024-04-26T11:47:44.434063+0000","last_clean":"2024-04-26T11:47:44.434063+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:47:44.434063+0000","last_undegraded":"2024-04-26T11:47:44.434063+0000","last_fullsized":"2024-04-26T11:47:44.434063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":917,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145267+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:47:44.145267+0000","last_peered":"2024-04-26T11:47:44.145267+0000","last_clean":"2024-04-26T11:47:44.145267+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:47:44.145267+0000","last_undegraded":"2024-04-26T11:47:44.145267+0000","last_fullsized":"2024-04-26T11:47:44.145267+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:10.908191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":523,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.433405+0000","last_change":"2024-04-26T11:47:42.470100+0000","last_active":"2024-04-26T11:47:44.433405+0000","last_peered":"2024-04-26T11:47:44.433405+0000","last_clean":"2024-04-26T11:47:44.433405+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:47:44.433405+0000","last_undegraded":"2024-04-26T11:47:44.433405+0000","last_fullsized":"2024-04-26T11:47:44.433405+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:37.523362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1006,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138967+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:47:44.138967+0000","last_peered":"2024-04-26T11:47:44.138967+0000","last_clean":"2024-04-26T11:47:44.138967+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:47:44.138967+0000","last_undegraded":"2024-04-26T11:47:44.138967+0000","last_fullsized":"2024-04-26T11:47:44.138967+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":920,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139492+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:47:44.139492+0000","last_peered":"2024-04-26T11:47:44.139492+0000","last_clean":"2024-04-26T11:47:44.139492+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:47:44.139492+0000","last_undegraded":"2024-04-26T11:47:44.139492+0000","last_fullsized":"2024-04-26T11:47:44.139492+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:16.863281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":569,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.144606+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:47:44.144606+0000","last_peered":"2024-04-26T11:47:44.144606+0000","last_clean":"2024-04-26T11:47:44.144606+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:47:44.144606+0000","last_undegraded":"2024-04-26T11:47:44.144606+0000","last_fullsized":"2024-04-26T11:47:44.144606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":507,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.431567+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:47:44.431567+0000","last_peered":"2024-04-26T11:47:44.431567+0000","last_clean":"2024-04-26T11:47:44.431567+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:47:44.431567+0000","last_undegraded":"2024-04-26T11:47:44.431567+0000","last_fullsized":"2024-04-26T11:47:44.431567+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1024,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.143683+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:47:44.143683+0000","last_peered":"2024-04-26T11:47:44.143683+0000","last_clean":"2024-04-26T11:47:44.143683+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:47:44.143683+0000","last_undegraded":"2024-04-26T11:47:44.143683+0000","last_fullsized":"2024-04-26T11:47:44.143683+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":505,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145835+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:47:44.145835+0000","last_peered":"2024-04-26T11:47:44.145835+0000","last_clean":"2024-04-26T11:47:44.145835+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:47:44.145835+0000","last_undegraded":"2024-04-26T11:47:44.145835+0000","last_fullsized":"2024-04-26T11:47:44.145835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":613,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.433732+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:47:44.433732+0000","last_peered":"2024-04-26T11:47:44.433732+0000","last_clean":"2024-04-26T11:47:44.433732+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:47:44.433732+0000","last_undegraded":"2024-04-26T11:47:44.433732+0000","last_fullsized":"2024-04-26T11:47:44.433732+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:48.523722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":507,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139613+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:47:44.139613+0000","last_peered":"2024-04-26T11:47:44.139613+0000","last_clean":"2024-04-26T11:47:44.139613+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:47:44.139613+0000","last_undegraded":"2024-04-26T11:47:44.139613+0000","last_fullsized":"2024-04-26T11:47:44.139613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":588,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.147265+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:47:44.147265+0000","last_peered":"2024-04-26T11:47:44.147265+0000","last_clean":"2024-04-26T11:47:44.147265+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:47:44.147265+0000","last_undegraded":"2024-04-26T11:47:44.147265+0000","last_fullsized":"2024-04-26T11:47:44.147265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":500,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.431983+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:47:44.431983+0000","last_peered":"2024-04-26T11:47:44.431983+0000","last_clean":"2024-04-26T11:47:44.431983+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:47:44.431983+0000","last_undegraded":"2024-04-26T11:47:44.431983+0000","last_fullsized":"2024-04-26T11:47:44.431983+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":617,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145086+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:47:44.145086+0000","last_peered":"2024-04-26T11:47:44.145086+0000","last_clean":"2024-04-26T11:47:44.145086+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:47:44.145086+0000","last_undegraded":"2024-04-26T11:47:44.145086+0000","last_fullsized":"2024-04-26T11:47:44.145086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":565,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.432072+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:47:44.432072+0000","last_peered":"2024-04-26T11:47:44.432072+0000","last_clean":"2024-04-26T11:47:44.432072+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:47:44.432072+0000","last_undegraded":"2024-04-26T11:47:44.432072+0000","last_fullsized":"2024-04-26T11:47:44.432072+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":942,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T11:47:45.147770+0000","last_change":"2024-04-26T11:47:45.147770+0000","last_active":"2024-04-26T11:47:45.147770+0000","last_peered":"2024-04-26T11:47:45.147770+0000","last_clean":"2024-04-26T11:47:45.147770+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:47:45.147770+0000","last_undegraded":"2024-04-26T11:47:45.147770+0000","last_fullsized":"2024-04-26T11:47:45.147770+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:52.444032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":834,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T11:47:45.156703+0000","last_change":"2024-04-26T11:47:45.156703+0000","last_active":"2024-04-26T11:47:45.156703+0000","last_peered":"2024-04-26T11:47:45.156703+0000","last_clean":"2024-04-26T11:47:45.156703+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:47:45.156703+0000","last_undegraded":"2024-04-26T11:47:45.156703+0000","last_fullsized":"2024-04-26T11:47:45.156703+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:22.809278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":615,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139757+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:47:44.139757+0000","last_peered":"2024-04-26T11:47:44.139757+0000","last_clean":"2024-04-26T11:47:44.139757+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:47:44.139757+0000","last_undegraded":"2024-04-26T11:47:44.139757+0000","last_fullsized":"2024-04-26T11:47:44.139757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":973,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.155714+0000","last_change":"2024-04-26T11:47:44.154527+0000","last_active":"2024-04-26T11:47:44.155714+0000","last_peered":"2024-04-26T11:47:44.155714+0000","last_clean":"2024-04-26T11:47:44.155714+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:47:44.155714+0000","last_undegraded":"2024-04-26T11:47:44.155714+0000","last_fullsized":"2024-04-26T11:47:44.155714+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:36.227910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":56,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.431944+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:47:44.431944+0000","last_peered":"2024-04-26T11:47:44.431944+0000","last_clean":"2024-04-26T11:47:44.431944+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:47:44.431944+0000","last_undegraded":"2024-04-26T11:47:44.431944+0000","last_fullsized":"2024-04-26T11:47:44.431944+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":507,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.433313+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:47:44.433313+0000","last_peered":"2024-04-26T11:47:44.433313+0000","last_clean":"2024-04-26T11:47:44.433313+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:47:44.433313+0000","last_undegraded":"2024-04-26T11:47:44.433313+0000","last_fullsized":"2024-04-26T11:47:44.433313+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":160,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.144104+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:47:44.144104+0000","last_peered":"2024-04-26T11:47:44.144104+0000","last_clean":"2024-04-26T11:47:44.144104+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:47:44.144104+0000","last_undegraded":"2024-04-26T11:47:44.144104+0000","last_fullsized":"2024-04-26T11:47:44.144104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":542,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.433617+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:47:44.433617+0000","last_peered":"2024-04-26T11:47:44.433617+0000","last_clean":"2024-04-26T11:47:44.433617+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:47:44.433617+0000","last_undegraded":"2024-04-26T11:47:44.433617+0000","last_fullsized":"2024-04-26T11:47:44.433617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":167,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138173+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:47:44.138173+0000","last_peered":"2024-04-26T11:47:44.138173+0000","last_clean":"2024-04-26T11:47:44.138173+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:47:44.138173+0000","last_undegraded":"2024-04-26T11:47:44.138173+0000","last_fullsized":"2024-04-26T11:47:44.138173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":314,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139768+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:47:44.139768+0000","last_peered":"2024-04-26T11:47:44.139768+0000","last_clean":"2024-04-26T11:47:44.139768+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:47:44.139768+0000","last_undegraded":"2024-04-26T11:47:44.139768+0000","last_fullsized":"2024-04-26T11:47:44.139768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":532,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.143716+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:47:44.143716+0000","last_peered":"2024-04-26T11:47:44.143716+0000","last_clean":"2024-04-26T11:47:44.143716+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:47:44.143716+0000","last_undegraded":"2024-04-26T11:47:44.143716+0000","last_fullsized":"2024-04-26T11:47:44.143716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":492,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145506+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:47:44.145506+0000","last_peered":"2024-04-26T11:47:44.145506+0000","last_clean":"2024-04-26T11:47:44.145506+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:47:44.145506+0000","last_undegraded":"2024-04-26T11:47:44.145506+0000","last_fullsized":"2024-04-26T11:47:44.145506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1023,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.144640+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:47:44.144640+0000","last_peered":"2024-04-26T11:47:44.144640+0000","last_clean":"2024-04-26T11:47:44.144640+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:47:44.144640+0000","last_undegraded":"2024-04-26T11:47:44.144640+0000","last_fullsized":"2024-04-26T11:47:44.144640+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":686,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.140247+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:47:44.140247+0000","last_peered":"2024-04-26T11:47:44.140247+0000","last_clean":"2024-04-26T11:47:44.140247+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:47:44.140247+0000","last_undegraded":"2024-04-26T11:47:44.140247+0000","last_fullsized":"2024-04-26T11:47:44.140247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1007,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138616+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:47:44.138616+0000","last_peered":"2024-04-26T11:47:44.138616+0000","last_clean":"2024-04-26T11:47:44.138616+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:47:44.138616+0000","last_undegraded":"2024-04-26T11:47:44.138616+0000","last_fullsized":"2024-04-26T11:47:44.138616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":175,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139540+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:47:44.139540+0000","last_peered":"2024-04-26T11:47:44.139540+0000","last_clean":"2024-04-26T11:47:44.139540+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:47:44.139540+0000","last_undegraded":"2024-04-26T11:47:44.139540+0000","last_fullsized":"2024-04-26T11:47:44.139540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":612,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.432994+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:47:44.432994+0000","last_peered":"2024-04-26T11:47:44.432994+0000","last_clean":"2024-04-26T11:47:44.432994+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:47:44.432994+0000","last_undegraded":"2024-04-26T11:47:44.432994+0000","last_fullsized":"2024-04-26T11:47:44.432994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":364,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.432675+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:47:44.432675+0000","last_peered":"2024-04-26T11:47:44.432675+0000","last_clean":"2024-04-26T11:47:44.432675+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:47:44.432675+0000","last_undegraded":"2024-04-26T11:47:44.432675+0000","last_fullsized":"2024-04-26T11:47:44.432675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":954,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138972+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:47:44.138972+0000","last_peered":"2024-04-26T11:47:44.138972+0000","last_clean":"2024-04-26T11:47:44.138972+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:47:44.138972+0000","last_undegraded":"2024-04-26T11:47:44.138972+0000","last_fullsized":"2024-04-26T11:47:44.138972+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":275,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139623+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:47:44.139623+0000","last_peered":"2024-04-26T11:47:44.139623+0000","last_clean":"2024-04-26T11:47:44.139623+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:47:44.139623+0000","last_undegraded":"2024-04-26T11:47:44.139623+0000","last_fullsized":"2024-04-26T11:47:44.139623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":540,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.140000+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:47:44.140000+0000","last_peered":"2024-04-26T11:47:44.140000+0000","last_clean":"2024-04-26T11:47:44.140000+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:47:44.140000+0000","last_undegraded":"2024-04-26T11:47:44.140000+0000","last_fullsized":"2024-04-26T11:47:44.140000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":154,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.144372+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:47:44.144372+0000","last_peered":"2024-04-26T11:47:44.144372+0000","last_clean":"2024-04-26T11:47:44.144372+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:47:44.144372+0000","last_undegraded":"2024-04-26T11:47:44.144372+0000","last_fullsized":"2024-04-26T11:47:44.144372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":478,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.140059+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:47:44.140059+0000","last_peered":"2024-04-26T11:47:44.140059+0000","last_clean":"2024-04-26T11:47:44.140059+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:47:44.140059+0000","last_undegraded":"2024-04-26T11:47:44.140059+0000","last_fullsized":"2024-04-26T11:47:44.140059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":626,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.143990+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:47:44.143990+0000","last_peered":"2024-04-26T11:47:44.143990+0000","last_clean":"2024-04-26T11:47:44.143990+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:47:44.143990+0000","last_undegraded":"2024-04-26T11:47:44.143990+0000","last_fullsized":"2024-04-26T11:47:44.143990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":517,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.434560+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:47:44.434560+0000","last_peered":"2024-04-26T11:47:44.434560+0000","last_clean":"2024-04-26T11:47:44.434560+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:47:44.434560+0000","last_undegraded":"2024-04-26T11:47:44.434560+0000","last_fullsized":"2024-04-26T11:47:44.434560+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":302,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138941+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:47:44.138941+0000","last_peered":"2024-04-26T11:47:44.138941+0000","last_clean":"2024-04-26T11:47:44.138941+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:47:44.138941+0000","last_undegraded":"2024-04-26T11:47:44.138941+0000","last_fullsized":"2024-04-26T11:47:44.138941+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":116,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139990+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:47:44.139990+0000","last_peered":"2024-04-26T11:47:44.139990+0000","last_clean":"2024-04-26T11:47:44.139990+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:47:44.139990+0000","last_undegraded":"2024-04-26T11:47:44.139990+0000","last_fullsized":"2024-04-26T11:47:44.139990+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":606,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.432218+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:47:44.432218+0000","last_peered":"2024-04-26T11:47:44.432218+0000","last_clean":"2024-04-26T11:47:44.432218+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:47:44.432218+0000","last_undegraded":"2024-04-26T11:47:44.432218+0000","last_fullsized":"2024-04-26T11:47:44.432218+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":566,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.140145+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:47:44.140145+0000","last_peered":"2024-04-26T11:47:44.140145+0000","last_clean":"2024-04-26T11:47:44.140145+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:47:44.140145+0000","last_undegraded":"2024-04-26T11:47:44.140145+0000","last_fullsized":"2024-04-26T11:47:44.140145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":103,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138686+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:47:44.138686+0000","last_peered":"2024-04-26T11:47:44.138686+0000","last_clean":"2024-04-26T11:47:44.138686+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:47:44.138686+0000","last_undegraded":"2024-04-26T11:47:44.138686+0000","last_fullsized":"2024-04-26T11:47:44.138686+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":358,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.431239+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:47:44.431239+0000","last_peered":"2024-04-26T11:47:44.431239+0000","last_clean":"2024-04-26T11:47:44.431239+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:47:44.431239+0000","last_undegraded":"2024-04-26T11:47:44.431239+0000","last_fullsized":"2024-04-26T11:47:44.431239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":990,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145329+0000","last_change":"2024-04-26T11:47:34.145286+0000","last_active":"2024-04-26T11:47:44.145329+0000","last_peered":"2024-04-26T11:47:44.145329+0000","last_clean":"2024-04-26T11:47:44.145329+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:47:44.145329+0000","last_undegraded":"2024-04-26T11:47:44.145329+0000","last_fullsized":"2024-04-26T11:47:44.145329+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:13.918331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.431809+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:47:44.431809+0000","last_peered":"2024-04-26T11:47:44.431809+0000","last_clean":"2024-04-26T11:47:44.431809+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:47:44.431809+0000","last_undegraded":"2024-04-26T11:47:44.431809+0000","last_fullsized":"2024-04-26T11:47:44.431809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":523,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.144009+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:47:44.144009+0000","last_peered":"2024-04-26T11:47:44.144009+0000","last_clean":"2024-04-26T11:47:44.144009+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:47:44.144009+0000","last_undegraded":"2024-04-26T11:47:44.144009+0000","last_fullsized":"2024-04-26T11:47:44.144009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":450,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.434518+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:47:44.434518+0000","last_peered":"2024-04-26T11:47:44.434518+0000","last_clean":"2024-04-26T11:47:44.434518+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:47:44.434518+0000","last_undegraded":"2024-04-26T11:47:44.434518+0000","last_fullsized":"2024-04-26T11:47:44.434518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":116,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139527+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:47:44.139527+0000","last_peered":"2024-04-26T11:47:44.139527+0000","last_clean":"2024-04-26T11:47:44.139527+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:47:44.139527+0000","last_undegraded":"2024-04-26T11:47:44.139527+0000","last_fullsized":"2024-04-26T11:47:44.139527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":178,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139783+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:47:44.139783+0000","last_peered":"2024-04-26T11:47:44.139783+0000","last_clean":"2024-04-26T11:47:44.139783+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:47:44.139783+0000","last_undegraded":"2024-04-26T11:47:44.139783+0000","last_fullsized":"2024-04-26T11:47:44.139783+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":494,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.432649+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:47:44.432649+0000","last_peered":"2024-04-26T11:47:44.432649+0000","last_clean":"2024-04-26T11:47:44.432649+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:47:44.432649+0000","last_undegraded":"2024-04-26T11:47:44.432649+0000","last_fullsized":"2024-04-26T11:47:44.432649+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":637,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.140348+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:47:44.140348+0000","last_peered":"2024-04-26T11:47:44.140348+0000","last_clean":"2024-04-26T11:47:44.140348+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:47:44.140348+0000","last_undegraded":"2024-04-26T11:47:44.140348+0000","last_fullsized":"2024-04-26T11:47:44.140348+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.432477+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:47:44.432477+0000","last_peered":"2024-04-26T11:47:44.432477+0000","last_clean":"2024-04-26T11:47:44.432477+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:47:44.432477+0000","last_undegraded":"2024-04-26T11:47:44.432477+0000","last_fullsized":"2024-04-26T11:47:44.432477+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":478,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.144847+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:47:44.144847+0000","last_peered":"2024-04-26T11:47:44.144847+0000","last_clean":"2024-04-26T11:47:44.144847+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:47:44.144847+0000","last_undegraded":"2024-04-26T11:47:44.144847+0000","last_fullsized":"2024-04-26T11:47:44.144847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":59,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.433022+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:47:44.433022+0000","last_peered":"2024-04-26T11:47:44.433022+0000","last_clean":"2024-04-26T11:47:44.433022+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:47:44.433022+0000","last_undegraded":"2024-04-26T11:47:44.433022+0000","last_fullsized":"2024-04-26T11:47:44.433022+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":116,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.146112+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:47:44.146112+0000","last_peered":"2024-04-26T11:47:44.146112+0000","last_clean":"2024-04-26T11:47:44.146112+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:47:44.146112+0000","last_undegraded":"2024-04-26T11:47:44.146112+0000","last_fullsized":"2024-04-26T11:47:44.146112+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":519,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.144378+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:47:44.144378+0000","last_peered":"2024-04-26T11:47:44.144378+0000","last_clean":"2024-04-26T11:47:44.144378+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:47:44.144378+0000","last_undegraded":"2024-04-26T11:47:44.144378+0000","last_fullsized":"2024-04-26T11:47:44.144378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":59,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.433875+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:47:44.433875+0000","last_peered":"2024-04-26T11:47:44.433875+0000","last_clean":"2024-04-26T11:47:44.433875+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:47:44.433875+0000","last_undegraded":"2024-04-26T11:47:44.433875+0000","last_fullsized":"2024-04-26T11:47:44.433875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.433001+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:47:44.433001+0000","last_peered":"2024-04-26T11:47:44.433001+0000","last_clean":"2024-04-26T11:47:44.433001+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:47:44.433001+0000","last_undegraded":"2024-04-26T11:47:44.433001+0000","last_fullsized":"2024-04-26T11:47:44.433001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":475,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.432040+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:47:44.432040+0000","last_peered":"2024-04-26T11:47:44.432040+0000","last_clean":"2024-04-26T11:47:44.432040+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:47:44.432040+0000","last_undegraded":"2024-04-26T11:47:44.432040+0000","last_fullsized":"2024-04-26T11:47:44.432040+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:47.076399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":70,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.433234+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:47:44.433234+0000","last_peered":"2024-04-26T11:47:44.433234+0000","last_clean":"2024-04-26T11:47:44.433234+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:47:44.433234+0000","last_undegraded":"2024-04-26T11:47:44.433234+0000","last_fullsized":"2024-04-26T11:47:44.433234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":103,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139895+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:47:44.139895+0000","last_peered":"2024-04-26T11:47:44.139895+0000","last_clean":"2024-04-26T11:47:44.139895+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:47:44.139895+0000","last_undegraded":"2024-04-26T11:47:44.139895+0000","last_fullsized":"2024-04-26T11:47:44.139895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":552,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.143875+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:47:44.143875+0000","last_peered":"2024-04-26T11:47:44.143875+0000","last_clean":"2024-04-26T11:47:44.143875+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:47:44.143875+0000","last_undegraded":"2024-04-26T11:47:44.143875+0000","last_fullsized":"2024-04-26T11:47:44.143875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":564,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139473+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:47:44.139473+0000","last_peered":"2024-04-26T11:47:44.139473+0000","last_clean":"2024-04-26T11:47:44.139473+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:47:44.139473+0000","last_undegraded":"2024-04-26T11:47:44.139473+0000","last_fullsized":"2024-04-26T11:47:44.139473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139282+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:47:44.139282+0000","last_peered":"2024-04-26T11:47:44.139282+0000","last_clean":"2024-04-26T11:47:44.139282+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:47:44.139282+0000","last_undegraded":"2024-04-26T11:47:44.139282+0000","last_fullsized":"2024-04-26T11:47:44.139282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":538,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.431710+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:47:44.431710+0000","last_peered":"2024-04-26T11:47:44.431710+0000","last_clean":"2024-04-26T11:47:44.431710+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:47:44.431710+0000","last_undegraded":"2024-04-26T11:47:44.431710+0000","last_fullsized":"2024-04-26T11:47:44.431710+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":203,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145911+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:47:44.145911+0000","last_peered":"2024-04-26T11:47:44.145911+0000","last_clean":"2024-04-26T11:47:44.145911+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:47:44.145911+0000","last_undegraded":"2024-04-26T11:47:44.145911+0000","last_fullsized":"2024-04-26T11:47:44.145911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":458,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.140020+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:47:44.140020+0000","last_peered":"2024-04-26T11:47:44.140020+0000","last_clean":"2024-04-26T11:47:44.140020+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:47:44.140020+0000","last_undegraded":"2024-04-26T11:47:44.140020+0000","last_fullsized":"2024-04-26T11:47:44.140020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":571,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.431768+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:47:44.431768+0000","last_peered":"2024-04-26T11:47:44.431768+0000","last_clean":"2024-04-26T11:47:44.431768+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:47:44.431768+0000","last_undegraded":"2024-04-26T11:47:44.431768+0000","last_fullsized":"2024-04-26T11:47:44.431768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":55,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.434303+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:47:44.434303+0000","last_peered":"2024-04-26T11:47:44.434303+0000","last_clean":"2024-04-26T11:47:44.434303+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:47:44.434303+0000","last_undegraded":"2024-04-26T11:47:44.434303+0000","last_fullsized":"2024-04-26T11:47:44.434303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":567,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.431565+0000","last_change":"2024-04-26T11:47:41.467086+0000","last_active":"2024-04-26T11:47:44.431565+0000","last_peered":"2024-04-26T11:47:44.431565+0000","last_clean":"2024-04-26T11:47:44.431565+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:47:44.431565+0000","last_undegraded":"2024-04-26T11:47:44.431565+0000","last_fullsized":"2024-04-26T11:47:44.431565+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:45.011728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":510,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145809+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:47:44.145809+0000","last_peered":"2024-04-26T11:47:44.145809+0000","last_clean":"2024-04-26T11:47:44.145809+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:47:44.145809+0000","last_undegraded":"2024-04-26T11:47:44.145809+0000","last_fullsized":"2024-04-26T11:47:44.145809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":867,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.431177+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:47:44.431177+0000","last_peered":"2024-04-26T11:47:44.431177+0000","last_clean":"2024-04-26T11:47:44.431177+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:47:44.431177+0000","last_undegraded":"2024-04-26T11:47:44.431177+0000","last_fullsized":"2024-04-26T11:47:44.431177+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":490,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.433536+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:47:44.433536+0000","last_peered":"2024-04-26T11:47:44.433536+0000","last_clean":"2024-04-26T11:47:44.433536+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:47:44.433536+0000","last_undegraded":"2024-04-26T11:47:44.433536+0000","last_fullsized":"2024-04-26T11:47:44.433536+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":424,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.431301+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:47:44.431301+0000","last_peered":"2024-04-26T11:47:44.431301+0000","last_clean":"2024-04-26T11:47:44.431301+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:47:44.431301+0000","last_undegraded":"2024-04-26T11:47:44.431301+0000","last_fullsized":"2024-04-26T11:47:44.431301+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":531,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145629+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:47:44.145629+0000","last_peered":"2024-04-26T11:47:44.145629+0000","last_clean":"2024-04-26T11:47:44.145629+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:47:44.145629+0000","last_undegraded":"2024-04-26T11:47:44.145629+0000","last_fullsized":"2024-04-26T11:47:44.145629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":480,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145311+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:47:44.145311+0000","last_peered":"2024-04-26T11:47:44.145311+0000","last_clean":"2024-04-26T11:47:44.145311+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:47:44.145311+0000","last_undegraded":"2024-04-26T11:47:44.145311+0000","last_fullsized":"2024-04-26T11:47:44.145311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":846,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145457+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:47:44.145457+0000","last_peered":"2024-04-26T11:47:44.145457+0000","last_clean":"2024-04-26T11:47:44.145457+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:47:44.145457+0000","last_undegraded":"2024-04-26T11:47:44.145457+0000","last_fullsized":"2024-04-26T11:47:44.145457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":157,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145261+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:47:44.145261+0000","last_peered":"2024-04-26T11:47:44.145261+0000","last_clean":"2024-04-26T11:47:44.145261+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:47:44.145261+0000","last_undegraded":"2024-04-26T11:47:44.145261+0000","last_fullsized":"2024-04-26T11:47:44.145261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":876,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138408+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:47:44.138408+0000","last_peered":"2024-04-26T11:47:44.138408+0000","last_clean":"2024-04-26T11:47:44.138408+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:47:44.138408+0000","last_undegraded":"2024-04-26T11:47:44.138408+0000","last_fullsized":"2024-04-26T11:47:44.138408+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":400,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139244+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:47:44.139244+0000","last_peered":"2024-04-26T11:47:44.139244+0000","last_clean":"2024-04-26T11:47:44.139244+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:47:44.139244+0000","last_undegraded":"2024-04-26T11:47:44.139244+0000","last_fullsized":"2024-04-26T11:47:44.139244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":893,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.139142+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:47:44.139142+0000","last_peered":"2024-04-26T11:47:44.139142+0000","last_clean":"2024-04-26T11:47:44.139142+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:47:44.139142+0000","last_undegraded":"2024-04-26T11:47:44.139142+0000","last_fullsized":"2024-04-26T11:47:44.139142+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":429,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.145787+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:47:44.145787+0000","last_peered":"2024-04-26T11:47:44.145787+0000","last_clean":"2024-04-26T11:47:44.145787+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:47:44.145787+0000","last_undegraded":"2024-04-26T11:47:44.145787+0000","last_fullsized":"2024-04-26T11:47:44.145787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":944,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.146060+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:47:44.146060+0000","last_peered":"2024-04-26T11:47:44.146060+0000","last_clean":"2024-04-26T11:47:44.146060+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:47:44.146060+0000","last_undegraded":"2024-04-26T11:47:44.146060+0000","last_fullsized":"2024-04-26T11:47:44.146060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":64,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.433868+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:47:44.433868+0000","last_peered":"2024-04-26T11:47:44.433868+0000","last_clean":"2024-04-26T11:47:44.433868+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:47:44.433868+0000","last_undegraded":"2024-04-26T11:47:44.433868+0000","last_fullsized":"2024-04-26T11:47:44.433868+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":972,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.138485+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:47:44.138485+0000","last_peered":"2024-04-26T11:47:44.138485+0000","last_clean":"2024-04-26T11:47:44.138485+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:47:44.138485+0000","last_undegraded":"2024-04-26T11:47:44.138485+0000","last_fullsized":"2024-04-26T11:47:44.138485+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.430609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:47:44.433373+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:47:44.433373+0000","last_peered":"2024-04-26T11:47:44.433373+0000","last_clean":"2024-04-26T11:47:44.433373+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:47:44.433373+0000","last_undegraded":"2024-04-26T11:47:44.433373+0000","last_fullsized":"2024-04-26T11:47:44.433373+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738416,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200436,"kb_used_data":89000,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171404,"statfs":{"total":96636764160,"available":96431517696,"internally_reserved":0,"allocated":91136000,"data_stored":90550561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":1,"up_from":72,"seq":309237645321,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125556,"kb_used_data":79976,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246284,"statfs":{"total":96636764160,"available":96508194816,"internally_reserved":0,"allocated":81895424,"data_stored":81331706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":0,"up_from":8,"seq":34359738415,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190616,"kb_used_data":83268,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181224,"statfs":{"total":96636764160,"available":96441573376,"internally_reserved":0,"allocated":85266432,"data_stored":84692604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.68300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:47:50.477 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T11:47:50.477 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:47:50.477 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-04-26T11:47:50.477 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-04-26T11:47:51.156 INFO:tasks.ceph.mon.a.smithi029.stderr:2024-04-26T11:47:51.151+0000 7f90ec683700 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-04-26T11:47:51.171 INFO:teuthology.orchestra.run.smithi029.stderr:osd set-full-ratio 0.001 2024-04-26T11:47:52.184 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-04-26T11:47:52.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-04-26T11:47:53.187 INFO:teuthology.orchestra.run.smithi029.stderr:osd set-full-ratio 0.95 2024-04-26T11:47:58.201 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T11:47:58.343 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a: {} 2024-04-26T11:47:58.364 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b: {} 2024-04-26T11:47:58.376 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c: {} 2024-04-26T11:47:58.382 INFO:teuthology.orchestra.run.smithi029.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:47:58.383 INFO:teuthology.orchestra.run.smithi029.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:47:58.383 INFO:teuthology.orchestra.run.smithi029.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:47:58.393 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T11:47:59.125 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T11:47:59.138 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T11:48:00.137 INFO:teuthology.orchestra.run.smithi029.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T11:48:00.149 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T11:48:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T11:48:01.159 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T11:48:02.155 INFO:teuthology.orchestra.run.smithi029.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T11:48:02.168 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T11:48:03.167 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T11:48:03.179 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T11:48:04.181 INFO:teuthology.orchestra.run.smithi029.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T11:48:04.196 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T11:48:04.196 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T11:48:04.196 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T11:48:04.196 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T11:48:04.196 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T11:48:04.196 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:48:04.498 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:48:04.498 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":115,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:48:04.159996+0000","last_up_change":"2024-04-26T11:47:10.111142+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":72,"up_thru":103,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1425},{"type":"v1","addr":"172.21.15.82:6801","nonce":1425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1425},{"type":"v1","addr":"172.21.15.82:6803","nonce":1425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1425},{"type":"v1","addr":"172.21.15.82:6807","nonce":1425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1425},{"type":"v1","addr":"172.21.15.82:6805","nonce":1425}]},"public_addr":"172.21.15.82:6801/1425","cluster_addr":"172.21.15.82:6803/1425","heartbeat_back_addr":"172.21.15.82:6807/1425","heartbeat_front_addr":"172.21.15.82:6805/1425","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:48:04.513 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T11:48:04.514 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:48:04.815 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:48:04.815 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":115,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:48:04.159996+0000","last_up_change":"2024-04-26T11:47:10.111142+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":72,"up_thru":103,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1425},{"type":"v1","addr":"172.21.15.82:6801","nonce":1425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1425},{"type":"v1","addr":"172.21.15.82:6803","nonce":1425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1425},{"type":"v1","addr":"172.21.15.82:6807","nonce":1425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1425},{"type":"v1","addr":"172.21.15.82:6805","nonce":1425}]},"public_addr":"172.21.15.82:6801/1425","cluster_addr":"172.21.15.82:6803/1425","heartbeat_back_addr":"172.21.15.82:6807/1425","heartbeat_front_addr":"172.21.15.82:6805/1425","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:48:04.830 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T11:48:04.831 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T11:48:04.831 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T11:48:04.972 INFO:teuthology.orchestra.run.smithi029.stdout:34359738419 2024-04-26T11:48:04.972 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:48:04.988 INFO:teuthology.orchestra.run.smithi029.stdout:34359738420 2024-04-26T11:48:04.988 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:48:04.990 INFO:teuthology.orchestra.run.smithi029.stdout:309237645325 2024-04-26T11:48:04.990 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:48:05.280 INFO:teuthology.orchestra.run.smithi029.stdout:34359738417 2024-04-26T11:48:05.281 INFO:teuthology.orchestra.run.smithi029.stdout:34359738418 2024-04-26T11:48:05.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738419 got 34359738417 for osd.0 2024-04-26T11:48:05.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738420 got 34359738418 for osd.2 2024-04-26T11:48:05.349 INFO:teuthology.orchestra.run.smithi029.stdout:309237645323 2024-04-26T11:48:05.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 309237645325 got 309237645323 for osd.1 2024-04-26T11:48:06.302 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:48:06.302 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:48:06.366 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:48:06.605 INFO:teuthology.orchestra.run.smithi029.stdout:34359738419 2024-04-26T11:48:06.610 INFO:teuthology.orchestra.run.smithi029.stdout:34359738420 2024-04-26T11:48:06.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738419 got 34359738419 for osd.0 2024-04-26T11:48:06.620 DEBUG:teuthology.parallel:result is None 2024-04-26T11:48:06.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738420 got 34359738420 for osd.2 2024-04-26T11:48:06.629 DEBUG:teuthology.parallel:result is None 2024-04-26T11:48:06.681 INFO:teuthology.orchestra.run.smithi029.stdout:309237645325 2024-04-26T11:48:06.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 309237645325 got 309237645325 for osd.1 2024-04-26T11:48:06.696 DEBUG:teuthology.parallel:result is None 2024-04-26T11:48:06.696 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T11:48:06.696 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:48:07.024 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:48:07.026 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:48:07.039 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-04-26T11:48:06.055499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516788,"kb_used_data":252420,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598732,"statfs":{"total":289910292480,"available":289381101568,"internally_reserved":0,"allocated":258478080,"data_stored":256667819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921477"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":960,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345135+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:48:02.345135+0000","last_peered":"2024-04-26T11:48:02.345135+0000","last_clean":"2024-04-26T11:48:02.345135+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:48:02.345135+0000","last_undegraded":"2024-04-26T11:48:02.345135+0000","last_fullsized":"2024-04-26T11:48:02.345135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1017,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344511+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:48:02.344511+0000","last_peered":"2024-04-26T11:48:02.344511+0000","last_clean":"2024-04-26T11:48:02.344511+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:48:02.344511+0000","last_undegraded":"2024-04-26T11:48:02.344511+0000","last_fullsized":"2024-04-26T11:48:02.344511+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:25.339699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":524,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161869+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:03.161869+0000","last_peered":"2024-04-26T11:48:03.161869+0000","last_clean":"2024-04-26T11:48:03.161869+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:03.161869+0000","last_undegraded":"2024-04-26T11:48:03.161869+0000","last_fullsized":"2024-04-26T11:48:03.161869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":839,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161509+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:03.161509+0000","last_peered":"2024-04-26T11:48:03.161509+0000","last_clean":"2024-04-26T11:48:03.161509+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:03.161509+0000","last_undegraded":"2024-04-26T11:48:03.161509+0000","last_fullsized":"2024-04-26T11:48:03.161509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":916,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344231+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:48:02.344231+0000","last_peered":"2024-04-26T11:48:02.344231+0000","last_clean":"2024-04-26T11:48:02.344231+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:48:02.344231+0000","last_undegraded":"2024-04-26T11:48:02.344231+0000","last_fullsized":"2024-04-26T11:48:02.344231+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":845,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160817+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:48:03.160817+0000","last_peered":"2024-04-26T11:48:03.160817+0000","last_clean":"2024-04-26T11:48:03.160817+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:48:03.160817+0000","last_undegraded":"2024-04-26T11:48:03.160817+0000","last_fullsized":"2024-04-26T11:48:03.160817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1037,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161066+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:48:03.161066+0000","last_peered":"2024-04-26T11:48:03.161066+0000","last_clean":"2024-04-26T11:48:03.161066+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:48:03.161066+0000","last_undegraded":"2024-04-26T11:48:03.161066+0000","last_fullsized":"2024-04-26T11:48:03.161066+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:59.926464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":846,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160198+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:03.160198+0000","last_peered":"2024-04-26T11:48:03.160198+0000","last_clean":"2024-04-26T11:48:03.160198+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:03.160198+0000","last_undegraded":"2024-04-26T11:48:03.160198+0000","last_fullsized":"2024-04-26T11:48:03.160198+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:56.834748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":542,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826282+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:48:03.826282+0000","last_peered":"2024-04-26T11:48:03.826282+0000","last_clean":"2024-04-26T11:48:03.826282+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:03.826282+0000","last_undegraded":"2024-04-26T11:48:03.826282+0000","last_fullsized":"2024-04-26T11:48:03.826282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":959,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344619+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:48:02.344619+0000","last_peered":"2024-04-26T11:48:02.344619+0000","last_clean":"2024-04-26T11:48:02.344619+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:48:02.344619+0000","last_undegraded":"2024-04-26T11:48:02.344619+0000","last_fullsized":"2024-04-26T11:48:02.344619+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:32.091133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":873,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161839+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:48:03.161839+0000","last_peered":"2024-04-26T11:48:03.161839+0000","last_clean":"2024-04-26T11:48:03.161839+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:48:03.161839+0000","last_undegraded":"2024-04-26T11:48:03.161839+0000","last_fullsized":"2024-04-26T11:48:03.161839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":490,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344166+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:48:02.344166+0000","last_peered":"2024-04-26T11:48:02.344166+0000","last_clean":"2024-04-26T11:48:02.344166+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:02.344166+0000","last_undegraded":"2024-04-26T11:48:02.344166+0000","last_fullsized":"2024-04-26T11:48:02.344166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":892,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343964+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:48:02.343964+0000","last_peered":"2024-04-26T11:48:02.343964+0000","last_clean":"2024-04-26T11:48:02.343964+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:48:02.343964+0000","last_undegraded":"2024-04-26T11:48:02.343964+0000","last_fullsized":"2024-04-26T11:48:02.343964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":563,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160823+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:48:03.160823+0000","last_peered":"2024-04-26T11:48:03.160823+0000","last_clean":"2024-04-26T11:48:03.160823+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:03.160823+0000","last_undegraded":"2024-04-26T11:48:03.160823+0000","last_fullsized":"2024-04-26T11:48:03.160823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":605,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161294+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:48:03.161294+0000","last_peered":"2024-04-26T11:48:03.161294+0000","last_clean":"2024-04-26T11:48:03.161294+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:03.161294+0000","last_undegraded":"2024-04-26T11:48:03.161294+0000","last_fullsized":"2024-04-26T11:48:03.161294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1060,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160188+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:48:03.160188+0000","last_peered":"2024-04-26T11:48:03.160188+0000","last_clean":"2024-04-26T11:48:03.160188+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:48:03.160188+0000","last_undegraded":"2024-04-26T11:48:03.160188+0000","last_fullsized":"2024-04-26T11:48:03.160188+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:50.720876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":510,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826051+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:48:03.826051+0000","last_peered":"2024-04-26T11:48:03.826051+0000","last_clean":"2024-04-26T11:48:03.826051+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:03.826051+0000","last_undegraded":"2024-04-26T11:48:03.826051+0000","last_fullsized":"2024-04-26T11:48:03.826051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":924,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.342787+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:48:02.342787+0000","last_peered":"2024-04-26T11:48:02.342787+0000","last_clean":"2024-04-26T11:48:02.342787+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:48:02.342787+0000","last_undegraded":"2024-04-26T11:48:02.342787+0000","last_fullsized":"2024-04-26T11:48:02.342787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:10.908191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":531,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825386+0000","last_change":"2024-04-26T11:47:42.470100+0000","last_active":"2024-04-26T11:48:03.825386+0000","last_peered":"2024-04-26T11:48:03.825386+0000","last_clean":"2024-04-26T11:48:03.825386+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:48:03.825386+0000","last_undegraded":"2024-04-26T11:48:03.825386+0000","last_fullsized":"2024-04-26T11:48:03.825386+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:37.523362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1014,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162195+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:48:03.162195+0000","last_peered":"2024-04-26T11:48:03.162195+0000","last_clean":"2024-04-26T11:48:03.162195+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:48:03.162195+0000","last_undegraded":"2024-04-26T11:48:03.162195+0000","last_fullsized":"2024-04-26T11:48:03.162195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":928,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161249+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:48:03.161249+0000","last_peered":"2024-04-26T11:48:03.161249+0000","last_clean":"2024-04-26T11:48:03.161249+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:03.161249+0000","last_undegraded":"2024-04-26T11:48:03.161249+0000","last_fullsized":"2024-04-26T11:48:03.161249+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:16.863281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":576,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343679+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:48:02.343679+0000","last_peered":"2024-04-26T11:48:02.343679+0000","last_clean":"2024-04-26T11:48:02.343679+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:02.343679+0000","last_undegraded":"2024-04-26T11:48:02.343679+0000","last_fullsized":"2024-04-26T11:48:02.343679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823660+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:48:03.823660+0000","last_peered":"2024-04-26T11:48:03.823660+0000","last_clean":"2024-04-26T11:48:03.823660+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:48:03.823660+0000","last_undegraded":"2024-04-26T11:48:03.823660+0000","last_fullsized":"2024-04-26T11:48:03.823660+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1031,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343072+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:48:02.343072+0000","last_peered":"2024-04-26T11:48:02.343072+0000","last_clean":"2024-04-26T11:48:02.343072+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:48:02.343072+0000","last_undegraded":"2024-04-26T11:48:02.343072+0000","last_fullsized":"2024-04-26T11:48:02.343072+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":512,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345205+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:48:02.345205+0000","last_peered":"2024-04-26T11:48:02.345205+0000","last_clean":"2024-04-26T11:48:02.345205+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:48:02.345205+0000","last_undegraded":"2024-04-26T11:48:02.345205+0000","last_fullsized":"2024-04-26T11:48:02.345205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":621,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826248+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:48:03.826248+0000","last_peered":"2024-04-26T11:48:03.826248+0000","last_clean":"2024-04-26T11:48:03.826248+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:48:03.826248+0000","last_undegraded":"2024-04-26T11:48:03.826248+0000","last_fullsized":"2024-04-26T11:48:03.826248+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:48.523722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162056+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:48:03.162056+0000","last_peered":"2024-04-26T11:48:03.162056+0000","last_clean":"2024-04-26T11:48:03.162056+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:03.162056+0000","last_undegraded":"2024-04-26T11:48:03.162056+0000","last_fullsized":"2024-04-26T11:48:03.162056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":595,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344618+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:48:02.344618+0000","last_peered":"2024-04-26T11:48:02.344618+0000","last_clean":"2024-04-26T11:48:02.344618+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:02.344618+0000","last_undegraded":"2024-04-26T11:48:02.344618+0000","last_fullsized":"2024-04-26T11:48:02.344618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":508,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824009+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:48:03.824009+0000","last_peered":"2024-04-26T11:48:03.824009+0000","last_clean":"2024-04-26T11:48:03.824009+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:48:03.824009+0000","last_undegraded":"2024-04-26T11:48:03.824009+0000","last_fullsized":"2024-04-26T11:48:03.824009+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343945+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:48:02.343945+0000","last_peered":"2024-04-26T11:48:02.343945+0000","last_clean":"2024-04-26T11:48:02.343945+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:02.343945+0000","last_undegraded":"2024-04-26T11:48:02.343945+0000","last_fullsized":"2024-04-26T11:48:02.343945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":573,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825525+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:48:03.825525+0000","last_peered":"2024-04-26T11:48:03.825525+0000","last_clean":"2024-04-26T11:48:03.825525+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:03.825525+0000","last_undegraded":"2024-04-26T11:48:03.825525+0000","last_fullsized":"2024-04-26T11:48:03.825525+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":950,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160503+0000","last_change":"2024-04-26T11:47:45.147770+0000","last_active":"2024-04-26T11:48:03.160503+0000","last_peered":"2024-04-26T11:48:03.160503+0000","last_clean":"2024-04-26T11:48:03.160503+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:03.160503+0000","last_undegraded":"2024-04-26T11:48:03.160503+0000","last_fullsized":"2024-04-26T11:48:03.160503+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:52.444032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":841,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344401+0000","last_change":"2024-04-26T11:47:45.156703+0000","last_active":"2024-04-26T11:48:02.344401+0000","last_peered":"2024-04-26T11:48:02.344401+0000","last_clean":"2024-04-26T11:48:02.344401+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:02.344401+0000","last_undegraded":"2024-04-26T11:48:02.344401+0000","last_fullsized":"2024-04-26T11:48:02.344401+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:22.809278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":623,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161374+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:48:03.161374+0000","last_peered":"2024-04-26T11:48:03.161374+0000","last_clean":"2024-04-26T11:48:03.161374+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:03.161374+0000","last_undegraded":"2024-04-26T11:48:03.161374+0000","last_fullsized":"2024-04-26T11:48:03.161374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345164+0000","last_change":"2024-04-26T11:47:44.154527+0000","last_active":"2024-04-26T11:48:02.345164+0000","last_peered":"2024-04-26T11:48:02.345164+0000","last_clean":"2024-04-26T11:48:02.345164+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:02.345164+0000","last_undegraded":"2024-04-26T11:48:02.345164+0000","last_fullsized":"2024-04-26T11:48:02.345164+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:36.227910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":64,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824342+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:48:03.824342+0000","last_peered":"2024-04-26T11:48:03.824342+0000","last_clean":"2024-04-26T11:48:03.824342+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:03.824342+0000","last_undegraded":"2024-04-26T11:48:03.824342+0000","last_fullsized":"2024-04-26T11:48:03.824342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825621+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:48:03.825621+0000","last_peered":"2024-04-26T11:48:03.825621+0000","last_clean":"2024-04-26T11:48:03.825621+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:03.825621+0000","last_undegraded":"2024-04-26T11:48:03.825621+0000","last_fullsized":"2024-04-26T11:48:03.825621+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":167,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343469+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:48:02.343469+0000","last_peered":"2024-04-26T11:48:02.343469+0000","last_clean":"2024-04-26T11:48:02.343469+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:48:02.343469+0000","last_undegraded":"2024-04-26T11:48:02.343469+0000","last_fullsized":"2024-04-26T11:48:02.343469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":550,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825717+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:48:03.825717+0000","last_peered":"2024-04-26T11:48:03.825717+0000","last_clean":"2024-04-26T11:48:03.825717+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:03.825717+0000","last_undegraded":"2024-04-26T11:48:03.825717+0000","last_fullsized":"2024-04-26T11:48:03.825717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":175,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160477+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:48:03.160477+0000","last_peered":"2024-04-26T11:48:03.160477+0000","last_clean":"2024-04-26T11:48:03.160477+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:03.160477+0000","last_undegraded":"2024-04-26T11:48:03.160477+0000","last_fullsized":"2024-04-26T11:48:03.160477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":322,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162943+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:48:03.162943+0000","last_peered":"2024-04-26T11:48:03.162943+0000","last_clean":"2024-04-26T11:48:03.162943+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:03.162943+0000","last_undegraded":"2024-04-26T11:48:03.162943+0000","last_fullsized":"2024-04-26T11:48:03.162943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":539,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343162+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:48:02.343162+0000","last_peered":"2024-04-26T11:48:02.343162+0000","last_clean":"2024-04-26T11:48:02.343162+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:02.343162+0000","last_undegraded":"2024-04-26T11:48:02.343162+0000","last_fullsized":"2024-04-26T11:48:02.343162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":499,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344928+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:48:02.344928+0000","last_peered":"2024-04-26T11:48:02.344928+0000","last_clean":"2024-04-26T11:48:02.344928+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:48:02.344928+0000","last_undegraded":"2024-04-26T11:48:02.344928+0000","last_fullsized":"2024-04-26T11:48:02.344928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1030,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343160+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:48:02.343160+0000","last_peered":"2024-04-26T11:48:02.343160+0000","last_clean":"2024-04-26T11:48:02.343160+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:02.343160+0000","last_undegraded":"2024-04-26T11:48:02.343160+0000","last_fullsized":"2024-04-26T11:48:02.343160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":694,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162634+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:48:03.162634+0000","last_peered":"2024-04-26T11:48:03.162634+0000","last_clean":"2024-04-26T11:48:03.162634+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:03.162634+0000","last_undegraded":"2024-04-26T11:48:03.162634+0000","last_fullsized":"2024-04-26T11:48:03.162634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1015,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161081+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:48:03.161081+0000","last_peered":"2024-04-26T11:48:03.161081+0000","last_clean":"2024-04-26T11:48:03.161081+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:03.161081+0000","last_undegraded":"2024-04-26T11:48:03.161081+0000","last_fullsized":"2024-04-26T11:48:03.161081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":183,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162531+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:48:03.162531+0000","last_peered":"2024-04-26T11:48:03.162531+0000","last_clean":"2024-04-26T11:48:03.162531+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:48:03.162531+0000","last_undegraded":"2024-04-26T11:48:03.162531+0000","last_fullsized":"2024-04-26T11:48:03.162531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":620,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825094+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:48:03.825094+0000","last_peered":"2024-04-26T11:48:03.825094+0000","last_clean":"2024-04-26T11:48:03.825094+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:48:03.825094+0000","last_undegraded":"2024-04-26T11:48:03.825094+0000","last_fullsized":"2024-04-26T11:48:03.825094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":372,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824588+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:48:03.824588+0000","last_peered":"2024-04-26T11:48:03.824588+0000","last_clean":"2024-04-26T11:48:03.824588+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:03.824588+0000","last_undegraded":"2024-04-26T11:48:03.824588+0000","last_fullsized":"2024-04-26T11:48:03.824588+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":962,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161856+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:48:03.161856+0000","last_peered":"2024-04-26T11:48:03.161856+0000","last_clean":"2024-04-26T11:48:03.161856+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:03.161856+0000","last_undegraded":"2024-04-26T11:48:03.161856+0000","last_fullsized":"2024-04-26T11:48:03.161856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":283,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161232+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:48:03.161232+0000","last_peered":"2024-04-26T11:48:03.161232+0000","last_clean":"2024-04-26T11:48:03.161232+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:48:03.161232+0000","last_undegraded":"2024-04-26T11:48:03.161232+0000","last_fullsized":"2024-04-26T11:48:03.161232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":548,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162292+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:48:03.162292+0000","last_peered":"2024-04-26T11:48:03.162292+0000","last_clean":"2024-04-26T11:48:03.162292+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:03.162292+0000","last_undegraded":"2024-04-26T11:48:03.162292+0000","last_fullsized":"2024-04-26T11:48:03.162292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":161,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343897+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:48:02.343897+0000","last_peered":"2024-04-26T11:48:02.343897+0000","last_clean":"2024-04-26T11:48:02.343897+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:48:02.343897+0000","last_undegraded":"2024-04-26T11:48:02.343897+0000","last_fullsized":"2024-04-26T11:48:02.343897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":486,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162640+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:48:03.162640+0000","last_peered":"2024-04-26T11:48:03.162640+0000","last_clean":"2024-04-26T11:48:03.162640+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:03.162640+0000","last_undegraded":"2024-04-26T11:48:03.162640+0000","last_fullsized":"2024-04-26T11:48:03.162640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":633,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343271+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:48:02.343271+0000","last_peered":"2024-04-26T11:48:02.343271+0000","last_clean":"2024-04-26T11:48:02.343271+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:48:02.343271+0000","last_undegraded":"2024-04-26T11:48:02.343271+0000","last_fullsized":"2024-04-26T11:48:02.343271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":525,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826617+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:48:03.826617+0000","last_peered":"2024-04-26T11:48:03.826617+0000","last_clean":"2024-04-26T11:48:03.826617+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:48:03.826617+0000","last_undegraded":"2024-04-26T11:48:03.826617+0000","last_fullsized":"2024-04-26T11:48:03.826617+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":310,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161015+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:48:03.161015+0000","last_peered":"2024-04-26T11:48:03.161015+0000","last_clean":"2024-04-26T11:48:03.161015+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:48:03.161015+0000","last_undegraded":"2024-04-26T11:48:03.161015+0000","last_fullsized":"2024-04-26T11:48:03.161015+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161600+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:48:03.161600+0000","last_peered":"2024-04-26T11:48:03.161600+0000","last_clean":"2024-04-26T11:48:03.161600+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:48:03.161600+0000","last_undegraded":"2024-04-26T11:48:03.161600+0000","last_fullsized":"2024-04-26T11:48:03.161600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":614,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825007+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:48:03.825007+0000","last_peered":"2024-04-26T11:48:03.825007+0000","last_clean":"2024-04-26T11:48:03.825007+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:48:03.825007+0000","last_undegraded":"2024-04-26T11:48:03.825007+0000","last_fullsized":"2024-04-26T11:48:03.825007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":574,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162328+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:48:03.162328+0000","last_peered":"2024-04-26T11:48:03.162328+0000","last_clean":"2024-04-26T11:48:03.162328+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:03.162328+0000","last_undegraded":"2024-04-26T11:48:03.162328+0000","last_fullsized":"2024-04-26T11:48:03.162328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160745+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:48:03.160745+0000","last_peered":"2024-04-26T11:48:03.160745+0000","last_clean":"2024-04-26T11:48:03.160745+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:48:03.160745+0000","last_undegraded":"2024-04-26T11:48:03.160745+0000","last_fullsized":"2024-04-26T11:48:03.160745+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":366,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823407+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:48:03.823407+0000","last_peered":"2024-04-26T11:48:03.823407+0000","last_clean":"2024-04-26T11:48:03.823407+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:48:03.823407+0000","last_undegraded":"2024-04-26T11:48:03.823407+0000","last_fullsized":"2024-04-26T11:48:03.823407+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":997,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344910+0000","last_change":"2024-04-26T11:47:34.145286+0000","last_active":"2024-04-26T11:48:02.344910+0000","last_peered":"2024-04-26T11:48:02.344910+0000","last_clean":"2024-04-26T11:48:02.344910+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:02.344910+0000","last_undegraded":"2024-04-26T11:48:02.344910+0000","last_fullsized":"2024-04-26T11:48:02.344910+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:13.918331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823886+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:48:03.823886+0000","last_peered":"2024-04-26T11:48:03.823886+0000","last_clean":"2024-04-26T11:48:03.823886+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:03.823886+0000","last_undegraded":"2024-04-26T11:48:03.823886+0000","last_fullsized":"2024-04-26T11:48:03.823886+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":530,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343412+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:48:02.343412+0000","last_peered":"2024-04-26T11:48:02.343412+0000","last_clean":"2024-04-26T11:48:02.343412+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:48:02.343412+0000","last_undegraded":"2024-04-26T11:48:02.343412+0000","last_fullsized":"2024-04-26T11:48:02.343412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":458,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826547+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:48:03.826547+0000","last_peered":"2024-04-26T11:48:03.826547+0000","last_clean":"2024-04-26T11:48:03.826547+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:48:03.826547+0000","last_undegraded":"2024-04-26T11:48:03.826547+0000","last_fullsized":"2024-04-26T11:48:03.826547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161461+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:48:03.161461+0000","last_peered":"2024-04-26T11:48:03.161461+0000","last_clean":"2024-04-26T11:48:03.161461+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:48:03.161461+0000","last_undegraded":"2024-04-26T11:48:03.161461+0000","last_fullsized":"2024-04-26T11:48:03.161461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":186,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161510+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:48:03.161510+0000","last_peered":"2024-04-26T11:48:03.161510+0000","last_clean":"2024-04-26T11:48:03.161510+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:48:03.161510+0000","last_undegraded":"2024-04-26T11:48:03.161510+0000","last_fullsized":"2024-04-26T11:48:03.161510+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":502,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824262+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:48:03.824262+0000","last_peered":"2024-04-26T11:48:03.824262+0000","last_clean":"2024-04-26T11:48:03.824262+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:48:03.824262+0000","last_undegraded":"2024-04-26T11:48:03.824262+0000","last_fullsized":"2024-04-26T11:48:03.824262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":645,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162571+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:48:03.162571+0000","last_peered":"2024-04-26T11:48:03.162571+0000","last_clean":"2024-04-26T11:48:03.162571+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:48:03.162571+0000","last_undegraded":"2024-04-26T11:48:03.162571+0000","last_fullsized":"2024-04-26T11:48:03.162571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824165+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:48:03.824165+0000","last_peered":"2024-04-26T11:48:03.824165+0000","last_clean":"2024-04-26T11:48:03.824165+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:48:03.824165+0000","last_undegraded":"2024-04-26T11:48:03.824165+0000","last_fullsized":"2024-04-26T11:48:03.824165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":485,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343931+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:48:02.343931+0000","last_peered":"2024-04-26T11:48:02.343931+0000","last_clean":"2024-04-26T11:48:02.343931+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:02.343931+0000","last_undegraded":"2024-04-26T11:48:02.343931+0000","last_fullsized":"2024-04-26T11:48:02.343931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824763+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:48:03.824763+0000","last_peered":"2024-04-26T11:48:03.824763+0000","last_clean":"2024-04-26T11:48:03.824763+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:03.824763+0000","last_undegraded":"2024-04-26T11:48:03.824763+0000","last_fullsized":"2024-04-26T11:48:03.824763+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345473+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:48:02.345473+0000","last_peered":"2024-04-26T11:48:02.345473+0000","last_clean":"2024-04-26T11:48:02.345473+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:48:02.345473+0000","last_undegraded":"2024-04-26T11:48:02.345473+0000","last_fullsized":"2024-04-26T11:48:02.345473+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":526,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344236+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:48:02.344236+0000","last_peered":"2024-04-26T11:48:02.344236+0000","last_clean":"2024-04-26T11:48:02.344236+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:02.344236+0000","last_undegraded":"2024-04-26T11:48:02.344236+0000","last_fullsized":"2024-04-26T11:48:02.344236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825839+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:48:03.825839+0000","last_peered":"2024-04-26T11:48:03.825839+0000","last_clean":"2024-04-26T11:48:03.825839+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:03.825839+0000","last_undegraded":"2024-04-26T11:48:03.825839+0000","last_fullsized":"2024-04-26T11:48:03.825839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825423+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:48:03.825423+0000","last_peered":"2024-04-26T11:48:03.825423+0000","last_clean":"2024-04-26T11:48:03.825423+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:03.825423+0000","last_undegraded":"2024-04-26T11:48:03.825423+0000","last_fullsized":"2024-04-26T11:48:03.825423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":483,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823562+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:48:03.823562+0000","last_peered":"2024-04-26T11:48:03.823562+0000","last_clean":"2024-04-26T11:48:03.823562+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:48:03.823562+0000","last_undegraded":"2024-04-26T11:48:03.823562+0000","last_fullsized":"2024-04-26T11:48:03.823562+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:47.076399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":78,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825424+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:48:03.825424+0000","last_peered":"2024-04-26T11:48:03.825424+0000","last_clean":"2024-04-26T11:48:03.825424+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:03.825424+0000","last_undegraded":"2024-04-26T11:48:03.825424+0000","last_fullsized":"2024-04-26T11:48:03.825424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162936+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:48:03.162936+0000","last_peered":"2024-04-26T11:48:03.162936+0000","last_clean":"2024-04-26T11:48:03.162936+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:48:03.162936+0000","last_undegraded":"2024-04-26T11:48:03.162936+0000","last_fullsized":"2024-04-26T11:48:03.162936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":559,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343413+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:48:02.343413+0000","last_peered":"2024-04-26T11:48:02.343413+0000","last_clean":"2024-04-26T11:48:02.343413+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:02.343413+0000","last_undegraded":"2024-04-26T11:48:02.343413+0000","last_fullsized":"2024-04-26T11:48:02.343413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":572,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161019+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:48:03.161019+0000","last_peered":"2024-04-26T11:48:03.161019+0000","last_clean":"2024-04-26T11:48:03.161019+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:48:03.161019+0000","last_undegraded":"2024-04-26T11:48:03.161019+0000","last_fullsized":"2024-04-26T11:48:03.161019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":519,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162325+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:48:03.162325+0000","last_peered":"2024-04-26T11:48:03.162325+0000","last_clean":"2024-04-26T11:48:03.162325+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:03.162325+0000","last_undegraded":"2024-04-26T11:48:03.162325+0000","last_fullsized":"2024-04-26T11:48:03.162325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":546,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824093+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:48:03.824093+0000","last_peered":"2024-04-26T11:48:03.824093+0000","last_clean":"2024-04-26T11:48:03.824093+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:03.824093+0000","last_undegraded":"2024-04-26T11:48:03.824093+0000","last_fullsized":"2024-04-26T11:48:03.824093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":210,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345365+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:48:02.345365+0000","last_peered":"2024-04-26T11:48:02.345365+0000","last_clean":"2024-04-26T11:48:02.345365+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:48:02.345365+0000","last_undegraded":"2024-04-26T11:48:02.345365+0000","last_fullsized":"2024-04-26T11:48:02.345365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":466,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162787+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:48:03.162787+0000","last_peered":"2024-04-26T11:48:03.162787+0000","last_clean":"2024-04-26T11:48:03.162787+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:48:03.162787+0000","last_undegraded":"2024-04-26T11:48:03.162787+0000","last_fullsized":"2024-04-26T11:48:03.162787+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":579,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823761+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:48:03.823761+0000","last_peered":"2024-04-26T11:48:03.823761+0000","last_clean":"2024-04-26T11:48:03.823761+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:03.823761+0000","last_undegraded":"2024-04-26T11:48:03.823761+0000","last_fullsized":"2024-04-26T11:48:03.823761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":63,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826308+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:48:03.826308+0000","last_peered":"2024-04-26T11:48:03.826308+0000","last_clean":"2024-04-26T11:48:03.826308+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:03.826308+0000","last_undegraded":"2024-04-26T11:48:03.826308+0000","last_fullsized":"2024-04-26T11:48:03.826308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":575,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823378+0000","last_change":"2024-04-26T11:47:41.467086+0000","last_active":"2024-04-26T11:48:03.823378+0000","last_peered":"2024-04-26T11:48:03.823378+0000","last_clean":"2024-04-26T11:48:03.823378+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:03.823378+0000","last_undegraded":"2024-04-26T11:48:03.823378+0000","last_fullsized":"2024-04-26T11:48:03.823378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:45.011728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":517,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345346+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:48:02.345346+0000","last_peered":"2024-04-26T11:48:02.345346+0000","last_clean":"2024-04-26T11:48:02.345346+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:02.345346+0000","last_undegraded":"2024-04-26T11:48:02.345346+0000","last_fullsized":"2024-04-26T11:48:02.345346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":875,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823118+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:48:03.823118+0000","last_peered":"2024-04-26T11:48:03.823118+0000","last_clean":"2024-04-26T11:48:03.823118+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:48:03.823118+0000","last_undegraded":"2024-04-26T11:48:03.823118+0000","last_fullsized":"2024-04-26T11:48:03.823118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":498,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826015+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:48:03.826015+0000","last_peered":"2024-04-26T11:48:03.826015+0000","last_clean":"2024-04-26T11:48:03.826015+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:48:03.826015+0000","last_undegraded":"2024-04-26T11:48:03.826015+0000","last_fullsized":"2024-04-26T11:48:03.826015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":432,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823352+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:48:03.823352+0000","last_peered":"2024-04-26T11:48:03.823352+0000","last_clean":"2024-04-26T11:48:03.823352+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:48:03.823352+0000","last_undegraded":"2024-04-26T11:48:03.823352+0000","last_fullsized":"2024-04-26T11:48:03.823352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":538,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345036+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:48:02.345036+0000","last_peered":"2024-04-26T11:48:02.345036+0000","last_clean":"2024-04-26T11:48:02.345036+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:02.345036+0000","last_undegraded":"2024-04-26T11:48:02.345036+0000","last_fullsized":"2024-04-26T11:48:02.345036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":487,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344183+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:48:02.344183+0000","last_peered":"2024-04-26T11:48:02.344183+0000","last_clean":"2024-04-26T11:48:02.344183+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:48:02.344183+0000","last_undegraded":"2024-04-26T11:48:02.344183+0000","last_fullsized":"2024-04-26T11:48:02.344183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":853,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344697+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:48:02.344697+0000","last_peered":"2024-04-26T11:48:02.344697+0000","last_clean":"2024-04-26T11:48:02.344697+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:02.344697+0000","last_undegraded":"2024-04-26T11:48:02.344697+0000","last_fullsized":"2024-04-26T11:48:02.344697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":164,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344504+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:48:02.344504+0000","last_peered":"2024-04-26T11:48:02.344504+0000","last_clean":"2024-04-26T11:48:02.344504+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:48:02.344504+0000","last_undegraded":"2024-04-26T11:48:02.344504+0000","last_fullsized":"2024-04-26T11:48:02.344504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":884,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160938+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:48:03.160938+0000","last_peered":"2024-04-26T11:48:03.160938+0000","last_clean":"2024-04-26T11:48:03.160938+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:03.160938+0000","last_undegraded":"2024-04-26T11:48:03.160938+0000","last_fullsized":"2024-04-26T11:48:03.160938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":408,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162094+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:48:03.162094+0000","last_peered":"2024-04-26T11:48:03.162094+0000","last_clean":"2024-04-26T11:48:03.162094+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:03.162094+0000","last_undegraded":"2024-04-26T11:48:03.162094+0000","last_fullsized":"2024-04-26T11:48:03.162094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":901,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161287+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:48:03.161287+0000","last_peered":"2024-04-26T11:48:03.161287+0000","last_clean":"2024-04-26T11:48:03.161287+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:03.161287+0000","last_undegraded":"2024-04-26T11:48:03.161287+0000","last_fullsized":"2024-04-26T11:48:03.161287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":436,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345272+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:48:02.345272+0000","last_peered":"2024-04-26T11:48:02.345272+0000","last_clean":"2024-04-26T11:48:02.345272+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:02.345272+0000","last_undegraded":"2024-04-26T11:48:02.345272+0000","last_fullsized":"2024-04-26T11:48:02.345272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":951,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343732+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:48:02.343732+0000","last_peered":"2024-04-26T11:48:02.343732+0000","last_clean":"2024-04-26T11:48:02.343732+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:02.343732+0000","last_undegraded":"2024-04-26T11:48:02.343732+0000","last_fullsized":"2024-04-26T11:48:02.343732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":72,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826406+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:48:03.826406+0000","last_peered":"2024-04-26T11:48:03.826406+0000","last_clean":"2024-04-26T11:48:03.826406+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:48:03.826406+0000","last_undegraded":"2024-04-26T11:48:03.826406+0000","last_fullsized":"2024-04-26T11:48:03.826406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":980,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160781+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:48:03.160781+0000","last_peered":"2024-04-26T11:48:03.160781+0000","last_clean":"2024-04-26T11:48:03.160781+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:48:03.160781+0000","last_undegraded":"2024-04-26T11:48:03.160781+0000","last_fullsized":"2024-04-26T11:48:03.160781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.430609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":70,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826070+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:48:03.826070+0000","last_peered":"2024-04-26T11:48:03.826070+0000","last_clean":"2024-04-26T11:48:03.826070+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:48:03.826070+0000","last_undegraded":"2024-04-26T11:48:03.826070+0000","last_fullsized":"2024-04-26T11:48:03.826070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738420,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200492,"kb_used_data":89056,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171348,"statfs":{"total":96636764160,"available":96431460352,"internally_reserved":0,"allocated":91193344,"data_stored":90580133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":1,"up_from":72,"seq":309237645325,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125624,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246216,"statfs":{"total":96636764160,"available":96508125184,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190672,"kb_used_data":83324,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181168,"statfs":{"total":96636764160,"available":96441516032,"internally_reserved":0,"allocated":85323776,"data_stored":84722176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:48:07.044 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:48:07.356 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:48:07.358 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:48:07.370 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-04-26T11:48:06.055499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516788,"kb_used_data":252420,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598732,"statfs":{"total":289910292480,"available":289381101568,"internally_reserved":0,"allocated":258478080,"data_stored":256667819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921477"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":960,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345135+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:48:02.345135+0000","last_peered":"2024-04-26T11:48:02.345135+0000","last_clean":"2024-04-26T11:48:02.345135+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:48:02.345135+0000","last_undegraded":"2024-04-26T11:48:02.345135+0000","last_fullsized":"2024-04-26T11:48:02.345135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1017,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344511+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:48:02.344511+0000","last_peered":"2024-04-26T11:48:02.344511+0000","last_clean":"2024-04-26T11:48:02.344511+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:48:02.344511+0000","last_undegraded":"2024-04-26T11:48:02.344511+0000","last_fullsized":"2024-04-26T11:48:02.344511+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:25.339699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":524,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161869+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:03.161869+0000","last_peered":"2024-04-26T11:48:03.161869+0000","last_clean":"2024-04-26T11:48:03.161869+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:03.161869+0000","last_undegraded":"2024-04-26T11:48:03.161869+0000","last_fullsized":"2024-04-26T11:48:03.161869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":839,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161509+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:03.161509+0000","last_peered":"2024-04-26T11:48:03.161509+0000","last_clean":"2024-04-26T11:48:03.161509+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:03.161509+0000","last_undegraded":"2024-04-26T11:48:03.161509+0000","last_fullsized":"2024-04-26T11:48:03.161509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":916,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344231+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:48:02.344231+0000","last_peered":"2024-04-26T11:48:02.344231+0000","last_clean":"2024-04-26T11:48:02.344231+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:48:02.344231+0000","last_undegraded":"2024-04-26T11:48:02.344231+0000","last_fullsized":"2024-04-26T11:48:02.344231+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":845,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160817+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:48:03.160817+0000","last_peered":"2024-04-26T11:48:03.160817+0000","last_clean":"2024-04-26T11:48:03.160817+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:48:03.160817+0000","last_undegraded":"2024-04-26T11:48:03.160817+0000","last_fullsized":"2024-04-26T11:48:03.160817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1037,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161066+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:48:03.161066+0000","last_peered":"2024-04-26T11:48:03.161066+0000","last_clean":"2024-04-26T11:48:03.161066+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:48:03.161066+0000","last_undegraded":"2024-04-26T11:48:03.161066+0000","last_fullsized":"2024-04-26T11:48:03.161066+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:59.926464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":846,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160198+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:03.160198+0000","last_peered":"2024-04-26T11:48:03.160198+0000","last_clean":"2024-04-26T11:48:03.160198+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:03.160198+0000","last_undegraded":"2024-04-26T11:48:03.160198+0000","last_fullsized":"2024-04-26T11:48:03.160198+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:56.834748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":542,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826282+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:48:03.826282+0000","last_peered":"2024-04-26T11:48:03.826282+0000","last_clean":"2024-04-26T11:48:03.826282+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:03.826282+0000","last_undegraded":"2024-04-26T11:48:03.826282+0000","last_fullsized":"2024-04-26T11:48:03.826282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":959,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344619+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:48:02.344619+0000","last_peered":"2024-04-26T11:48:02.344619+0000","last_clean":"2024-04-26T11:48:02.344619+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:48:02.344619+0000","last_undegraded":"2024-04-26T11:48:02.344619+0000","last_fullsized":"2024-04-26T11:48:02.344619+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:32.091133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":873,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161839+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:48:03.161839+0000","last_peered":"2024-04-26T11:48:03.161839+0000","last_clean":"2024-04-26T11:48:03.161839+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:48:03.161839+0000","last_undegraded":"2024-04-26T11:48:03.161839+0000","last_fullsized":"2024-04-26T11:48:03.161839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":490,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344166+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:48:02.344166+0000","last_peered":"2024-04-26T11:48:02.344166+0000","last_clean":"2024-04-26T11:48:02.344166+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:02.344166+0000","last_undegraded":"2024-04-26T11:48:02.344166+0000","last_fullsized":"2024-04-26T11:48:02.344166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":892,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343964+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:48:02.343964+0000","last_peered":"2024-04-26T11:48:02.343964+0000","last_clean":"2024-04-26T11:48:02.343964+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:48:02.343964+0000","last_undegraded":"2024-04-26T11:48:02.343964+0000","last_fullsized":"2024-04-26T11:48:02.343964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":563,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160823+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:48:03.160823+0000","last_peered":"2024-04-26T11:48:03.160823+0000","last_clean":"2024-04-26T11:48:03.160823+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:03.160823+0000","last_undegraded":"2024-04-26T11:48:03.160823+0000","last_fullsized":"2024-04-26T11:48:03.160823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":605,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161294+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:48:03.161294+0000","last_peered":"2024-04-26T11:48:03.161294+0000","last_clean":"2024-04-26T11:48:03.161294+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:03.161294+0000","last_undegraded":"2024-04-26T11:48:03.161294+0000","last_fullsized":"2024-04-26T11:48:03.161294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1060,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160188+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:48:03.160188+0000","last_peered":"2024-04-26T11:48:03.160188+0000","last_clean":"2024-04-26T11:48:03.160188+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:48:03.160188+0000","last_undegraded":"2024-04-26T11:48:03.160188+0000","last_fullsized":"2024-04-26T11:48:03.160188+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:50.720876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":510,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826051+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:48:03.826051+0000","last_peered":"2024-04-26T11:48:03.826051+0000","last_clean":"2024-04-26T11:48:03.826051+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:03.826051+0000","last_undegraded":"2024-04-26T11:48:03.826051+0000","last_fullsized":"2024-04-26T11:48:03.826051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":924,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.342787+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:48:02.342787+0000","last_peered":"2024-04-26T11:48:02.342787+0000","last_clean":"2024-04-26T11:48:02.342787+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:48:02.342787+0000","last_undegraded":"2024-04-26T11:48:02.342787+0000","last_fullsized":"2024-04-26T11:48:02.342787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:10.908191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":531,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825386+0000","last_change":"2024-04-26T11:47:42.470100+0000","last_active":"2024-04-26T11:48:03.825386+0000","last_peered":"2024-04-26T11:48:03.825386+0000","last_clean":"2024-04-26T11:48:03.825386+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:48:03.825386+0000","last_undegraded":"2024-04-26T11:48:03.825386+0000","last_fullsized":"2024-04-26T11:48:03.825386+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:37.523362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1014,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162195+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:48:03.162195+0000","last_peered":"2024-04-26T11:48:03.162195+0000","last_clean":"2024-04-26T11:48:03.162195+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:48:03.162195+0000","last_undegraded":"2024-04-26T11:48:03.162195+0000","last_fullsized":"2024-04-26T11:48:03.162195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":928,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161249+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:48:03.161249+0000","last_peered":"2024-04-26T11:48:03.161249+0000","last_clean":"2024-04-26T11:48:03.161249+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:03.161249+0000","last_undegraded":"2024-04-26T11:48:03.161249+0000","last_fullsized":"2024-04-26T11:48:03.161249+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:16.863281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":576,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343679+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:48:02.343679+0000","last_peered":"2024-04-26T11:48:02.343679+0000","last_clean":"2024-04-26T11:48:02.343679+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:02.343679+0000","last_undegraded":"2024-04-26T11:48:02.343679+0000","last_fullsized":"2024-04-26T11:48:02.343679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823660+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:48:03.823660+0000","last_peered":"2024-04-26T11:48:03.823660+0000","last_clean":"2024-04-26T11:48:03.823660+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:48:03.823660+0000","last_undegraded":"2024-04-26T11:48:03.823660+0000","last_fullsized":"2024-04-26T11:48:03.823660+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1031,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343072+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:48:02.343072+0000","last_peered":"2024-04-26T11:48:02.343072+0000","last_clean":"2024-04-26T11:48:02.343072+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:48:02.343072+0000","last_undegraded":"2024-04-26T11:48:02.343072+0000","last_fullsized":"2024-04-26T11:48:02.343072+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":512,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345205+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:48:02.345205+0000","last_peered":"2024-04-26T11:48:02.345205+0000","last_clean":"2024-04-26T11:48:02.345205+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:48:02.345205+0000","last_undegraded":"2024-04-26T11:48:02.345205+0000","last_fullsized":"2024-04-26T11:48:02.345205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":621,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826248+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:48:03.826248+0000","last_peered":"2024-04-26T11:48:03.826248+0000","last_clean":"2024-04-26T11:48:03.826248+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:48:03.826248+0000","last_undegraded":"2024-04-26T11:48:03.826248+0000","last_fullsized":"2024-04-26T11:48:03.826248+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:48.523722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162056+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:48:03.162056+0000","last_peered":"2024-04-26T11:48:03.162056+0000","last_clean":"2024-04-26T11:48:03.162056+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:03.162056+0000","last_undegraded":"2024-04-26T11:48:03.162056+0000","last_fullsized":"2024-04-26T11:48:03.162056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":595,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344618+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:48:02.344618+0000","last_peered":"2024-04-26T11:48:02.344618+0000","last_clean":"2024-04-26T11:48:02.344618+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:02.344618+0000","last_undegraded":"2024-04-26T11:48:02.344618+0000","last_fullsized":"2024-04-26T11:48:02.344618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":508,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824009+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:48:03.824009+0000","last_peered":"2024-04-26T11:48:03.824009+0000","last_clean":"2024-04-26T11:48:03.824009+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:48:03.824009+0000","last_undegraded":"2024-04-26T11:48:03.824009+0000","last_fullsized":"2024-04-26T11:48:03.824009+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343945+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:48:02.343945+0000","last_peered":"2024-04-26T11:48:02.343945+0000","last_clean":"2024-04-26T11:48:02.343945+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:02.343945+0000","last_undegraded":"2024-04-26T11:48:02.343945+0000","last_fullsized":"2024-04-26T11:48:02.343945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":573,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825525+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:48:03.825525+0000","last_peered":"2024-04-26T11:48:03.825525+0000","last_clean":"2024-04-26T11:48:03.825525+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:03.825525+0000","last_undegraded":"2024-04-26T11:48:03.825525+0000","last_fullsized":"2024-04-26T11:48:03.825525+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":950,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160503+0000","last_change":"2024-04-26T11:47:45.147770+0000","last_active":"2024-04-26T11:48:03.160503+0000","last_peered":"2024-04-26T11:48:03.160503+0000","last_clean":"2024-04-26T11:48:03.160503+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:03.160503+0000","last_undegraded":"2024-04-26T11:48:03.160503+0000","last_fullsized":"2024-04-26T11:48:03.160503+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:52.444032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":841,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344401+0000","last_change":"2024-04-26T11:47:45.156703+0000","last_active":"2024-04-26T11:48:02.344401+0000","last_peered":"2024-04-26T11:48:02.344401+0000","last_clean":"2024-04-26T11:48:02.344401+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:02.344401+0000","last_undegraded":"2024-04-26T11:48:02.344401+0000","last_fullsized":"2024-04-26T11:48:02.344401+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:22.809278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":623,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161374+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:48:03.161374+0000","last_peered":"2024-04-26T11:48:03.161374+0000","last_clean":"2024-04-26T11:48:03.161374+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:03.161374+0000","last_undegraded":"2024-04-26T11:48:03.161374+0000","last_fullsized":"2024-04-26T11:48:03.161374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345164+0000","last_change":"2024-04-26T11:47:44.154527+0000","last_active":"2024-04-26T11:48:02.345164+0000","last_peered":"2024-04-26T11:48:02.345164+0000","last_clean":"2024-04-26T11:48:02.345164+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:02.345164+0000","last_undegraded":"2024-04-26T11:48:02.345164+0000","last_fullsized":"2024-04-26T11:48:02.345164+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:36.227910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":64,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824342+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:48:03.824342+0000","last_peered":"2024-04-26T11:48:03.824342+0000","last_clean":"2024-04-26T11:48:03.824342+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:03.824342+0000","last_undegraded":"2024-04-26T11:48:03.824342+0000","last_fullsized":"2024-04-26T11:48:03.824342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825621+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:48:03.825621+0000","last_peered":"2024-04-26T11:48:03.825621+0000","last_clean":"2024-04-26T11:48:03.825621+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:03.825621+0000","last_undegraded":"2024-04-26T11:48:03.825621+0000","last_fullsized":"2024-04-26T11:48:03.825621+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":167,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343469+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:48:02.343469+0000","last_peered":"2024-04-26T11:48:02.343469+0000","last_clean":"2024-04-26T11:48:02.343469+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:48:02.343469+0000","last_undegraded":"2024-04-26T11:48:02.343469+0000","last_fullsized":"2024-04-26T11:48:02.343469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":550,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825717+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:48:03.825717+0000","last_peered":"2024-04-26T11:48:03.825717+0000","last_clean":"2024-04-26T11:48:03.825717+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:03.825717+0000","last_undegraded":"2024-04-26T11:48:03.825717+0000","last_fullsized":"2024-04-26T11:48:03.825717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":175,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160477+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:48:03.160477+0000","last_peered":"2024-04-26T11:48:03.160477+0000","last_clean":"2024-04-26T11:48:03.160477+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:03.160477+0000","last_undegraded":"2024-04-26T11:48:03.160477+0000","last_fullsized":"2024-04-26T11:48:03.160477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":322,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162943+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:48:03.162943+0000","last_peered":"2024-04-26T11:48:03.162943+0000","last_clean":"2024-04-26T11:48:03.162943+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:03.162943+0000","last_undegraded":"2024-04-26T11:48:03.162943+0000","last_fullsized":"2024-04-26T11:48:03.162943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":539,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343162+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:48:02.343162+0000","last_peered":"2024-04-26T11:48:02.343162+0000","last_clean":"2024-04-26T11:48:02.343162+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:02.343162+0000","last_undegraded":"2024-04-26T11:48:02.343162+0000","last_fullsized":"2024-04-26T11:48:02.343162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":499,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344928+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:48:02.344928+0000","last_peered":"2024-04-26T11:48:02.344928+0000","last_clean":"2024-04-26T11:48:02.344928+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:48:02.344928+0000","last_undegraded":"2024-04-26T11:48:02.344928+0000","last_fullsized":"2024-04-26T11:48:02.344928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1030,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343160+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:48:02.343160+0000","last_peered":"2024-04-26T11:48:02.343160+0000","last_clean":"2024-04-26T11:48:02.343160+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:02.343160+0000","last_undegraded":"2024-04-26T11:48:02.343160+0000","last_fullsized":"2024-04-26T11:48:02.343160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":694,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162634+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:48:03.162634+0000","last_peered":"2024-04-26T11:48:03.162634+0000","last_clean":"2024-04-26T11:48:03.162634+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:03.162634+0000","last_undegraded":"2024-04-26T11:48:03.162634+0000","last_fullsized":"2024-04-26T11:48:03.162634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1015,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161081+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:48:03.161081+0000","last_peered":"2024-04-26T11:48:03.161081+0000","last_clean":"2024-04-26T11:48:03.161081+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:03.161081+0000","last_undegraded":"2024-04-26T11:48:03.161081+0000","last_fullsized":"2024-04-26T11:48:03.161081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":183,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162531+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:48:03.162531+0000","last_peered":"2024-04-26T11:48:03.162531+0000","last_clean":"2024-04-26T11:48:03.162531+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:48:03.162531+0000","last_undegraded":"2024-04-26T11:48:03.162531+0000","last_fullsized":"2024-04-26T11:48:03.162531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":620,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825094+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:48:03.825094+0000","last_peered":"2024-04-26T11:48:03.825094+0000","last_clean":"2024-04-26T11:48:03.825094+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:48:03.825094+0000","last_undegraded":"2024-04-26T11:48:03.825094+0000","last_fullsized":"2024-04-26T11:48:03.825094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":372,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824588+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:48:03.824588+0000","last_peered":"2024-04-26T11:48:03.824588+0000","last_clean":"2024-04-26T11:48:03.824588+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:03.824588+0000","last_undegraded":"2024-04-26T11:48:03.824588+0000","last_fullsized":"2024-04-26T11:48:03.824588+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":962,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161856+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:48:03.161856+0000","last_peered":"2024-04-26T11:48:03.161856+0000","last_clean":"2024-04-26T11:48:03.161856+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:03.161856+0000","last_undegraded":"2024-04-26T11:48:03.161856+0000","last_fullsized":"2024-04-26T11:48:03.161856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":283,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161232+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:48:03.161232+0000","last_peered":"2024-04-26T11:48:03.161232+0000","last_clean":"2024-04-26T11:48:03.161232+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:48:03.161232+0000","last_undegraded":"2024-04-26T11:48:03.161232+0000","last_fullsized":"2024-04-26T11:48:03.161232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":548,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162292+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:48:03.162292+0000","last_peered":"2024-04-26T11:48:03.162292+0000","last_clean":"2024-04-26T11:48:03.162292+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:03.162292+0000","last_undegraded":"2024-04-26T11:48:03.162292+0000","last_fullsized":"2024-04-26T11:48:03.162292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":161,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343897+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:48:02.343897+0000","last_peered":"2024-04-26T11:48:02.343897+0000","last_clean":"2024-04-26T11:48:02.343897+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:48:02.343897+0000","last_undegraded":"2024-04-26T11:48:02.343897+0000","last_fullsized":"2024-04-26T11:48:02.343897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":486,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162640+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:48:03.162640+0000","last_peered":"2024-04-26T11:48:03.162640+0000","last_clean":"2024-04-26T11:48:03.162640+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:03.162640+0000","last_undegraded":"2024-04-26T11:48:03.162640+0000","last_fullsized":"2024-04-26T11:48:03.162640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":633,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343271+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:48:02.343271+0000","last_peered":"2024-04-26T11:48:02.343271+0000","last_clean":"2024-04-26T11:48:02.343271+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:48:02.343271+0000","last_undegraded":"2024-04-26T11:48:02.343271+0000","last_fullsized":"2024-04-26T11:48:02.343271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":525,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826617+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:48:03.826617+0000","last_peered":"2024-04-26T11:48:03.826617+0000","last_clean":"2024-04-26T11:48:03.826617+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:48:03.826617+0000","last_undegraded":"2024-04-26T11:48:03.826617+0000","last_fullsized":"2024-04-26T11:48:03.826617+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":310,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161015+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:48:03.161015+0000","last_peered":"2024-04-26T11:48:03.161015+0000","last_clean":"2024-04-26T11:48:03.161015+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:48:03.161015+0000","last_undegraded":"2024-04-26T11:48:03.161015+0000","last_fullsized":"2024-04-26T11:48:03.161015+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161600+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:48:03.161600+0000","last_peered":"2024-04-26T11:48:03.161600+0000","last_clean":"2024-04-26T11:48:03.161600+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:48:03.161600+0000","last_undegraded":"2024-04-26T11:48:03.161600+0000","last_fullsized":"2024-04-26T11:48:03.161600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":614,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825007+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:48:03.825007+0000","last_peered":"2024-04-26T11:48:03.825007+0000","last_clean":"2024-04-26T11:48:03.825007+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:48:03.825007+0000","last_undegraded":"2024-04-26T11:48:03.825007+0000","last_fullsized":"2024-04-26T11:48:03.825007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":574,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162328+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:48:03.162328+0000","last_peered":"2024-04-26T11:48:03.162328+0000","last_clean":"2024-04-26T11:48:03.162328+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:03.162328+0000","last_undegraded":"2024-04-26T11:48:03.162328+0000","last_fullsized":"2024-04-26T11:48:03.162328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160745+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:48:03.160745+0000","last_peered":"2024-04-26T11:48:03.160745+0000","last_clean":"2024-04-26T11:48:03.160745+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:48:03.160745+0000","last_undegraded":"2024-04-26T11:48:03.160745+0000","last_fullsized":"2024-04-26T11:48:03.160745+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":366,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823407+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:48:03.823407+0000","last_peered":"2024-04-26T11:48:03.823407+0000","last_clean":"2024-04-26T11:48:03.823407+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:48:03.823407+0000","last_undegraded":"2024-04-26T11:48:03.823407+0000","last_fullsized":"2024-04-26T11:48:03.823407+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":997,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344910+0000","last_change":"2024-04-26T11:47:34.145286+0000","last_active":"2024-04-26T11:48:02.344910+0000","last_peered":"2024-04-26T11:48:02.344910+0000","last_clean":"2024-04-26T11:48:02.344910+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:02.344910+0000","last_undegraded":"2024-04-26T11:48:02.344910+0000","last_fullsized":"2024-04-26T11:48:02.344910+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:13.918331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823886+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:48:03.823886+0000","last_peered":"2024-04-26T11:48:03.823886+0000","last_clean":"2024-04-26T11:48:03.823886+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:03.823886+0000","last_undegraded":"2024-04-26T11:48:03.823886+0000","last_fullsized":"2024-04-26T11:48:03.823886+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":530,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343412+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:48:02.343412+0000","last_peered":"2024-04-26T11:48:02.343412+0000","last_clean":"2024-04-26T11:48:02.343412+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:48:02.343412+0000","last_undegraded":"2024-04-26T11:48:02.343412+0000","last_fullsized":"2024-04-26T11:48:02.343412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":458,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826547+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:48:03.826547+0000","last_peered":"2024-04-26T11:48:03.826547+0000","last_clean":"2024-04-26T11:48:03.826547+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:48:03.826547+0000","last_undegraded":"2024-04-26T11:48:03.826547+0000","last_fullsized":"2024-04-26T11:48:03.826547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161461+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:48:03.161461+0000","last_peered":"2024-04-26T11:48:03.161461+0000","last_clean":"2024-04-26T11:48:03.161461+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:48:03.161461+0000","last_undegraded":"2024-04-26T11:48:03.161461+0000","last_fullsized":"2024-04-26T11:48:03.161461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":186,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161510+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:48:03.161510+0000","last_peered":"2024-04-26T11:48:03.161510+0000","last_clean":"2024-04-26T11:48:03.161510+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:48:03.161510+0000","last_undegraded":"2024-04-26T11:48:03.161510+0000","last_fullsized":"2024-04-26T11:48:03.161510+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":502,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824262+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:48:03.824262+0000","last_peered":"2024-04-26T11:48:03.824262+0000","last_clean":"2024-04-26T11:48:03.824262+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:48:03.824262+0000","last_undegraded":"2024-04-26T11:48:03.824262+0000","last_fullsized":"2024-04-26T11:48:03.824262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":645,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162571+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:48:03.162571+0000","last_peered":"2024-04-26T11:48:03.162571+0000","last_clean":"2024-04-26T11:48:03.162571+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:48:03.162571+0000","last_undegraded":"2024-04-26T11:48:03.162571+0000","last_fullsized":"2024-04-26T11:48:03.162571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824165+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:48:03.824165+0000","last_peered":"2024-04-26T11:48:03.824165+0000","last_clean":"2024-04-26T11:48:03.824165+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:48:03.824165+0000","last_undegraded":"2024-04-26T11:48:03.824165+0000","last_fullsized":"2024-04-26T11:48:03.824165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":485,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343931+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:48:02.343931+0000","last_peered":"2024-04-26T11:48:02.343931+0000","last_clean":"2024-04-26T11:48:02.343931+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:02.343931+0000","last_undegraded":"2024-04-26T11:48:02.343931+0000","last_fullsized":"2024-04-26T11:48:02.343931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824763+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:48:03.824763+0000","last_peered":"2024-04-26T11:48:03.824763+0000","last_clean":"2024-04-26T11:48:03.824763+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:03.824763+0000","last_undegraded":"2024-04-26T11:48:03.824763+0000","last_fullsized":"2024-04-26T11:48:03.824763+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345473+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:48:02.345473+0000","last_peered":"2024-04-26T11:48:02.345473+0000","last_clean":"2024-04-26T11:48:02.345473+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:48:02.345473+0000","last_undegraded":"2024-04-26T11:48:02.345473+0000","last_fullsized":"2024-04-26T11:48:02.345473+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":526,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344236+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:48:02.344236+0000","last_peered":"2024-04-26T11:48:02.344236+0000","last_clean":"2024-04-26T11:48:02.344236+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:02.344236+0000","last_undegraded":"2024-04-26T11:48:02.344236+0000","last_fullsized":"2024-04-26T11:48:02.344236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825839+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:48:03.825839+0000","last_peered":"2024-04-26T11:48:03.825839+0000","last_clean":"2024-04-26T11:48:03.825839+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:03.825839+0000","last_undegraded":"2024-04-26T11:48:03.825839+0000","last_fullsized":"2024-04-26T11:48:03.825839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825423+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:48:03.825423+0000","last_peered":"2024-04-26T11:48:03.825423+0000","last_clean":"2024-04-26T11:48:03.825423+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:03.825423+0000","last_undegraded":"2024-04-26T11:48:03.825423+0000","last_fullsized":"2024-04-26T11:48:03.825423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":483,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823562+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:48:03.823562+0000","last_peered":"2024-04-26T11:48:03.823562+0000","last_clean":"2024-04-26T11:48:03.823562+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:48:03.823562+0000","last_undegraded":"2024-04-26T11:48:03.823562+0000","last_fullsized":"2024-04-26T11:48:03.823562+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:47.076399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":78,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825424+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:48:03.825424+0000","last_peered":"2024-04-26T11:48:03.825424+0000","last_clean":"2024-04-26T11:48:03.825424+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:03.825424+0000","last_undegraded":"2024-04-26T11:48:03.825424+0000","last_fullsized":"2024-04-26T11:48:03.825424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162936+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:48:03.162936+0000","last_peered":"2024-04-26T11:48:03.162936+0000","last_clean":"2024-04-26T11:48:03.162936+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:48:03.162936+0000","last_undegraded":"2024-04-26T11:48:03.162936+0000","last_fullsized":"2024-04-26T11:48:03.162936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":559,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343413+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:48:02.343413+0000","last_peered":"2024-04-26T11:48:02.343413+0000","last_clean":"2024-04-26T11:48:02.343413+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:02.343413+0000","last_undegraded":"2024-04-26T11:48:02.343413+0000","last_fullsized":"2024-04-26T11:48:02.343413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":572,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161019+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:48:03.161019+0000","last_peered":"2024-04-26T11:48:03.161019+0000","last_clean":"2024-04-26T11:48:03.161019+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:48:03.161019+0000","last_undegraded":"2024-04-26T11:48:03.161019+0000","last_fullsized":"2024-04-26T11:48:03.161019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":519,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162325+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:48:03.162325+0000","last_peered":"2024-04-26T11:48:03.162325+0000","last_clean":"2024-04-26T11:48:03.162325+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:03.162325+0000","last_undegraded":"2024-04-26T11:48:03.162325+0000","last_fullsized":"2024-04-26T11:48:03.162325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":546,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824093+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:48:03.824093+0000","last_peered":"2024-04-26T11:48:03.824093+0000","last_clean":"2024-04-26T11:48:03.824093+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:03.824093+0000","last_undegraded":"2024-04-26T11:48:03.824093+0000","last_fullsized":"2024-04-26T11:48:03.824093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":210,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345365+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:48:02.345365+0000","last_peered":"2024-04-26T11:48:02.345365+0000","last_clean":"2024-04-26T11:48:02.345365+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:48:02.345365+0000","last_undegraded":"2024-04-26T11:48:02.345365+0000","last_fullsized":"2024-04-26T11:48:02.345365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":466,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162787+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:48:03.162787+0000","last_peered":"2024-04-26T11:48:03.162787+0000","last_clean":"2024-04-26T11:48:03.162787+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:48:03.162787+0000","last_undegraded":"2024-04-26T11:48:03.162787+0000","last_fullsized":"2024-04-26T11:48:03.162787+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":579,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823761+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:48:03.823761+0000","last_peered":"2024-04-26T11:48:03.823761+0000","last_clean":"2024-04-26T11:48:03.823761+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:03.823761+0000","last_undegraded":"2024-04-26T11:48:03.823761+0000","last_fullsized":"2024-04-26T11:48:03.823761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":63,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826308+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:48:03.826308+0000","last_peered":"2024-04-26T11:48:03.826308+0000","last_clean":"2024-04-26T11:48:03.826308+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:03.826308+0000","last_undegraded":"2024-04-26T11:48:03.826308+0000","last_fullsized":"2024-04-26T11:48:03.826308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":575,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823378+0000","last_change":"2024-04-26T11:47:41.467086+0000","last_active":"2024-04-26T11:48:03.823378+0000","last_peered":"2024-04-26T11:48:03.823378+0000","last_clean":"2024-04-26T11:48:03.823378+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:03.823378+0000","last_undegraded":"2024-04-26T11:48:03.823378+0000","last_fullsized":"2024-04-26T11:48:03.823378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:45.011728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":517,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345346+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:48:02.345346+0000","last_peered":"2024-04-26T11:48:02.345346+0000","last_clean":"2024-04-26T11:48:02.345346+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:02.345346+0000","last_undegraded":"2024-04-26T11:48:02.345346+0000","last_fullsized":"2024-04-26T11:48:02.345346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":875,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823118+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:48:03.823118+0000","last_peered":"2024-04-26T11:48:03.823118+0000","last_clean":"2024-04-26T11:48:03.823118+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:48:03.823118+0000","last_undegraded":"2024-04-26T11:48:03.823118+0000","last_fullsized":"2024-04-26T11:48:03.823118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":498,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826015+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:48:03.826015+0000","last_peered":"2024-04-26T11:48:03.826015+0000","last_clean":"2024-04-26T11:48:03.826015+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:48:03.826015+0000","last_undegraded":"2024-04-26T11:48:03.826015+0000","last_fullsized":"2024-04-26T11:48:03.826015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":432,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823352+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:48:03.823352+0000","last_peered":"2024-04-26T11:48:03.823352+0000","last_clean":"2024-04-26T11:48:03.823352+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:48:03.823352+0000","last_undegraded":"2024-04-26T11:48:03.823352+0000","last_fullsized":"2024-04-26T11:48:03.823352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":538,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345036+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:48:02.345036+0000","last_peered":"2024-04-26T11:48:02.345036+0000","last_clean":"2024-04-26T11:48:02.345036+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:02.345036+0000","last_undegraded":"2024-04-26T11:48:02.345036+0000","last_fullsized":"2024-04-26T11:48:02.345036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":487,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344183+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:48:02.344183+0000","last_peered":"2024-04-26T11:48:02.344183+0000","last_clean":"2024-04-26T11:48:02.344183+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:48:02.344183+0000","last_undegraded":"2024-04-26T11:48:02.344183+0000","last_fullsized":"2024-04-26T11:48:02.344183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":853,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344697+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:48:02.344697+0000","last_peered":"2024-04-26T11:48:02.344697+0000","last_clean":"2024-04-26T11:48:02.344697+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:02.344697+0000","last_undegraded":"2024-04-26T11:48:02.344697+0000","last_fullsized":"2024-04-26T11:48:02.344697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":164,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344504+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:48:02.344504+0000","last_peered":"2024-04-26T11:48:02.344504+0000","last_clean":"2024-04-26T11:48:02.344504+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:48:02.344504+0000","last_undegraded":"2024-04-26T11:48:02.344504+0000","last_fullsized":"2024-04-26T11:48:02.344504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":884,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160938+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:48:03.160938+0000","last_peered":"2024-04-26T11:48:03.160938+0000","last_clean":"2024-04-26T11:48:03.160938+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:03.160938+0000","last_undegraded":"2024-04-26T11:48:03.160938+0000","last_fullsized":"2024-04-26T11:48:03.160938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":408,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162094+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:48:03.162094+0000","last_peered":"2024-04-26T11:48:03.162094+0000","last_clean":"2024-04-26T11:48:03.162094+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:03.162094+0000","last_undegraded":"2024-04-26T11:48:03.162094+0000","last_fullsized":"2024-04-26T11:48:03.162094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":901,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161287+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:48:03.161287+0000","last_peered":"2024-04-26T11:48:03.161287+0000","last_clean":"2024-04-26T11:48:03.161287+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:03.161287+0000","last_undegraded":"2024-04-26T11:48:03.161287+0000","last_fullsized":"2024-04-26T11:48:03.161287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":436,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345272+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:48:02.345272+0000","last_peered":"2024-04-26T11:48:02.345272+0000","last_clean":"2024-04-26T11:48:02.345272+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:02.345272+0000","last_undegraded":"2024-04-26T11:48:02.345272+0000","last_fullsized":"2024-04-26T11:48:02.345272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":951,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343732+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:48:02.343732+0000","last_peered":"2024-04-26T11:48:02.343732+0000","last_clean":"2024-04-26T11:48:02.343732+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:02.343732+0000","last_undegraded":"2024-04-26T11:48:02.343732+0000","last_fullsized":"2024-04-26T11:48:02.343732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":72,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826406+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:48:03.826406+0000","last_peered":"2024-04-26T11:48:03.826406+0000","last_clean":"2024-04-26T11:48:03.826406+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:48:03.826406+0000","last_undegraded":"2024-04-26T11:48:03.826406+0000","last_fullsized":"2024-04-26T11:48:03.826406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":980,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160781+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:48:03.160781+0000","last_peered":"2024-04-26T11:48:03.160781+0000","last_clean":"2024-04-26T11:48:03.160781+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:48:03.160781+0000","last_undegraded":"2024-04-26T11:48:03.160781+0000","last_fullsized":"2024-04-26T11:48:03.160781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.430609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":70,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826070+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:48:03.826070+0000","last_peered":"2024-04-26T11:48:03.826070+0000","last_clean":"2024-04-26T11:48:03.826070+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:48:03.826070+0000","last_undegraded":"2024-04-26T11:48:03.826070+0000","last_fullsized":"2024-04-26T11:48:03.826070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738420,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200492,"kb_used_data":89056,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171348,"statfs":{"total":96636764160,"available":96431460352,"internally_reserved":0,"allocated":91193344,"data_stored":90580133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":1,"up_from":72,"seq":309237645325,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125624,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246216,"statfs":{"total":96636764160,"available":96508125184,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190672,"kb_used_data":83324,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181168,"statfs":{"total":96636764160,"available":96441516032,"internally_reserved":0,"allocated":85323776,"data_stored":84722176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:48:07.415 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T11:48:07.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T11:48:07.749 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T11:48:07.759 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T11:48:07.759 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:48:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:48:08.083 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:48:08.096 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-04-26T11:48:08.056372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516788,"kb_used_data":252420,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598732,"statfs":{"total":289910292480,"available":289381101568,"internally_reserved":0,"allocated":258478080,"data_stored":256667819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001982"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":960,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345135+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:48:02.345135+0000","last_peered":"2024-04-26T11:48:02.345135+0000","last_clean":"2024-04-26T11:48:02.345135+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:48:02.345135+0000","last_undegraded":"2024-04-26T11:48:02.345135+0000","last_fullsized":"2024-04-26T11:48:02.345135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1017,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344511+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:48:02.344511+0000","last_peered":"2024-04-26T11:48:02.344511+0000","last_clean":"2024-04-26T11:48:02.344511+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:48:02.344511+0000","last_undegraded":"2024-04-26T11:48:02.344511+0000","last_fullsized":"2024-04-26T11:48:02.344511+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:25.339699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":524,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161869+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:03.161869+0000","last_peered":"2024-04-26T11:48:03.161869+0000","last_clean":"2024-04-26T11:48:03.161869+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:03.161869+0000","last_undegraded":"2024-04-26T11:48:03.161869+0000","last_fullsized":"2024-04-26T11:48:03.161869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":839,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161509+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:03.161509+0000","last_peered":"2024-04-26T11:48:03.161509+0000","last_clean":"2024-04-26T11:48:03.161509+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:03.161509+0000","last_undegraded":"2024-04-26T11:48:03.161509+0000","last_fullsized":"2024-04-26T11:48:03.161509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":916,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344231+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:48:02.344231+0000","last_peered":"2024-04-26T11:48:02.344231+0000","last_clean":"2024-04-26T11:48:02.344231+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:48:02.344231+0000","last_undegraded":"2024-04-26T11:48:02.344231+0000","last_fullsized":"2024-04-26T11:48:02.344231+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":845,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160817+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:48:03.160817+0000","last_peered":"2024-04-26T11:48:03.160817+0000","last_clean":"2024-04-26T11:48:03.160817+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:48:03.160817+0000","last_undegraded":"2024-04-26T11:48:03.160817+0000","last_fullsized":"2024-04-26T11:48:03.160817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1037,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161066+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:48:03.161066+0000","last_peered":"2024-04-26T11:48:03.161066+0000","last_clean":"2024-04-26T11:48:03.161066+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:48:03.161066+0000","last_undegraded":"2024-04-26T11:48:03.161066+0000","last_fullsized":"2024-04-26T11:48:03.161066+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:59.926464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":846,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160198+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:03.160198+0000","last_peered":"2024-04-26T11:48:03.160198+0000","last_clean":"2024-04-26T11:48:03.160198+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:03.160198+0000","last_undegraded":"2024-04-26T11:48:03.160198+0000","last_fullsized":"2024-04-26T11:48:03.160198+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:56.834748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":542,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826282+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:48:03.826282+0000","last_peered":"2024-04-26T11:48:03.826282+0000","last_clean":"2024-04-26T11:48:03.826282+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:03.826282+0000","last_undegraded":"2024-04-26T11:48:03.826282+0000","last_fullsized":"2024-04-26T11:48:03.826282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":959,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344619+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:48:02.344619+0000","last_peered":"2024-04-26T11:48:02.344619+0000","last_clean":"2024-04-26T11:48:02.344619+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:48:02.344619+0000","last_undegraded":"2024-04-26T11:48:02.344619+0000","last_fullsized":"2024-04-26T11:48:02.344619+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:32.091133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":873,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161839+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:48:03.161839+0000","last_peered":"2024-04-26T11:48:03.161839+0000","last_clean":"2024-04-26T11:48:03.161839+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:48:03.161839+0000","last_undegraded":"2024-04-26T11:48:03.161839+0000","last_fullsized":"2024-04-26T11:48:03.161839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":490,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344166+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:48:02.344166+0000","last_peered":"2024-04-26T11:48:02.344166+0000","last_clean":"2024-04-26T11:48:02.344166+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:02.344166+0000","last_undegraded":"2024-04-26T11:48:02.344166+0000","last_fullsized":"2024-04-26T11:48:02.344166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":892,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343964+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:48:02.343964+0000","last_peered":"2024-04-26T11:48:02.343964+0000","last_clean":"2024-04-26T11:48:02.343964+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:48:02.343964+0000","last_undegraded":"2024-04-26T11:48:02.343964+0000","last_fullsized":"2024-04-26T11:48:02.343964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":563,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160823+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:48:03.160823+0000","last_peered":"2024-04-26T11:48:03.160823+0000","last_clean":"2024-04-26T11:48:03.160823+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:03.160823+0000","last_undegraded":"2024-04-26T11:48:03.160823+0000","last_fullsized":"2024-04-26T11:48:03.160823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":605,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161294+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:48:03.161294+0000","last_peered":"2024-04-26T11:48:03.161294+0000","last_clean":"2024-04-26T11:48:03.161294+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:03.161294+0000","last_undegraded":"2024-04-26T11:48:03.161294+0000","last_fullsized":"2024-04-26T11:48:03.161294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1060,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160188+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:48:03.160188+0000","last_peered":"2024-04-26T11:48:03.160188+0000","last_clean":"2024-04-26T11:48:03.160188+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:48:03.160188+0000","last_undegraded":"2024-04-26T11:48:03.160188+0000","last_fullsized":"2024-04-26T11:48:03.160188+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:50.720876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":510,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826051+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:48:03.826051+0000","last_peered":"2024-04-26T11:48:03.826051+0000","last_clean":"2024-04-26T11:48:03.826051+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:03.826051+0000","last_undegraded":"2024-04-26T11:48:03.826051+0000","last_fullsized":"2024-04-26T11:48:03.826051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":924,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.342787+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:48:02.342787+0000","last_peered":"2024-04-26T11:48:02.342787+0000","last_clean":"2024-04-26T11:48:02.342787+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:48:02.342787+0000","last_undegraded":"2024-04-26T11:48:02.342787+0000","last_fullsized":"2024-04-26T11:48:02.342787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:10.908191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":531,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825386+0000","last_change":"2024-04-26T11:47:42.470100+0000","last_active":"2024-04-26T11:48:03.825386+0000","last_peered":"2024-04-26T11:48:03.825386+0000","last_clean":"2024-04-26T11:48:03.825386+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:48:03.825386+0000","last_undegraded":"2024-04-26T11:48:03.825386+0000","last_fullsized":"2024-04-26T11:48:03.825386+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:37.523362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1014,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162195+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:48:03.162195+0000","last_peered":"2024-04-26T11:48:03.162195+0000","last_clean":"2024-04-26T11:48:03.162195+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:48:03.162195+0000","last_undegraded":"2024-04-26T11:48:03.162195+0000","last_fullsized":"2024-04-26T11:48:03.162195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":928,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161249+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:48:03.161249+0000","last_peered":"2024-04-26T11:48:03.161249+0000","last_clean":"2024-04-26T11:48:03.161249+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:03.161249+0000","last_undegraded":"2024-04-26T11:48:03.161249+0000","last_fullsized":"2024-04-26T11:48:03.161249+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:16.863281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":576,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343679+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:48:02.343679+0000","last_peered":"2024-04-26T11:48:02.343679+0000","last_clean":"2024-04-26T11:48:02.343679+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:02.343679+0000","last_undegraded":"2024-04-26T11:48:02.343679+0000","last_fullsized":"2024-04-26T11:48:02.343679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823660+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:48:03.823660+0000","last_peered":"2024-04-26T11:48:03.823660+0000","last_clean":"2024-04-26T11:48:03.823660+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:48:03.823660+0000","last_undegraded":"2024-04-26T11:48:03.823660+0000","last_fullsized":"2024-04-26T11:48:03.823660+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1031,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343072+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:48:02.343072+0000","last_peered":"2024-04-26T11:48:02.343072+0000","last_clean":"2024-04-26T11:48:02.343072+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:48:02.343072+0000","last_undegraded":"2024-04-26T11:48:02.343072+0000","last_fullsized":"2024-04-26T11:48:02.343072+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":512,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345205+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:48:02.345205+0000","last_peered":"2024-04-26T11:48:02.345205+0000","last_clean":"2024-04-26T11:48:02.345205+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:48:02.345205+0000","last_undegraded":"2024-04-26T11:48:02.345205+0000","last_fullsized":"2024-04-26T11:48:02.345205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":621,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826248+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:48:03.826248+0000","last_peered":"2024-04-26T11:48:03.826248+0000","last_clean":"2024-04-26T11:48:03.826248+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:48:03.826248+0000","last_undegraded":"2024-04-26T11:48:03.826248+0000","last_fullsized":"2024-04-26T11:48:03.826248+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:48.523722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162056+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:48:03.162056+0000","last_peered":"2024-04-26T11:48:03.162056+0000","last_clean":"2024-04-26T11:48:03.162056+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:03.162056+0000","last_undegraded":"2024-04-26T11:48:03.162056+0000","last_fullsized":"2024-04-26T11:48:03.162056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":595,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344618+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:48:02.344618+0000","last_peered":"2024-04-26T11:48:02.344618+0000","last_clean":"2024-04-26T11:48:02.344618+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:02.344618+0000","last_undegraded":"2024-04-26T11:48:02.344618+0000","last_fullsized":"2024-04-26T11:48:02.344618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":508,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824009+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:48:03.824009+0000","last_peered":"2024-04-26T11:48:03.824009+0000","last_clean":"2024-04-26T11:48:03.824009+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:48:03.824009+0000","last_undegraded":"2024-04-26T11:48:03.824009+0000","last_fullsized":"2024-04-26T11:48:03.824009+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343945+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:48:02.343945+0000","last_peered":"2024-04-26T11:48:02.343945+0000","last_clean":"2024-04-26T11:48:02.343945+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:02.343945+0000","last_undegraded":"2024-04-26T11:48:02.343945+0000","last_fullsized":"2024-04-26T11:48:02.343945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":573,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825525+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:48:03.825525+0000","last_peered":"2024-04-26T11:48:03.825525+0000","last_clean":"2024-04-26T11:48:03.825525+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:03.825525+0000","last_undegraded":"2024-04-26T11:48:03.825525+0000","last_fullsized":"2024-04-26T11:48:03.825525+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":950,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160503+0000","last_change":"2024-04-26T11:47:45.147770+0000","last_active":"2024-04-26T11:48:03.160503+0000","last_peered":"2024-04-26T11:48:03.160503+0000","last_clean":"2024-04-26T11:48:03.160503+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:03.160503+0000","last_undegraded":"2024-04-26T11:48:03.160503+0000","last_fullsized":"2024-04-26T11:48:03.160503+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:52.444032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":841,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344401+0000","last_change":"2024-04-26T11:47:45.156703+0000","last_active":"2024-04-26T11:48:02.344401+0000","last_peered":"2024-04-26T11:48:02.344401+0000","last_clean":"2024-04-26T11:48:02.344401+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:02.344401+0000","last_undegraded":"2024-04-26T11:48:02.344401+0000","last_fullsized":"2024-04-26T11:48:02.344401+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:22.809278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":623,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161374+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:48:03.161374+0000","last_peered":"2024-04-26T11:48:03.161374+0000","last_clean":"2024-04-26T11:48:03.161374+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:03.161374+0000","last_undegraded":"2024-04-26T11:48:03.161374+0000","last_fullsized":"2024-04-26T11:48:03.161374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345164+0000","last_change":"2024-04-26T11:47:44.154527+0000","last_active":"2024-04-26T11:48:02.345164+0000","last_peered":"2024-04-26T11:48:02.345164+0000","last_clean":"2024-04-26T11:48:02.345164+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:02.345164+0000","last_undegraded":"2024-04-26T11:48:02.345164+0000","last_fullsized":"2024-04-26T11:48:02.345164+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:36.227910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":64,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824342+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:48:03.824342+0000","last_peered":"2024-04-26T11:48:03.824342+0000","last_clean":"2024-04-26T11:48:03.824342+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:03.824342+0000","last_undegraded":"2024-04-26T11:48:03.824342+0000","last_fullsized":"2024-04-26T11:48:03.824342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825621+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:48:03.825621+0000","last_peered":"2024-04-26T11:48:03.825621+0000","last_clean":"2024-04-26T11:48:03.825621+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:03.825621+0000","last_undegraded":"2024-04-26T11:48:03.825621+0000","last_fullsized":"2024-04-26T11:48:03.825621+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":167,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343469+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:48:02.343469+0000","last_peered":"2024-04-26T11:48:02.343469+0000","last_clean":"2024-04-26T11:48:02.343469+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:48:02.343469+0000","last_undegraded":"2024-04-26T11:48:02.343469+0000","last_fullsized":"2024-04-26T11:48:02.343469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":550,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825717+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:48:03.825717+0000","last_peered":"2024-04-26T11:48:03.825717+0000","last_clean":"2024-04-26T11:48:03.825717+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:03.825717+0000","last_undegraded":"2024-04-26T11:48:03.825717+0000","last_fullsized":"2024-04-26T11:48:03.825717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":175,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160477+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:48:03.160477+0000","last_peered":"2024-04-26T11:48:03.160477+0000","last_clean":"2024-04-26T11:48:03.160477+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:03.160477+0000","last_undegraded":"2024-04-26T11:48:03.160477+0000","last_fullsized":"2024-04-26T11:48:03.160477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":322,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162943+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:48:03.162943+0000","last_peered":"2024-04-26T11:48:03.162943+0000","last_clean":"2024-04-26T11:48:03.162943+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:03.162943+0000","last_undegraded":"2024-04-26T11:48:03.162943+0000","last_fullsized":"2024-04-26T11:48:03.162943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":539,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343162+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:48:02.343162+0000","last_peered":"2024-04-26T11:48:02.343162+0000","last_clean":"2024-04-26T11:48:02.343162+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:02.343162+0000","last_undegraded":"2024-04-26T11:48:02.343162+0000","last_fullsized":"2024-04-26T11:48:02.343162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":499,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344928+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:48:02.344928+0000","last_peered":"2024-04-26T11:48:02.344928+0000","last_clean":"2024-04-26T11:48:02.344928+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:48:02.344928+0000","last_undegraded":"2024-04-26T11:48:02.344928+0000","last_fullsized":"2024-04-26T11:48:02.344928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1030,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343160+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:48:02.343160+0000","last_peered":"2024-04-26T11:48:02.343160+0000","last_clean":"2024-04-26T11:48:02.343160+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:02.343160+0000","last_undegraded":"2024-04-26T11:48:02.343160+0000","last_fullsized":"2024-04-26T11:48:02.343160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":694,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162634+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:48:03.162634+0000","last_peered":"2024-04-26T11:48:03.162634+0000","last_clean":"2024-04-26T11:48:03.162634+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:03.162634+0000","last_undegraded":"2024-04-26T11:48:03.162634+0000","last_fullsized":"2024-04-26T11:48:03.162634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1015,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161081+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:48:03.161081+0000","last_peered":"2024-04-26T11:48:03.161081+0000","last_clean":"2024-04-26T11:48:03.161081+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:03.161081+0000","last_undegraded":"2024-04-26T11:48:03.161081+0000","last_fullsized":"2024-04-26T11:48:03.161081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":183,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162531+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:48:03.162531+0000","last_peered":"2024-04-26T11:48:03.162531+0000","last_clean":"2024-04-26T11:48:03.162531+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:48:03.162531+0000","last_undegraded":"2024-04-26T11:48:03.162531+0000","last_fullsized":"2024-04-26T11:48:03.162531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":620,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825094+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:48:03.825094+0000","last_peered":"2024-04-26T11:48:03.825094+0000","last_clean":"2024-04-26T11:48:03.825094+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:48:03.825094+0000","last_undegraded":"2024-04-26T11:48:03.825094+0000","last_fullsized":"2024-04-26T11:48:03.825094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":372,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824588+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:48:03.824588+0000","last_peered":"2024-04-26T11:48:03.824588+0000","last_clean":"2024-04-26T11:48:03.824588+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:03.824588+0000","last_undegraded":"2024-04-26T11:48:03.824588+0000","last_fullsized":"2024-04-26T11:48:03.824588+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":962,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161856+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:48:03.161856+0000","last_peered":"2024-04-26T11:48:03.161856+0000","last_clean":"2024-04-26T11:48:03.161856+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:03.161856+0000","last_undegraded":"2024-04-26T11:48:03.161856+0000","last_fullsized":"2024-04-26T11:48:03.161856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":283,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161232+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:48:03.161232+0000","last_peered":"2024-04-26T11:48:03.161232+0000","last_clean":"2024-04-26T11:48:03.161232+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:48:03.161232+0000","last_undegraded":"2024-04-26T11:48:03.161232+0000","last_fullsized":"2024-04-26T11:48:03.161232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":548,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162292+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:48:03.162292+0000","last_peered":"2024-04-26T11:48:03.162292+0000","last_clean":"2024-04-26T11:48:03.162292+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:03.162292+0000","last_undegraded":"2024-04-26T11:48:03.162292+0000","last_fullsized":"2024-04-26T11:48:03.162292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":161,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343897+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:48:02.343897+0000","last_peered":"2024-04-26T11:48:02.343897+0000","last_clean":"2024-04-26T11:48:02.343897+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:48:02.343897+0000","last_undegraded":"2024-04-26T11:48:02.343897+0000","last_fullsized":"2024-04-26T11:48:02.343897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":486,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162640+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:48:03.162640+0000","last_peered":"2024-04-26T11:48:03.162640+0000","last_clean":"2024-04-26T11:48:03.162640+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:03.162640+0000","last_undegraded":"2024-04-26T11:48:03.162640+0000","last_fullsized":"2024-04-26T11:48:03.162640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":633,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343271+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:48:02.343271+0000","last_peered":"2024-04-26T11:48:02.343271+0000","last_clean":"2024-04-26T11:48:02.343271+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:48:02.343271+0000","last_undegraded":"2024-04-26T11:48:02.343271+0000","last_fullsized":"2024-04-26T11:48:02.343271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":525,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826617+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:48:03.826617+0000","last_peered":"2024-04-26T11:48:03.826617+0000","last_clean":"2024-04-26T11:48:03.826617+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:48:03.826617+0000","last_undegraded":"2024-04-26T11:48:03.826617+0000","last_fullsized":"2024-04-26T11:48:03.826617+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":310,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161015+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:48:03.161015+0000","last_peered":"2024-04-26T11:48:03.161015+0000","last_clean":"2024-04-26T11:48:03.161015+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:48:03.161015+0000","last_undegraded":"2024-04-26T11:48:03.161015+0000","last_fullsized":"2024-04-26T11:48:03.161015+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161600+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:48:03.161600+0000","last_peered":"2024-04-26T11:48:03.161600+0000","last_clean":"2024-04-26T11:48:03.161600+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:48:03.161600+0000","last_undegraded":"2024-04-26T11:48:03.161600+0000","last_fullsized":"2024-04-26T11:48:03.161600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":614,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825007+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:48:03.825007+0000","last_peered":"2024-04-26T11:48:03.825007+0000","last_clean":"2024-04-26T11:48:03.825007+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:48:03.825007+0000","last_undegraded":"2024-04-26T11:48:03.825007+0000","last_fullsized":"2024-04-26T11:48:03.825007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":574,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162328+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:48:03.162328+0000","last_peered":"2024-04-26T11:48:03.162328+0000","last_clean":"2024-04-26T11:48:03.162328+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:03.162328+0000","last_undegraded":"2024-04-26T11:48:03.162328+0000","last_fullsized":"2024-04-26T11:48:03.162328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160745+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:48:03.160745+0000","last_peered":"2024-04-26T11:48:03.160745+0000","last_clean":"2024-04-26T11:48:03.160745+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:48:03.160745+0000","last_undegraded":"2024-04-26T11:48:03.160745+0000","last_fullsized":"2024-04-26T11:48:03.160745+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":366,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823407+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:48:03.823407+0000","last_peered":"2024-04-26T11:48:03.823407+0000","last_clean":"2024-04-26T11:48:03.823407+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:48:03.823407+0000","last_undegraded":"2024-04-26T11:48:03.823407+0000","last_fullsized":"2024-04-26T11:48:03.823407+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":997,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344910+0000","last_change":"2024-04-26T11:47:34.145286+0000","last_active":"2024-04-26T11:48:02.344910+0000","last_peered":"2024-04-26T11:48:02.344910+0000","last_clean":"2024-04-26T11:48:02.344910+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:02.344910+0000","last_undegraded":"2024-04-26T11:48:02.344910+0000","last_fullsized":"2024-04-26T11:48:02.344910+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:13.918331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823886+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:48:03.823886+0000","last_peered":"2024-04-26T11:48:03.823886+0000","last_clean":"2024-04-26T11:48:03.823886+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:03.823886+0000","last_undegraded":"2024-04-26T11:48:03.823886+0000","last_fullsized":"2024-04-26T11:48:03.823886+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":530,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343412+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:48:02.343412+0000","last_peered":"2024-04-26T11:48:02.343412+0000","last_clean":"2024-04-26T11:48:02.343412+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:48:02.343412+0000","last_undegraded":"2024-04-26T11:48:02.343412+0000","last_fullsized":"2024-04-26T11:48:02.343412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":458,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826547+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:48:03.826547+0000","last_peered":"2024-04-26T11:48:03.826547+0000","last_clean":"2024-04-26T11:48:03.826547+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:48:03.826547+0000","last_undegraded":"2024-04-26T11:48:03.826547+0000","last_fullsized":"2024-04-26T11:48:03.826547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161461+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:48:03.161461+0000","last_peered":"2024-04-26T11:48:03.161461+0000","last_clean":"2024-04-26T11:48:03.161461+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:48:03.161461+0000","last_undegraded":"2024-04-26T11:48:03.161461+0000","last_fullsized":"2024-04-26T11:48:03.161461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":186,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161510+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:48:03.161510+0000","last_peered":"2024-04-26T11:48:03.161510+0000","last_clean":"2024-04-26T11:48:03.161510+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:48:03.161510+0000","last_undegraded":"2024-04-26T11:48:03.161510+0000","last_fullsized":"2024-04-26T11:48:03.161510+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":502,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824262+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:48:03.824262+0000","last_peered":"2024-04-26T11:48:03.824262+0000","last_clean":"2024-04-26T11:48:03.824262+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:48:03.824262+0000","last_undegraded":"2024-04-26T11:48:03.824262+0000","last_fullsized":"2024-04-26T11:48:03.824262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":645,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162571+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:48:03.162571+0000","last_peered":"2024-04-26T11:48:03.162571+0000","last_clean":"2024-04-26T11:48:03.162571+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:48:03.162571+0000","last_undegraded":"2024-04-26T11:48:03.162571+0000","last_fullsized":"2024-04-26T11:48:03.162571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824165+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:48:03.824165+0000","last_peered":"2024-04-26T11:48:03.824165+0000","last_clean":"2024-04-26T11:48:03.824165+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:48:03.824165+0000","last_undegraded":"2024-04-26T11:48:03.824165+0000","last_fullsized":"2024-04-26T11:48:03.824165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":485,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343931+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:48:02.343931+0000","last_peered":"2024-04-26T11:48:02.343931+0000","last_clean":"2024-04-26T11:48:02.343931+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:02.343931+0000","last_undegraded":"2024-04-26T11:48:02.343931+0000","last_fullsized":"2024-04-26T11:48:02.343931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824763+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:48:03.824763+0000","last_peered":"2024-04-26T11:48:03.824763+0000","last_clean":"2024-04-26T11:48:03.824763+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:03.824763+0000","last_undegraded":"2024-04-26T11:48:03.824763+0000","last_fullsized":"2024-04-26T11:48:03.824763+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345473+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:48:02.345473+0000","last_peered":"2024-04-26T11:48:02.345473+0000","last_clean":"2024-04-26T11:48:02.345473+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:48:02.345473+0000","last_undegraded":"2024-04-26T11:48:02.345473+0000","last_fullsized":"2024-04-26T11:48:02.345473+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":526,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344236+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:48:02.344236+0000","last_peered":"2024-04-26T11:48:02.344236+0000","last_clean":"2024-04-26T11:48:02.344236+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:02.344236+0000","last_undegraded":"2024-04-26T11:48:02.344236+0000","last_fullsized":"2024-04-26T11:48:02.344236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825839+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:48:03.825839+0000","last_peered":"2024-04-26T11:48:03.825839+0000","last_clean":"2024-04-26T11:48:03.825839+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:03.825839+0000","last_undegraded":"2024-04-26T11:48:03.825839+0000","last_fullsized":"2024-04-26T11:48:03.825839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825423+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:48:03.825423+0000","last_peered":"2024-04-26T11:48:03.825423+0000","last_clean":"2024-04-26T11:48:03.825423+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:03.825423+0000","last_undegraded":"2024-04-26T11:48:03.825423+0000","last_fullsized":"2024-04-26T11:48:03.825423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":483,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823562+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:48:03.823562+0000","last_peered":"2024-04-26T11:48:03.823562+0000","last_clean":"2024-04-26T11:48:03.823562+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:48:03.823562+0000","last_undegraded":"2024-04-26T11:48:03.823562+0000","last_fullsized":"2024-04-26T11:48:03.823562+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:47.076399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":78,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825424+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:48:03.825424+0000","last_peered":"2024-04-26T11:48:03.825424+0000","last_clean":"2024-04-26T11:48:03.825424+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:03.825424+0000","last_undegraded":"2024-04-26T11:48:03.825424+0000","last_fullsized":"2024-04-26T11:48:03.825424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162936+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:48:03.162936+0000","last_peered":"2024-04-26T11:48:03.162936+0000","last_clean":"2024-04-26T11:48:03.162936+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:48:03.162936+0000","last_undegraded":"2024-04-26T11:48:03.162936+0000","last_fullsized":"2024-04-26T11:48:03.162936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":559,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343413+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:48:02.343413+0000","last_peered":"2024-04-26T11:48:02.343413+0000","last_clean":"2024-04-26T11:48:02.343413+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:02.343413+0000","last_undegraded":"2024-04-26T11:48:02.343413+0000","last_fullsized":"2024-04-26T11:48:02.343413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":572,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161019+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:48:03.161019+0000","last_peered":"2024-04-26T11:48:03.161019+0000","last_clean":"2024-04-26T11:48:03.161019+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:48:03.161019+0000","last_undegraded":"2024-04-26T11:48:03.161019+0000","last_fullsized":"2024-04-26T11:48:03.161019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":519,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162325+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:48:03.162325+0000","last_peered":"2024-04-26T11:48:03.162325+0000","last_clean":"2024-04-26T11:48:03.162325+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:03.162325+0000","last_undegraded":"2024-04-26T11:48:03.162325+0000","last_fullsized":"2024-04-26T11:48:03.162325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":546,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824093+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:48:03.824093+0000","last_peered":"2024-04-26T11:48:03.824093+0000","last_clean":"2024-04-26T11:48:03.824093+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:03.824093+0000","last_undegraded":"2024-04-26T11:48:03.824093+0000","last_fullsized":"2024-04-26T11:48:03.824093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":210,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345365+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:48:02.345365+0000","last_peered":"2024-04-26T11:48:02.345365+0000","last_clean":"2024-04-26T11:48:02.345365+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:48:02.345365+0000","last_undegraded":"2024-04-26T11:48:02.345365+0000","last_fullsized":"2024-04-26T11:48:02.345365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":466,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162787+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:48:03.162787+0000","last_peered":"2024-04-26T11:48:03.162787+0000","last_clean":"2024-04-26T11:48:03.162787+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:48:03.162787+0000","last_undegraded":"2024-04-26T11:48:03.162787+0000","last_fullsized":"2024-04-26T11:48:03.162787+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":579,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823761+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:48:03.823761+0000","last_peered":"2024-04-26T11:48:03.823761+0000","last_clean":"2024-04-26T11:48:03.823761+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:03.823761+0000","last_undegraded":"2024-04-26T11:48:03.823761+0000","last_fullsized":"2024-04-26T11:48:03.823761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":63,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826308+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:48:03.826308+0000","last_peered":"2024-04-26T11:48:03.826308+0000","last_clean":"2024-04-26T11:48:03.826308+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:03.826308+0000","last_undegraded":"2024-04-26T11:48:03.826308+0000","last_fullsized":"2024-04-26T11:48:03.826308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":575,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823378+0000","last_change":"2024-04-26T11:47:41.467086+0000","last_active":"2024-04-26T11:48:03.823378+0000","last_peered":"2024-04-26T11:48:03.823378+0000","last_clean":"2024-04-26T11:48:03.823378+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:03.823378+0000","last_undegraded":"2024-04-26T11:48:03.823378+0000","last_fullsized":"2024-04-26T11:48:03.823378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:45.011728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":517,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345346+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:48:02.345346+0000","last_peered":"2024-04-26T11:48:02.345346+0000","last_clean":"2024-04-26T11:48:02.345346+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:02.345346+0000","last_undegraded":"2024-04-26T11:48:02.345346+0000","last_fullsized":"2024-04-26T11:48:02.345346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":875,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823118+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:48:03.823118+0000","last_peered":"2024-04-26T11:48:03.823118+0000","last_clean":"2024-04-26T11:48:03.823118+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:48:03.823118+0000","last_undegraded":"2024-04-26T11:48:03.823118+0000","last_fullsized":"2024-04-26T11:48:03.823118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":498,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826015+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:48:03.826015+0000","last_peered":"2024-04-26T11:48:03.826015+0000","last_clean":"2024-04-26T11:48:03.826015+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:48:03.826015+0000","last_undegraded":"2024-04-26T11:48:03.826015+0000","last_fullsized":"2024-04-26T11:48:03.826015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":432,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823352+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:48:03.823352+0000","last_peered":"2024-04-26T11:48:03.823352+0000","last_clean":"2024-04-26T11:48:03.823352+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:48:03.823352+0000","last_undegraded":"2024-04-26T11:48:03.823352+0000","last_fullsized":"2024-04-26T11:48:03.823352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":538,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345036+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:48:02.345036+0000","last_peered":"2024-04-26T11:48:02.345036+0000","last_clean":"2024-04-26T11:48:02.345036+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:02.345036+0000","last_undegraded":"2024-04-26T11:48:02.345036+0000","last_fullsized":"2024-04-26T11:48:02.345036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":487,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344183+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:48:02.344183+0000","last_peered":"2024-04-26T11:48:02.344183+0000","last_clean":"2024-04-26T11:48:02.344183+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:48:02.344183+0000","last_undegraded":"2024-04-26T11:48:02.344183+0000","last_fullsized":"2024-04-26T11:48:02.344183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":853,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344697+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:48:02.344697+0000","last_peered":"2024-04-26T11:48:02.344697+0000","last_clean":"2024-04-26T11:48:02.344697+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:02.344697+0000","last_undegraded":"2024-04-26T11:48:02.344697+0000","last_fullsized":"2024-04-26T11:48:02.344697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":164,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344504+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:48:02.344504+0000","last_peered":"2024-04-26T11:48:02.344504+0000","last_clean":"2024-04-26T11:48:02.344504+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:48:02.344504+0000","last_undegraded":"2024-04-26T11:48:02.344504+0000","last_fullsized":"2024-04-26T11:48:02.344504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":884,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160938+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:48:03.160938+0000","last_peered":"2024-04-26T11:48:03.160938+0000","last_clean":"2024-04-26T11:48:03.160938+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:03.160938+0000","last_undegraded":"2024-04-26T11:48:03.160938+0000","last_fullsized":"2024-04-26T11:48:03.160938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":408,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162094+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:48:03.162094+0000","last_peered":"2024-04-26T11:48:03.162094+0000","last_clean":"2024-04-26T11:48:03.162094+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:03.162094+0000","last_undegraded":"2024-04-26T11:48:03.162094+0000","last_fullsized":"2024-04-26T11:48:03.162094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":901,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161287+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:48:03.161287+0000","last_peered":"2024-04-26T11:48:03.161287+0000","last_clean":"2024-04-26T11:48:03.161287+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:03.161287+0000","last_undegraded":"2024-04-26T11:48:03.161287+0000","last_fullsized":"2024-04-26T11:48:03.161287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":436,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345272+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:48:02.345272+0000","last_peered":"2024-04-26T11:48:02.345272+0000","last_clean":"2024-04-26T11:48:02.345272+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:02.345272+0000","last_undegraded":"2024-04-26T11:48:02.345272+0000","last_fullsized":"2024-04-26T11:48:02.345272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":951,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343732+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:48:02.343732+0000","last_peered":"2024-04-26T11:48:02.343732+0000","last_clean":"2024-04-26T11:48:02.343732+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:02.343732+0000","last_undegraded":"2024-04-26T11:48:02.343732+0000","last_fullsized":"2024-04-26T11:48:02.343732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":72,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826406+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:48:03.826406+0000","last_peered":"2024-04-26T11:48:03.826406+0000","last_clean":"2024-04-26T11:48:03.826406+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:48:03.826406+0000","last_undegraded":"2024-04-26T11:48:03.826406+0000","last_fullsized":"2024-04-26T11:48:03.826406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":980,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160781+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:48:03.160781+0000","last_peered":"2024-04-26T11:48:03.160781+0000","last_clean":"2024-04-26T11:48:03.160781+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:48:03.160781+0000","last_undegraded":"2024-04-26T11:48:03.160781+0000","last_fullsized":"2024-04-26T11:48:03.160781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.430609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":70,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826070+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:48:03.826070+0000","last_peered":"2024-04-26T11:48:03.826070+0000","last_clean":"2024-04-26T11:48:03.826070+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:48:03.826070+0000","last_undegraded":"2024-04-26T11:48:03.826070+0000","last_fullsized":"2024-04-26T11:48:03.826070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738420,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200492,"kb_used_data":89056,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171348,"statfs":{"total":96636764160,"available":96431460352,"internally_reserved":0,"allocated":91193344,"data_stored":90580133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":1,"up_from":72,"seq":309237645325,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125624,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246216,"statfs":{"total":96636764160,"available":96508125184,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190672,"kb_used_data":83324,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181168,"statfs":{"total":96636764160,"available":96441516032,"internally_reserved":0,"allocated":85323776,"data_stored":84722176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:48:08.100 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:48:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:48:08.423 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:48:08.436 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-04-26T11:48:08.056372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516788,"kb_used_data":252420,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598732,"statfs":{"total":289910292480,"available":289381101568,"internally_reserved":0,"allocated":258478080,"data_stored":256667819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001982"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":960,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345135+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:48:02.345135+0000","last_peered":"2024-04-26T11:48:02.345135+0000","last_clean":"2024-04-26T11:48:02.345135+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:48:02.345135+0000","last_undegraded":"2024-04-26T11:48:02.345135+0000","last_fullsized":"2024-04-26T11:48:02.345135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1017,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344511+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:48:02.344511+0000","last_peered":"2024-04-26T11:48:02.344511+0000","last_clean":"2024-04-26T11:48:02.344511+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:48:02.344511+0000","last_undegraded":"2024-04-26T11:48:02.344511+0000","last_fullsized":"2024-04-26T11:48:02.344511+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:25.339699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":524,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161869+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:03.161869+0000","last_peered":"2024-04-26T11:48:03.161869+0000","last_clean":"2024-04-26T11:48:03.161869+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:03.161869+0000","last_undegraded":"2024-04-26T11:48:03.161869+0000","last_fullsized":"2024-04-26T11:48:03.161869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":839,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161509+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:03.161509+0000","last_peered":"2024-04-26T11:48:03.161509+0000","last_clean":"2024-04-26T11:48:03.161509+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:03.161509+0000","last_undegraded":"2024-04-26T11:48:03.161509+0000","last_fullsized":"2024-04-26T11:48:03.161509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":916,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344231+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:48:02.344231+0000","last_peered":"2024-04-26T11:48:02.344231+0000","last_clean":"2024-04-26T11:48:02.344231+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:48:02.344231+0000","last_undegraded":"2024-04-26T11:48:02.344231+0000","last_fullsized":"2024-04-26T11:48:02.344231+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":845,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160817+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:48:03.160817+0000","last_peered":"2024-04-26T11:48:03.160817+0000","last_clean":"2024-04-26T11:48:03.160817+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:48:03.160817+0000","last_undegraded":"2024-04-26T11:48:03.160817+0000","last_fullsized":"2024-04-26T11:48:03.160817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1037,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161066+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:48:03.161066+0000","last_peered":"2024-04-26T11:48:03.161066+0000","last_clean":"2024-04-26T11:48:03.161066+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:48:03.161066+0000","last_undegraded":"2024-04-26T11:48:03.161066+0000","last_fullsized":"2024-04-26T11:48:03.161066+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:59.926464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":846,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160198+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:03.160198+0000","last_peered":"2024-04-26T11:48:03.160198+0000","last_clean":"2024-04-26T11:48:03.160198+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:03.160198+0000","last_undegraded":"2024-04-26T11:48:03.160198+0000","last_fullsized":"2024-04-26T11:48:03.160198+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:56.834748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":542,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826282+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:48:03.826282+0000","last_peered":"2024-04-26T11:48:03.826282+0000","last_clean":"2024-04-26T11:48:03.826282+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:03.826282+0000","last_undegraded":"2024-04-26T11:48:03.826282+0000","last_fullsized":"2024-04-26T11:48:03.826282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":959,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344619+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:48:02.344619+0000","last_peered":"2024-04-26T11:48:02.344619+0000","last_clean":"2024-04-26T11:48:02.344619+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:48:02.344619+0000","last_undegraded":"2024-04-26T11:48:02.344619+0000","last_fullsized":"2024-04-26T11:48:02.344619+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:32.091133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":873,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161839+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:48:03.161839+0000","last_peered":"2024-04-26T11:48:03.161839+0000","last_clean":"2024-04-26T11:48:03.161839+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:48:03.161839+0000","last_undegraded":"2024-04-26T11:48:03.161839+0000","last_fullsized":"2024-04-26T11:48:03.161839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":490,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344166+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:48:02.344166+0000","last_peered":"2024-04-26T11:48:02.344166+0000","last_clean":"2024-04-26T11:48:02.344166+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:02.344166+0000","last_undegraded":"2024-04-26T11:48:02.344166+0000","last_fullsized":"2024-04-26T11:48:02.344166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":892,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343964+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:48:02.343964+0000","last_peered":"2024-04-26T11:48:02.343964+0000","last_clean":"2024-04-26T11:48:02.343964+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:48:02.343964+0000","last_undegraded":"2024-04-26T11:48:02.343964+0000","last_fullsized":"2024-04-26T11:48:02.343964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":563,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160823+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:48:03.160823+0000","last_peered":"2024-04-26T11:48:03.160823+0000","last_clean":"2024-04-26T11:48:03.160823+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:03.160823+0000","last_undegraded":"2024-04-26T11:48:03.160823+0000","last_fullsized":"2024-04-26T11:48:03.160823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":605,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161294+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:48:03.161294+0000","last_peered":"2024-04-26T11:48:03.161294+0000","last_clean":"2024-04-26T11:48:03.161294+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:03.161294+0000","last_undegraded":"2024-04-26T11:48:03.161294+0000","last_fullsized":"2024-04-26T11:48:03.161294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1060,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160188+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:48:03.160188+0000","last_peered":"2024-04-26T11:48:03.160188+0000","last_clean":"2024-04-26T11:48:03.160188+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:48:03.160188+0000","last_undegraded":"2024-04-26T11:48:03.160188+0000","last_fullsized":"2024-04-26T11:48:03.160188+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:50.720876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":510,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826051+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:48:03.826051+0000","last_peered":"2024-04-26T11:48:03.826051+0000","last_clean":"2024-04-26T11:48:03.826051+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:03.826051+0000","last_undegraded":"2024-04-26T11:48:03.826051+0000","last_fullsized":"2024-04-26T11:48:03.826051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":924,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.342787+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:48:02.342787+0000","last_peered":"2024-04-26T11:48:02.342787+0000","last_clean":"2024-04-26T11:48:02.342787+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:48:02.342787+0000","last_undegraded":"2024-04-26T11:48:02.342787+0000","last_fullsized":"2024-04-26T11:48:02.342787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:10.908191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":531,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825386+0000","last_change":"2024-04-26T11:47:42.470100+0000","last_active":"2024-04-26T11:48:03.825386+0000","last_peered":"2024-04-26T11:48:03.825386+0000","last_clean":"2024-04-26T11:48:03.825386+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:48:03.825386+0000","last_undegraded":"2024-04-26T11:48:03.825386+0000","last_fullsized":"2024-04-26T11:48:03.825386+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:37.523362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1014,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162195+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:48:03.162195+0000","last_peered":"2024-04-26T11:48:03.162195+0000","last_clean":"2024-04-26T11:48:03.162195+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:48:03.162195+0000","last_undegraded":"2024-04-26T11:48:03.162195+0000","last_fullsized":"2024-04-26T11:48:03.162195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":928,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161249+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:48:03.161249+0000","last_peered":"2024-04-26T11:48:03.161249+0000","last_clean":"2024-04-26T11:48:03.161249+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:03.161249+0000","last_undegraded":"2024-04-26T11:48:03.161249+0000","last_fullsized":"2024-04-26T11:48:03.161249+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:16.863281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":576,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343679+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:48:02.343679+0000","last_peered":"2024-04-26T11:48:02.343679+0000","last_clean":"2024-04-26T11:48:02.343679+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:02.343679+0000","last_undegraded":"2024-04-26T11:48:02.343679+0000","last_fullsized":"2024-04-26T11:48:02.343679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823660+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:48:03.823660+0000","last_peered":"2024-04-26T11:48:03.823660+0000","last_clean":"2024-04-26T11:48:03.823660+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:48:03.823660+0000","last_undegraded":"2024-04-26T11:48:03.823660+0000","last_fullsized":"2024-04-26T11:48:03.823660+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1031,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343072+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:48:02.343072+0000","last_peered":"2024-04-26T11:48:02.343072+0000","last_clean":"2024-04-26T11:48:02.343072+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:48:02.343072+0000","last_undegraded":"2024-04-26T11:48:02.343072+0000","last_fullsized":"2024-04-26T11:48:02.343072+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":512,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345205+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:48:02.345205+0000","last_peered":"2024-04-26T11:48:02.345205+0000","last_clean":"2024-04-26T11:48:02.345205+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:48:02.345205+0000","last_undegraded":"2024-04-26T11:48:02.345205+0000","last_fullsized":"2024-04-26T11:48:02.345205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":621,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826248+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:48:03.826248+0000","last_peered":"2024-04-26T11:48:03.826248+0000","last_clean":"2024-04-26T11:48:03.826248+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:48:03.826248+0000","last_undegraded":"2024-04-26T11:48:03.826248+0000","last_fullsized":"2024-04-26T11:48:03.826248+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:48.523722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162056+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:48:03.162056+0000","last_peered":"2024-04-26T11:48:03.162056+0000","last_clean":"2024-04-26T11:48:03.162056+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:03.162056+0000","last_undegraded":"2024-04-26T11:48:03.162056+0000","last_fullsized":"2024-04-26T11:48:03.162056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":595,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344618+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:48:02.344618+0000","last_peered":"2024-04-26T11:48:02.344618+0000","last_clean":"2024-04-26T11:48:02.344618+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:02.344618+0000","last_undegraded":"2024-04-26T11:48:02.344618+0000","last_fullsized":"2024-04-26T11:48:02.344618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":508,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824009+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:48:03.824009+0000","last_peered":"2024-04-26T11:48:03.824009+0000","last_clean":"2024-04-26T11:48:03.824009+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:48:03.824009+0000","last_undegraded":"2024-04-26T11:48:03.824009+0000","last_fullsized":"2024-04-26T11:48:03.824009+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343945+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:48:02.343945+0000","last_peered":"2024-04-26T11:48:02.343945+0000","last_clean":"2024-04-26T11:48:02.343945+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:02.343945+0000","last_undegraded":"2024-04-26T11:48:02.343945+0000","last_fullsized":"2024-04-26T11:48:02.343945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":573,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825525+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:48:03.825525+0000","last_peered":"2024-04-26T11:48:03.825525+0000","last_clean":"2024-04-26T11:48:03.825525+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:03.825525+0000","last_undegraded":"2024-04-26T11:48:03.825525+0000","last_fullsized":"2024-04-26T11:48:03.825525+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":950,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160503+0000","last_change":"2024-04-26T11:47:45.147770+0000","last_active":"2024-04-26T11:48:03.160503+0000","last_peered":"2024-04-26T11:48:03.160503+0000","last_clean":"2024-04-26T11:48:03.160503+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:03.160503+0000","last_undegraded":"2024-04-26T11:48:03.160503+0000","last_fullsized":"2024-04-26T11:48:03.160503+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:52.444032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":841,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344401+0000","last_change":"2024-04-26T11:47:45.156703+0000","last_active":"2024-04-26T11:48:02.344401+0000","last_peered":"2024-04-26T11:48:02.344401+0000","last_clean":"2024-04-26T11:48:02.344401+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:02.344401+0000","last_undegraded":"2024-04-26T11:48:02.344401+0000","last_fullsized":"2024-04-26T11:48:02.344401+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:22.809278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":623,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161374+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:48:03.161374+0000","last_peered":"2024-04-26T11:48:03.161374+0000","last_clean":"2024-04-26T11:48:03.161374+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:03.161374+0000","last_undegraded":"2024-04-26T11:48:03.161374+0000","last_fullsized":"2024-04-26T11:48:03.161374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345164+0000","last_change":"2024-04-26T11:47:44.154527+0000","last_active":"2024-04-26T11:48:02.345164+0000","last_peered":"2024-04-26T11:48:02.345164+0000","last_clean":"2024-04-26T11:48:02.345164+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:02.345164+0000","last_undegraded":"2024-04-26T11:48:02.345164+0000","last_fullsized":"2024-04-26T11:48:02.345164+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:36.227910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":64,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824342+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:48:03.824342+0000","last_peered":"2024-04-26T11:48:03.824342+0000","last_clean":"2024-04-26T11:48:03.824342+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:03.824342+0000","last_undegraded":"2024-04-26T11:48:03.824342+0000","last_fullsized":"2024-04-26T11:48:03.824342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825621+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:48:03.825621+0000","last_peered":"2024-04-26T11:48:03.825621+0000","last_clean":"2024-04-26T11:48:03.825621+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:03.825621+0000","last_undegraded":"2024-04-26T11:48:03.825621+0000","last_fullsized":"2024-04-26T11:48:03.825621+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":167,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343469+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:48:02.343469+0000","last_peered":"2024-04-26T11:48:02.343469+0000","last_clean":"2024-04-26T11:48:02.343469+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:48:02.343469+0000","last_undegraded":"2024-04-26T11:48:02.343469+0000","last_fullsized":"2024-04-26T11:48:02.343469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":550,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825717+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:48:03.825717+0000","last_peered":"2024-04-26T11:48:03.825717+0000","last_clean":"2024-04-26T11:48:03.825717+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:03.825717+0000","last_undegraded":"2024-04-26T11:48:03.825717+0000","last_fullsized":"2024-04-26T11:48:03.825717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":175,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160477+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:48:03.160477+0000","last_peered":"2024-04-26T11:48:03.160477+0000","last_clean":"2024-04-26T11:48:03.160477+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:03.160477+0000","last_undegraded":"2024-04-26T11:48:03.160477+0000","last_fullsized":"2024-04-26T11:48:03.160477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":322,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162943+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:48:03.162943+0000","last_peered":"2024-04-26T11:48:03.162943+0000","last_clean":"2024-04-26T11:48:03.162943+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:03.162943+0000","last_undegraded":"2024-04-26T11:48:03.162943+0000","last_fullsized":"2024-04-26T11:48:03.162943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":539,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343162+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:48:02.343162+0000","last_peered":"2024-04-26T11:48:02.343162+0000","last_clean":"2024-04-26T11:48:02.343162+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:02.343162+0000","last_undegraded":"2024-04-26T11:48:02.343162+0000","last_fullsized":"2024-04-26T11:48:02.343162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":499,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344928+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:48:02.344928+0000","last_peered":"2024-04-26T11:48:02.344928+0000","last_clean":"2024-04-26T11:48:02.344928+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:48:02.344928+0000","last_undegraded":"2024-04-26T11:48:02.344928+0000","last_fullsized":"2024-04-26T11:48:02.344928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1030,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343160+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:48:02.343160+0000","last_peered":"2024-04-26T11:48:02.343160+0000","last_clean":"2024-04-26T11:48:02.343160+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:02.343160+0000","last_undegraded":"2024-04-26T11:48:02.343160+0000","last_fullsized":"2024-04-26T11:48:02.343160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":694,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162634+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:48:03.162634+0000","last_peered":"2024-04-26T11:48:03.162634+0000","last_clean":"2024-04-26T11:48:03.162634+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:03.162634+0000","last_undegraded":"2024-04-26T11:48:03.162634+0000","last_fullsized":"2024-04-26T11:48:03.162634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1015,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161081+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:48:03.161081+0000","last_peered":"2024-04-26T11:48:03.161081+0000","last_clean":"2024-04-26T11:48:03.161081+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:03.161081+0000","last_undegraded":"2024-04-26T11:48:03.161081+0000","last_fullsized":"2024-04-26T11:48:03.161081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":183,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162531+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:48:03.162531+0000","last_peered":"2024-04-26T11:48:03.162531+0000","last_clean":"2024-04-26T11:48:03.162531+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:48:03.162531+0000","last_undegraded":"2024-04-26T11:48:03.162531+0000","last_fullsized":"2024-04-26T11:48:03.162531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":620,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825094+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:48:03.825094+0000","last_peered":"2024-04-26T11:48:03.825094+0000","last_clean":"2024-04-26T11:48:03.825094+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:48:03.825094+0000","last_undegraded":"2024-04-26T11:48:03.825094+0000","last_fullsized":"2024-04-26T11:48:03.825094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":372,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824588+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:48:03.824588+0000","last_peered":"2024-04-26T11:48:03.824588+0000","last_clean":"2024-04-26T11:48:03.824588+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:03.824588+0000","last_undegraded":"2024-04-26T11:48:03.824588+0000","last_fullsized":"2024-04-26T11:48:03.824588+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":962,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161856+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:48:03.161856+0000","last_peered":"2024-04-26T11:48:03.161856+0000","last_clean":"2024-04-26T11:48:03.161856+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:03.161856+0000","last_undegraded":"2024-04-26T11:48:03.161856+0000","last_fullsized":"2024-04-26T11:48:03.161856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":283,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161232+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:48:03.161232+0000","last_peered":"2024-04-26T11:48:03.161232+0000","last_clean":"2024-04-26T11:48:03.161232+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:48:03.161232+0000","last_undegraded":"2024-04-26T11:48:03.161232+0000","last_fullsized":"2024-04-26T11:48:03.161232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":548,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162292+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:48:03.162292+0000","last_peered":"2024-04-26T11:48:03.162292+0000","last_clean":"2024-04-26T11:48:03.162292+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:03.162292+0000","last_undegraded":"2024-04-26T11:48:03.162292+0000","last_fullsized":"2024-04-26T11:48:03.162292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":161,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343897+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:48:02.343897+0000","last_peered":"2024-04-26T11:48:02.343897+0000","last_clean":"2024-04-26T11:48:02.343897+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:48:02.343897+0000","last_undegraded":"2024-04-26T11:48:02.343897+0000","last_fullsized":"2024-04-26T11:48:02.343897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":486,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162640+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:48:03.162640+0000","last_peered":"2024-04-26T11:48:03.162640+0000","last_clean":"2024-04-26T11:48:03.162640+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:03.162640+0000","last_undegraded":"2024-04-26T11:48:03.162640+0000","last_fullsized":"2024-04-26T11:48:03.162640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":633,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343271+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:48:02.343271+0000","last_peered":"2024-04-26T11:48:02.343271+0000","last_clean":"2024-04-26T11:48:02.343271+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:48:02.343271+0000","last_undegraded":"2024-04-26T11:48:02.343271+0000","last_fullsized":"2024-04-26T11:48:02.343271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":525,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826617+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:48:03.826617+0000","last_peered":"2024-04-26T11:48:03.826617+0000","last_clean":"2024-04-26T11:48:03.826617+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:48:03.826617+0000","last_undegraded":"2024-04-26T11:48:03.826617+0000","last_fullsized":"2024-04-26T11:48:03.826617+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":310,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161015+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:48:03.161015+0000","last_peered":"2024-04-26T11:48:03.161015+0000","last_clean":"2024-04-26T11:48:03.161015+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:48:03.161015+0000","last_undegraded":"2024-04-26T11:48:03.161015+0000","last_fullsized":"2024-04-26T11:48:03.161015+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161600+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:48:03.161600+0000","last_peered":"2024-04-26T11:48:03.161600+0000","last_clean":"2024-04-26T11:48:03.161600+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:48:03.161600+0000","last_undegraded":"2024-04-26T11:48:03.161600+0000","last_fullsized":"2024-04-26T11:48:03.161600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":614,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825007+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:48:03.825007+0000","last_peered":"2024-04-26T11:48:03.825007+0000","last_clean":"2024-04-26T11:48:03.825007+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:48:03.825007+0000","last_undegraded":"2024-04-26T11:48:03.825007+0000","last_fullsized":"2024-04-26T11:48:03.825007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":574,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162328+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:48:03.162328+0000","last_peered":"2024-04-26T11:48:03.162328+0000","last_clean":"2024-04-26T11:48:03.162328+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:03.162328+0000","last_undegraded":"2024-04-26T11:48:03.162328+0000","last_fullsized":"2024-04-26T11:48:03.162328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160745+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:48:03.160745+0000","last_peered":"2024-04-26T11:48:03.160745+0000","last_clean":"2024-04-26T11:48:03.160745+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:48:03.160745+0000","last_undegraded":"2024-04-26T11:48:03.160745+0000","last_fullsized":"2024-04-26T11:48:03.160745+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":366,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823407+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:48:03.823407+0000","last_peered":"2024-04-26T11:48:03.823407+0000","last_clean":"2024-04-26T11:48:03.823407+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:48:03.823407+0000","last_undegraded":"2024-04-26T11:48:03.823407+0000","last_fullsized":"2024-04-26T11:48:03.823407+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":997,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344910+0000","last_change":"2024-04-26T11:47:34.145286+0000","last_active":"2024-04-26T11:48:02.344910+0000","last_peered":"2024-04-26T11:48:02.344910+0000","last_clean":"2024-04-26T11:48:02.344910+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:02.344910+0000","last_undegraded":"2024-04-26T11:48:02.344910+0000","last_fullsized":"2024-04-26T11:48:02.344910+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:13.918331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823886+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:48:03.823886+0000","last_peered":"2024-04-26T11:48:03.823886+0000","last_clean":"2024-04-26T11:48:03.823886+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:03.823886+0000","last_undegraded":"2024-04-26T11:48:03.823886+0000","last_fullsized":"2024-04-26T11:48:03.823886+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":530,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343412+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:48:02.343412+0000","last_peered":"2024-04-26T11:48:02.343412+0000","last_clean":"2024-04-26T11:48:02.343412+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:48:02.343412+0000","last_undegraded":"2024-04-26T11:48:02.343412+0000","last_fullsized":"2024-04-26T11:48:02.343412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":458,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826547+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:48:03.826547+0000","last_peered":"2024-04-26T11:48:03.826547+0000","last_clean":"2024-04-26T11:48:03.826547+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:48:03.826547+0000","last_undegraded":"2024-04-26T11:48:03.826547+0000","last_fullsized":"2024-04-26T11:48:03.826547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161461+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:48:03.161461+0000","last_peered":"2024-04-26T11:48:03.161461+0000","last_clean":"2024-04-26T11:48:03.161461+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:48:03.161461+0000","last_undegraded":"2024-04-26T11:48:03.161461+0000","last_fullsized":"2024-04-26T11:48:03.161461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":186,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161510+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:48:03.161510+0000","last_peered":"2024-04-26T11:48:03.161510+0000","last_clean":"2024-04-26T11:48:03.161510+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:48:03.161510+0000","last_undegraded":"2024-04-26T11:48:03.161510+0000","last_fullsized":"2024-04-26T11:48:03.161510+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":502,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824262+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:48:03.824262+0000","last_peered":"2024-04-26T11:48:03.824262+0000","last_clean":"2024-04-26T11:48:03.824262+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:48:03.824262+0000","last_undegraded":"2024-04-26T11:48:03.824262+0000","last_fullsized":"2024-04-26T11:48:03.824262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":645,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162571+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:48:03.162571+0000","last_peered":"2024-04-26T11:48:03.162571+0000","last_clean":"2024-04-26T11:48:03.162571+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:48:03.162571+0000","last_undegraded":"2024-04-26T11:48:03.162571+0000","last_fullsized":"2024-04-26T11:48:03.162571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824165+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:48:03.824165+0000","last_peered":"2024-04-26T11:48:03.824165+0000","last_clean":"2024-04-26T11:48:03.824165+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:48:03.824165+0000","last_undegraded":"2024-04-26T11:48:03.824165+0000","last_fullsized":"2024-04-26T11:48:03.824165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":485,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343931+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:48:02.343931+0000","last_peered":"2024-04-26T11:48:02.343931+0000","last_clean":"2024-04-26T11:48:02.343931+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:02.343931+0000","last_undegraded":"2024-04-26T11:48:02.343931+0000","last_fullsized":"2024-04-26T11:48:02.343931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824763+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:48:03.824763+0000","last_peered":"2024-04-26T11:48:03.824763+0000","last_clean":"2024-04-26T11:48:03.824763+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:03.824763+0000","last_undegraded":"2024-04-26T11:48:03.824763+0000","last_fullsized":"2024-04-26T11:48:03.824763+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345473+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:48:02.345473+0000","last_peered":"2024-04-26T11:48:02.345473+0000","last_clean":"2024-04-26T11:48:02.345473+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:48:02.345473+0000","last_undegraded":"2024-04-26T11:48:02.345473+0000","last_fullsized":"2024-04-26T11:48:02.345473+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":526,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344236+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:48:02.344236+0000","last_peered":"2024-04-26T11:48:02.344236+0000","last_clean":"2024-04-26T11:48:02.344236+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:02.344236+0000","last_undegraded":"2024-04-26T11:48:02.344236+0000","last_fullsized":"2024-04-26T11:48:02.344236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825839+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:48:03.825839+0000","last_peered":"2024-04-26T11:48:03.825839+0000","last_clean":"2024-04-26T11:48:03.825839+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:03.825839+0000","last_undegraded":"2024-04-26T11:48:03.825839+0000","last_fullsized":"2024-04-26T11:48:03.825839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825423+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:48:03.825423+0000","last_peered":"2024-04-26T11:48:03.825423+0000","last_clean":"2024-04-26T11:48:03.825423+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:03.825423+0000","last_undegraded":"2024-04-26T11:48:03.825423+0000","last_fullsized":"2024-04-26T11:48:03.825423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":483,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823562+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:48:03.823562+0000","last_peered":"2024-04-26T11:48:03.823562+0000","last_clean":"2024-04-26T11:48:03.823562+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:48:03.823562+0000","last_undegraded":"2024-04-26T11:48:03.823562+0000","last_fullsized":"2024-04-26T11:48:03.823562+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:47.076399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":78,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825424+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:48:03.825424+0000","last_peered":"2024-04-26T11:48:03.825424+0000","last_clean":"2024-04-26T11:48:03.825424+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:03.825424+0000","last_undegraded":"2024-04-26T11:48:03.825424+0000","last_fullsized":"2024-04-26T11:48:03.825424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162936+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:48:03.162936+0000","last_peered":"2024-04-26T11:48:03.162936+0000","last_clean":"2024-04-26T11:48:03.162936+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:48:03.162936+0000","last_undegraded":"2024-04-26T11:48:03.162936+0000","last_fullsized":"2024-04-26T11:48:03.162936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":559,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343413+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:48:02.343413+0000","last_peered":"2024-04-26T11:48:02.343413+0000","last_clean":"2024-04-26T11:48:02.343413+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:02.343413+0000","last_undegraded":"2024-04-26T11:48:02.343413+0000","last_fullsized":"2024-04-26T11:48:02.343413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":572,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161019+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:48:03.161019+0000","last_peered":"2024-04-26T11:48:03.161019+0000","last_clean":"2024-04-26T11:48:03.161019+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:48:03.161019+0000","last_undegraded":"2024-04-26T11:48:03.161019+0000","last_fullsized":"2024-04-26T11:48:03.161019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":519,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162325+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:48:03.162325+0000","last_peered":"2024-04-26T11:48:03.162325+0000","last_clean":"2024-04-26T11:48:03.162325+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:03.162325+0000","last_undegraded":"2024-04-26T11:48:03.162325+0000","last_fullsized":"2024-04-26T11:48:03.162325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":546,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824093+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:48:03.824093+0000","last_peered":"2024-04-26T11:48:03.824093+0000","last_clean":"2024-04-26T11:48:03.824093+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:03.824093+0000","last_undegraded":"2024-04-26T11:48:03.824093+0000","last_fullsized":"2024-04-26T11:48:03.824093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":210,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345365+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:48:02.345365+0000","last_peered":"2024-04-26T11:48:02.345365+0000","last_clean":"2024-04-26T11:48:02.345365+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:48:02.345365+0000","last_undegraded":"2024-04-26T11:48:02.345365+0000","last_fullsized":"2024-04-26T11:48:02.345365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":466,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162787+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:48:03.162787+0000","last_peered":"2024-04-26T11:48:03.162787+0000","last_clean":"2024-04-26T11:48:03.162787+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:48:03.162787+0000","last_undegraded":"2024-04-26T11:48:03.162787+0000","last_fullsized":"2024-04-26T11:48:03.162787+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":579,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823761+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:48:03.823761+0000","last_peered":"2024-04-26T11:48:03.823761+0000","last_clean":"2024-04-26T11:48:03.823761+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:03.823761+0000","last_undegraded":"2024-04-26T11:48:03.823761+0000","last_fullsized":"2024-04-26T11:48:03.823761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":63,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826308+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:48:03.826308+0000","last_peered":"2024-04-26T11:48:03.826308+0000","last_clean":"2024-04-26T11:48:03.826308+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:03.826308+0000","last_undegraded":"2024-04-26T11:48:03.826308+0000","last_fullsized":"2024-04-26T11:48:03.826308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":575,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823378+0000","last_change":"2024-04-26T11:47:41.467086+0000","last_active":"2024-04-26T11:48:03.823378+0000","last_peered":"2024-04-26T11:48:03.823378+0000","last_clean":"2024-04-26T11:48:03.823378+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:03.823378+0000","last_undegraded":"2024-04-26T11:48:03.823378+0000","last_fullsized":"2024-04-26T11:48:03.823378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:45.011728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":517,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345346+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:48:02.345346+0000","last_peered":"2024-04-26T11:48:02.345346+0000","last_clean":"2024-04-26T11:48:02.345346+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:02.345346+0000","last_undegraded":"2024-04-26T11:48:02.345346+0000","last_fullsized":"2024-04-26T11:48:02.345346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":875,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823118+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:48:03.823118+0000","last_peered":"2024-04-26T11:48:03.823118+0000","last_clean":"2024-04-26T11:48:03.823118+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:48:03.823118+0000","last_undegraded":"2024-04-26T11:48:03.823118+0000","last_fullsized":"2024-04-26T11:48:03.823118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":498,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826015+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:48:03.826015+0000","last_peered":"2024-04-26T11:48:03.826015+0000","last_clean":"2024-04-26T11:48:03.826015+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:48:03.826015+0000","last_undegraded":"2024-04-26T11:48:03.826015+0000","last_fullsized":"2024-04-26T11:48:03.826015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":432,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823352+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:48:03.823352+0000","last_peered":"2024-04-26T11:48:03.823352+0000","last_clean":"2024-04-26T11:48:03.823352+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:48:03.823352+0000","last_undegraded":"2024-04-26T11:48:03.823352+0000","last_fullsized":"2024-04-26T11:48:03.823352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":538,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345036+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:48:02.345036+0000","last_peered":"2024-04-26T11:48:02.345036+0000","last_clean":"2024-04-26T11:48:02.345036+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:02.345036+0000","last_undegraded":"2024-04-26T11:48:02.345036+0000","last_fullsized":"2024-04-26T11:48:02.345036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":487,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344183+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:48:02.344183+0000","last_peered":"2024-04-26T11:48:02.344183+0000","last_clean":"2024-04-26T11:48:02.344183+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:48:02.344183+0000","last_undegraded":"2024-04-26T11:48:02.344183+0000","last_fullsized":"2024-04-26T11:48:02.344183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":853,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344697+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:48:02.344697+0000","last_peered":"2024-04-26T11:48:02.344697+0000","last_clean":"2024-04-26T11:48:02.344697+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:02.344697+0000","last_undegraded":"2024-04-26T11:48:02.344697+0000","last_fullsized":"2024-04-26T11:48:02.344697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":164,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344504+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:48:02.344504+0000","last_peered":"2024-04-26T11:48:02.344504+0000","last_clean":"2024-04-26T11:48:02.344504+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:48:02.344504+0000","last_undegraded":"2024-04-26T11:48:02.344504+0000","last_fullsized":"2024-04-26T11:48:02.344504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":884,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160938+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:48:03.160938+0000","last_peered":"2024-04-26T11:48:03.160938+0000","last_clean":"2024-04-26T11:48:03.160938+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:03.160938+0000","last_undegraded":"2024-04-26T11:48:03.160938+0000","last_fullsized":"2024-04-26T11:48:03.160938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":408,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162094+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:48:03.162094+0000","last_peered":"2024-04-26T11:48:03.162094+0000","last_clean":"2024-04-26T11:48:03.162094+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:03.162094+0000","last_undegraded":"2024-04-26T11:48:03.162094+0000","last_fullsized":"2024-04-26T11:48:03.162094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":901,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161287+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:48:03.161287+0000","last_peered":"2024-04-26T11:48:03.161287+0000","last_clean":"2024-04-26T11:48:03.161287+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:03.161287+0000","last_undegraded":"2024-04-26T11:48:03.161287+0000","last_fullsized":"2024-04-26T11:48:03.161287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":436,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345272+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:48:02.345272+0000","last_peered":"2024-04-26T11:48:02.345272+0000","last_clean":"2024-04-26T11:48:02.345272+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:02.345272+0000","last_undegraded":"2024-04-26T11:48:02.345272+0000","last_fullsized":"2024-04-26T11:48:02.345272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":951,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343732+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:48:02.343732+0000","last_peered":"2024-04-26T11:48:02.343732+0000","last_clean":"2024-04-26T11:48:02.343732+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:02.343732+0000","last_undegraded":"2024-04-26T11:48:02.343732+0000","last_fullsized":"2024-04-26T11:48:02.343732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":72,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826406+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:48:03.826406+0000","last_peered":"2024-04-26T11:48:03.826406+0000","last_clean":"2024-04-26T11:48:03.826406+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:48:03.826406+0000","last_undegraded":"2024-04-26T11:48:03.826406+0000","last_fullsized":"2024-04-26T11:48:03.826406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":980,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160781+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:48:03.160781+0000","last_peered":"2024-04-26T11:48:03.160781+0000","last_clean":"2024-04-26T11:48:03.160781+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:48:03.160781+0000","last_undegraded":"2024-04-26T11:48:03.160781+0000","last_fullsized":"2024-04-26T11:48:03.160781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.430609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":70,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826070+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:48:03.826070+0000","last_peered":"2024-04-26T11:48:03.826070+0000","last_clean":"2024-04-26T11:48:03.826070+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:48:03.826070+0000","last_undegraded":"2024-04-26T11:48:03.826070+0000","last_fullsized":"2024-04-26T11:48:03.826070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738420,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200492,"kb_used_data":89056,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171348,"statfs":{"total":96636764160,"available":96431460352,"internally_reserved":0,"allocated":91193344,"data_stored":90580133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":1,"up_from":72,"seq":309237645325,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125624,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246216,"statfs":{"total":96636764160,"available":96508125184,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190672,"kb_used_data":83324,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181168,"statfs":{"total":96636764160,"available":96441516032,"internally_reserved":0,"allocated":85323776,"data_stored":84722176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:48:08.440 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T11:48:08.440 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:48:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:48:08.758 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:48:08.771 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-04-26T11:48:08.056372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516788,"kb_used_data":252420,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598732,"statfs":{"total":289910292480,"available":289381101568,"internally_reserved":0,"allocated":258478080,"data_stored":256667819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001982"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":960,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345135+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:48:02.345135+0000","last_peered":"2024-04-26T11:48:02.345135+0000","last_clean":"2024-04-26T11:48:02.345135+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:48:02.345135+0000","last_undegraded":"2024-04-26T11:48:02.345135+0000","last_fullsized":"2024-04-26T11:48:02.345135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1017,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344511+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:48:02.344511+0000","last_peered":"2024-04-26T11:48:02.344511+0000","last_clean":"2024-04-26T11:48:02.344511+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:48:02.344511+0000","last_undegraded":"2024-04-26T11:48:02.344511+0000","last_fullsized":"2024-04-26T11:48:02.344511+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:25.339699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":524,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161869+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:03.161869+0000","last_peered":"2024-04-26T11:48:03.161869+0000","last_clean":"2024-04-26T11:48:03.161869+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:03.161869+0000","last_undegraded":"2024-04-26T11:48:03.161869+0000","last_fullsized":"2024-04-26T11:48:03.161869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":839,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161509+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:03.161509+0000","last_peered":"2024-04-26T11:48:03.161509+0000","last_clean":"2024-04-26T11:48:03.161509+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:03.161509+0000","last_undegraded":"2024-04-26T11:48:03.161509+0000","last_fullsized":"2024-04-26T11:48:03.161509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":916,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344231+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:48:02.344231+0000","last_peered":"2024-04-26T11:48:02.344231+0000","last_clean":"2024-04-26T11:48:02.344231+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:48:02.344231+0000","last_undegraded":"2024-04-26T11:48:02.344231+0000","last_fullsized":"2024-04-26T11:48:02.344231+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":845,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160817+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:48:03.160817+0000","last_peered":"2024-04-26T11:48:03.160817+0000","last_clean":"2024-04-26T11:48:03.160817+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:48:03.160817+0000","last_undegraded":"2024-04-26T11:48:03.160817+0000","last_fullsized":"2024-04-26T11:48:03.160817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1037,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161066+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:48:03.161066+0000","last_peered":"2024-04-26T11:48:03.161066+0000","last_clean":"2024-04-26T11:48:03.161066+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:48:03.161066+0000","last_undegraded":"2024-04-26T11:48:03.161066+0000","last_fullsized":"2024-04-26T11:48:03.161066+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:59.926464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":846,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160198+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:03.160198+0000","last_peered":"2024-04-26T11:48:03.160198+0000","last_clean":"2024-04-26T11:48:03.160198+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:03.160198+0000","last_undegraded":"2024-04-26T11:48:03.160198+0000","last_fullsized":"2024-04-26T11:48:03.160198+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:56.834748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":542,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826282+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:48:03.826282+0000","last_peered":"2024-04-26T11:48:03.826282+0000","last_clean":"2024-04-26T11:48:03.826282+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:03.826282+0000","last_undegraded":"2024-04-26T11:48:03.826282+0000","last_fullsized":"2024-04-26T11:48:03.826282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":959,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344619+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:48:02.344619+0000","last_peered":"2024-04-26T11:48:02.344619+0000","last_clean":"2024-04-26T11:48:02.344619+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:48:02.344619+0000","last_undegraded":"2024-04-26T11:48:02.344619+0000","last_fullsized":"2024-04-26T11:48:02.344619+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:32.091133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":873,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161839+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:48:03.161839+0000","last_peered":"2024-04-26T11:48:03.161839+0000","last_clean":"2024-04-26T11:48:03.161839+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:48:03.161839+0000","last_undegraded":"2024-04-26T11:48:03.161839+0000","last_fullsized":"2024-04-26T11:48:03.161839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":490,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344166+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:48:02.344166+0000","last_peered":"2024-04-26T11:48:02.344166+0000","last_clean":"2024-04-26T11:48:02.344166+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:02.344166+0000","last_undegraded":"2024-04-26T11:48:02.344166+0000","last_fullsized":"2024-04-26T11:48:02.344166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":892,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343964+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:48:02.343964+0000","last_peered":"2024-04-26T11:48:02.343964+0000","last_clean":"2024-04-26T11:48:02.343964+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:48:02.343964+0000","last_undegraded":"2024-04-26T11:48:02.343964+0000","last_fullsized":"2024-04-26T11:48:02.343964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":563,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160823+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:48:03.160823+0000","last_peered":"2024-04-26T11:48:03.160823+0000","last_clean":"2024-04-26T11:48:03.160823+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:03.160823+0000","last_undegraded":"2024-04-26T11:48:03.160823+0000","last_fullsized":"2024-04-26T11:48:03.160823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":605,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161294+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:48:03.161294+0000","last_peered":"2024-04-26T11:48:03.161294+0000","last_clean":"2024-04-26T11:48:03.161294+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:03.161294+0000","last_undegraded":"2024-04-26T11:48:03.161294+0000","last_fullsized":"2024-04-26T11:48:03.161294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1060,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160188+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:48:03.160188+0000","last_peered":"2024-04-26T11:48:03.160188+0000","last_clean":"2024-04-26T11:48:03.160188+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:48:03.160188+0000","last_undegraded":"2024-04-26T11:48:03.160188+0000","last_fullsized":"2024-04-26T11:48:03.160188+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:50.720876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":510,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826051+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:48:03.826051+0000","last_peered":"2024-04-26T11:48:03.826051+0000","last_clean":"2024-04-26T11:48:03.826051+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:03.826051+0000","last_undegraded":"2024-04-26T11:48:03.826051+0000","last_fullsized":"2024-04-26T11:48:03.826051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":924,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.342787+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:48:02.342787+0000","last_peered":"2024-04-26T11:48:02.342787+0000","last_clean":"2024-04-26T11:48:02.342787+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:48:02.342787+0000","last_undegraded":"2024-04-26T11:48:02.342787+0000","last_fullsized":"2024-04-26T11:48:02.342787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:10.908191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":531,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825386+0000","last_change":"2024-04-26T11:47:42.470100+0000","last_active":"2024-04-26T11:48:03.825386+0000","last_peered":"2024-04-26T11:48:03.825386+0000","last_clean":"2024-04-26T11:48:03.825386+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:48:03.825386+0000","last_undegraded":"2024-04-26T11:48:03.825386+0000","last_fullsized":"2024-04-26T11:48:03.825386+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:37.523362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1014,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162195+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:48:03.162195+0000","last_peered":"2024-04-26T11:48:03.162195+0000","last_clean":"2024-04-26T11:48:03.162195+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:48:03.162195+0000","last_undegraded":"2024-04-26T11:48:03.162195+0000","last_fullsized":"2024-04-26T11:48:03.162195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":928,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161249+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:48:03.161249+0000","last_peered":"2024-04-26T11:48:03.161249+0000","last_clean":"2024-04-26T11:48:03.161249+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:03.161249+0000","last_undegraded":"2024-04-26T11:48:03.161249+0000","last_fullsized":"2024-04-26T11:48:03.161249+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:16.863281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":576,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343679+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:48:02.343679+0000","last_peered":"2024-04-26T11:48:02.343679+0000","last_clean":"2024-04-26T11:48:02.343679+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:02.343679+0000","last_undegraded":"2024-04-26T11:48:02.343679+0000","last_fullsized":"2024-04-26T11:48:02.343679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823660+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:48:03.823660+0000","last_peered":"2024-04-26T11:48:03.823660+0000","last_clean":"2024-04-26T11:48:03.823660+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:48:03.823660+0000","last_undegraded":"2024-04-26T11:48:03.823660+0000","last_fullsized":"2024-04-26T11:48:03.823660+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1031,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343072+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:48:02.343072+0000","last_peered":"2024-04-26T11:48:02.343072+0000","last_clean":"2024-04-26T11:48:02.343072+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:48:02.343072+0000","last_undegraded":"2024-04-26T11:48:02.343072+0000","last_fullsized":"2024-04-26T11:48:02.343072+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":512,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345205+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:48:02.345205+0000","last_peered":"2024-04-26T11:48:02.345205+0000","last_clean":"2024-04-26T11:48:02.345205+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:48:02.345205+0000","last_undegraded":"2024-04-26T11:48:02.345205+0000","last_fullsized":"2024-04-26T11:48:02.345205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":621,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826248+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:48:03.826248+0000","last_peered":"2024-04-26T11:48:03.826248+0000","last_clean":"2024-04-26T11:48:03.826248+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:48:03.826248+0000","last_undegraded":"2024-04-26T11:48:03.826248+0000","last_fullsized":"2024-04-26T11:48:03.826248+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:48.523722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162056+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:48:03.162056+0000","last_peered":"2024-04-26T11:48:03.162056+0000","last_clean":"2024-04-26T11:48:03.162056+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:03.162056+0000","last_undegraded":"2024-04-26T11:48:03.162056+0000","last_fullsized":"2024-04-26T11:48:03.162056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":595,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344618+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:48:02.344618+0000","last_peered":"2024-04-26T11:48:02.344618+0000","last_clean":"2024-04-26T11:48:02.344618+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:02.344618+0000","last_undegraded":"2024-04-26T11:48:02.344618+0000","last_fullsized":"2024-04-26T11:48:02.344618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":508,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824009+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:48:03.824009+0000","last_peered":"2024-04-26T11:48:03.824009+0000","last_clean":"2024-04-26T11:48:03.824009+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:48:03.824009+0000","last_undegraded":"2024-04-26T11:48:03.824009+0000","last_fullsized":"2024-04-26T11:48:03.824009+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343945+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:48:02.343945+0000","last_peered":"2024-04-26T11:48:02.343945+0000","last_clean":"2024-04-26T11:48:02.343945+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:02.343945+0000","last_undegraded":"2024-04-26T11:48:02.343945+0000","last_fullsized":"2024-04-26T11:48:02.343945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":573,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825525+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:48:03.825525+0000","last_peered":"2024-04-26T11:48:03.825525+0000","last_clean":"2024-04-26T11:48:03.825525+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:03.825525+0000","last_undegraded":"2024-04-26T11:48:03.825525+0000","last_fullsized":"2024-04-26T11:48:03.825525+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":950,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160503+0000","last_change":"2024-04-26T11:47:45.147770+0000","last_active":"2024-04-26T11:48:03.160503+0000","last_peered":"2024-04-26T11:48:03.160503+0000","last_clean":"2024-04-26T11:48:03.160503+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:03.160503+0000","last_undegraded":"2024-04-26T11:48:03.160503+0000","last_fullsized":"2024-04-26T11:48:03.160503+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:52.444032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":841,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344401+0000","last_change":"2024-04-26T11:47:45.156703+0000","last_active":"2024-04-26T11:48:02.344401+0000","last_peered":"2024-04-26T11:48:02.344401+0000","last_clean":"2024-04-26T11:48:02.344401+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:02.344401+0000","last_undegraded":"2024-04-26T11:48:02.344401+0000","last_fullsized":"2024-04-26T11:48:02.344401+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:22.809278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":623,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161374+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:48:03.161374+0000","last_peered":"2024-04-26T11:48:03.161374+0000","last_clean":"2024-04-26T11:48:03.161374+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:03.161374+0000","last_undegraded":"2024-04-26T11:48:03.161374+0000","last_fullsized":"2024-04-26T11:48:03.161374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345164+0000","last_change":"2024-04-26T11:47:44.154527+0000","last_active":"2024-04-26T11:48:02.345164+0000","last_peered":"2024-04-26T11:48:02.345164+0000","last_clean":"2024-04-26T11:48:02.345164+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:02.345164+0000","last_undegraded":"2024-04-26T11:48:02.345164+0000","last_fullsized":"2024-04-26T11:48:02.345164+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:36.227910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":64,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824342+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:48:03.824342+0000","last_peered":"2024-04-26T11:48:03.824342+0000","last_clean":"2024-04-26T11:48:03.824342+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:03.824342+0000","last_undegraded":"2024-04-26T11:48:03.824342+0000","last_fullsized":"2024-04-26T11:48:03.824342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825621+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:48:03.825621+0000","last_peered":"2024-04-26T11:48:03.825621+0000","last_clean":"2024-04-26T11:48:03.825621+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:03.825621+0000","last_undegraded":"2024-04-26T11:48:03.825621+0000","last_fullsized":"2024-04-26T11:48:03.825621+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":167,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343469+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:48:02.343469+0000","last_peered":"2024-04-26T11:48:02.343469+0000","last_clean":"2024-04-26T11:48:02.343469+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:48:02.343469+0000","last_undegraded":"2024-04-26T11:48:02.343469+0000","last_fullsized":"2024-04-26T11:48:02.343469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":550,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825717+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:48:03.825717+0000","last_peered":"2024-04-26T11:48:03.825717+0000","last_clean":"2024-04-26T11:48:03.825717+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:03.825717+0000","last_undegraded":"2024-04-26T11:48:03.825717+0000","last_fullsized":"2024-04-26T11:48:03.825717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":175,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160477+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:48:03.160477+0000","last_peered":"2024-04-26T11:48:03.160477+0000","last_clean":"2024-04-26T11:48:03.160477+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:03.160477+0000","last_undegraded":"2024-04-26T11:48:03.160477+0000","last_fullsized":"2024-04-26T11:48:03.160477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":322,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162943+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:48:03.162943+0000","last_peered":"2024-04-26T11:48:03.162943+0000","last_clean":"2024-04-26T11:48:03.162943+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:03.162943+0000","last_undegraded":"2024-04-26T11:48:03.162943+0000","last_fullsized":"2024-04-26T11:48:03.162943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":539,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343162+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:48:02.343162+0000","last_peered":"2024-04-26T11:48:02.343162+0000","last_clean":"2024-04-26T11:48:02.343162+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:02.343162+0000","last_undegraded":"2024-04-26T11:48:02.343162+0000","last_fullsized":"2024-04-26T11:48:02.343162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":499,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344928+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:48:02.344928+0000","last_peered":"2024-04-26T11:48:02.344928+0000","last_clean":"2024-04-26T11:48:02.344928+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:48:02.344928+0000","last_undegraded":"2024-04-26T11:48:02.344928+0000","last_fullsized":"2024-04-26T11:48:02.344928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1030,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343160+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:48:02.343160+0000","last_peered":"2024-04-26T11:48:02.343160+0000","last_clean":"2024-04-26T11:48:02.343160+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:02.343160+0000","last_undegraded":"2024-04-26T11:48:02.343160+0000","last_fullsized":"2024-04-26T11:48:02.343160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":694,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162634+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:48:03.162634+0000","last_peered":"2024-04-26T11:48:03.162634+0000","last_clean":"2024-04-26T11:48:03.162634+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:03.162634+0000","last_undegraded":"2024-04-26T11:48:03.162634+0000","last_fullsized":"2024-04-26T11:48:03.162634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1015,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161081+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:48:03.161081+0000","last_peered":"2024-04-26T11:48:03.161081+0000","last_clean":"2024-04-26T11:48:03.161081+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:03.161081+0000","last_undegraded":"2024-04-26T11:48:03.161081+0000","last_fullsized":"2024-04-26T11:48:03.161081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":183,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162531+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:48:03.162531+0000","last_peered":"2024-04-26T11:48:03.162531+0000","last_clean":"2024-04-26T11:48:03.162531+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:48:03.162531+0000","last_undegraded":"2024-04-26T11:48:03.162531+0000","last_fullsized":"2024-04-26T11:48:03.162531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":620,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825094+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:48:03.825094+0000","last_peered":"2024-04-26T11:48:03.825094+0000","last_clean":"2024-04-26T11:48:03.825094+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:48:03.825094+0000","last_undegraded":"2024-04-26T11:48:03.825094+0000","last_fullsized":"2024-04-26T11:48:03.825094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":372,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824588+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:48:03.824588+0000","last_peered":"2024-04-26T11:48:03.824588+0000","last_clean":"2024-04-26T11:48:03.824588+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:03.824588+0000","last_undegraded":"2024-04-26T11:48:03.824588+0000","last_fullsized":"2024-04-26T11:48:03.824588+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":962,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161856+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:48:03.161856+0000","last_peered":"2024-04-26T11:48:03.161856+0000","last_clean":"2024-04-26T11:48:03.161856+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:03.161856+0000","last_undegraded":"2024-04-26T11:48:03.161856+0000","last_fullsized":"2024-04-26T11:48:03.161856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":283,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161232+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:48:03.161232+0000","last_peered":"2024-04-26T11:48:03.161232+0000","last_clean":"2024-04-26T11:48:03.161232+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:48:03.161232+0000","last_undegraded":"2024-04-26T11:48:03.161232+0000","last_fullsized":"2024-04-26T11:48:03.161232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":548,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162292+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:48:03.162292+0000","last_peered":"2024-04-26T11:48:03.162292+0000","last_clean":"2024-04-26T11:48:03.162292+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:03.162292+0000","last_undegraded":"2024-04-26T11:48:03.162292+0000","last_fullsized":"2024-04-26T11:48:03.162292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":161,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343897+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:48:02.343897+0000","last_peered":"2024-04-26T11:48:02.343897+0000","last_clean":"2024-04-26T11:48:02.343897+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:48:02.343897+0000","last_undegraded":"2024-04-26T11:48:02.343897+0000","last_fullsized":"2024-04-26T11:48:02.343897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":486,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162640+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:48:03.162640+0000","last_peered":"2024-04-26T11:48:03.162640+0000","last_clean":"2024-04-26T11:48:03.162640+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:03.162640+0000","last_undegraded":"2024-04-26T11:48:03.162640+0000","last_fullsized":"2024-04-26T11:48:03.162640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":633,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343271+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:48:02.343271+0000","last_peered":"2024-04-26T11:48:02.343271+0000","last_clean":"2024-04-26T11:48:02.343271+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:48:02.343271+0000","last_undegraded":"2024-04-26T11:48:02.343271+0000","last_fullsized":"2024-04-26T11:48:02.343271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":525,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826617+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:48:03.826617+0000","last_peered":"2024-04-26T11:48:03.826617+0000","last_clean":"2024-04-26T11:48:03.826617+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:48:03.826617+0000","last_undegraded":"2024-04-26T11:48:03.826617+0000","last_fullsized":"2024-04-26T11:48:03.826617+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":310,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161015+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:48:03.161015+0000","last_peered":"2024-04-26T11:48:03.161015+0000","last_clean":"2024-04-26T11:48:03.161015+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:48:03.161015+0000","last_undegraded":"2024-04-26T11:48:03.161015+0000","last_fullsized":"2024-04-26T11:48:03.161015+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161600+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:48:03.161600+0000","last_peered":"2024-04-26T11:48:03.161600+0000","last_clean":"2024-04-26T11:48:03.161600+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:48:03.161600+0000","last_undegraded":"2024-04-26T11:48:03.161600+0000","last_fullsized":"2024-04-26T11:48:03.161600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":614,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825007+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:48:03.825007+0000","last_peered":"2024-04-26T11:48:03.825007+0000","last_clean":"2024-04-26T11:48:03.825007+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:48:03.825007+0000","last_undegraded":"2024-04-26T11:48:03.825007+0000","last_fullsized":"2024-04-26T11:48:03.825007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":574,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162328+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:48:03.162328+0000","last_peered":"2024-04-26T11:48:03.162328+0000","last_clean":"2024-04-26T11:48:03.162328+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:03.162328+0000","last_undegraded":"2024-04-26T11:48:03.162328+0000","last_fullsized":"2024-04-26T11:48:03.162328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160745+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:48:03.160745+0000","last_peered":"2024-04-26T11:48:03.160745+0000","last_clean":"2024-04-26T11:48:03.160745+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:48:03.160745+0000","last_undegraded":"2024-04-26T11:48:03.160745+0000","last_fullsized":"2024-04-26T11:48:03.160745+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":366,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823407+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:48:03.823407+0000","last_peered":"2024-04-26T11:48:03.823407+0000","last_clean":"2024-04-26T11:48:03.823407+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:48:03.823407+0000","last_undegraded":"2024-04-26T11:48:03.823407+0000","last_fullsized":"2024-04-26T11:48:03.823407+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":997,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344910+0000","last_change":"2024-04-26T11:47:34.145286+0000","last_active":"2024-04-26T11:48:02.344910+0000","last_peered":"2024-04-26T11:48:02.344910+0000","last_clean":"2024-04-26T11:48:02.344910+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:02.344910+0000","last_undegraded":"2024-04-26T11:48:02.344910+0000","last_fullsized":"2024-04-26T11:48:02.344910+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:13.918331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823886+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:48:03.823886+0000","last_peered":"2024-04-26T11:48:03.823886+0000","last_clean":"2024-04-26T11:48:03.823886+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:03.823886+0000","last_undegraded":"2024-04-26T11:48:03.823886+0000","last_fullsized":"2024-04-26T11:48:03.823886+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":530,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343412+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:48:02.343412+0000","last_peered":"2024-04-26T11:48:02.343412+0000","last_clean":"2024-04-26T11:48:02.343412+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:48:02.343412+0000","last_undegraded":"2024-04-26T11:48:02.343412+0000","last_fullsized":"2024-04-26T11:48:02.343412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":458,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826547+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:48:03.826547+0000","last_peered":"2024-04-26T11:48:03.826547+0000","last_clean":"2024-04-26T11:48:03.826547+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:48:03.826547+0000","last_undegraded":"2024-04-26T11:48:03.826547+0000","last_fullsized":"2024-04-26T11:48:03.826547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161461+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:48:03.161461+0000","last_peered":"2024-04-26T11:48:03.161461+0000","last_clean":"2024-04-26T11:48:03.161461+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:48:03.161461+0000","last_undegraded":"2024-04-26T11:48:03.161461+0000","last_fullsized":"2024-04-26T11:48:03.161461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":186,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161510+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:48:03.161510+0000","last_peered":"2024-04-26T11:48:03.161510+0000","last_clean":"2024-04-26T11:48:03.161510+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:48:03.161510+0000","last_undegraded":"2024-04-26T11:48:03.161510+0000","last_fullsized":"2024-04-26T11:48:03.161510+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":502,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824262+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:48:03.824262+0000","last_peered":"2024-04-26T11:48:03.824262+0000","last_clean":"2024-04-26T11:48:03.824262+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:48:03.824262+0000","last_undegraded":"2024-04-26T11:48:03.824262+0000","last_fullsized":"2024-04-26T11:48:03.824262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":645,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162571+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:48:03.162571+0000","last_peered":"2024-04-26T11:48:03.162571+0000","last_clean":"2024-04-26T11:48:03.162571+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:48:03.162571+0000","last_undegraded":"2024-04-26T11:48:03.162571+0000","last_fullsized":"2024-04-26T11:48:03.162571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824165+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:48:03.824165+0000","last_peered":"2024-04-26T11:48:03.824165+0000","last_clean":"2024-04-26T11:48:03.824165+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:48:03.824165+0000","last_undegraded":"2024-04-26T11:48:03.824165+0000","last_fullsized":"2024-04-26T11:48:03.824165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":485,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343931+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:48:02.343931+0000","last_peered":"2024-04-26T11:48:02.343931+0000","last_clean":"2024-04-26T11:48:02.343931+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:02.343931+0000","last_undegraded":"2024-04-26T11:48:02.343931+0000","last_fullsized":"2024-04-26T11:48:02.343931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824763+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:48:03.824763+0000","last_peered":"2024-04-26T11:48:03.824763+0000","last_clean":"2024-04-26T11:48:03.824763+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:03.824763+0000","last_undegraded":"2024-04-26T11:48:03.824763+0000","last_fullsized":"2024-04-26T11:48:03.824763+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345473+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:48:02.345473+0000","last_peered":"2024-04-26T11:48:02.345473+0000","last_clean":"2024-04-26T11:48:02.345473+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:48:02.345473+0000","last_undegraded":"2024-04-26T11:48:02.345473+0000","last_fullsized":"2024-04-26T11:48:02.345473+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":526,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344236+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:48:02.344236+0000","last_peered":"2024-04-26T11:48:02.344236+0000","last_clean":"2024-04-26T11:48:02.344236+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:02.344236+0000","last_undegraded":"2024-04-26T11:48:02.344236+0000","last_fullsized":"2024-04-26T11:48:02.344236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825839+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:48:03.825839+0000","last_peered":"2024-04-26T11:48:03.825839+0000","last_clean":"2024-04-26T11:48:03.825839+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:03.825839+0000","last_undegraded":"2024-04-26T11:48:03.825839+0000","last_fullsized":"2024-04-26T11:48:03.825839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825423+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:48:03.825423+0000","last_peered":"2024-04-26T11:48:03.825423+0000","last_clean":"2024-04-26T11:48:03.825423+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:03.825423+0000","last_undegraded":"2024-04-26T11:48:03.825423+0000","last_fullsized":"2024-04-26T11:48:03.825423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":483,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823562+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:48:03.823562+0000","last_peered":"2024-04-26T11:48:03.823562+0000","last_clean":"2024-04-26T11:48:03.823562+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:48:03.823562+0000","last_undegraded":"2024-04-26T11:48:03.823562+0000","last_fullsized":"2024-04-26T11:48:03.823562+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:47.076399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":78,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825424+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:48:03.825424+0000","last_peered":"2024-04-26T11:48:03.825424+0000","last_clean":"2024-04-26T11:48:03.825424+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:03.825424+0000","last_undegraded":"2024-04-26T11:48:03.825424+0000","last_fullsized":"2024-04-26T11:48:03.825424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162936+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:48:03.162936+0000","last_peered":"2024-04-26T11:48:03.162936+0000","last_clean":"2024-04-26T11:48:03.162936+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:48:03.162936+0000","last_undegraded":"2024-04-26T11:48:03.162936+0000","last_fullsized":"2024-04-26T11:48:03.162936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":559,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343413+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:48:02.343413+0000","last_peered":"2024-04-26T11:48:02.343413+0000","last_clean":"2024-04-26T11:48:02.343413+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:02.343413+0000","last_undegraded":"2024-04-26T11:48:02.343413+0000","last_fullsized":"2024-04-26T11:48:02.343413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":572,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161019+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:48:03.161019+0000","last_peered":"2024-04-26T11:48:03.161019+0000","last_clean":"2024-04-26T11:48:03.161019+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:48:03.161019+0000","last_undegraded":"2024-04-26T11:48:03.161019+0000","last_fullsized":"2024-04-26T11:48:03.161019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":519,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162325+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:48:03.162325+0000","last_peered":"2024-04-26T11:48:03.162325+0000","last_clean":"2024-04-26T11:48:03.162325+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:03.162325+0000","last_undegraded":"2024-04-26T11:48:03.162325+0000","last_fullsized":"2024-04-26T11:48:03.162325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":546,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824093+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:48:03.824093+0000","last_peered":"2024-04-26T11:48:03.824093+0000","last_clean":"2024-04-26T11:48:03.824093+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:03.824093+0000","last_undegraded":"2024-04-26T11:48:03.824093+0000","last_fullsized":"2024-04-26T11:48:03.824093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":210,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345365+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:48:02.345365+0000","last_peered":"2024-04-26T11:48:02.345365+0000","last_clean":"2024-04-26T11:48:02.345365+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:48:02.345365+0000","last_undegraded":"2024-04-26T11:48:02.345365+0000","last_fullsized":"2024-04-26T11:48:02.345365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":466,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162787+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:48:03.162787+0000","last_peered":"2024-04-26T11:48:03.162787+0000","last_clean":"2024-04-26T11:48:03.162787+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:48:03.162787+0000","last_undegraded":"2024-04-26T11:48:03.162787+0000","last_fullsized":"2024-04-26T11:48:03.162787+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":579,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823761+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:48:03.823761+0000","last_peered":"2024-04-26T11:48:03.823761+0000","last_clean":"2024-04-26T11:48:03.823761+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:03.823761+0000","last_undegraded":"2024-04-26T11:48:03.823761+0000","last_fullsized":"2024-04-26T11:48:03.823761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":63,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826308+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:48:03.826308+0000","last_peered":"2024-04-26T11:48:03.826308+0000","last_clean":"2024-04-26T11:48:03.826308+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:03.826308+0000","last_undegraded":"2024-04-26T11:48:03.826308+0000","last_fullsized":"2024-04-26T11:48:03.826308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":575,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823378+0000","last_change":"2024-04-26T11:47:41.467086+0000","last_active":"2024-04-26T11:48:03.823378+0000","last_peered":"2024-04-26T11:48:03.823378+0000","last_clean":"2024-04-26T11:48:03.823378+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:03.823378+0000","last_undegraded":"2024-04-26T11:48:03.823378+0000","last_fullsized":"2024-04-26T11:48:03.823378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:45.011728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":517,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345346+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:48:02.345346+0000","last_peered":"2024-04-26T11:48:02.345346+0000","last_clean":"2024-04-26T11:48:02.345346+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:02.345346+0000","last_undegraded":"2024-04-26T11:48:02.345346+0000","last_fullsized":"2024-04-26T11:48:02.345346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":875,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823118+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:48:03.823118+0000","last_peered":"2024-04-26T11:48:03.823118+0000","last_clean":"2024-04-26T11:48:03.823118+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:48:03.823118+0000","last_undegraded":"2024-04-26T11:48:03.823118+0000","last_fullsized":"2024-04-26T11:48:03.823118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":498,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826015+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:48:03.826015+0000","last_peered":"2024-04-26T11:48:03.826015+0000","last_clean":"2024-04-26T11:48:03.826015+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:48:03.826015+0000","last_undegraded":"2024-04-26T11:48:03.826015+0000","last_fullsized":"2024-04-26T11:48:03.826015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":432,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823352+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:48:03.823352+0000","last_peered":"2024-04-26T11:48:03.823352+0000","last_clean":"2024-04-26T11:48:03.823352+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:48:03.823352+0000","last_undegraded":"2024-04-26T11:48:03.823352+0000","last_fullsized":"2024-04-26T11:48:03.823352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":538,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345036+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:48:02.345036+0000","last_peered":"2024-04-26T11:48:02.345036+0000","last_clean":"2024-04-26T11:48:02.345036+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:02.345036+0000","last_undegraded":"2024-04-26T11:48:02.345036+0000","last_fullsized":"2024-04-26T11:48:02.345036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":487,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344183+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:48:02.344183+0000","last_peered":"2024-04-26T11:48:02.344183+0000","last_clean":"2024-04-26T11:48:02.344183+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:48:02.344183+0000","last_undegraded":"2024-04-26T11:48:02.344183+0000","last_fullsized":"2024-04-26T11:48:02.344183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":853,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344697+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:48:02.344697+0000","last_peered":"2024-04-26T11:48:02.344697+0000","last_clean":"2024-04-26T11:48:02.344697+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:02.344697+0000","last_undegraded":"2024-04-26T11:48:02.344697+0000","last_fullsized":"2024-04-26T11:48:02.344697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":164,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.344504+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:48:02.344504+0000","last_peered":"2024-04-26T11:48:02.344504+0000","last_clean":"2024-04-26T11:48:02.344504+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:48:02.344504+0000","last_undegraded":"2024-04-26T11:48:02.344504+0000","last_fullsized":"2024-04-26T11:48:02.344504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":884,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160938+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:48:03.160938+0000","last_peered":"2024-04-26T11:48:03.160938+0000","last_clean":"2024-04-26T11:48:03.160938+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:03.160938+0000","last_undegraded":"2024-04-26T11:48:03.160938+0000","last_fullsized":"2024-04-26T11:48:03.160938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":408,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162094+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:48:03.162094+0000","last_peered":"2024-04-26T11:48:03.162094+0000","last_clean":"2024-04-26T11:48:03.162094+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:03.162094+0000","last_undegraded":"2024-04-26T11:48:03.162094+0000","last_fullsized":"2024-04-26T11:48:03.162094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":901,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161287+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:48:03.161287+0000","last_peered":"2024-04-26T11:48:03.161287+0000","last_clean":"2024-04-26T11:48:03.161287+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:03.161287+0000","last_undegraded":"2024-04-26T11:48:03.161287+0000","last_fullsized":"2024-04-26T11:48:03.161287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":436,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.345272+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:48:02.345272+0000","last_peered":"2024-04-26T11:48:02.345272+0000","last_clean":"2024-04-26T11:48:02.345272+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:02.345272+0000","last_undegraded":"2024-04-26T11:48:02.345272+0000","last_fullsized":"2024-04-26T11:48:02.345272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":951,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-26T11:48:02.343732+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:48:02.343732+0000","last_peered":"2024-04-26T11:48:02.343732+0000","last_clean":"2024-04-26T11:48:02.343732+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:02.343732+0000","last_undegraded":"2024-04-26T11:48:02.343732+0000","last_fullsized":"2024-04-26T11:48:02.343732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":72,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826406+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:48:03.826406+0000","last_peered":"2024-04-26T11:48:03.826406+0000","last_clean":"2024-04-26T11:48:03.826406+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:48:03.826406+0000","last_undegraded":"2024-04-26T11:48:03.826406+0000","last_fullsized":"2024-04-26T11:48:03.826406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":980,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160781+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:48:03.160781+0000","last_peered":"2024-04-26T11:48:03.160781+0000","last_clean":"2024-04-26T11:48:03.160781+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:48:03.160781+0000","last_undegraded":"2024-04-26T11:48:03.160781+0000","last_fullsized":"2024-04-26T11:48:03.160781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.430609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":70,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826070+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:48:03.826070+0000","last_peered":"2024-04-26T11:48:03.826070+0000","last_clean":"2024-04-26T11:48:03.826070+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:48:03.826070+0000","last_undegraded":"2024-04-26T11:48:03.826070+0000","last_fullsized":"2024-04-26T11:48:03.826070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738420,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200492,"kb_used_data":89056,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171348,"statfs":{"total":96636764160,"available":96431460352,"internally_reserved":0,"allocated":91193344,"data_stored":90580133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":1,"up_from":72,"seq":309237645325,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125624,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246216,"statfs":{"total":96636764160,"available":96508125184,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190672,"kb_used_data":83324,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181168,"statfs":{"total":96636764160,"available":96441516032,"internally_reserved":0,"allocated":85323776,"data_stored":84722176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:48:08.775 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:48:09.076 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:48:09.076 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":115,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:48:04.159996+0000","last_up_change":"2024-04-26T11:47:10.111142+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":72,"up_thru":103,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1425},{"type":"v1","addr":"172.21.15.82:6801","nonce":1425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1425},{"type":"v1","addr":"172.21.15.82:6803","nonce":1425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1425},{"type":"v1","addr":"172.21.15.82:6807","nonce":1425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1425},{"type":"v1","addr":"172.21.15.82:6805","nonce":1425}]},"public_addr":"172.21.15.82:6801/1425","cluster_addr":"172.21.15.82:6803/1425","heartbeat_back_addr":"172.21.15.82:6807/1425","heartbeat_front_addr":"172.21.15.82:6805/1425","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:48:10.096 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T11:48:10.097 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T11:48:10.261 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:48:10.261 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T11:48:10.261 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:48:10.280 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T11:48:10.597 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T11:48:10.608 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T11:48:10.609 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T11:48:10.759 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:48:10.759 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T11:48:10.759 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:48:10.777 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T11:48:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T11:48:11.101 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T11:48:11.101 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T11:48:11.266 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:48:11.267 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T11:48:11.267 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:48:11.280 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T11:48:11.594 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T11:48:11.605 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:48:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:48:11.931 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:48:11.944 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-04-26T11:48:10.056944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34084,"ondisk_log_size":34084,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516800,"kb_used_data":252436,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598720,"statfs":{"total":289910292480,"available":289381089280,"internally_reserved":0,"allocated":258494464,"data_stored":256676283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.913450"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":961,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.165154+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:48:03.165154+0000","last_peered":"2024-04-26T11:48:03.165154+0000","last_clean":"2024-04-26T11:48:03.165154+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:48:03.165154+0000","last_undegraded":"2024-04-26T11:48:03.165154+0000","last_fullsized":"2024-04-26T11:48:03.165154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.471841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1018,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.164283+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:48:03.164283+0000","last_peered":"2024-04-26T11:48:03.164283+0000","last_clean":"2024-04-26T11:48:03.164283+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:48:03.164283+0000","last_undegraded":"2024-04-26T11:48:03.164283+0000","last_fullsized":"2024-04-26T11:48:03.164283+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:25.339699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":524,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161869+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:03.161869+0000","last_peered":"2024-04-26T11:48:03.161869+0000","last_clean":"2024-04-26T11:48:03.161869+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:03.161869+0000","last_undegraded":"2024-04-26T11:48:03.161869+0000","last_fullsized":"2024-04-26T11:48:03.161869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:26.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":839,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161509+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:03.161509+0000","last_peered":"2024-04-26T11:48:03.161509+0000","last_clean":"2024-04-26T11:48:03.161509+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:03.161509+0000","last_undegraded":"2024-04-26T11:48:03.161509+0000","last_fullsized":"2024-04-26T11:48:03.161509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.712879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":917,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163898+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:48:03.163898+0000","last_peered":"2024-04-26T11:48:03.163898+0000","last_clean":"2024-04-26T11:48:03.163898+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:48:03.163898+0000","last_undegraded":"2024-04-26T11:48:03.163898+0000","last_fullsized":"2024-04-26T11:48:03.163898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.055377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":845,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160817+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:48:03.160817+0000","last_peered":"2024-04-26T11:48:03.160817+0000","last_clean":"2024-04-26T11:48:03.160817+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:48:03.160817+0000","last_undegraded":"2024-04-26T11:48:03.160817+0000","last_fullsized":"2024-04-26T11:48:03.160817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1037,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161066+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:48:03.161066+0000","last_peered":"2024-04-26T11:48:03.161066+0000","last_clean":"2024-04-26T11:48:03.161066+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:48:03.161066+0000","last_undegraded":"2024-04-26T11:48:03.161066+0000","last_fullsized":"2024-04-26T11:48:03.161066+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:59.926464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":846,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160198+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:03.160198+0000","last_peered":"2024-04-26T11:48:03.160198+0000","last_clean":"2024-04-26T11:48:03.160198+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:03.160198+0000","last_undegraded":"2024-04-26T11:48:03.160198+0000","last_fullsized":"2024-04-26T11:48:03.160198+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:56.834748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":542,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826282+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:48:03.826282+0000","last_peered":"2024-04-26T11:48:03.826282+0000","last_clean":"2024-04-26T11:48:03.826282+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:03.826282+0000","last_undegraded":"2024-04-26T11:48:03.826282+0000","last_fullsized":"2024-04-26T11:48:03.826282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:32.312646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":960,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.164466+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:48:03.164466+0000","last_peered":"2024-04-26T11:48:03.164466+0000","last_clean":"2024-04-26T11:48:03.164466+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:48:03.164466+0000","last_undegraded":"2024-04-26T11:48:03.164466+0000","last_fullsized":"2024-04-26T11:48:03.164466+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:32.091133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":873,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161839+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:48:03.161839+0000","last_peered":"2024-04-26T11:48:03.161839+0000","last_clean":"2024-04-26T11:48:03.161839+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:48:03.161839+0000","last_undegraded":"2024-04-26T11:48:03.161839+0000","last_fullsized":"2024-04-26T11:48:03.161839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.634550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":491,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163923+0000","last_change":"2024-04-26T11:44:21.443613+0000","last_active":"2024-04-26T11:48:03.163923+0000","last_peered":"2024-04-26T11:48:03.163923+0000","last_clean":"2024-04-26T11:48:03.163923+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:03.163923+0000","last_undegraded":"2024-04-26T11:48:03.163923+0000","last_fullsized":"2024-04-26T11:48:03.163923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":893,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163673+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:48:03.163673+0000","last_peered":"2024-04-26T11:48:03.163673+0000","last_clean":"2024-04-26T11:48:03.163673+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:48:03.163673+0000","last_undegraded":"2024-04-26T11:48:03.163673+0000","last_fullsized":"2024-04-26T11:48:03.163673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":563,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160823+0000","last_change":"2024-04-26T11:44:21.450872+0000","last_active":"2024-04-26T11:48:03.160823+0000","last_peered":"2024-04-26T11:48:03.160823+0000","last_clean":"2024-04-26T11:48:03.160823+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:03.160823+0000","last_undegraded":"2024-04-26T11:48:03.160823+0000","last_fullsized":"2024-04-26T11:48:03.160823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":605,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161294+0000","last_change":"2024-04-26T11:44:21.449985+0000","last_active":"2024-04-26T11:48:03.161294+0000","last_peered":"2024-04-26T11:48:03.161294+0000","last_clean":"2024-04-26T11:48:03.161294+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:03.161294+0000","last_undegraded":"2024-04-26T11:48:03.161294+0000","last_fullsized":"2024-04-26T11:48:03.161294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1060,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160188+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:48:03.160188+0000","last_peered":"2024-04-26T11:48:03.160188+0000","last_clean":"2024-04-26T11:48:03.160188+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:48:03.160188+0000","last_undegraded":"2024-04-26T11:48:03.160188+0000","last_fullsized":"2024-04-26T11:48:03.160188+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:50.720876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":510,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826051+0000","last_change":"2024-04-26T11:47:17.441916+0000","last_active":"2024-04-26T11:48:03.826051+0000","last_peered":"2024-04-26T11:48:03.826051+0000","last_clean":"2024-04-26T11:48:03.826051+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:03.826051+0000","last_undegraded":"2024-04-26T11:48:03.826051+0000","last_fullsized":"2024-04-26T11:48:03.826051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:30.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":925,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.164745+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:48:03.164745+0000","last_peered":"2024-04-26T11:48:03.164745+0000","last_clean":"2024-04-26T11:48:03.164745+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:48:03.164745+0000","last_undegraded":"2024-04-26T11:48:03.164745+0000","last_fullsized":"2024-04-26T11:48:03.164745+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:10.908191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":531,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825386+0000","last_change":"2024-04-26T11:47:42.470100+0000","last_active":"2024-04-26T11:48:03.825386+0000","last_peered":"2024-04-26T11:48:03.825386+0000","last_clean":"2024-04-26T11:48:03.825386+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:48:03.825386+0000","last_undegraded":"2024-04-26T11:48:03.825386+0000","last_fullsized":"2024-04-26T11:48:03.825386+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:37.523362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1014,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162195+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:48:03.162195+0000","last_peered":"2024-04-26T11:48:03.162195+0000","last_clean":"2024-04-26T11:48:03.162195+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:48:03.162195+0000","last_undegraded":"2024-04-26T11:48:03.162195+0000","last_fullsized":"2024-04-26T11:48:03.162195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:08.296789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":928,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161249+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:48:03.161249+0000","last_peered":"2024-04-26T11:48:03.161249+0000","last_clean":"2024-04-26T11:48:03.161249+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:03.161249+0000","last_undegraded":"2024-04-26T11:48:03.161249+0000","last_fullsized":"2024-04-26T11:48:03.161249+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:16.863281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":577,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163289+0000","last_change":"2024-04-26T11:44:21.445176+0000","last_active":"2024-04-26T11:48:03.163289+0000","last_peered":"2024-04-26T11:48:03.163289+0000","last_clean":"2024-04-26T11:48:03.163289+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:03.163289+0000","last_undegraded":"2024-04-26T11:48:03.163289+0000","last_fullsized":"2024-04-26T11:48:03.163289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823660+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:48:03.823660+0000","last_peered":"2024-04-26T11:48:03.823660+0000","last_clean":"2024-04-26T11:48:03.823660+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:48:03.823660+0000","last_undegraded":"2024-04-26T11:48:03.823660+0000","last_fullsized":"2024-04-26T11:48:03.823660+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:54.534197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1032,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162726+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:48:03.162726+0000","last_peered":"2024-04-26T11:48:03.162726+0000","last_clean":"2024-04-26T11:48:03.162726+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:48:03.162726+0000","last_undegraded":"2024-04-26T11:48:03.162726+0000","last_fullsized":"2024-04-26T11:48:03.162726+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:35.832698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":513,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.165269+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:48:03.165269+0000","last_peered":"2024-04-26T11:48:03.165269+0000","last_clean":"2024-04-26T11:48:03.165269+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:48:03.165269+0000","last_undegraded":"2024-04-26T11:48:03.165269+0000","last_fullsized":"2024-04-26T11:48:03.165269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:56.192744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":621,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826248+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:48:03.826248+0000","last_peered":"2024-04-26T11:48:03.826248+0000","last_clean":"2024-04-26T11:48:03.826248+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:48:03.826248+0000","last_undegraded":"2024-04-26T11:48:03.826248+0000","last_fullsized":"2024-04-26T11:48:03.826248+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:48.523722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162056+0000","last_change":"2024-04-26T11:44:21.451828+0000","last_active":"2024-04-26T11:48:03.162056+0000","last_peered":"2024-04-26T11:48:03.162056+0000","last_clean":"2024-04-26T11:48:03.162056+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:03.162056+0000","last_undegraded":"2024-04-26T11:48:03.162056+0000","last_fullsized":"2024-04-26T11:48:03.162056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:23.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":596,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.164160+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:48:03.164160+0000","last_peered":"2024-04-26T11:48:03.164160+0000","last_clean":"2024-04-26T11:48:03.164160+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:03.164160+0000","last_undegraded":"2024-04-26T11:48:03.164160+0000","last_fullsized":"2024-04-26T11:48:03.164160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":508,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824009+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:48:03.824009+0000","last_peered":"2024-04-26T11:48:03.824009+0000","last_clean":"2024-04-26T11:48:03.824009+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:48:03.824009+0000","last_undegraded":"2024-04-26T11:48:03.824009+0000","last_fullsized":"2024-04-26T11:48:03.824009+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:40.497543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":625,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163468+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:48:03.163468+0000","last_peered":"2024-04-26T11:48:03.163468+0000","last_clean":"2024-04-26T11:48:03.163468+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:03.163468+0000","last_undegraded":"2024-04-26T11:48:03.163468+0000","last_fullsized":"2024-04-26T11:48:03.163468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":573,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825525+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:48:03.825525+0000","last_peered":"2024-04-26T11:48:03.825525+0000","last_clean":"2024-04-26T11:48:03.825525+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:03.825525+0000","last_undegraded":"2024-04-26T11:48:03.825525+0000","last_fullsized":"2024-04-26T11:48:03.825525+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:35.378403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":950,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160503+0000","last_change":"2024-04-26T11:47:45.147770+0000","last_active":"2024-04-26T11:48:03.160503+0000","last_peered":"2024-04-26T11:48:03.160503+0000","last_clean":"2024-04-26T11:48:03.160503+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:03.160503+0000","last_undegraded":"2024-04-26T11:48:03.160503+0000","last_fullsized":"2024-04-26T11:48:03.160503+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:52.444032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":842,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.164157+0000","last_change":"2024-04-26T11:47:45.156703+0000","last_active":"2024-04-26T11:48:03.164157+0000","last_peered":"2024-04-26T11:48:03.164157+0000","last_clean":"2024-04-26T11:48:03.164157+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:03.164157+0000","last_undegraded":"2024-04-26T11:48:03.164157+0000","last_fullsized":"2024-04-26T11:48:03.164157+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:22.809278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":623,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161374+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:48:03.161374+0000","last_peered":"2024-04-26T11:48:03.161374+0000","last_clean":"2024-04-26T11:48:03.161374+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:03.161374+0000","last_undegraded":"2024-04-26T11:48:03.161374+0000","last_fullsized":"2024-04-26T11:48:03.161374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:02.102733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":981,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.164572+0000","last_change":"2024-04-26T11:47:44.154527+0000","last_active":"2024-04-26T11:48:03.164572+0000","last_peered":"2024-04-26T11:48:03.164572+0000","last_clean":"2024-04-26T11:48:03.164572+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:03.164572+0000","last_undegraded":"2024-04-26T11:48:03.164572+0000","last_fullsized":"2024-04-26T11:48:03.164572+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:36.227910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":64,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824342+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:48:03.824342+0000","last_peered":"2024-04-26T11:48:03.824342+0000","last_clean":"2024-04-26T11:48:03.824342+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:03.824342+0000","last_undegraded":"2024-04-26T11:48:03.824342+0000","last_fullsized":"2024-04-26T11:48:03.824342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:16.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":515,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825621+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:48:03.825621+0000","last_peered":"2024-04-26T11:48:03.825621+0000","last_clean":"2024-04-26T11:48:03.825621+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:03.825621+0000","last_undegraded":"2024-04-26T11:48:03.825621+0000","last_fullsized":"2024-04-26T11:48:03.825621+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:47.514444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":168,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163259+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:48:03.163259+0000","last_peered":"2024-04-26T11:48:03.163259+0000","last_clean":"2024-04-26T11:48:03.163259+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:48:03.163259+0000","last_undegraded":"2024-04-26T11:48:03.163259+0000","last_fullsized":"2024-04-26T11:48:03.163259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:49.837381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":550,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825717+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:48:03.825717+0000","last_peered":"2024-04-26T11:48:03.825717+0000","last_clean":"2024-04-26T11:48:03.825717+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:03.825717+0000","last_undegraded":"2024-04-26T11:48:03.825717+0000","last_fullsized":"2024-04-26T11:48:03.825717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:52.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":175,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160477+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:48:03.160477+0000","last_peered":"2024-04-26T11:48:03.160477+0000","last_clean":"2024-04-26T11:48:03.160477+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:03.160477+0000","last_undegraded":"2024-04-26T11:48:03.160477+0000","last_fullsized":"2024-04-26T11:48:03.160477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":322,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162943+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:48:03.162943+0000","last_peered":"2024-04-26T11:48:03.162943+0000","last_clean":"2024-04-26T11:48:03.162943+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:03.162943+0000","last_undegraded":"2024-04-26T11:48:03.162943+0000","last_fullsized":"2024-04-26T11:48:03.162943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":540,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162802+0000","last_change":"2024-04-26T11:44:21.447164+0000","last_active":"2024-04-26T11:48:03.162802+0000","last_peered":"2024-04-26T11:48:03.162802+0000","last_clean":"2024-04-26T11:48:03.162802+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:03.162802+0000","last_undegraded":"2024-04-26T11:48:03.162802+0000","last_fullsized":"2024-04-26T11:48:03.162802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:54.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":500,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.165406+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:48:03.165406+0000","last_peered":"2024-04-26T11:48:03.165406+0000","last_clean":"2024-04-26T11:48:03.165406+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:48:03.165406+0000","last_undegraded":"2024-04-26T11:48:03.165406+0000","last_fullsized":"2024-04-26T11:48:03.165406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.302897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1031,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163028+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:48:03.163028+0000","last_peered":"2024-04-26T11:48:03.163028+0000","last_clean":"2024-04-26T11:48:03.163028+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:03.163028+0000","last_undegraded":"2024-04-26T11:48:03.163028+0000","last_fullsized":"2024-04-26T11:48:03.163028+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:08.707636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":694,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162634+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:48:03.162634+0000","last_peered":"2024-04-26T11:48:03.162634+0000","last_clean":"2024-04-26T11:48:03.162634+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:03.162634+0000","last_undegraded":"2024-04-26T11:48:03.162634+0000","last_fullsized":"2024-04-26T11:48:03.162634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1015,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161081+0000","last_change":"2024-04-26T11:47:23.181778+0000","last_active":"2024-04-26T11:48:03.161081+0000","last_peered":"2024-04-26T11:48:03.161081+0000","last_clean":"2024-04-26T11:48:03.161081+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:03.161081+0000","last_undegraded":"2024-04-26T11:48:03.161081+0000","last_fullsized":"2024-04-26T11:48:03.161081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:18.101282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":183,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162531+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:48:03.162531+0000","last_peered":"2024-04-26T11:48:03.162531+0000","last_clean":"2024-04-26T11:48:03.162531+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:48:03.162531+0000","last_undegraded":"2024-04-26T11:48:03.162531+0000","last_fullsized":"2024-04-26T11:48:03.162531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:16.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":620,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825094+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:48:03.825094+0000","last_peered":"2024-04-26T11:48:03.825094+0000","last_clean":"2024-04-26T11:48:03.825094+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:48:03.825094+0000","last_undegraded":"2024-04-26T11:48:03.825094+0000","last_fullsized":"2024-04-26T11:48:03.825094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:48.369563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":372,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824588+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:48:03.824588+0000","last_peered":"2024-04-26T11:48:03.824588+0000","last_clean":"2024-04-26T11:48:03.824588+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:03.824588+0000","last_undegraded":"2024-04-26T11:48:03.824588+0000","last_fullsized":"2024-04-26T11:48:03.824588+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:29.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":962,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161856+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:48:03.161856+0000","last_peered":"2024-04-26T11:48:03.161856+0000","last_clean":"2024-04-26T11:48:03.161856+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:03.161856+0000","last_undegraded":"2024-04-26T11:48:03.161856+0000","last_fullsized":"2024-04-26T11:48:03.161856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:34.024236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":283,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161232+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:48:03.161232+0000","last_peered":"2024-04-26T11:48:03.161232+0000","last_clean":"2024-04-26T11:48:03.161232+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:48:03.161232+0000","last_undegraded":"2024-04-26T11:48:03.161232+0000","last_fullsized":"2024-04-26T11:48:03.161232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:33.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":548,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162292+0000","last_change":"2024-04-26T11:44:21.452035+0000","last_active":"2024-04-26T11:48:03.162292+0000","last_peered":"2024-04-26T11:48:03.162292+0000","last_clean":"2024-04-26T11:48:03.162292+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:03.162292+0000","last_undegraded":"2024-04-26T11:48:03.162292+0000","last_fullsized":"2024-04-26T11:48:03.162292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:58.918837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":162,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163540+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:48:03.163540+0000","last_peered":"2024-04-26T11:48:03.163540+0000","last_clean":"2024-04-26T11:48:03.163540+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:48:03.163540+0000","last_undegraded":"2024-04-26T11:48:03.163540+0000","last_fullsized":"2024-04-26T11:48:03.163540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:00.332767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":486,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162640+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:48:03.162640+0000","last_peered":"2024-04-26T11:48:03.162640+0000","last_clean":"2024-04-26T11:48:03.162640+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:03.162640+0000","last_undegraded":"2024-04-26T11:48:03.162640+0000","last_fullsized":"2024-04-26T11:48:03.162640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":634,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162910+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:48:03.162910+0000","last_peered":"2024-04-26T11:48:03.162910+0000","last_clean":"2024-04-26T11:48:03.162910+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:48:03.162910+0000","last_undegraded":"2024-04-26T11:48:03.162910+0000","last_fullsized":"2024-04-26T11:48:03.162910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:21.630913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":525,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826617+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:48:03.826617+0000","last_peered":"2024-04-26T11:48:03.826617+0000","last_clean":"2024-04-26T11:48:03.826617+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:48:03.826617+0000","last_undegraded":"2024-04-26T11:48:03.826617+0000","last_fullsized":"2024-04-26T11:48:03.826617+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:40.700461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":310,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161015+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:48:03.161015+0000","last_peered":"2024-04-26T11:48:03.161015+0000","last_clean":"2024-04-26T11:48:03.161015+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:48:03.161015+0000","last_undegraded":"2024-04-26T11:48:03.161015+0000","last_fullsized":"2024-04-26T11:48:03.161015+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:24.945641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161600+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:48:03.161600+0000","last_peered":"2024-04-26T11:48:03.161600+0000","last_clean":"2024-04-26T11:48:03.161600+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:48:03.161600+0000","last_undegraded":"2024-04-26T11:48:03.161600+0000","last_fullsized":"2024-04-26T11:48:03.161600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:28.990848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":614,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825007+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:48:03.825007+0000","last_peered":"2024-04-26T11:48:03.825007+0000","last_clean":"2024-04-26T11:48:03.825007+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:48:03.825007+0000","last_undegraded":"2024-04-26T11:48:03.825007+0000","last_fullsized":"2024-04-26T11:48:03.825007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:37.739068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":574,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162328+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:48:03.162328+0000","last_peered":"2024-04-26T11:48:03.162328+0000","last_clean":"2024-04-26T11:48:03.162328+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:03.162328+0000","last_undegraded":"2024-04-26T11:48:03.162328+0000","last_fullsized":"2024-04-26T11:48:03.162328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:27.851172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160745+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:48:03.160745+0000","last_peered":"2024-04-26T11:48:03.160745+0000","last_clean":"2024-04-26T11:48:03.160745+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:48:03.160745+0000","last_undegraded":"2024-04-26T11:48:03.160745+0000","last_fullsized":"2024-04-26T11:48:03.160745+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:08.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":366,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823407+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:48:03.823407+0000","last_peered":"2024-04-26T11:48:03.823407+0000","last_clean":"2024-04-26T11:48:03.823407+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:48:03.823407+0000","last_undegraded":"2024-04-26T11:48:03.823407+0000","last_fullsized":"2024-04-26T11:48:03.823407+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:50.543468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":998,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.164873+0000","last_change":"2024-04-26T11:47:34.145286+0000","last_active":"2024-04-26T11:48:03.164873+0000","last_peered":"2024-04-26T11:48:03.164873+0000","last_clean":"2024-04-26T11:48:03.164873+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:03.164873+0000","last_undegraded":"2024-04-26T11:48:03.164873+0000","last_fullsized":"2024-04-26T11:48:03.164873+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:13.918331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823886+0000","last_change":"2024-04-26T11:47:11.443185+0000","last_active":"2024-04-26T11:48:03.823886+0000","last_peered":"2024-04-26T11:48:03.823886+0000","last_clean":"2024-04-26T11:48:03.823886+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:03.823886+0000","last_undegraded":"2024-04-26T11:48:03.823886+0000","last_fullsized":"2024-04-26T11:48:03.823886+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:51.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":531,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163027+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:48:03.163027+0000","last_peered":"2024-04-26T11:48:03.163027+0000","last_clean":"2024-04-26T11:48:03.163027+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:48:03.163027+0000","last_undegraded":"2024-04-26T11:48:03.163027+0000","last_fullsized":"2024-04-26T11:48:03.163027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:41.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":458,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826547+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:48:03.826547+0000","last_peered":"2024-04-26T11:48:03.826547+0000","last_clean":"2024-04-26T11:48:03.826547+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:48:03.826547+0000","last_undegraded":"2024-04-26T11:48:03.826547+0000","last_fullsized":"2024-04-26T11:48:03.826547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:49.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161461+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:48:03.161461+0000","last_peered":"2024-04-26T11:48:03.161461+0000","last_clean":"2024-04-26T11:48:03.161461+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:48:03.161461+0000","last_undegraded":"2024-04-26T11:48:03.161461+0000","last_fullsized":"2024-04-26T11:48:03.161461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":186,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161510+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:48:03.161510+0000","last_peered":"2024-04-26T11:48:03.161510+0000","last_clean":"2024-04-26T11:48:03.161510+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:48:03.161510+0000","last_undegraded":"2024-04-26T11:48:03.161510+0000","last_fullsized":"2024-04-26T11:48:03.161510+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:14.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":502,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824262+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:48:03.824262+0000","last_peered":"2024-04-26T11:48:03.824262+0000","last_clean":"2024-04-26T11:48:03.824262+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:48:03.824262+0000","last_undegraded":"2024-04-26T11:48:03.824262+0000","last_fullsized":"2024-04-26T11:48:03.824262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:32.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":645,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162571+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:48:03.162571+0000","last_peered":"2024-04-26T11:48:03.162571+0000","last_clean":"2024-04-26T11:48:03.162571+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:48:03.162571+0000","last_undegraded":"2024-04-26T11:48:03.162571+0000","last_fullsized":"2024-04-26T11:48:03.162571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.834336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824165+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:48:03.824165+0000","last_peered":"2024-04-26T11:48:03.824165+0000","last_clean":"2024-04-26T11:48:03.824165+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:48:03.824165+0000","last_undegraded":"2024-04-26T11:48:03.824165+0000","last_fullsized":"2024-04-26T11:48:03.824165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.200817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":486,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163343+0000","last_change":"2024-04-26T11:44:21.444601+0000","last_active":"2024-04-26T11:48:03.163343+0000","last_peered":"2024-04-26T11:48:03.163343+0000","last_clean":"2024-04-26T11:48:03.163343+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:03.163343+0000","last_undegraded":"2024-04-26T11:48:03.163343+0000","last_fullsized":"2024-04-26T11:48:03.163343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:31.818663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824763+0000","last_change":"2024-04-26T11:47:11.441923+0000","last_active":"2024-04-26T11:48:03.824763+0000","last_peered":"2024-04-26T11:48:03.824763+0000","last_clean":"2024-04-26T11:48:03.824763+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:03.824763+0000","last_undegraded":"2024-04-26T11:48:03.824763+0000","last_fullsized":"2024-04-26T11:48:03.824763+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:16.294246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.165185+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:48:03.165185+0000","last_peered":"2024-04-26T11:48:03.165185+0000","last_clean":"2024-04-26T11:48:03.165185+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:48:03.165185+0000","last_undegraded":"2024-04-26T11:48:03.165185+0000","last_fullsized":"2024-04-26T11:48:03.165185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:31.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":527,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163816+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:48:03.163816+0000","last_peered":"2024-04-26T11:48:03.163816+0000","last_clean":"2024-04-26T11:48:03.163816+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:03.163816+0000","last_undegraded":"2024-04-26T11:48:03.163816+0000","last_fullsized":"2024-04-26T11:48:03.163816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:05.464736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"74'58","reported_seq":67,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825839+0000","last_change":"2024-04-26T11:47:11.444451+0000","last_active":"2024-04-26T11:48:03.825839+0000","last_peered":"2024-04-26T11:48:03.825839+0000","last_clean":"2024-04-26T11:48:03.825839+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:03.825839+0000","last_undegraded":"2024-04-26T11:48:03.825839+0000","last_fullsized":"2024-04-26T11:48:03.825839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:31.145150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825423+0000","last_change":"2024-04-26T11:47:11.443756+0000","last_active":"2024-04-26T11:48:03.825423+0000","last_peered":"2024-04-26T11:48:03.825423+0000","last_clean":"2024-04-26T11:48:03.825423+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:03.825423+0000","last_undegraded":"2024-04-26T11:48:03.825423+0000","last_fullsized":"2024-04-26T11:48:03.825423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:44.524493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":483,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823562+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:48:03.823562+0000","last_peered":"2024-04-26T11:48:03.823562+0000","last_clean":"2024-04-26T11:48:03.823562+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:48:03.823562+0000","last_undegraded":"2024-04-26T11:48:03.823562+0000","last_fullsized":"2024-04-26T11:48:03.823562+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:47.076399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"79'71","reported_seq":78,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.825424+0000","last_change":"2024-04-26T11:47:11.486844+0000","last_active":"2024-04-26T11:48:03.825424+0000","last_peered":"2024-04-26T11:48:03.825424+0000","last_clean":"2024-04-26T11:48:03.825424+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:03.825424+0000","last_undegraded":"2024-04-26T11:48:03.825424+0000","last_fullsized":"2024-04-26T11:48:03.825424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:24.309893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162936+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:48:03.162936+0000","last_peered":"2024-04-26T11:48:03.162936+0000","last_clean":"2024-04-26T11:48:03.162936+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:48:03.162936+0000","last_undegraded":"2024-04-26T11:48:03.162936+0000","last_fullsized":"2024-04-26T11:48:03.162936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.992951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":560,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163047+0000","last_change":"2024-04-26T11:44:21.436638+0000","last_active":"2024-04-26T11:48:03.163047+0000","last_peered":"2024-04-26T11:48:03.163047+0000","last_clean":"2024-04-26T11:48:03.163047+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:03.163047+0000","last_undegraded":"2024-04-26T11:48:03.163047+0000","last_fullsized":"2024-04-26T11:48:03.163047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:46.665469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":572,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161019+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:48:03.161019+0000","last_peered":"2024-04-26T11:48:03.161019+0000","last_clean":"2024-04-26T11:48:03.161019+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:48:03.161019+0000","last_undegraded":"2024-04-26T11:48:03.161019+0000","last_fullsized":"2024-04-26T11:48:03.161019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:59.844889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":519,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162325+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:48:03.162325+0000","last_peered":"2024-04-26T11:48:03.162325+0000","last_clean":"2024-04-26T11:48:03.162325+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:03.162325+0000","last_undegraded":"2024-04-26T11:48:03.162325+0000","last_fullsized":"2024-04-26T11:48:03.162325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":546,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.824093+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:48:03.824093+0000","last_peered":"2024-04-26T11:48:03.824093+0000","last_clean":"2024-04-26T11:48:03.824093+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:03.824093+0000","last_undegraded":"2024-04-26T11:48:03.824093+0000","last_fullsized":"2024-04-26T11:48:03.824093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:09.498295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":211,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.164972+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:48:03.164972+0000","last_peered":"2024-04-26T11:48:03.164972+0000","last_clean":"2024-04-26T11:48:03.164972+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:48:03.164972+0000","last_undegraded":"2024-04-26T11:48:03.164972+0000","last_fullsized":"2024-04-26T11:48:03.164972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:10.517458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":466,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162787+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:48:03.162787+0000","last_peered":"2024-04-26T11:48:03.162787+0000","last_clean":"2024-04-26T11:48:03.162787+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:48:03.162787+0000","last_undegraded":"2024-04-26T11:48:03.162787+0000","last_fullsized":"2024-04-26T11:48:03.162787+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.942105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":579,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823761+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:48:03.823761+0000","last_peered":"2024-04-26T11:48:03.823761+0000","last_clean":"2024-04-26T11:48:03.823761+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:03.823761+0000","last_undegraded":"2024-04-26T11:48:03.823761+0000","last_fullsized":"2024-04-26T11:48:03.823761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:34.795752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":63,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826308+0000","last_change":"2024-04-26T11:47:11.446475+0000","last_active":"2024-04-26T11:48:03.826308+0000","last_peered":"2024-04-26T11:48:03.826308+0000","last_clean":"2024-04-26T11:48:03.826308+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:03.826308+0000","last_undegraded":"2024-04-26T11:48:03.826308+0000","last_fullsized":"2024-04-26T11:48:03.826308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:11.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":575,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823378+0000","last_change":"2024-04-26T11:47:41.467086+0000","last_active":"2024-04-26T11:48:03.823378+0000","last_peered":"2024-04-26T11:48:03.823378+0000","last_clean":"2024-04-26T11:48:03.823378+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:03.823378+0000","last_undegraded":"2024-04-26T11:48:03.823378+0000","last_fullsized":"2024-04-26T11:48:03.823378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:45.011728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":518,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.165309+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:48:03.165309+0000","last_peered":"2024-04-26T11:48:03.165309+0000","last_clean":"2024-04-26T11:48:03.165309+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:03.165309+0000","last_undegraded":"2024-04-26T11:48:03.165309+0000","last_fullsized":"2024-04-26T11:48:03.165309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:20.621217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":875,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823118+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:48:03.823118+0000","last_peered":"2024-04-26T11:48:03.823118+0000","last_clean":"2024-04-26T11:48:03.823118+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:48:03.823118+0000","last_undegraded":"2024-04-26T11:48:03.823118+0000","last_fullsized":"2024-04-26T11:48:03.823118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:50.568098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":498,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826015+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:48:03.826015+0000","last_peered":"2024-04-26T11:48:03.826015+0000","last_clean":"2024-04-26T11:48:03.826015+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:48:03.826015+0000","last_undegraded":"2024-04-26T11:48:03.826015+0000","last_fullsized":"2024-04-26T11:48:03.826015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:51.175633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":432,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.823352+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:48:03.823352+0000","last_peered":"2024-04-26T11:48:03.823352+0000","last_clean":"2024-04-26T11:48:03.823352+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:48:03.823352+0000","last_undegraded":"2024-04-26T11:48:03.823352+0000","last_fullsized":"2024-04-26T11:48:03.823352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:50.027819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":539,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.164309+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:48:03.164309+0000","last_peered":"2024-04-26T11:48:03.164309+0000","last_clean":"2024-04-26T11:48:03.164309+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:03.164309+0000","last_undegraded":"2024-04-26T11:48:03.164309+0000","last_fullsized":"2024-04-26T11:48:03.164309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:19.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":488,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163564+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:48:03.163564+0000","last_peered":"2024-04-26T11:48:03.163564+0000","last_clean":"2024-04-26T11:48:03.163564+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:48:03.163564+0000","last_undegraded":"2024-04-26T11:48:03.163564+0000","last_fullsized":"2024-04-26T11:48:03.163564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:26.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":854,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163901+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:48:03.163901+0000","last_peered":"2024-04-26T11:48:03.163901+0000","last_clean":"2024-04-26T11:48:03.163901+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:03.163901+0000","last_undegraded":"2024-04-26T11:48:03.163901+0000","last_fullsized":"2024-04-26T11:48:03.163901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:14.432883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":165,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.164120+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:48:03.164120+0000","last_peered":"2024-04-26T11:48:03.164120+0000","last_clean":"2024-04-26T11:48:03.164120+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:48:03.164120+0000","last_undegraded":"2024-04-26T11:48:03.164120+0000","last_fullsized":"2024-04-26T11:48:03.164120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:53.532637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":884,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160938+0000","last_change":"2024-04-26T11:47:30.146525+0000","last_active":"2024-04-26T11:48:03.160938+0000","last_peered":"2024-04-26T11:48:03.160938+0000","last_clean":"2024-04-26T11:48:03.160938+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:03.160938+0000","last_undegraded":"2024-04-26T11:48:03.160938+0000","last_fullsized":"2024-04-26T11:48:03.160938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"74'275","reported_seq":408,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.162094+0000","last_change":"2024-04-26T11:47:14.134305+0000","last_active":"2024-04-26T11:48:03.162094+0000","last_peered":"2024-04-26T11:48:03.162094+0000","last_clean":"2024-04-26T11:48:03.162094+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:03.162094+0000","last_undegraded":"2024-04-26T11:48:03.162094+0000","last_fullsized":"2024-04-26T11:48:03.162094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:12.911248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":901,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.161287+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:48:03.161287+0000","last_peered":"2024-04-26T11:48:03.161287+0000","last_clean":"2024-04-26T11:48:03.161287+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:03.161287+0000","last_undegraded":"2024-04-26T11:48:03.161287+0000","last_fullsized":"2024-04-26T11:48:03.161287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:14.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":437,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.164823+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:48:03.164823+0000","last_peered":"2024-04-26T11:48:03.164823+0000","last_clean":"2024-04-26T11:48:03.164823+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:03.164823+0000","last_undegraded":"2024-04-26T11:48:03.164823+0000","last_fullsized":"2024-04-26T11:48:03.164823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:34.878747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":952,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.163761+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:48:03.163761+0000","last_peered":"2024-04-26T11:48:03.163761+0000","last_clean":"2024-04-26T11:48:03.163761+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:03.163761+0000","last_undegraded":"2024-04-26T11:48:03.163761+0000","last_fullsized":"2024-04-26T11:48:03.163761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:46.648969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":72,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826406+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:48:03.826406+0000","last_peered":"2024-04-26T11:48:03.826406+0000","last_clean":"2024-04-26T11:48:03.826406+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:48:03.826406+0000","last_undegraded":"2024-04-26T11:48:03.826406+0000","last_fullsized":"2024-04-26T11:48:03.826406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:15.027355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":980,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.160781+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:48:03.160781+0000","last_peered":"2024-04-26T11:48:03.160781+0000","last_clean":"2024-04-26T11:48:03.160781+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:48:03.160781+0000","last_undegraded":"2024-04-26T11:48:03.160781+0000","last_fullsized":"2024-04-26T11:48:03.160781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.430609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":70,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T11:48:03.826070+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:48:03.826070+0000","last_peered":"2024-04-26T11:48:03.826070+0000","last_clean":"2024-04-26T11:48:03.826070+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:48:03.826070+0000","last_undegraded":"2024-04-26T11:48:03.826070+0000","last_fullsized":"2024-04-26T11:48:03.826070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:56.114269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7875,"ondisk_log_size":7875,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738421,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200504,"kb_used_data":89064,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171336,"statfs":{"total":96636764160,"available":96431448064,"internally_reserved":0,"allocated":91201536,"data_stored":90584365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:47:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":72,"seq":309237645326,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125624,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246216,"statfs":{"total":96636764160,"available":96508125184,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738420,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190672,"kb_used_data":83332,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181168,"statfs":{"total":96636764160,"available":96441516032,"internally_reserved":0,"allocated":85331968,"data_stored":84726408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Apr 26 11:47:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:48:11.951 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.952 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.952 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.952 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.952 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.952 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.952 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.952 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.952 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.953 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.953 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.953 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.953 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.953 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.953 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.953 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.953 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.953 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.953 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.954 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.954 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.954 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.954 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.954 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.954 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.954 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.954 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.954 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.955 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.955 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.955 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.955 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.955 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.955 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.955 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.955 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.955 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.955 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.956 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.956 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.956 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.956 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.956 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.957 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.957 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.957 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.957 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.957 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.957 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.957 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.957 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.957 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.957 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.958 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.958 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.958 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.958 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T11:44:10.975511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.958 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.958 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.958 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.958 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.958 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.959 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.959 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.959 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.959 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.959 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.959 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.959 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.959 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.959 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.959 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.960 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.960 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.960 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.960 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.960 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.960 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.960 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.960 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.960 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.960 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.961 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.961 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.961 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.961 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.961 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.962 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.962 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.962 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.962 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.962 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.962 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.962 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.962 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.962 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.963 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.963 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.963 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.963 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.963 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.963 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.963 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.963 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.963 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:11.963 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:48:31.964 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:48:32.294 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:48:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:48:32.307 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-04-26T11:48:32.065342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34088,"ondisk_log_size":34088,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516780,"kb_used_data":252436,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598740,"statfs":{"total":289910292480,"available":289381109760,"internally_reserved":0,"allocated":258494464,"data_stored":256676283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004404"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":962,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.246302+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:48:05.246302+0000","last_peered":"2024-04-26T11:48:05.246302+0000","last_clean":"2024-04-26T11:48:05.246302+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:48:05.246302+0000","last_undegraded":"2024-04-26T11:48:05.246302+0000","last_fullsized":"2024-04-26T11:48:05.246302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1019,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244366+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:48:05.244366+0000","last_peered":"2024-04-26T11:48:05.244366+0000","last_clean":"2024-04-26T11:48:05.244366+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:48:05.244366+0000","last_undegraded":"2024-04-26T11:48:05.244366+0000","last_fullsized":"2024-04-26T11:48:05.244366+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":525,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179030+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:04.179030+0000","last_peered":"2024-04-26T11:48:04.179030+0000","last_clean":"2024-04-26T11:48:04.179030+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:04.179030+0000","last_undegraded":"2024-04-26T11:48:04.179030+0000","last_fullsized":"2024-04-26T11:48:04.179030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":841,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593170+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:11.593170+0000","last_peered":"2024-04-26T11:48:11.593170+0000","last_clean":"2024-04-26T11:48:11.593170+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:11.593170+0000","last_undegraded":"2024-04-26T11:48:11.593170+0000","last_fullsized":"2024-04-26T11:48:11.593170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":918,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244890+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:48:05.244890+0000","last_peered":"2024-04-26T11:48:05.244890+0000","last_clean":"2024-04-26T11:48:05.244890+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:48:05.244890+0000","last_undegraded":"2024-04-26T11:48:05.244890+0000","last_fullsized":"2024-04-26T11:48:05.244890+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":846,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177494+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:48:04.177494+0000","last_peered":"2024-04-26T11:48:04.177494+0000","last_clean":"2024-04-26T11:48:04.177494+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:48:04.177494+0000","last_undegraded":"2024-04-26T11:48:04.177494+0000","last_fullsized":"2024-04-26T11:48:04.177494+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1038,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177458+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:48:04.177458+0000","last_peered":"2024-04-26T11:48:04.177458+0000","last_clean":"2024-04-26T11:48:04.177458+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:48:04.177458+0000","last_undegraded":"2024-04-26T11:48:04.177458+0000","last_fullsized":"2024-04-26T11:48:04.177458+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":847,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.176842+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:04.176842+0000","last_peered":"2024-04-26T11:48:04.176842+0000","last_clean":"2024-04-26T11:48:04.176842+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:04.176842+0000","last_undegraded":"2024-04-26T11:48:04.176842+0000","last_fullsized":"2024-04-26T11:48:04.176842+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":543,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470858+0000","last_change":"2024-04-26T11:47:15.439420+0000","last_active":"2024-04-26T11:48:04.470858+0000","last_peered":"2024-04-26T11:48:04.470858+0000","last_clean":"2024-04-26T11:48:04.470858+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:04.470858+0000","last_undegraded":"2024-04-26T11:48:04.470858+0000","last_fullsized":"2024-04-26T11:48:04.470858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":961,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244493+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:48:05.244493+0000","last_peered":"2024-04-26T11:48:05.244493+0000","last_clean":"2024-04-26T11:48:05.244493+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:48:05.244493+0000","last_undegraded":"2024-04-26T11:48:05.244493+0000","last_fullsized":"2024-04-26T11:48:05.244493+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":874,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179159+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:48:04.179159+0000","last_peered":"2024-04-26T11:48:04.179159+0000","last_clean":"2024-04-26T11:48:04.179159+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:48:04.179159+0000","last_undegraded":"2024-04-26T11:48:04.179159+0000","last_fullsized":"2024-04-26T11:48:04.179159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":503,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.698922+0000","last_change":"2024-04-26T11:48:10.699169+0000","last_active":"2024-04-26T11:48:10.698922+0000","last_peered":"2024-04-26T11:48:10.698922+0000","last_clean":"2024-04-26T11:48:10.698922+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:10.698922+0000","last_undegraded":"2024-04-26T11:48:10.698922+0000","last_fullsized":"2024-04-26T11:48:10.698922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'345","last_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_deep_scrub":"76'345","last_deep_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_clean_scrub_stamp":"2024-04-26T11:48:10.698866+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:11.706179+0000","scrub_duration":0.0058868610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":894,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244426+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:48:05.244426+0000","last_peered":"2024-04-26T11:48:05.244426+0000","last_clean":"2024-04-26T11:48:05.244426+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:48:05.244426+0000","last_undegraded":"2024-04-26T11:48:05.244426+0000","last_fullsized":"2024-04-26T11:48:05.244426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":575,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.180464+0000","last_change":"2024-04-26T11:48:12.180736+0000","last_active":"2024-04-26T11:48:12.180464+0000","last_peered":"2024-04-26T11:48:12.180464+0000","last_clean":"2024-04-26T11:48:12.180464+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:12.180464+0000","last_undegraded":"2024-04-26T11:48:12.180464+0000","last_fullsized":"2024-04-26T11:48:12.180464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'418","last_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_deep_scrub":"76'418","last_deep_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.180413+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.283252+0000","scrub_duration":0.0053701490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":617,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.056783+0000","last_change":"2024-04-26T11:48:26.057064+0000","last_active":"2024-04-26T11:48:26.056783+0000","last_peered":"2024-04-26T11:48:26.056783+0000","last_clean":"2024-04-26T11:48:26.056783+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:26.056783+0000","last_undegraded":"2024-04-26T11:48:26.056783+0000","last_fullsized":"2024-04-26T11:48:26.056783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'428","last_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_deep_scrub":"76'428","last_deep_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.056732+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:01.294605+0000","scrub_duration":0.0057736879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1061,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177178+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:48:04.177178+0000","last_peered":"2024-04-26T11:48:04.177178+0000","last_clean":"2024-04-26T11:48:04.177178+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:48:04.177178+0000","last_undegraded":"2024-04-26T11:48:04.177178+0000","last_fullsized":"2024-04-26T11:48:04.177178+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":522,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.949014+0000","last_change":"2024-04-26T11:48:27.949389+0000","last_active":"2024-04-26T11:48:27.949014+0000","last_peered":"2024-04-26T11:48:27.949014+0000","last_clean":"2024-04-26T11:48:27.949014+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:27.949014+0000","last_undegraded":"2024-04-26T11:48:27.949014+0000","last_fullsized":"2024-04-26T11:48:27.949014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.948898+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:29.597751+0000","scrub_duration":0.0043304119999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":926,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244790+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:48:05.244790+0000","last_peered":"2024-04-26T11:48:05.244790+0000","last_clean":"2024-04-26T11:48:05.244790+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:48:05.244790+0000","last_undegraded":"2024-04-26T11:48:05.244790+0000","last_fullsized":"2024-04-26T11:48:05.244790+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":532,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469812+0000","last_change":"2024-04-26T11:47:42.470100+0000","last_active":"2024-04-26T11:48:04.469812+0000","last_peered":"2024-04-26T11:48:04.469812+0000","last_clean":"2024-04-26T11:48:04.469812+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:48:04.469812+0000","last_undegraded":"2024-04-26T11:48:04.469812+0000","last_fullsized":"2024-04-26T11:48:04.469812+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1015,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.178927+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:48:04.178927+0000","last_peered":"2024-04-26T11:48:04.178927+0000","last_clean":"2024-04-26T11:48:04.178927+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:48:04.178927+0000","last_undegraded":"2024-04-26T11:48:04.178927+0000","last_fullsized":"2024-04-26T11:48:04.178927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":929,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.178236+0000","last_change":"2024-04-26T11:47:34.142932+0000","last_active":"2024-04-26T11:48:04.178236+0000","last_peered":"2024-04-26T11:48:04.178236+0000","last_clean":"2024-04-26T11:48:04.178236+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:04.178236+0000","last_undegraded":"2024-04-26T11:48:04.178236+0000","last_fullsized":"2024-04-26T11:48:04.178236+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":589,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.703479+0000","last_change":"2024-04-26T11:48:16.703736+0000","last_active":"2024-04-26T11:48:16.703479+0000","last_peered":"2024-04-26T11:48:16.703479+0000","last_clean":"2024-04-26T11:48:16.703479+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:16.703479+0000","last_undegraded":"2024-04-26T11:48:16.703479+0000","last_fullsized":"2024-04-26T11:48:16.703479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.703427+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:09.548341+0000","scrub_duration":0.0060063829999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":516,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468122+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:48:04.468122+0000","last_peered":"2024-04-26T11:48:04.468122+0000","last_clean":"2024-04-26T11:48:04.468122+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:48:04.468122+0000","last_undegraded":"2024-04-26T11:48:04.468122+0000","last_fullsized":"2024-04-26T11:48:04.468122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1033,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244120+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:48:05.244120+0000","last_peered":"2024-04-26T11:48:05.244120+0000","last_clean":"2024-04-26T11:48:05.244120+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:48:05.244120+0000","last_undegraded":"2024-04-26T11:48:05.244120+0000","last_fullsized":"2024-04-26T11:48:05.244120+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":514,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.246604+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:48:05.246604+0000","last_peered":"2024-04-26T11:48:05.246604+0000","last_clean":"2024-04-26T11:48:05.246604+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:48:05.246604+0000","last_undegraded":"2024-04-26T11:48:05.246604+0000","last_fullsized":"2024-04-26T11:48:05.246604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":622,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470256+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:48:04.470256+0000","last_peered":"2024-04-26T11:48:04.470256+0000","last_clean":"2024-04-26T11:48:04.470256+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:48:04.470256+0000","last_undegraded":"2024-04-26T11:48:04.470256+0000","last_fullsized":"2024-04-26T11:48:04.470256+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":527,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.159278+0000","last_change":"2024-04-26T11:48:20.159519+0000","last_active":"2024-04-26T11:48:20.159278+0000","last_peered":"2024-04-26T11:48:20.159278+0000","last_clean":"2024-04-26T11:48:20.159278+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:20.159278+0000","last_undegraded":"2024-04-26T11:48:20.159278+0000","last_fullsized":"2024-04-26T11:48:20.159278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.159224+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:05.701212+0000","scrub_duration":0.0055914299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":597,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.245652+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:48:05.245652+0000","last_peered":"2024-04-26T11:48:05.245652+0000","last_clean":"2024-04-26T11:48:05.245652+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:05.245652+0000","last_undegraded":"2024-04-26T11:48:05.245652+0000","last_fullsized":"2024-04-26T11:48:05.245652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":509,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468908+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:48:04.468908+0000","last_peered":"2024-04-26T11:48:04.468908+0000","last_clean":"2024-04-26T11:48:04.468908+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:48:04.468908+0000","last_undegraded":"2024-04-26T11:48:04.468908+0000","last_fullsized":"2024-04-26T11:48:04.468908+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":626,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.245902+0000","last_change":"2024-04-26T11:44:21.444878+0000","last_active":"2024-04-26T11:48:05.245902+0000","last_peered":"2024-04-26T11:48:05.245902+0000","last_clean":"2024-04-26T11:48:05.245902+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:05.245902+0000","last_undegraded":"2024-04-26T11:48:05.245902+0000","last_fullsized":"2024-04-26T11:48:05.245902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":574,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468511+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:48:04.468511+0000","last_peered":"2024-04-26T11:48:04.468511+0000","last_clean":"2024-04-26T11:48:04.468511+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:04.468511+0000","last_undegraded":"2024-04-26T11:48:04.468511+0000","last_fullsized":"2024-04-26T11:48:04.468511+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":962,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.161310+0000","last_change":"2024-04-26T11:48:16.161557+0000","last_active":"2024-04-26T11:48:16.161310+0000","last_peered":"2024-04-26T11:48:16.161310+0000","last_clean":"2024-04-26T11:48:16.161310+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:16.161310+0000","last_undegraded":"2024-04-26T11:48:16.161310+0000","last_fullsized":"2024-04-26T11:48:16.161310+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'412","last_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_deep_scrub":"76'412","last_deep_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.161259+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:19.609307+0000","scrub_duration":0.005601534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":843,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.245426+0000","last_change":"2024-04-26T11:47:45.156703+0000","last_active":"2024-04-26T11:48:05.245426+0000","last_peered":"2024-04-26T11:48:05.245426+0000","last_clean":"2024-04-26T11:48:05.245426+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:05.245426+0000","last_undegraded":"2024-04-26T11:48:05.245426+0000","last_fullsized":"2024-04-26T11:48:05.245426+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"74'488","reported_seq":624,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.178389+0000","last_change":"2024-04-26T11:47:14.134448+0000","last_active":"2024-04-26T11:48:04.178389+0000","last_peered":"2024-04-26T11:48:04.178389+0000","last_clean":"2024-04-26T11:48:04.178389+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:04.178389+0000","last_undegraded":"2024-04-26T11:48:04.178389+0000","last_fullsized":"2024-04-26T11:48:04.178389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":982,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.246443+0000","last_change":"2024-04-26T11:47:44.154527+0000","last_active":"2024-04-26T11:48:05.246443+0000","last_peered":"2024-04-26T11:48:05.246443+0000","last_clean":"2024-04-26T11:48:05.246443+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:05.246443+0000","last_undegraded":"2024-04-26T11:48:05.246443+0000","last_fullsized":"2024-04-26T11:48:05.246443+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":65,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468463+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:48:04.468463+0000","last_peered":"2024-04-26T11:48:04.468463+0000","last_clean":"2024-04-26T11:48:04.468463+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:04.468463+0000","last_undegraded":"2024-04-26T11:48:04.468463+0000","last_fullsized":"2024-04-26T11:48:04.468463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":516,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469783+0000","last_change":"2024-04-26T11:47:32.449446+0000","last_active":"2024-04-26T11:48:04.469783+0000","last_peered":"2024-04-26T11:48:04.469783+0000","last_clean":"2024-04-26T11:48:04.469783+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:04.469783+0000","last_undegraded":"2024-04-26T11:48:04.469783+0000","last_fullsized":"2024-04-26T11:48:04.469783+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":169,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.243606+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:48:05.243606+0000","last_peered":"2024-04-26T11:48:05.243606+0000","last_clean":"2024-04-26T11:48:05.243606+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:48:05.243606+0000","last_undegraded":"2024-04-26T11:48:05.243606+0000","last_fullsized":"2024-04-26T11:48:05.243606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":551,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470503+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:48:04.470503+0000","last_peered":"2024-04-26T11:48:04.470503+0000","last_clean":"2024-04-26T11:48:04.470503+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:04.470503+0000","last_undegraded":"2024-04-26T11:48:04.470503+0000","last_fullsized":"2024-04-26T11:48:04.470503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":176,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177900+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:48:04.177900+0000","last_peered":"2024-04-26T11:48:04.177900+0000","last_clean":"2024-04-26T11:48:04.177900+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:04.177900+0000","last_undegraded":"2024-04-26T11:48:04.177900+0000","last_fullsized":"2024-04-26T11:48:04.177900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":323,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.180313+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:48:04.180313+0000","last_peered":"2024-04-26T11:48:04.180313+0000","last_clean":"2024-04-26T11:48:04.180313+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:04.180313+0000","last_undegraded":"2024-04-26T11:48:04.180313+0000","last_fullsized":"2024-04-26T11:48:04.180313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":552,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.700105+0000","last_change":"2024-04-26T11:48:19.700459+0000","last_active":"2024-04-26T11:48:19.700105+0000","last_peered":"2024-04-26T11:48:19.700105+0000","last_clean":"2024-04-26T11:48:19.700105+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:19.700105+0000","last_undegraded":"2024-04-26T11:48:19.700105+0000","last_fullsized":"2024-04-26T11:48:19.700105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.700054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:19.776698+0000","scrub_duration":0.0059321139999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":501,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.243499+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:48:05.243499+0000","last_peered":"2024-04-26T11:48:05.243499+0000","last_clean":"2024-04-26T11:48:05.243499+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:48:05.243499+0000","last_undegraded":"2024-04-26T11:48:05.243499+0000","last_fullsized":"2024-04-26T11:48:05.243499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1032,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.245260+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:48:05.245260+0000","last_peered":"2024-04-26T11:48:05.245260+0000","last_clean":"2024-04-26T11:48:05.245260+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:05.245260+0000","last_undegraded":"2024-04-26T11:48:05.245260+0000","last_fullsized":"2024-04-26T11:48:05.245260+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"74'586","reported_seq":695,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179565+0000","last_change":"2024-04-26T11:44:21.067339+0000","last_active":"2024-04-26T11:48:04.179565+0000","last_peered":"2024-04-26T11:48:04.179565+0000","last_clean":"2024-04-26T11:48:04.179565+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:04.179565+0000","last_undegraded":"2024-04-26T11:48:04.179565+0000","last_fullsized":"2024-04-26T11:48:04.179565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1027,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.113679+0000","last_change":"2024-04-26T11:48:19.113972+0000","last_active":"2024-04-26T11:48:19.113679+0000","last_peered":"2024-04-26T11:48:19.113679+0000","last_clean":"2024-04-26T11:48:19.113679+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:19.113679+0000","last_undegraded":"2024-04-26T11:48:19.113679+0000","last_fullsized":"2024-04-26T11:48:19.113679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'446","last_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_deep_scrub":"76'446","last_deep_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.113630+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:18.946024+0000","scrub_duration":0.0051973490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":184,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179393+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:48:04.179393+0000","last_peered":"2024-04-26T11:48:04.179393+0000","last_clean":"2024-04-26T11:48:04.179393+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:48:04.179393+0000","last_undegraded":"2024-04-26T11:48:04.179393+0000","last_fullsized":"2024-04-26T11:48:04.179393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":621,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469476+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:48:04.469476+0000","last_peered":"2024-04-26T11:48:04.469476+0000","last_clean":"2024-04-26T11:48:04.469476+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:48:04.469476+0000","last_undegraded":"2024-04-26T11:48:04.469476+0000","last_fullsized":"2024-04-26T11:48:04.469476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":373,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469002+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:48:04.469002+0000","last_peered":"2024-04-26T11:48:04.469002+0000","last_clean":"2024-04-26T11:48:04.469002+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:04.469002+0000","last_undegraded":"2024-04-26T11:48:04.469002+0000","last_fullsized":"2024-04-26T11:48:04.469002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":963,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179095+0000","last_change":"2024-04-26T11:47:29.145917+0000","last_active":"2024-04-26T11:48:04.179095+0000","last_peered":"2024-04-26T11:48:04.179095+0000","last_clean":"2024-04-26T11:48:04.179095+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:04.179095+0000","last_undegraded":"2024-04-26T11:48:04.179095+0000","last_fullsized":"2024-04-26T11:48:04.179095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":284,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.178288+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:48:04.178288+0000","last_peered":"2024-04-26T11:48:04.178288+0000","last_clean":"2024-04-26T11:48:04.178288+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:48:04.178288+0000","last_undegraded":"2024-04-26T11:48:04.178288+0000","last_fullsized":"2024-04-26T11:48:04.178288+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":560,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:24.108478+0000","last_change":"2024-04-26T11:48:24.108717+0000","last_active":"2024-04-26T11:48:24.108478+0000","last_peered":"2024-04-26T11:48:24.108478+0000","last_clean":"2024-04-26T11:48:24.108478+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:24.108478+0000","last_undegraded":"2024-04-26T11:48:24.108478+0000","last_fullsized":"2024-04-26T11:48:24.108478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'403","last_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_deep_scrub":"76'403","last_deep_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_clean_scrub_stamp":"2024-04-26T11:48:24.108430+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:30.212481+0000","scrub_duration":0.0053830830000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":163,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.243802+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:48:05.243802+0000","last_peered":"2024-04-26T11:48:05.243802+0000","last_clean":"2024-04-26T11:48:05.243802+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:48:05.243802+0000","last_undegraded":"2024-04-26T11:48:05.243802+0000","last_fullsized":"2024-04-26T11:48:05.243802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":487,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179823+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:48:04.179823+0000","last_peered":"2024-04-26T11:48:04.179823+0000","last_clean":"2024-04-26T11:48:04.179823+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:04.179823+0000","last_undegraded":"2024-04-26T11:48:04.179823+0000","last_fullsized":"2024-04-26T11:48:04.179823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":635,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244599+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:48:05.244599+0000","last_peered":"2024-04-26T11:48:05.244599+0000","last_clean":"2024-04-26T11:48:05.244599+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:48:05.244599+0000","last_undegraded":"2024-04-26T11:48:05.244599+0000","last_fullsized":"2024-04-26T11:48:05.244599+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.471332+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:48:04.471332+0000","last_peered":"2024-04-26T11:48:04.471332+0000","last_clean":"2024-04-26T11:48:04.471332+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:48:04.471332+0000","last_undegraded":"2024-04-26T11:48:04.471332+0000","last_fullsized":"2024-04-26T11:48:04.471332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":312,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592075+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:48:11.592075+0000","last_peered":"2024-04-26T11:48:11.592075+0000","last_clean":"2024-04-26T11:48:11.592075+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:48:11.592075+0000","last_undegraded":"2024-04-26T11:48:11.592075+0000","last_fullsized":"2024-04-26T11:48:11.592075+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":126,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592201+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:48:11.592201+0000","last_peered":"2024-04-26T11:48:11.592201+0000","last_clean":"2024-04-26T11:48:11.592201+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:48:11.592201+0000","last_undegraded":"2024-04-26T11:48:11.592201+0000","last_fullsized":"2024-04-26T11:48:11.592201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":615,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468620+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:48:04.468620+0000","last_peered":"2024-04-26T11:48:04.468620+0000","last_clean":"2024-04-26T11:48:04.468620+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:48:04.468620+0000","last_undegraded":"2024-04-26T11:48:04.468620+0000","last_fullsized":"2024-04-26T11:48:04.468620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":575,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179613+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:48:04.179613+0000","last_peered":"2024-04-26T11:48:04.179613+0000","last_clean":"2024-04-26T11:48:04.179613+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:04.179613+0000","last_undegraded":"2024-04-26T11:48:04.179613+0000","last_fullsized":"2024-04-26T11:48:04.179613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592083+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:48:11.592083+0000","last_peered":"2024-04-26T11:48:11.592083+0000","last_clean":"2024-04-26T11:48:11.592083+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:48:11.592083+0000","last_undegraded":"2024-04-26T11:48:11.592083+0000","last_fullsized":"2024-04-26T11:48:11.592083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":367,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.467742+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:48:04.467742+0000","last_peered":"2024-04-26T11:48:04.467742+0000","last_clean":"2024-04-26T11:48:04.467742+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:48:04.467742+0000","last_undegraded":"2024-04-26T11:48:04.467742+0000","last_fullsized":"2024-04-26T11:48:04.467742+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":1010,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:21.674547+0000","last_change":"2024-04-26T11:48:21.674829+0000","last_active":"2024-04-26T11:48:21.674547+0000","last_peered":"2024-04-26T11:48:21.674547+0000","last_clean":"2024-04-26T11:48:21.674547+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:21.674547+0000","last_undegraded":"2024-04-26T11:48:21.674547+0000","last_fullsized":"2024-04-26T11:48:21.674547+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'445","last_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_deep_scrub":"76'445","last_deep_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_clean_scrub_stamp":"2024-04-26T11:48:21.674498+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:22.562702+0000","scrub_duration":0.0044128639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.989633+0000","last_change":"2024-04-26T11:48:28.989853+0000","last_active":"2024-04-26T11:48:28.989633+0000","last_peered":"2024-04-26T11:48:28.989633+0000","last_clean":"2024-04-26T11:48:28.989633+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:28.989633+0000","last_undegraded":"2024-04-26T11:48:28.989633+0000","last_fullsized":"2024-04-26T11:48:28.989633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.989586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:35.455730+0000","scrub_duration":0.0033627959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":533,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.594209+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:48:10.594209+0000","last_peered":"2024-04-26T11:48:10.594209+0000","last_clean":"2024-04-26T11:48:10.594209+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:48:10.594209+0000","last_undegraded":"2024-04-26T11:48:10.594209+0000","last_fullsized":"2024-04-26T11:48:10.594209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":459,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.471207+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:48:04.471207+0000","last_peered":"2024-04-26T11:48:04.471207+0000","last_clean":"2024-04-26T11:48:04.471207+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:48:04.471207+0000","last_undegraded":"2024-04-26T11:48:04.471207+0000","last_fullsized":"2024-04-26T11:48:04.471207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":126,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592592+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:48:11.592592+0000","last_peered":"2024-04-26T11:48:11.592592+0000","last_clean":"2024-04-26T11:48:11.592592+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:48:11.592592+0000","last_undegraded":"2024-04-26T11:48:11.592592+0000","last_fullsized":"2024-04-26T11:48:11.592592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":187,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.178352+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:48:04.178352+0000","last_peered":"2024-04-26T11:48:04.178352+0000","last_clean":"2024-04-26T11:48:04.178352+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:48:04.178352+0000","last_undegraded":"2024-04-26T11:48:04.178352+0000","last_fullsized":"2024-04-26T11:48:04.178352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":503,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469215+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:48:04.469215+0000","last_peered":"2024-04-26T11:48:04.469215+0000","last_clean":"2024-04-26T11:48:04.469215+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:48:04.469215+0000","last_undegraded":"2024-04-26T11:48:04.469215+0000","last_fullsized":"2024-04-26T11:48:04.469215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":646,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179838+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:48:04.179838+0000","last_peered":"2024-04-26T11:48:04.179838+0000","last_clean":"2024-04-26T11:48:04.179838+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:48:04.179838+0000","last_undegraded":"2024-04-26T11:48:04.179838+0000","last_fullsized":"2024-04-26T11:48:04.179838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469160+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:48:04.469160+0000","last_peered":"2024-04-26T11:48:04.469160+0000","last_clean":"2024-04-26T11:48:04.469160+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:48:04.469160+0000","last_undegraded":"2024-04-26T11:48:04.469160+0000","last_fullsized":"2024-04-26T11:48:04.469160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":498,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.714171+0000","last_change":"2024-04-26T11:48:28.714423+0000","last_active":"2024-04-26T11:48:28.714171+0000","last_peered":"2024-04-26T11:48:28.714171+0000","last_clean":"2024-04-26T11:48:28.714171+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:28.714171+0000","last_undegraded":"2024-04-26T11:48:28.714171+0000","last_fullsized":"2024-04-26T11:48:28.714171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.714119+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:28.093833+0000","scrub_duration":0.0054659280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.033438+0000","last_change":"2024-04-26T11:48:20.033773+0000","last_active":"2024-04-26T11:48:20.033438+0000","last_peered":"2024-04-26T11:48:20.033438+0000","last_clean":"2024-04-26T11:48:20.033438+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:20.033438+0000","last_undegraded":"2024-04-26T11:48:20.033438+0000","last_fullsized":"2024-04-26T11:48:20.033438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'63","last_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_deep_scrub":"74'63","last_deep_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.033325+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:48.515506+0000","scrub_duration":0.0038822000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":126,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.594199+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:48:10.594199+0000","last_peered":"2024-04-26T11:48:10.594199+0000","last_clean":"2024-04-26T11:48:10.594199+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:48:10.594199+0000","last_undegraded":"2024-04-26T11:48:10.594199+0000","last_fullsized":"2024-04-26T11:48:10.594199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244654+0000","last_change":"2024-04-26T11:44:21.445855+0000","last_active":"2024-04-26T11:48:05.244654+0000","last_peered":"2024-04-26T11:48:05.244654+0000","last_clean":"2024-04-26T11:48:05.244654+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:05.244654+0000","last_undegraded":"2024-04-26T11:48:05.244654+0000","last_fullsized":"2024-04-26T11:48:05.244654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"115'59","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.993267+0000","last_change":"2024-04-26T11:48:26.993614+0000","last_active":"2024-04-26T11:48:26.993267+0000","last_peered":"2024-04-26T11:48:26.993267+0000","last_clean":"2024-04-26T11:48:26.993267+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:26.993267+0000","last_undegraded":"2024-04-26T11:48:26.993267+0000","last_fullsized":"2024-04-26T11:48:26.993267+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'59","last_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_deep_scrub":"115'59","last_deep_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.993216+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:01.847961+0000","scrub_duration":0.0066337560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:22.028121+0000","last_change":"2024-04-26T11:48:22.028330+0000","last_active":"2024-04-26T11:48:22.028121+0000","last_peered":"2024-04-26T11:48:22.028121+0000","last_clean":"2024-04-26T11:48:22.028121+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:22.028121+0000","last_undegraded":"2024-04-26T11:48:22.028121+0000","last_fullsized":"2024-04-26T11:48:22.028121+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_clean_scrub_stamp":"2024-04-26T11:48:22.028073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:50.488548+0000","scrub_duration":0.0032986119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":484,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.467959+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:48:04.467959+0000","last_peered":"2024-04-26T11:48:04.467959+0000","last_clean":"2024-04-26T11:48:04.467959+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:48:04.467959+0000","last_undegraded":"2024-04-26T11:48:04.467959+0000","last_fullsized":"2024-04-26T11:48:04.467959+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"115'72","reported_seq":91,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:15.150733+0000","last_change":"2024-04-26T11:48:15.150969+0000","last_active":"2024-04-26T11:48:15.150733+0000","last_peered":"2024-04-26T11:48:15.150733+0000","last_clean":"2024-04-26T11:48:15.150733+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:15.150733+0000","last_undegraded":"2024-04-26T11:48:15.150733+0000","last_fullsized":"2024-04-26T11:48:15.150733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'72","last_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_deep_scrub":"115'72","last_deep_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_clean_scrub_stamp":"2024-04-26T11:48:15.150680+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:41.664584+0000","scrub_duration":0.021253264000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.180344+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:48:04.180344+0000","last_peered":"2024-04-26T11:48:04.180344+0000","last_clean":"2024-04-26T11:48:04.180344+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:48:04.180344+0000","last_undegraded":"2024-04-26T11:48:04.180344+0000","last_fullsized":"2024-04-26T11:48:04.180344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":572,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:23.712145+0000","last_change":"2024-04-26T11:48:23.712478+0000","last_active":"2024-04-26T11:48:23.712145+0000","last_peered":"2024-04-26T11:48:23.712145+0000","last_clean":"2024-04-26T11:48:23.712145+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:23.712145+0000","last_undegraded":"2024-04-26T11:48:23.712145+0000","last_fullsized":"2024-04-26T11:48:23.712145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_clean_scrub_stamp":"2024-04-26T11:48:23.712095+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:55.117125+0000","scrub_duration":0.0051007090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":573,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.178125+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:48:04.178125+0000","last_peered":"2024-04-26T11:48:04.178125+0000","last_clean":"2024-04-26T11:48:04.178125+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:48:04.178125+0000","last_undegraded":"2024-04-26T11:48:04.178125+0000","last_fullsized":"2024-04-26T11:48:04.178125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"74'411","reported_seq":520,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179312+0000","last_change":"2024-04-26T11:44:21.067284+0000","last_active":"2024-04-26T11:48:04.179312+0000","last_peered":"2024-04-26T11:48:04.179312+0000","last_clean":"2024-04-26T11:48:04.179312+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:04.179312+0000","last_undegraded":"2024-04-26T11:48:04.179312+0000","last_fullsized":"2024-04-26T11:48:04.179312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":547,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468267+0000","last_change":"2024-04-26T11:47:31.445866+0000","last_active":"2024-04-26T11:48:04.468267+0000","last_peered":"2024-04-26T11:48:04.468267+0000","last_clean":"2024-04-26T11:48:04.468267+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:04.468267+0000","last_undegraded":"2024-04-26T11:48:04.468267+0000","last_fullsized":"2024-04-26T11:48:04.468267+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":212,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244614+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:48:05.244614+0000","last_peered":"2024-04-26T11:48:05.244614+0000","last_clean":"2024-04-26T11:48:05.244614+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:48:05.244614+0000","last_undegraded":"2024-04-26T11:48:05.244614+0000","last_fullsized":"2024-04-26T11:48:05.244614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":467,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.180116+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:48:04.180116+0000","last_peered":"2024-04-26T11:48:04.180116+0000","last_clean":"2024-04-26T11:48:04.180116+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:48:04.180116+0000","last_undegraded":"2024-04-26T11:48:04.180116+0000","last_fullsized":"2024-04-26T11:48:04.180116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":580,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468398+0000","last_change":"2024-04-26T11:47:26.453057+0000","last_active":"2024-04-26T11:48:04.468398+0000","last_peered":"2024-04-26T11:48:04.468398+0000","last_clean":"2024-04-26T11:48:04.468398+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:04.468398+0000","last_undegraded":"2024-04-26T11:48:04.468398+0000","last_fullsized":"2024-04-26T11:48:04.468398+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.018812+0000","last_change":"2024-04-26T11:48:12.019177+0000","last_active":"2024-04-26T11:48:12.018812+0000","last_peered":"2024-04-26T11:48:12.018812+0000","last_clean":"2024-04-26T11:48:12.018812+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:12.018812+0000","last_undegraded":"2024-04-26T11:48:12.018812+0000","last_fullsized":"2024-04-26T11:48:12.018812+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.018689+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:01.030509+0000","scrub_duration":0.0039670319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":576,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.467783+0000","last_change":"2024-04-26T11:47:41.467086+0000","last_active":"2024-04-26T11:48:04.467783+0000","last_peered":"2024-04-26T11:48:04.467783+0000","last_clean":"2024-04-26T11:48:04.467783+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:04.467783+0000","last_undegraded":"2024-04-26T11:48:04.467783+0000","last_fullsized":"2024-04-26T11:48:04.467783+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":519,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.246610+0000","last_change":"2024-04-26T11:44:21.438116+0000","last_active":"2024-04-26T11:48:05.246610+0000","last_peered":"2024-04-26T11:48:05.246610+0000","last_clean":"2024-04-26T11:48:05.246610+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:05.246610+0000","last_undegraded":"2024-04-26T11:48:05.246610+0000","last_fullsized":"2024-04-26T11:48:05.246610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":876,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.467525+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:48:04.467525+0000","last_peered":"2024-04-26T11:48:04.467525+0000","last_clean":"2024-04-26T11:48:04.467525+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:48:04.467525+0000","last_undegraded":"2024-04-26T11:48:04.467525+0000","last_fullsized":"2024-04-26T11:48:04.467525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470096+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:48:04.470096+0000","last_peered":"2024-04-26T11:48:04.470096+0000","last_clean":"2024-04-26T11:48:04.470096+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:48:04.470096+0000","last_undegraded":"2024-04-26T11:48:04.470096+0000","last_fullsized":"2024-04-26T11:48:04.470096+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":433,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.467781+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:48:04.467781+0000","last_peered":"2024-04-26T11:48:04.467781+0000","last_clean":"2024-04-26T11:48:04.467781+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:48:04.467781+0000","last_undegraded":"2024-04-26T11:48:04.467781+0000","last_fullsized":"2024-04-26T11:48:04.467781+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":540,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.246369+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:48:05.246369+0000","last_peered":"2024-04-26T11:48:05.246369+0000","last_clean":"2024-04-26T11:48:05.246369+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:05.246369+0000","last_undegraded":"2024-04-26T11:48:05.246369+0000","last_fullsized":"2024-04-26T11:48:05.246369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":489,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.245946+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:48:05.245946+0000","last_peered":"2024-04-26T11:48:05.245946+0000","last_clean":"2024-04-26T11:48:05.245946+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:48:05.245946+0000","last_undegraded":"2024-04-26T11:48:05.245946+0000","last_fullsized":"2024-04-26T11:48:05.245946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":855,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.245181+0000","last_change":"2024-04-26T11:47:19.141705+0000","last_active":"2024-04-26T11:48:05.245181+0000","last_peered":"2024-04-26T11:48:05.245181+0000","last_clean":"2024-04-26T11:48:05.245181+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:05.245181+0000","last_undegraded":"2024-04-26T11:48:05.245181+0000","last_fullsized":"2024-04-26T11:48:05.245181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":166,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.243316+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:48:05.243316+0000","last_peered":"2024-04-26T11:48:05.243316+0000","last_clean":"2024-04-26T11:48:05.243316+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:48:05.243316+0000","last_undegraded":"2024-04-26T11:48:05.243316+0000","last_fullsized":"2024-04-26T11:48:05.243316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":896,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:13.226572+0000","last_change":"2024-04-26T11:48:13.226901+0000","last_active":"2024-04-26T11:48:13.226572+0000","last_peered":"2024-04-26T11:48:13.226572+0000","last_clean":"2024-04-26T11:48:13.226572+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:13.226572+0000","last_undegraded":"2024-04-26T11:48:13.226572+0000","last_fullsized":"2024-04-26T11:48:13.226572+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'377","last_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_deep_scrub":"76'377","last_deep_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_clean_scrub_stamp":"2024-04-26T11:48:13.226463+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:03.708994+0000","scrub_duration":0.0044302090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"115'277","reported_seq":422,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.109084+0000","last_change":"2024-04-26T11:48:27.109273+0000","last_active":"2024-04-26T11:48:27.109084+0000","last_peered":"2024-04-26T11:48:27.109084+0000","last_clean":"2024-04-26T11:48:27.109084+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:27.109084+0000","last_undegraded":"2024-04-26T11:48:27.109084+0000","last_fullsized":"2024-04-26T11:48:27.109084+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'277","last_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_deep_scrub":"115'277","last_deep_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.109059+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:02.122709+0000","scrub_duration":0.021146224000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":902,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.178077+0000","last_change":"2024-04-26T11:47:25.146057+0000","last_active":"2024-04-26T11:48:04.178077+0000","last_peered":"2024-04-26T11:48:04.178077+0000","last_clean":"2024-04-26T11:48:04.178077+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:04.178077+0000","last_undegraded":"2024-04-26T11:48:04.178077+0000","last_fullsized":"2024-04-26T11:48:04.178077+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":438,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.245345+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:48:05.245345+0000","last_peered":"2024-04-26T11:48:05.245345+0000","last_clean":"2024-04-26T11:48:05.245345+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:05.245345+0000","last_undegraded":"2024-04-26T11:48:05.245345+0000","last_fullsized":"2024-04-26T11:48:05.245345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":953,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.245607+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:48:05.245607+0000","last_peered":"2024-04-26T11:48:05.245607+0000","last_clean":"2024-04-26T11:48:05.245607+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:05.245607+0000","last_undegraded":"2024-04-26T11:48:05.245607+0000","last_fullsized":"2024-04-26T11:48:05.245607+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470314+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:48:04.470314+0000","last_peered":"2024-04-26T11:48:04.470314+0000","last_clean":"2024-04-26T11:48:04.470314+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:48:04.470314+0000","last_undegraded":"2024-04-26T11:48:04.470314+0000","last_fullsized":"2024-04-26T11:48:04.470314+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":981,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177423+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:48:04.177423+0000","last_peered":"2024-04-26T11:48:04.177423+0000","last_clean":"2024-04-26T11:48:04.177423+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:48:04.177423+0000","last_undegraded":"2024-04-26T11:48:04.177423+0000","last_fullsized":"2024-04-26T11:48:04.177423+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470456+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:48:04.470456+0000","last_peered":"2024-04-26T11:48:04.470456+0000","last_clean":"2024-04-26T11:48:04.470456+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:48:04.470456+0000","last_undegraded":"2024-04-26T11:48:04.470456+0000","last_fullsized":"2024-04-26T11:48:04.470456+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7879,"ondisk_log_size":7879,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738425,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200496,"kb_used_data":89064,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171344,"statfs":{"total":96636764160,"available":96431456256,"internally_reserved":0,"allocated":91201536,"data_stored":90584365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69199999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77400000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Apr 26 11:48:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.77700000000000002}]}]},{"osd":1,"up_from":72,"seq":309237645330,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125616,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246224,"statfs":{"total":96636764160,"available":96508133376,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.68999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190668,"kb_used_data":83332,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181172,"statfs":{"total":96636764160,"available":96441520128,"internally_reserved":0,"allocated":85331968,"data_stored":84726408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66500000000000004,"15min":0.69299999999999995},"min":{"1min":0.54400000000000004,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77200000000000002,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:48:32.313 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.313 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.313 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.313 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.313 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.313 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.314 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.314 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.314 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.314 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.314 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.314 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.314 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.314 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.315 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.315 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.315 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.315 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.315 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.315 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.315 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.315 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.315 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.315 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.316 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.316 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.316 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.316 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.316 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.316 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.316 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.316 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.316 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.317 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.317 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.317 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.317 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.317 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.317 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.317 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.318 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.318 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.318 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.318 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.318 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.318 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.318 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T11:44:10.975511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.318 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.318 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.319 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.319 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.319 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.319 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.319 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.319 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.319 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.320 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.320 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.320 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.320 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.320 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.320 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.320 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.321 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.321 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.321 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.321 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.321 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.321 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.321 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.321 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.321 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.322 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.322 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.322 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.322 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.322 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.322 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.322 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.322 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.322 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.323 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.323 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.323 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:32.323 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:48:52.324 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:48:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:48:52.662 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:48:52.672 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-26T11:48:52.071968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34099,"ondisk_log_size":34099,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516780,"kb_used_data":252436,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598740,"statfs":{"total":289910292480,"available":289381109760,"internally_reserved":0,"allocated":258494464,"data_stored":256676283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004197"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":963,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595322+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:48:10.595322+0000","last_peered":"2024-04-26T11:48:10.595322+0000","last_clean":"2024-04-26T11:48:10.595322+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:48:10.595322+0000","last_undegraded":"2024-04-26T11:48:10.595322+0000","last_fullsized":"2024-04-26T11:48:10.595322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1020,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595346+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:48:10.595346+0000","last_peered":"2024-04-26T11:48:10.595346+0000","last_clean":"2024-04-26T11:48:10.595346+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:48:10.595346+0000","last_undegraded":"2024-04-26T11:48:10.595346+0000","last_fullsized":"2024-04-26T11:48:10.595346+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593307+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:11.593307+0000","last_peered":"2024-04-26T11:48:11.593307+0000","last_clean":"2024-04-26T11:48:11.593307+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:11.593307+0000","last_undegraded":"2024-04-26T11:48:11.593307+0000","last_fullsized":"2024-04-26T11:48:11.593307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":841,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593170+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:11.593170+0000","last_peered":"2024-04-26T11:48:11.593170+0000","last_clean":"2024-04-26T11:48:11.593170+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:11.593170+0000","last_undegraded":"2024-04-26T11:48:11.593170+0000","last_fullsized":"2024-04-26T11:48:11.593170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":918,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244890+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:48:05.244890+0000","last_peered":"2024-04-26T11:48:05.244890+0000","last_clean":"2024-04-26T11:48:05.244890+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:48:05.244890+0000","last_undegraded":"2024-04-26T11:48:05.244890+0000","last_fullsized":"2024-04-26T11:48:05.244890+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":846,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177494+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:48:04.177494+0000","last_peered":"2024-04-26T11:48:04.177494+0000","last_clean":"2024-04-26T11:48:04.177494+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:48:04.177494+0000","last_undegraded":"2024-04-26T11:48:04.177494+0000","last_fullsized":"2024-04-26T11:48:04.177494+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1038,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177458+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:48:04.177458+0000","last_peered":"2024-04-26T11:48:04.177458+0000","last_clean":"2024-04-26T11:48:04.177458+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:48:04.177458+0000","last_undegraded":"2024-04-26T11:48:04.177458+0000","last_fullsized":"2024-04-26T11:48:04.177458+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":847,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.176842+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:04.176842+0000","last_peered":"2024-04-26T11:48:04.176842+0000","last_clean":"2024-04-26T11:48:04.176842+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:04.176842+0000","last_undegraded":"2024-04-26T11:48:04.176842+0000","last_fullsized":"2024-04-26T11:48:04.176842+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":554,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:33.918517+0000","last_change":"2024-04-26T11:48:33.918870+0000","last_active":"2024-04-26T11:48:33.918517+0000","last_peered":"2024-04-26T11:48:33.918517+0000","last_clean":"2024-04-26T11:48:33.918517+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:33.918517+0000","last_undegraded":"2024-04-26T11:48:33.918517+0000","last_fullsized":"2024-04-26T11:48:33.918517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'421","last_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_deep_scrub":"77'421","last_deep_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:33.918413+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:33.584386+0000","scrub_duration":0.0044004430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":961,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244493+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:48:05.244493+0000","last_peered":"2024-04-26T11:48:05.244493+0000","last_clean":"2024-04-26T11:48:05.244493+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:48:05.244493+0000","last_undegraded":"2024-04-26T11:48:05.244493+0000","last_fullsized":"2024-04-26T11:48:05.244493+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":874,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179159+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:48:04.179159+0000","last_peered":"2024-04-26T11:48:04.179159+0000","last_clean":"2024-04-26T11:48:04.179159+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:48:04.179159+0000","last_undegraded":"2024-04-26T11:48:04.179159+0000","last_fullsized":"2024-04-26T11:48:04.179159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":503,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.698922+0000","last_change":"2024-04-26T11:48:10.699169+0000","last_active":"2024-04-26T11:48:10.698922+0000","last_peered":"2024-04-26T11:48:10.698922+0000","last_clean":"2024-04-26T11:48:10.698922+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:10.698922+0000","last_undegraded":"2024-04-26T11:48:10.698922+0000","last_fullsized":"2024-04-26T11:48:10.698922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'345","last_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_deep_scrub":"76'345","last_deep_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_clean_scrub_stamp":"2024-04-26T11:48:10.698866+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:11.706179+0000","scrub_duration":0.0058868610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":894,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244426+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:48:05.244426+0000","last_peered":"2024-04-26T11:48:05.244426+0000","last_clean":"2024-04-26T11:48:05.244426+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:48:05.244426+0000","last_undegraded":"2024-04-26T11:48:05.244426+0000","last_fullsized":"2024-04-26T11:48:05.244426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":575,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.180464+0000","last_change":"2024-04-26T11:48:12.180736+0000","last_active":"2024-04-26T11:48:12.180464+0000","last_peered":"2024-04-26T11:48:12.180464+0000","last_clean":"2024-04-26T11:48:12.180464+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:12.180464+0000","last_undegraded":"2024-04-26T11:48:12.180464+0000","last_fullsized":"2024-04-26T11:48:12.180464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'418","last_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_deep_scrub":"76'418","last_deep_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.180413+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.283252+0000","scrub_duration":0.0053701490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":617,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.056783+0000","last_change":"2024-04-26T11:48:26.057064+0000","last_active":"2024-04-26T11:48:26.056783+0000","last_peered":"2024-04-26T11:48:26.056783+0000","last_clean":"2024-04-26T11:48:26.056783+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:26.056783+0000","last_undegraded":"2024-04-26T11:48:26.056783+0000","last_fullsized":"2024-04-26T11:48:26.056783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'428","last_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_deep_scrub":"76'428","last_deep_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.056732+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:01.294605+0000","scrub_duration":0.0057736879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1061,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177178+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:48:04.177178+0000","last_peered":"2024-04-26T11:48:04.177178+0000","last_clean":"2024-04-26T11:48:04.177178+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:48:04.177178+0000","last_undegraded":"2024-04-26T11:48:04.177178+0000","last_fullsized":"2024-04-26T11:48:04.177178+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":522,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.949014+0000","last_change":"2024-04-26T11:48:27.949389+0000","last_active":"2024-04-26T11:48:27.949014+0000","last_peered":"2024-04-26T11:48:27.949014+0000","last_clean":"2024-04-26T11:48:27.949014+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:27.949014+0000","last_undegraded":"2024-04-26T11:48:27.949014+0000","last_fullsized":"2024-04-26T11:48:27.949014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.948898+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:29.597751+0000","scrub_duration":0.0043304119999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":926,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244790+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:48:05.244790+0000","last_peered":"2024-04-26T11:48:05.244790+0000","last_clean":"2024-04-26T11:48:05.244790+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:48:05.244790+0000","last_undegraded":"2024-04-26T11:48:05.244790+0000","last_fullsized":"2024-04-26T11:48:05.244790+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":532,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469812+0000","last_change":"2024-04-26T11:47:42.470100+0000","last_active":"2024-04-26T11:48:04.469812+0000","last_peered":"2024-04-26T11:48:04.469812+0000","last_clean":"2024-04-26T11:48:04.469812+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:48:04.469812+0000","last_undegraded":"2024-04-26T11:48:04.469812+0000","last_fullsized":"2024-04-26T11:48:04.469812+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1015,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.178927+0000","last_change":"2024-04-26T11:47:19.140872+0000","last_active":"2024-04-26T11:48:04.178927+0000","last_peered":"2024-04-26T11:48:04.178927+0000","last_clean":"2024-04-26T11:48:04.178927+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:48:04.178927+0000","last_undegraded":"2024-04-26T11:48:04.178927+0000","last_fullsized":"2024-04-26T11:48:04.178927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":940,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:40.996888+0000","last_change":"2024-04-26T11:48:40.997248+0000","last_active":"2024-04-26T11:48:40.996888+0000","last_peered":"2024-04-26T11:48:40.996888+0000","last_clean":"2024-04-26T11:48:40.996888+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:40.996888+0000","last_undegraded":"2024-04-26T11:48:40.996888+0000","last_fullsized":"2024-04-26T11:48:40.996888+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'404","last_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_deep_scrub":"76'404","last_deep_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_clean_scrub_stamp":"2024-04-26T11:48:40.996775+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:28.668510+0000","scrub_duration":0.0044704089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":589,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.703479+0000","last_change":"2024-04-26T11:48:16.703736+0000","last_active":"2024-04-26T11:48:16.703479+0000","last_peered":"2024-04-26T11:48:16.703479+0000","last_clean":"2024-04-26T11:48:16.703479+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:16.703479+0000","last_undegraded":"2024-04-26T11:48:16.703479+0000","last_fullsized":"2024-04-26T11:48:16.703479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.703427+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:09.548341+0000","scrub_duration":0.0060063829999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":516,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468122+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:48:04.468122+0000","last_peered":"2024-04-26T11:48:04.468122+0000","last_clean":"2024-04-26T11:48:04.468122+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:48:04.468122+0000","last_undegraded":"2024-04-26T11:48:04.468122+0000","last_fullsized":"2024-04-26T11:48:04.468122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1034,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595090+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:48:10.595090+0000","last_peered":"2024-04-26T11:48:10.595090+0000","last_clean":"2024-04-26T11:48:10.595090+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:48:10.595090+0000","last_undegraded":"2024-04-26T11:48:10.595090+0000","last_fullsized":"2024-04-26T11:48:10.595090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":515,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595068+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:48:10.595068+0000","last_peered":"2024-04-26T11:48:10.595068+0000","last_clean":"2024-04-26T11:48:10.595068+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:48:10.595068+0000","last_undegraded":"2024-04-26T11:48:10.595068+0000","last_fullsized":"2024-04-26T11:48:10.595068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":622,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470256+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:48:04.470256+0000","last_peered":"2024-04-26T11:48:04.470256+0000","last_clean":"2024-04-26T11:48:04.470256+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:48:04.470256+0000","last_undegraded":"2024-04-26T11:48:04.470256+0000","last_fullsized":"2024-04-26T11:48:04.470256+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.159519+0000","last_change":"2024-04-26T11:48:20.159519+0000","last_active":"2024-04-26T11:48:20.159519+0000","last_peered":"2024-04-26T11:48:20.159519+0000","last_clean":"2024-04-26T11:48:20.159519+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:20.159519+0000","last_undegraded":"2024-04-26T11:48:20.159519+0000","last_fullsized":"2024-04-26T11:48:20.159519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.159224+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:05.701212+0000","scrub_duration":0.0055914299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":598,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595037+0000","last_change":"2024-04-26T11:44:21.442986+0000","last_active":"2024-04-26T11:48:10.595037+0000","last_peered":"2024-04-26T11:48:10.595037+0000","last_clean":"2024-04-26T11:48:10.595037+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:10.595037+0000","last_undegraded":"2024-04-26T11:48:10.595037+0000","last_fullsized":"2024-04-26T11:48:10.595037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":509,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468908+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:48:04.468908+0000","last_peered":"2024-04-26T11:48:04.468908+0000","last_clean":"2024-04-26T11:48:04.468908+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:48:04.468908+0000","last_undegraded":"2024-04-26T11:48:04.468908+0000","last_fullsized":"2024-04-26T11:48:04.468908+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":638,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:42.691464+0000","last_change":"2024-04-26T11:48:42.691846+0000","last_active":"2024-04-26T11:48:42.691464+0000","last_peered":"2024-04-26T11:48:42.691464+0000","last_clean":"2024-04-26T11:48:42.691464+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:42.691464+0000","last_undegraded":"2024-04-26T11:48:42.691464+0000","last_fullsized":"2024-04-26T11:48:42.691464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'467","last_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_deep_scrub":"76'467","last_deep_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_clean_scrub_stamp":"2024-04-26T11:48:42.691415+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:34.091246+0000","scrub_duration":0.0058108070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":574,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468511+0000","last_change":"2024-04-26T11:47:32.455030+0000","last_active":"2024-04-26T11:48:04.468511+0000","last_peered":"2024-04-26T11:48:04.468511+0000","last_clean":"2024-04-26T11:48:04.468511+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:04.468511+0000","last_undegraded":"2024-04-26T11:48:04.468511+0000","last_fullsized":"2024-04-26T11:48:04.468511+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":963,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.161557+0000","last_change":"2024-04-26T11:48:16.161557+0000","last_active":"2024-04-26T11:48:16.161557+0000","last_peered":"2024-04-26T11:48:16.161557+0000","last_clean":"2024-04-26T11:48:16.161557+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:16.161557+0000","last_undegraded":"2024-04-26T11:48:16.161557+0000","last_fullsized":"2024-04-26T11:48:16.161557+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'412","last_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_deep_scrub":"76'412","last_deep_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.161259+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:19.609307+0000","scrub_duration":0.005601534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":854,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:46.658613+0000","last_change":"2024-04-26T11:48:46.658998+0000","last_active":"2024-04-26T11:48:46.658613+0000","last_peered":"2024-04-26T11:48:46.658613+0000","last_clean":"2024-04-26T11:48:46.658613+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:46.658613+0000","last_undegraded":"2024-04-26T11:48:46.658613+0000","last_fullsized":"2024-04-26T11:48:46.658613+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'370","last_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_deep_scrub":"76'370","last_deep_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_clean_scrub_stamp":"2024-04-26T11:48:46.658495+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:50.106542+0000","scrub_duration":0.0045947180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"115'492","reported_seq":639,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:39.978516+0000","last_change":"2024-04-26T11:48:39.978630+0000","last_active":"2024-04-26T11:48:39.978516+0000","last_peered":"2024-04-26T11:48:39.978516+0000","last_clean":"2024-04-26T11:48:39.978516+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:39.978516+0000","last_undegraded":"2024-04-26T11:48:39.978516+0000","last_fullsized":"2024-04-26T11:48:39.978516+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'492","last_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_deep_scrub":"115'492","last_deep_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_clean_scrub_stamp":"2024-04-26T11:48:39.978491+0000","objects_scrubbed":4,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:30.699411+0000","scrub_duration":0.028156690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":993,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.672135+0000","last_change":"2024-04-26T11:48:36.672399+0000","last_active":"2024-04-26T11:48:36.672135+0000","last_peered":"2024-04-26T11:48:36.672135+0000","last_clean":"2024-04-26T11:48:36.672135+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:36.672135+0000","last_undegraded":"2024-04-26T11:48:36.672135+0000","last_fullsized":"2024-04-26T11:48:36.672135+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'411","last_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_deep_scrub":"76'411","last_deep_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.672084+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:47.824742+0000","scrub_duration":0.0043867059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":65,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468463+0000","last_change":"2024-04-26T11:47:11.445933+0000","last_active":"2024-04-26T11:48:04.468463+0000","last_peered":"2024-04-26T11:48:04.468463+0000","last_clean":"2024-04-26T11:48:04.468463+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:04.468463+0000","last_undegraded":"2024-04-26T11:48:04.468463+0000","last_fullsized":"2024-04-26T11:48:04.468463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":527,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.973329+0000","last_change":"2024-04-26T11:48:38.973582+0000","last_active":"2024-04-26T11:48:38.973329+0000","last_peered":"2024-04-26T11:48:38.973329+0000","last_clean":"2024-04-26T11:48:38.973329+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:38.973329+0000","last_undegraded":"2024-04-26T11:48:38.973329+0000","last_fullsized":"2024-04-26T11:48:38.973329+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.973282+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:59.469110+0000","scrub_duration":0.0046745279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":169,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.243606+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:48:05.243606+0000","last_peered":"2024-04-26T11:48:05.243606+0000","last_clean":"2024-04-26T11:48:05.243606+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:48:05.243606+0000","last_undegraded":"2024-04-26T11:48:05.243606+0000","last_fullsized":"2024-04-26T11:48:05.243606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":551,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470503+0000","last_change":"2024-04-26T11:47:18.437930+0000","last_active":"2024-04-26T11:48:04.470503+0000","last_peered":"2024-04-26T11:48:04.470503+0000","last_clean":"2024-04-26T11:48:04.470503+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:04.470503+0000","last_undegraded":"2024-04-26T11:48:04.470503+0000","last_fullsized":"2024-04-26T11:48:04.470503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'67","reported_seq":176,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177900+0000","last_change":"2024-04-26T11:44:21.066875+0000","last_active":"2024-04-26T11:48:04.177900+0000","last_peered":"2024-04-26T11:48:04.177900+0000","last_clean":"2024-04-26T11:48:04.177900+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:04.177900+0000","last_undegraded":"2024-04-26T11:48:04.177900+0000","last_fullsized":"2024-04-26T11:48:04.177900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"74'214","reported_seq":323,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.180313+0000","last_change":"2024-04-26T11:44:21.067275+0000","last_active":"2024-04-26T11:48:04.180313+0000","last_peered":"2024-04-26T11:48:04.180313+0000","last_clean":"2024-04-26T11:48:04.180313+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:04.180313+0000","last_undegraded":"2024-04-26T11:48:04.180313+0000","last_fullsized":"2024-04-26T11:48:04.180313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":553,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.700459+0000","last_change":"2024-04-26T11:48:19.700459+0000","last_active":"2024-04-26T11:48:19.700459+0000","last_peered":"2024-04-26T11:48:19.700459+0000","last_clean":"2024-04-26T11:48:19.700459+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:19.700459+0000","last_undegraded":"2024-04-26T11:48:19.700459+0000","last_fullsized":"2024-04-26T11:48:19.700459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.700054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:19.776698+0000","scrub_duration":0.0059321139999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":501,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.243499+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:48:05.243499+0000","last_peered":"2024-04-26T11:48:05.243499+0000","last_clean":"2024-04-26T11:48:05.243499+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:48:05.243499+0000","last_undegraded":"2024-04-26T11:48:05.243499+0000","last_fullsized":"2024-04-26T11:48:05.243499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1033,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.594710+0000","last_change":"2024-04-26T11:47:24.144507+0000","last_active":"2024-04-26T11:48:10.594710+0000","last_peered":"2024-04-26T11:48:10.594710+0000","last_clean":"2024-04-26T11:48:10.594710+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:10.594710+0000","last_undegraded":"2024-04-26T11:48:10.594710+0000","last_fullsized":"2024-04-26T11:48:10.594710+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"115'588","reported_seq":708,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:47.005975+0000","last_change":"2024-04-26T11:48:47.006099+0000","last_active":"2024-04-26T11:48:47.005975+0000","last_peered":"2024-04-26T11:48:47.005975+0000","last_clean":"2024-04-26T11:48:47.005975+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:47.005975+0000","last_undegraded":"2024-04-26T11:48:47.005975+0000","last_fullsized":"2024-04-26T11:48:47.005975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'588","last_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_deep_scrub":"115'588","last_deep_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_clean_scrub_stamp":"2024-04-26T11:48:47.005948+0000","objects_scrubbed":2,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:57.335372+0000","scrub_duration":0.022816893000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1028,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.113972+0000","last_change":"2024-04-26T11:48:19.113972+0000","last_active":"2024-04-26T11:48:19.113972+0000","last_peered":"2024-04-26T11:48:19.113972+0000","last_clean":"2024-04-26T11:48:19.113972+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:19.113972+0000","last_undegraded":"2024-04-26T11:48:19.113972+0000","last_fullsized":"2024-04-26T11:48:19.113972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'446","last_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_deep_scrub":"76'446","last_deep_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.113630+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:18.946024+0000","scrub_duration":0.0051973490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":184,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179393+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:48:04.179393+0000","last_peered":"2024-04-26T11:48:04.179393+0000","last_clean":"2024-04-26T11:48:04.179393+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:48:04.179393+0000","last_undegraded":"2024-04-26T11:48:04.179393+0000","last_fullsized":"2024-04-26T11:48:04.179393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":621,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469476+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:48:04.469476+0000","last_peered":"2024-04-26T11:48:04.469476+0000","last_clean":"2024-04-26T11:48:04.469476+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:48:04.469476+0000","last_undegraded":"2024-04-26T11:48:04.469476+0000","last_fullsized":"2024-04-26T11:48:04.469476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"74'262","reported_seq":373,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469002+0000","last_change":"2024-04-26T11:47:14.430652+0000","last_active":"2024-04-26T11:48:04.469002+0000","last_peered":"2024-04-26T11:48:04.469002+0000","last_clean":"2024-04-26T11:48:04.469002+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:04.469002+0000","last_undegraded":"2024-04-26T11:48:04.469002+0000","last_fullsized":"2024-04-26T11:48:04.469002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":974,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.998199+0000","last_change":"2024-04-26T11:48:38.998461+0000","last_active":"2024-04-26T11:48:38.998199+0000","last_peered":"2024-04-26T11:48:38.998199+0000","last_clean":"2024-04-26T11:48:38.998199+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:38.998199+0000","last_undegraded":"2024-04-26T11:48:38.998199+0000","last_fullsized":"2024-04-26T11:48:38.998199+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.998146+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:36.290726+0000","scrub_duration":0.0044019580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":285,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592372+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:48:11.592372+0000","last_peered":"2024-04-26T11:48:11.592372+0000","last_clean":"2024-04-26T11:48:11.592372+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:48:11.592372+0000","last_undegraded":"2024-04-26T11:48:11.592372+0000","last_fullsized":"2024-04-26T11:48:11.592372+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":560,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:24.108478+0000","last_change":"2024-04-26T11:48:24.108717+0000","last_active":"2024-04-26T11:48:24.108478+0000","last_peered":"2024-04-26T11:48:24.108478+0000","last_clean":"2024-04-26T11:48:24.108478+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:24.108478+0000","last_undegraded":"2024-04-26T11:48:24.108478+0000","last_fullsized":"2024-04-26T11:48:24.108478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'403","last_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_deep_scrub":"76'403","last_deep_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_clean_scrub_stamp":"2024-04-26T11:48:24.108430+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:30.212481+0000","scrub_duration":0.0053830830000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":164,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.594270+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:48:10.594270+0000","last_peered":"2024-04-26T11:48:10.594270+0000","last_clean":"2024-04-26T11:48:10.594270+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:48:10.594270+0000","last_undegraded":"2024-04-26T11:48:10.594270+0000","last_fullsized":"2024-04-26T11:48:10.594270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":487,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179823+0000","last_change":"2024-04-26T11:44:21.450195+0000","last_active":"2024-04-26T11:48:04.179823+0000","last_peered":"2024-04-26T11:48:04.179823+0000","last_clean":"2024-04-26T11:48:04.179823+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:04.179823+0000","last_undegraded":"2024-04-26T11:48:04.179823+0000","last_fullsized":"2024-04-26T11:48:04.179823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"74'502","reported_seq":636,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.594269+0000","last_change":"2024-04-26T11:47:14.136183+0000","last_active":"2024-04-26T11:48:10.594269+0000","last_peered":"2024-04-26T11:48:10.594269+0000","last_clean":"2024-04-26T11:48:10.594269+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:48:10.594269+0000","last_undegraded":"2024-04-26T11:48:10.594269+0000","last_fullsized":"2024-04-26T11:48:10.594269+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.471332+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:48:04.471332+0000","last_peered":"2024-04-26T11:48:04.471332+0000","last_clean":"2024-04-26T11:48:04.471332+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:48:04.471332+0000","last_undegraded":"2024-04-26T11:48:04.471332+0000","last_fullsized":"2024-04-26T11:48:04.471332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":312,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592075+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:48:11.592075+0000","last_peered":"2024-04-26T11:48:11.592075+0000","last_clean":"2024-04-26T11:48:11.592075+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:48:11.592075+0000","last_undegraded":"2024-04-26T11:48:11.592075+0000","last_fullsized":"2024-04-26T11:48:11.592075+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":126,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592201+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:48:11.592201+0000","last_peered":"2024-04-26T11:48:11.592201+0000","last_clean":"2024-04-26T11:48:11.592201+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:48:11.592201+0000","last_undegraded":"2024-04-26T11:48:11.592201+0000","last_fullsized":"2024-04-26T11:48:11.592201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":615,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468620+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:48:04.468620+0000","last_peered":"2024-04-26T11:48:04.468620+0000","last_clean":"2024-04-26T11:48:04.468620+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:48:04.468620+0000","last_undegraded":"2024-04-26T11:48:04.468620+0000","last_fullsized":"2024-04-26T11:48:04.468620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":576,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592716+0000","last_change":"2024-04-26T11:44:21.452433+0000","last_active":"2024-04-26T11:48:11.592716+0000","last_peered":"2024-04-26T11:48:11.592716+0000","last_clean":"2024-04-26T11:48:11.592716+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:11.592716+0000","last_undegraded":"2024-04-26T11:48:11.592716+0000","last_fullsized":"2024-04-26T11:48:11.592716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592083+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:48:11.592083+0000","last_peered":"2024-04-26T11:48:11.592083+0000","last_clean":"2024-04-26T11:48:11.592083+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:48:11.592083+0000","last_undegraded":"2024-04-26T11:48:11.592083+0000","last_fullsized":"2024-04-26T11:48:11.592083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'168","reported_seq":367,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.467742+0000","last_change":"2024-04-26T11:47:14.430564+0000","last_active":"2024-04-26T11:48:04.467742+0000","last_peered":"2024-04-26T11:48:04.467742+0000","last_clean":"2024-04-26T11:48:04.467742+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:48:04.467742+0000","last_undegraded":"2024-04-26T11:48:04.467742+0000","last_fullsized":"2024-04-26T11:48:04.467742+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":1011,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:21.674829+0000","last_change":"2024-04-26T11:48:21.674829+0000","last_active":"2024-04-26T11:48:21.674829+0000","last_peered":"2024-04-26T11:48:21.674829+0000","last_clean":"2024-04-26T11:48:21.674829+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:21.674829+0000","last_undegraded":"2024-04-26T11:48:21.674829+0000","last_fullsized":"2024-04-26T11:48:21.674829+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'445","last_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_deep_scrub":"76'445","last_deep_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_clean_scrub_stamp":"2024-04-26T11:48:21.674498+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:22.562702+0000","scrub_duration":0.0044128639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.989633+0000","last_change":"2024-04-26T11:48:28.989853+0000","last_active":"2024-04-26T11:48:28.989633+0000","last_peered":"2024-04-26T11:48:28.989633+0000","last_clean":"2024-04-26T11:48:28.989633+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:28.989633+0000","last_undegraded":"2024-04-26T11:48:28.989633+0000","last_fullsized":"2024-04-26T11:48:28.989633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.989586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:35.455730+0000","scrub_duration":0.0033627959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":533,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.594209+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:48:10.594209+0000","last_peered":"2024-04-26T11:48:10.594209+0000","last_clean":"2024-04-26T11:48:10.594209+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:48:10.594209+0000","last_undegraded":"2024-04-26T11:48:10.594209+0000","last_fullsized":"2024-04-26T11:48:10.594209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":459,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.471207+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:48:04.471207+0000","last_peered":"2024-04-26T11:48:04.471207+0000","last_clean":"2024-04-26T11:48:04.471207+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:48:04.471207+0000","last_undegraded":"2024-04-26T11:48:04.471207+0000","last_fullsized":"2024-04-26T11:48:04.471207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":126,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592592+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:48:11.592592+0000","last_peered":"2024-04-26T11:48:11.592592+0000","last_clean":"2024-04-26T11:48:11.592592+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:48:11.592592+0000","last_undegraded":"2024-04-26T11:48:11.592592+0000","last_fullsized":"2024-04-26T11:48:11.592592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":188,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592694+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:48:11.592694+0000","last_peered":"2024-04-26T11:48:11.592694+0000","last_clean":"2024-04-26T11:48:11.592694+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:48:11.592694+0000","last_undegraded":"2024-04-26T11:48:11.592694+0000","last_fullsized":"2024-04-26T11:48:11.592694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":503,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469215+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:48:04.469215+0000","last_peered":"2024-04-26T11:48:04.469215+0000","last_clean":"2024-04-26T11:48:04.469215+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:48:04.469215+0000","last_undegraded":"2024-04-26T11:48:04.469215+0000","last_fullsized":"2024-04-26T11:48:04.469215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":647,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592227+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:48:11.592227+0000","last_peered":"2024-04-26T11:48:11.592227+0000","last_clean":"2024-04-26T11:48:11.592227+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:48:11.592227+0000","last_undegraded":"2024-04-26T11:48:11.592227+0000","last_fullsized":"2024-04-26T11:48:11.592227+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469160+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:48:04.469160+0000","last_peered":"2024-04-26T11:48:04.469160+0000","last_clean":"2024-04-26T11:48:04.469160+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:48:04.469160+0000","last_undegraded":"2024-04-26T11:48:04.469160+0000","last_fullsized":"2024-04-26T11:48:04.469160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.714423+0000","last_change":"2024-04-26T11:48:28.714423+0000","last_active":"2024-04-26T11:48:28.714423+0000","last_peered":"2024-04-26T11:48:28.714423+0000","last_clean":"2024-04-26T11:48:28.714423+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:28.714423+0000","last_undegraded":"2024-04-26T11:48:28.714423+0000","last_fullsized":"2024-04-26T11:48:28.714423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.714119+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:28.093833+0000","scrub_duration":0.0054659280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.033438+0000","last_change":"2024-04-26T11:48:20.033773+0000","last_active":"2024-04-26T11:48:20.033438+0000","last_peered":"2024-04-26T11:48:20.033438+0000","last_clean":"2024-04-26T11:48:20.033438+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:20.033438+0000","last_undegraded":"2024-04-26T11:48:20.033438+0000","last_fullsized":"2024-04-26T11:48:20.033438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'63","last_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_deep_scrub":"74'63","last_deep_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.033325+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:48.515506+0000","scrub_duration":0.0038822000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":126,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.594199+0000","last_change":"2024-04-26T11:47:11.149594+0000","last_active":"2024-04-26T11:48:10.594199+0000","last_peered":"2024-04-26T11:48:10.594199+0000","last_clean":"2024-04-26T11:48:10.594199+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:48:10.594199+0000","last_undegraded":"2024-04-26T11:48:10.594199+0000","last_fullsized":"2024-04-26T11:48:10.594199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":540,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:32.680131+0000","last_change":"2024-04-26T11:48:32.680131+0000","last_active":"2024-04-26T11:48:32.680131+0000","last_peered":"2024-04-26T11:48:32.680131+0000","last_clean":"2024-04-26T11:48:32.680131+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:32.680131+0000","last_undegraded":"2024-04-26T11:48:32.680131+0000","last_fullsized":"2024-04-26T11:48:32.680131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'387","last_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_deep_scrub":"76'387","last_deep_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_clean_scrub_stamp":"2024-04-26T11:48:32.679781+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:53.697537+0000","scrub_duration":0.0049983019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"115'59","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.993267+0000","last_change":"2024-04-26T11:48:26.993614+0000","last_active":"2024-04-26T11:48:26.993267+0000","last_peered":"2024-04-26T11:48:26.993267+0000","last_clean":"2024-04-26T11:48:26.993267+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:26.993267+0000","last_undegraded":"2024-04-26T11:48:26.993267+0000","last_fullsized":"2024-04-26T11:48:26.993267+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'59","last_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_deep_scrub":"115'59","last_deep_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.993216+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:01.847961+0000","scrub_duration":0.0066337560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:22.028121+0000","last_change":"2024-04-26T11:48:22.028330+0000","last_active":"2024-04-26T11:48:22.028121+0000","last_peered":"2024-04-26T11:48:22.028121+0000","last_clean":"2024-04-26T11:48:22.028121+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:22.028121+0000","last_undegraded":"2024-04-26T11:48:22.028121+0000","last_fullsized":"2024-04-26T11:48:22.028121+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_clean_scrub_stamp":"2024-04-26T11:48:22.028073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:50.488548+0000","scrub_duration":0.0032986119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":484,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.467959+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:48:04.467959+0000","last_peered":"2024-04-26T11:48:04.467959+0000","last_clean":"2024-04-26T11:48:04.467959+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:48:04.467959+0000","last_undegraded":"2024-04-26T11:48:04.467959+0000","last_fullsized":"2024-04-26T11:48:04.467959+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"115'72","reported_seq":91,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:15.150733+0000","last_change":"2024-04-26T11:48:15.150969+0000","last_active":"2024-04-26T11:48:15.150733+0000","last_peered":"2024-04-26T11:48:15.150733+0000","last_clean":"2024-04-26T11:48:15.150733+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:15.150733+0000","last_undegraded":"2024-04-26T11:48:15.150733+0000","last_fullsized":"2024-04-26T11:48:15.150733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'72","last_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_deep_scrub":"115'72","last_deep_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_clean_scrub_stamp":"2024-04-26T11:48:15.150680+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:41.664584+0000","scrub_duration":0.021253264000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":113,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592195+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:48:11.592195+0000","last_peered":"2024-04-26T11:48:11.592195+0000","last_clean":"2024-04-26T11:48:11.592195+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:48:11.592195+0000","last_undegraded":"2024-04-26T11:48:11.592195+0000","last_fullsized":"2024-04-26T11:48:11.592195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":573,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:23.712478+0000","last_change":"2024-04-26T11:48:23.712478+0000","last_active":"2024-04-26T11:48:23.712478+0000","last_peered":"2024-04-26T11:48:23.712478+0000","last_clean":"2024-04-26T11:48:23.712478+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:23.712478+0000","last_undegraded":"2024-04-26T11:48:23.712478+0000","last_fullsized":"2024-04-26T11:48:23.712478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_clean_scrub_stamp":"2024-04-26T11:48:23.712095+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:55.117125+0000","scrub_duration":0.0051007090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":573,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.178125+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:48:04.178125+0000","last_peered":"2024-04-26T11:48:04.178125+0000","last_clean":"2024-04-26T11:48:04.178125+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:48:04.178125+0000","last_undegraded":"2024-04-26T11:48:04.178125+0000","last_fullsized":"2024-04-26T11:48:04.178125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"115'416","reported_seq":536,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.029856+0000","last_change":"2024-04-26T11:48:36.029976+0000","last_active":"2024-04-26T11:48:36.029856+0000","last_peered":"2024-04-26T11:48:36.029856+0000","last_clean":"2024-04-26T11:48:36.029856+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:36.029856+0000","last_undegraded":"2024-04-26T11:48:36.029856+0000","last_fullsized":"2024-04-26T11:48:36.029856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'416","last_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_deep_scrub":"115'416","last_deep_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.029835+0000","objects_scrubbed":5,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:10.864228+0000","scrub_duration":0.034626879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":558,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:37.946554+0000","last_change":"2024-04-26T11:48:37.946809+0000","last_active":"2024-04-26T11:48:37.946554+0000","last_peered":"2024-04-26T11:48:37.946554+0000","last_clean":"2024-04-26T11:48:37.946554+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:37.946554+0000","last_undegraded":"2024-04-26T11:48:37.946554+0000","last_fullsized":"2024-04-26T11:48:37.946554+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'423","last_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_deep_scrub":"76'423","last_deep_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_clean_scrub_stamp":"2024-04-26T11:48:37.946505+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:45.776669+0000","scrub_duration":0.0044478900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":212,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244614+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:48:05.244614+0000","last_peered":"2024-04-26T11:48:05.244614+0000","last_clean":"2024-04-26T11:48:05.244614+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:48:05.244614+0000","last_undegraded":"2024-04-26T11:48:05.244614+0000","last_fullsized":"2024-04-26T11:48:05.244614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'334","reported_seq":467,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.180116+0000","last_change":"2024-04-26T11:47:14.138417+0000","last_active":"2024-04-26T11:48:04.180116+0000","last_peered":"2024-04-26T11:48:04.180116+0000","last_clean":"2024-04-26T11:48:04.180116+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:48:04.180116+0000","last_undegraded":"2024-04-26T11:48:04.180116+0000","last_fullsized":"2024-04-26T11:48:04.180116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":591,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.973031+0000","last_change":"2024-04-26T11:48:30.973251+0000","last_active":"2024-04-26T11:48:30.973031+0000","last_peered":"2024-04-26T11:48:30.973031+0000","last_clean":"2024-04-26T11:48:30.973031+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:30.973031+0000","last_undegraded":"2024-04-26T11:48:30.973031+0000","last_fullsized":"2024-04-26T11:48:30.973031+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'463","last_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_deep_scrub":"76'463","last_deep_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.972981+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:34.247031+0000","scrub_duration":0.0044136920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.018812+0000","last_change":"2024-04-26T11:48:12.019177+0000","last_active":"2024-04-26T11:48:12.018812+0000","last_peered":"2024-04-26T11:48:12.018812+0000","last_clean":"2024-04-26T11:48:12.018812+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:12.018812+0000","last_undegraded":"2024-04-26T11:48:12.018812+0000","last_fullsized":"2024-04-26T11:48:12.018812+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.018689+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:01.030509+0000","scrub_duration":0.0039670319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":587,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.005209+0000","last_change":"2024-04-26T11:48:30.005500+0000","last_active":"2024-04-26T11:48:30.005209+0000","last_peered":"2024-04-26T11:48:30.005209+0000","last_clean":"2024-04-26T11:48:30.005209+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:30.005209+0000","last_undegraded":"2024-04-26T11:48:30.005209+0000","last_fullsized":"2024-04-26T11:48:30.005209+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'447","last_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_deep_scrub":"76'447","last_deep_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.005160+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:09.022128+0000","scrub_duration":0.0044822300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":531,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:41.646917+0000","last_change":"2024-04-26T11:48:41.647158+0000","last_active":"2024-04-26T11:48:41.646917+0000","last_peered":"2024-04-26T11:48:41.646917+0000","last_clean":"2024-04-26T11:48:41.646917+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:41.646917+0000","last_undegraded":"2024-04-26T11:48:41.646917+0000","last_fullsized":"2024-04-26T11:48:41.646917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'366","last_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_deep_scrub":"76'366","last_deep_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_clean_scrub_stamp":"2024-04-26T11:48:41.646862+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:47.318788+0000","scrub_duration":0.0041890690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"74'774","reported_seq":876,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.467525+0000","last_change":"2024-04-26T11:47:14.431098+0000","last_active":"2024-04-26T11:48:04.467525+0000","last_peered":"2024-04-26T11:48:04.467525+0000","last_clean":"2024-04-26T11:48:04.467525+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:48:04.467525+0000","last_undegraded":"2024-04-26T11:48:04.467525+0000","last_fullsized":"2024-04-26T11:48:04.467525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470096+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:48:04.470096+0000","last_peered":"2024-04-26T11:48:04.470096+0000","last_clean":"2024-04-26T11:48:04.470096+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:48:04.470096+0000","last_undegraded":"2024-04-26T11:48:04.470096+0000","last_fullsized":"2024-04-26T11:48:04.470096+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"74'328","reported_seq":433,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.467781+0000","last_change":"2024-04-26T11:47:14.430449+0000","last_active":"2024-04-26T11:48:04.467781+0000","last_peered":"2024-04-26T11:48:04.467781+0000","last_clean":"2024-04-26T11:48:04.467781+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:48:04.467781+0000","last_undegraded":"2024-04-26T11:48:04.467781+0000","last_fullsized":"2024-04-26T11:48:04.467781+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":540,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.246369+0000","last_change":"2024-04-26T11:44:21.446973+0000","last_active":"2024-04-26T11:48:05.246369+0000","last_peered":"2024-04-26T11:48:05.246369+0000","last_clean":"2024-04-26T11:48:05.246369+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:05.246369+0000","last_undegraded":"2024-04-26T11:48:05.246369+0000","last_fullsized":"2024-04-26T11:48:05.246369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"77'351","reported_seq":489,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.245946+0000","last_change":"2024-04-26T11:47:14.142409+0000","last_active":"2024-04-26T11:48:05.245946+0000","last_peered":"2024-04-26T11:48:05.245946+0000","last_clean":"2024-04-26T11:48:05.245946+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:48:05.245946+0000","last_undegraded":"2024-04-26T11:48:05.245946+0000","last_fullsized":"2024-04-26T11:48:05.245946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":866,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:29.698483+0000","last_change":"2024-04-26T11:48:29.698714+0000","last_active":"2024-04-26T11:48:29.698483+0000","last_peered":"2024-04-26T11:48:29.698483+0000","last_clean":"2024-04-26T11:48:29.698483+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:29.698483+0000","last_undegraded":"2024-04-26T11:48:29.698483+0000","last_fullsized":"2024-04-26T11:48:29.698483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'369","last_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_deep_scrub":"76'369","last_deep_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_clean_scrub_stamp":"2024-04-26T11:48:29.698434+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:04.873874+0000","scrub_duration":0.004418478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":166,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.243316+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:48:05.243316+0000","last_peered":"2024-04-26T11:48:05.243316+0000","last_clean":"2024-04-26T11:48:05.243316+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:48:05.243316+0000","last_undegraded":"2024-04-26T11:48:05.243316+0000","last_fullsized":"2024-04-26T11:48:05.243316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":896,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:13.226572+0000","last_change":"2024-04-26T11:48:13.226901+0000","last_active":"2024-04-26T11:48:13.226572+0000","last_peered":"2024-04-26T11:48:13.226572+0000","last_clean":"2024-04-26T11:48:13.226572+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:13.226572+0000","last_undegraded":"2024-04-26T11:48:13.226572+0000","last_fullsized":"2024-04-26T11:48:13.226572+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'377","last_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_deep_scrub":"76'377","last_deep_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_clean_scrub_stamp":"2024-04-26T11:48:13.226463+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:03.708994+0000","scrub_duration":0.0044302090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"115'277","reported_seq":422,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.109084+0000","last_change":"2024-04-26T11:48:27.109273+0000","last_active":"2024-04-26T11:48:27.109084+0000","last_peered":"2024-04-26T11:48:27.109084+0000","last_clean":"2024-04-26T11:48:27.109084+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:27.109084+0000","last_undegraded":"2024-04-26T11:48:27.109084+0000","last_fullsized":"2024-04-26T11:48:27.109084+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'277","last_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_deep_scrub":"115'277","last_deep_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.109059+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:02.122709+0000","scrub_duration":0.021146224000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":913,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:34.042758+0000","last_change":"2024-04-26T11:48:34.042997+0000","last_active":"2024-04-26T11:48:34.042758+0000","last_peered":"2024-04-26T11:48:34.042758+0000","last_clean":"2024-04-26T11:48:34.042758+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:34.042758+0000","last_undegraded":"2024-04-26T11:48:34.042758+0000","last_fullsized":"2024-04-26T11:48:34.042758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'391","last_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_deep_scrub":"76'391","last_deep_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_clean_scrub_stamp":"2024-04-26T11:48:34.042706+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:24.193868+0000","scrub_duration":0.0052922139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'329","reported_seq":438,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.245345+0000","last_change":"2024-04-26T11:44:21.063365+0000","last_active":"2024-04-26T11:48:05.245345+0000","last_peered":"2024-04-26T11:48:05.245345+0000","last_clean":"2024-04-26T11:48:05.245345+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:05.245345+0000","last_undegraded":"2024-04-26T11:48:05.245345+0000","last_fullsized":"2024-04-26T11:48:05.245345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":953,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.245607+0000","last_change":"2024-04-26T11:47:23.183469+0000","last_active":"2024-04-26T11:48:05.245607+0000","last_peered":"2024-04-26T11:48:05.245607+0000","last_clean":"2024-04-26T11:48:05.245607+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:05.245607+0000","last_undegraded":"2024-04-26T11:48:05.245607+0000","last_fullsized":"2024-04-26T11:48:05.245607+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470314+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:48:04.470314+0000","last_peered":"2024-04-26T11:48:04.470314+0000","last_clean":"2024-04-26T11:48:04.470314+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:48:04.470314+0000","last_undegraded":"2024-04-26T11:48:04.470314+0000","last_fullsized":"2024-04-26T11:48:04.470314+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":981,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177423+0000","last_change":"2024-04-26T11:47:37.159206+0000","last_active":"2024-04-26T11:48:04.177423+0000","last_peered":"2024-04-26T11:48:04.177423+0000","last_clean":"2024-04-26T11:48:04.177423+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:48:04.177423+0000","last_undegraded":"2024-04-26T11:48:04.177423+0000","last_fullsized":"2024-04-26T11:48:04.177423+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470456+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:48:04.470456+0000","last_peered":"2024-04-26T11:48:04.470456+0000","last_clean":"2024-04-26T11:48:04.470456+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:48:04.470456+0000","last_undegraded":"2024-04-26T11:48:04.470456+0000","last_fullsized":"2024-04-26T11:48:04.470456+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7890,"ondisk_log_size":7890,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200496,"kb_used_data":89064,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171344,"statfs":{"total":96636764160,"available":96431456256,"internally_reserved":0,"allocated":91201536,"data_stored":90584365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69199999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77400000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Apr 26 11:48:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.625},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.441}]}]},{"osd":1,"up_from":72,"seq":309237645334,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125616,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246224,"statfs":{"total":96636764160,"available":96508133376,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.69399999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190668,"kb_used_data":83332,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181172,"statfs":{"total":96636764160,"available":96441520128,"internally_reserved":0,"allocated":85331968,"data_stored":84726408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66500000000000004,"15min":0.69299999999999995},"min":{"1min":0.54400000000000004,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77200000000000002,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:48:52.680 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.681 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.681 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.681 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.681 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.681 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.681 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.681 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.681 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.682 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.682 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.682 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.682 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.682 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.682 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.682 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.683 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.683 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.683 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.683 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.683 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.683 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.683 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.683 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.683 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.684 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.684 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.684 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.684 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.684 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.684 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.684 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.684 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.684 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.685 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.685 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.685 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.685 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T11:44:10.975511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.685 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.685 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.685 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.685 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.685 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.686 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.686 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.686 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.686 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.686 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.686 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.686 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.686 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.687 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.687 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.687 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.687 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.687 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.687 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.687 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.687 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.688 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.688 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.688 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.688 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.689 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.689 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.689 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.689 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:48:52.689 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:49:12.690 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:49:13.021 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:49:13.023 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:49:13.037 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-04-26T11:49:12.078881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34121,"ondisk_log_size":34121,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516780,"kb_used_data":252436,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598740,"statfs":{"total":289910292480,"available":289381109760,"internally_reserved":0,"allocated":258494464,"data_stored":256676283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004340"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":963,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595322+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:48:10.595322+0000","last_peered":"2024-04-26T11:48:10.595322+0000","last_clean":"2024-04-26T11:48:10.595322+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:48:10.595322+0000","last_undegraded":"2024-04-26T11:48:10.595322+0000","last_fullsized":"2024-04-26T11:48:10.595322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1020,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595346+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:48:10.595346+0000","last_peered":"2024-04-26T11:48:10.595346+0000","last_clean":"2024-04-26T11:48:10.595346+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:48:10.595346+0000","last_undegraded":"2024-04-26T11:48:10.595346+0000","last_fullsized":"2024-04-26T11:48:10.595346+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593307+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:11.593307+0000","last_peered":"2024-04-26T11:48:11.593307+0000","last_clean":"2024-04-26T11:48:11.593307+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:11.593307+0000","last_undegraded":"2024-04-26T11:48:11.593307+0000","last_fullsized":"2024-04-26T11:48:11.593307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":841,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593170+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:11.593170+0000","last_peered":"2024-04-26T11:48:11.593170+0000","last_clean":"2024-04-26T11:48:11.593170+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:11.593170+0000","last_undegraded":"2024-04-26T11:48:11.593170+0000","last_fullsized":"2024-04-26T11:48:11.593170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":918,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244890+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:48:05.244890+0000","last_peered":"2024-04-26T11:48:05.244890+0000","last_clean":"2024-04-26T11:48:05.244890+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:48:05.244890+0000","last_undegraded":"2024-04-26T11:48:05.244890+0000","last_fullsized":"2024-04-26T11:48:05.244890+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":846,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177494+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:48:04.177494+0000","last_peered":"2024-04-26T11:48:04.177494+0000","last_clean":"2024-04-26T11:48:04.177494+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:48:04.177494+0000","last_undegraded":"2024-04-26T11:48:04.177494+0000","last_fullsized":"2024-04-26T11:48:04.177494+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1038,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.177458+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:48:04.177458+0000","last_peered":"2024-04-26T11:48:04.177458+0000","last_clean":"2024-04-26T11:48:04.177458+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:48:04.177458+0000","last_undegraded":"2024-04-26T11:48:04.177458+0000","last_fullsized":"2024-04-26T11:48:04.177458+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":847,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.176842+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:04.176842+0000","last_peered":"2024-04-26T11:48:04.176842+0000","last_clean":"2024-04-26T11:48:04.176842+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:04.176842+0000","last_undegraded":"2024-04-26T11:48:04.176842+0000","last_fullsized":"2024-04-26T11:48:04.176842+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":554,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:33.918517+0000","last_change":"2024-04-26T11:48:33.918870+0000","last_active":"2024-04-26T11:48:33.918517+0000","last_peered":"2024-04-26T11:48:33.918517+0000","last_clean":"2024-04-26T11:48:33.918517+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:33.918517+0000","last_undegraded":"2024-04-26T11:48:33.918517+0000","last_fullsized":"2024-04-26T11:48:33.918517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'421","last_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_deep_scrub":"77'421","last_deep_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:33.918413+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:33.584386+0000","scrub_duration":0.0044004430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":961,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244493+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:48:05.244493+0000","last_peered":"2024-04-26T11:48:05.244493+0000","last_clean":"2024-04-26T11:48:05.244493+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:48:05.244493+0000","last_undegraded":"2024-04-26T11:48:05.244493+0000","last_fullsized":"2024-04-26T11:48:05.244493+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":874,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.179159+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:48:04.179159+0000","last_peered":"2024-04-26T11:48:04.179159+0000","last_clean":"2024-04-26T11:48:04.179159+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:48:04.179159+0000","last_undegraded":"2024-04-26T11:48:04.179159+0000","last_fullsized":"2024-04-26T11:48:04.179159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":503,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.698922+0000","last_change":"2024-04-26T11:48:10.699169+0000","last_active":"2024-04-26T11:48:10.698922+0000","last_peered":"2024-04-26T11:48:10.698922+0000","last_clean":"2024-04-26T11:48:10.698922+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:10.698922+0000","last_undegraded":"2024-04-26T11:48:10.698922+0000","last_fullsized":"2024-04-26T11:48:10.698922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'345","last_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_deep_scrub":"76'345","last_deep_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_clean_scrub_stamp":"2024-04-26T11:48:10.698866+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:11.706179+0000","scrub_duration":0.0058868610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":894,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244426+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:48:05.244426+0000","last_peered":"2024-04-26T11:48:05.244426+0000","last_clean":"2024-04-26T11:48:05.244426+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:48:05.244426+0000","last_undegraded":"2024-04-26T11:48:05.244426+0000","last_fullsized":"2024-04-26T11:48:05.244426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":576,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.180736+0000","last_change":"2024-04-26T11:48:12.180736+0000","last_active":"2024-04-26T11:48:12.180736+0000","last_peered":"2024-04-26T11:48:12.180736+0000","last_clean":"2024-04-26T11:48:12.180736+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:12.180736+0000","last_undegraded":"2024-04-26T11:48:12.180736+0000","last_fullsized":"2024-04-26T11:48:12.180736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'418","last_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_deep_scrub":"76'418","last_deep_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.180413+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.283252+0000","scrub_duration":0.0053701490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":618,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.057064+0000","last_change":"2024-04-26T11:48:26.057064+0000","last_active":"2024-04-26T11:48:26.057064+0000","last_peered":"2024-04-26T11:48:26.057064+0000","last_clean":"2024-04-26T11:48:26.057064+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:26.057064+0000","last_undegraded":"2024-04-26T11:48:26.057064+0000","last_fullsized":"2024-04-26T11:48:26.057064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'428","last_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_deep_scrub":"76'428","last_deep_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.056732+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:01.294605+0000","scrub_duration":0.0057736879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1062,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592977+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:48:11.592977+0000","last_peered":"2024-04-26T11:48:11.592977+0000","last_clean":"2024-04-26T11:48:11.592977+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:48:11.592977+0000","last_undegraded":"2024-04-26T11:48:11.592977+0000","last_fullsized":"2024-04-26T11:48:11.592977+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":522,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.949014+0000","last_change":"2024-04-26T11:48:27.949389+0000","last_active":"2024-04-26T11:48:27.949014+0000","last_peered":"2024-04-26T11:48:27.949014+0000","last_clean":"2024-04-26T11:48:27.949014+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:27.949014+0000","last_undegraded":"2024-04-26T11:48:27.949014+0000","last_fullsized":"2024-04-26T11:48:27.949014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.948898+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:29.597751+0000","scrub_duration":0.0043304119999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":927,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595205+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:48:10.595205+0000","last_peered":"2024-04-26T11:48:10.595205+0000","last_clean":"2024-04-26T11:48:10.595205+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:48:10.595205+0000","last_undegraded":"2024-04-26T11:48:10.595205+0000","last_fullsized":"2024-04-26T11:48:10.595205+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":543,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:01.026605+0000","last_change":"2024-04-26T11:49:01.026835+0000","last_active":"2024-04-26T11:49:01.026605+0000","last_peered":"2024-04-26T11:49:01.026605+0000","last_clean":"2024-04-26T11:49:01.026605+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:49:01.026605+0000","last_undegraded":"2024-04-26T11:49:01.026605+0000","last_fullsized":"2024-04-26T11:49:01.026605+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:49:01.026549+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:49:01.026549+0000","last_clean_scrub_stamp":"2024-04-26T11:49:01.026549+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:07.466257+0000","scrub_duration":0.0042339500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1027,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.158150+0000","last_change":"2024-04-26T11:49:07.158425+0000","last_active":"2024-04-26T11:49:07.158150+0000","last_peered":"2024-04-26T11:49:07.158150+0000","last_clean":"2024-04-26T11:49:07.158150+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:49:07.158150+0000","last_undegraded":"2024-04-26T11:49:07.158150+0000","last_fullsized":"2024-04-26T11:49:07.158150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'441","last_scrub_stamp":"2024-04-26T11:49:07.158098+0000","last_deep_scrub":"76'441","last_deep_scrub_stamp":"2024-04-26T11:49:07.158098+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.158098+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:31.523066+0000","scrub_duration":0.0045499240000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":941,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:40.997248+0000","last_change":"2024-04-26T11:48:40.997248+0000","last_active":"2024-04-26T11:48:40.997248+0000","last_peered":"2024-04-26T11:48:40.997248+0000","last_clean":"2024-04-26T11:48:40.997248+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:40.997248+0000","last_undegraded":"2024-04-26T11:48:40.997248+0000","last_fullsized":"2024-04-26T11:48:40.997248+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'404","last_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_deep_scrub":"76'404","last_deep_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_clean_scrub_stamp":"2024-04-26T11:48:40.996775+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:28.668510+0000","scrub_duration":0.0044704089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":590,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.703736+0000","last_change":"2024-04-26T11:48:16.703736+0000","last_active":"2024-04-26T11:48:16.703736+0000","last_peered":"2024-04-26T11:48:16.703736+0000","last_clean":"2024-04-26T11:48:16.703736+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:16.703736+0000","last_undegraded":"2024-04-26T11:48:16.703736+0000","last_fullsized":"2024-04-26T11:48:16.703736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.703427+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:09.548341+0000","scrub_duration":0.0060063829999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":516,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468122+0000","last_change":"2024-04-26T11:47:27.447981+0000","last_active":"2024-04-26T11:48:04.468122+0000","last_peered":"2024-04-26T11:48:04.468122+0000","last_clean":"2024-04-26T11:48:04.468122+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:48:04.468122+0000","last_undegraded":"2024-04-26T11:48:04.468122+0000","last_fullsized":"2024-04-26T11:48:04.468122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1034,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595090+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:48:10.595090+0000","last_peered":"2024-04-26T11:48:10.595090+0000","last_clean":"2024-04-26T11:48:10.595090+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:48:10.595090+0000","last_undegraded":"2024-04-26T11:48:10.595090+0000","last_fullsized":"2024-04-26T11:48:10.595090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":515,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595068+0000","last_change":"2024-04-26T11:44:21.443996+0000","last_active":"2024-04-26T11:48:10.595068+0000","last_peered":"2024-04-26T11:48:10.595068+0000","last_clean":"2024-04-26T11:48:10.595068+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:48:10.595068+0000","last_undegraded":"2024-04-26T11:48:10.595068+0000","last_fullsized":"2024-04-26T11:48:10.595068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":622,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470256+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:48:04.470256+0000","last_peered":"2024-04-26T11:48:04.470256+0000","last_clean":"2024-04-26T11:48:04.470256+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:48:04.470256+0000","last_undegraded":"2024-04-26T11:48:04.470256+0000","last_fullsized":"2024-04-26T11:48:04.470256+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.159519+0000","last_change":"2024-04-26T11:48:20.159519+0000","last_active":"2024-04-26T11:48:20.159519+0000","last_peered":"2024-04-26T11:48:20.159519+0000","last_clean":"2024-04-26T11:48:20.159519+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:20.159519+0000","last_undegraded":"2024-04-26T11:48:20.159519+0000","last_fullsized":"2024-04-26T11:48:20.159519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.159224+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:05.701212+0000","scrub_duration":0.0055914299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":609,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:57.742786+0000","last_change":"2024-04-26T11:48:57.743169+0000","last_active":"2024-04-26T11:48:57.742786+0000","last_peered":"2024-04-26T11:48:57.742786+0000","last_clean":"2024-04-26T11:48:57.742786+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:57.742786+0000","last_undegraded":"2024-04-26T11:48:57.742786+0000","last_fullsized":"2024-04-26T11:48:57.742786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'398","last_scrub_stamp":"2024-04-26T11:48:57.742669+0000","last_deep_scrub":"76'398","last_deep_scrub_stamp":"2024-04-26T11:48:57.742669+0000","last_clean_scrub_stamp":"2024-04-26T11:48:57.742669+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:32.756319+0000","scrub_duration":0.0055375609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":509,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468908+0000","last_change":"2024-04-26T11:47:28.465205+0000","last_active":"2024-04-26T11:48:04.468908+0000","last_peered":"2024-04-26T11:48:04.468908+0000","last_clean":"2024-04-26T11:48:04.468908+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:48:04.468908+0000","last_undegraded":"2024-04-26T11:48:04.468908+0000","last_fullsized":"2024-04-26T11:48:04.468908+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":638,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:42.691464+0000","last_change":"2024-04-26T11:48:42.691846+0000","last_active":"2024-04-26T11:48:42.691464+0000","last_peered":"2024-04-26T11:48:42.691464+0000","last_clean":"2024-04-26T11:48:42.691464+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:42.691464+0000","last_undegraded":"2024-04-26T11:48:42.691464+0000","last_fullsized":"2024-04-26T11:48:42.691464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'467","last_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_deep_scrub":"76'467","last_deep_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_clean_scrub_stamp":"2024-04-26T11:48:42.691415+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:34.091246+0000","scrub_duration":0.0058108070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":585,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:57.122552+0000","last_change":"2024-04-26T11:48:57.122777+0000","last_active":"2024-04-26T11:48:57.122552+0000","last_peered":"2024-04-26T11:48:57.122552+0000","last_clean":"2024-04-26T11:48:57.122552+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:57.122552+0000","last_undegraded":"2024-04-26T11:48:57.122552+0000","last_fullsized":"2024-04-26T11:48:57.122552+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'429","last_scrub_stamp":"2024-04-26T11:48:57.122503+0000","last_deep_scrub":"76'429","last_deep_scrub_stamp":"2024-04-26T11:48:57.122503+0000","last_clean_scrub_stamp":"2024-04-26T11:48:57.122503+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:41.507208+0000","scrub_duration":0.0037513580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":963,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.161557+0000","last_change":"2024-04-26T11:48:16.161557+0000","last_active":"2024-04-26T11:48:16.161557+0000","last_peered":"2024-04-26T11:48:16.161557+0000","last_clean":"2024-04-26T11:48:16.161557+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:16.161557+0000","last_undegraded":"2024-04-26T11:48:16.161557+0000","last_fullsized":"2024-04-26T11:48:16.161557+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'412","last_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_deep_scrub":"76'412","last_deep_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.161259+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:19.609307+0000","scrub_duration":0.005601534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":855,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:46.658998+0000","last_change":"2024-04-26T11:48:46.658998+0000","last_active":"2024-04-26T11:48:46.658998+0000","last_peered":"2024-04-26T11:48:46.658998+0000","last_clean":"2024-04-26T11:48:46.658998+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:46.658998+0000","last_undegraded":"2024-04-26T11:48:46.658998+0000","last_fullsized":"2024-04-26T11:48:46.658998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'370","last_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_deep_scrub":"76'370","last_deep_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_clean_scrub_stamp":"2024-04-26T11:48:46.658495+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:50.106542+0000","scrub_duration":0.0045947180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"115'492","reported_seq":640,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:39.978630+0000","last_change":"2024-04-26T11:48:39.978630+0000","last_active":"2024-04-26T11:48:39.978630+0000","last_peered":"2024-04-26T11:48:39.978630+0000","last_clean":"2024-04-26T11:48:39.978630+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:39.978630+0000","last_undegraded":"2024-04-26T11:48:39.978630+0000","last_fullsized":"2024-04-26T11:48:39.978630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'492","last_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_deep_scrub":"115'492","last_deep_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_clean_scrub_stamp":"2024-04-26T11:48:39.978491+0000","objects_scrubbed":4,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:30.699411+0000","scrub_duration":0.028156690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":993,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.672135+0000","last_change":"2024-04-26T11:48:36.672399+0000","last_active":"2024-04-26T11:48:36.672135+0000","last_peered":"2024-04-26T11:48:36.672135+0000","last_clean":"2024-04-26T11:48:36.672135+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:36.672135+0000","last_undegraded":"2024-04-26T11:48:36.672135+0000","last_fullsized":"2024-04-26T11:48:36.672135+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'411","last_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_deep_scrub":"76'411","last_deep_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.672084+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:47.824742+0000","scrub_duration":0.0043867059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:55.128231+0000","last_change":"2024-04-26T11:48:55.128485+0000","last_active":"2024-04-26T11:48:55.128231+0000","last_peered":"2024-04-26T11:48:55.128231+0000","last_clean":"2024-04-26T11:48:55.128231+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:55.128231+0000","last_undegraded":"2024-04-26T11:48:55.128231+0000","last_fullsized":"2024-04-26T11:48:55.128231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:55.128180+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:55.128180+0000","last_clean_scrub_stamp":"2024-04-26T11:48:55.128180+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:20.475572+0000","scrub_duration":0.0032158289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":527,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.973329+0000","last_change":"2024-04-26T11:48:38.973582+0000","last_active":"2024-04-26T11:48:38.973329+0000","last_peered":"2024-04-26T11:48:38.973329+0000","last_clean":"2024-04-26T11:48:38.973329+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:38.973329+0000","last_undegraded":"2024-04-26T11:48:38.973329+0000","last_fullsized":"2024-04-26T11:48:38.973329+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.973282+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:59.469110+0000","scrub_duration":0.0046745279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":170,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.594416+0000","last_change":"2024-04-26T11:44:21.063415+0000","last_active":"2024-04-26T11:48:10.594416+0000","last_peered":"2024-04-26T11:48:10.594416+0000","last_clean":"2024-04-26T11:48:10.594416+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:48:10.594416+0000","last_undegraded":"2024-04-26T11:48:10.594416+0000","last_fullsized":"2024-04-26T11:48:10.594416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":562,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:51.006568+0000","last_change":"2024-04-26T11:48:51.006799+0000","last_active":"2024-04-26T11:48:51.006568+0000","last_peered":"2024-04-26T11:48:51.006568+0000","last_clean":"2024-04-26T11:48:51.006568+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:51.006568+0000","last_undegraded":"2024-04-26T11:48:51.006568+0000","last_fullsized":"2024-04-26T11:48:51.006568+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:51.006513+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:51.006513+0000","last_clean_scrub_stamp":"2024-04-26T11:48:51.006513+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:16.562657+0000","scrub_duration":0.0040201380000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"115'71","reported_seq":192,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:58.169654+0000","last_change":"2024-04-26T11:48:58.169654+0000","last_active":"2024-04-26T11:48:58.169654+0000","last_peered":"2024-04-26T11:48:58.169654+0000","last_clean":"2024-04-26T11:48:58.169654+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:58.169654+0000","last_undegraded":"2024-04-26T11:48:58.169654+0000","last_fullsized":"2024-04-26T11:48:58.169654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'71","last_scrub_stamp":"2024-04-26T11:48:58.169317+0000","last_deep_scrub":"115'71","last_deep_scrub_stamp":"2024-04-26T11:48:58.169317+0000","last_clean_scrub_stamp":"2024-04-26T11:48:58.169317+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:30.105511+0000","scrub_duration":0.010931368,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"115'216","reported_seq":337,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:52.101678+0000","last_change":"2024-04-26T11:48:52.101678+0000","last_active":"2024-04-26T11:48:52.101678+0000","last_peered":"2024-04-26T11:48:52.101678+0000","last_clean":"2024-04-26T11:48:52.101678+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:52.101678+0000","last_undegraded":"2024-04-26T11:48:52.101678+0000","last_fullsized":"2024-04-26T11:48:52.101678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'216","last_scrub_stamp":"2024-04-26T11:48:52.101470+0000","last_deep_scrub":"115'216","last_deep_scrub_stamp":"2024-04-26T11:48:52.101470+0000","last_clean_scrub_stamp":"2024-04-26T11:48:52.101470+0000","objects_scrubbed":2,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:52.935231+0000","scrub_duration":0.022234593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":553,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.700459+0000","last_change":"2024-04-26T11:48:19.700459+0000","last_active":"2024-04-26T11:48:19.700459+0000","last_peered":"2024-04-26T11:48:19.700459+0000","last_clean":"2024-04-26T11:48:19.700459+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:19.700459+0000","last_undegraded":"2024-04-26T11:48:19.700459+0000","last_fullsized":"2024-04-26T11:48:19.700459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.700054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:19.776698+0000","scrub_duration":0.0059321139999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"74'392","reported_seq":502,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.594295+0000","last_change":"2024-04-26T11:44:21.063494+0000","last_active":"2024-04-26T11:48:10.594295+0000","last_peered":"2024-04-26T11:48:10.594295+0000","last_clean":"2024-04-26T11:48:10.594295+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:48:10.594295+0000","last_undegraded":"2024-04-26T11:48:10.594295+0000","last_fullsized":"2024-04-26T11:48:10.594295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1044,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:49.652705+0000","last_change":"2024-04-26T11:48:49.652958+0000","last_active":"2024-04-26T11:48:49.652705+0000","last_peered":"2024-04-26T11:48:49.652705+0000","last_clean":"2024-04-26T11:48:49.652705+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:49.652705+0000","last_undegraded":"2024-04-26T11:48:49.652705+0000","last_fullsized":"2024-04-26T11:48:49.652705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'453","last_scrub_stamp":"2024-04-26T11:48:49.652654+0000","last_deep_scrub":"76'453","last_deep_scrub_stamp":"2024-04-26T11:48:49.652654+0000","last_clean_scrub_stamp":"2024-04-26T11:48:49.652654+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.485049+0000","scrub_duration":0.0048848520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"115'588","reported_seq":709,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:47.006099+0000","last_change":"2024-04-26T11:48:47.006099+0000","last_active":"2024-04-26T11:48:47.006099+0000","last_peered":"2024-04-26T11:48:47.006099+0000","last_clean":"2024-04-26T11:48:47.006099+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:47.006099+0000","last_undegraded":"2024-04-26T11:48:47.006099+0000","last_fullsized":"2024-04-26T11:48:47.006099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'588","last_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_deep_scrub":"115'588","last_deep_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_clean_scrub_stamp":"2024-04-26T11:48:47.005948+0000","objects_scrubbed":2,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:57.335372+0000","scrub_duration":0.022816893000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1028,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.113972+0000","last_change":"2024-04-26T11:48:19.113972+0000","last_active":"2024-04-26T11:48:19.113972+0000","last_peered":"2024-04-26T11:48:19.113972+0000","last_clean":"2024-04-26T11:48:19.113972+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:19.113972+0000","last_undegraded":"2024-04-26T11:48:19.113972+0000","last_fullsized":"2024-04-26T11:48:19.113972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'446","last_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_deep_scrub":"76'446","last_deep_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.113630+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:18.946024+0000","scrub_duration":0.0051973490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":185,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592314+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:48:11.592314+0000","last_peered":"2024-04-26T11:48:11.592314+0000","last_clean":"2024-04-26T11:48:11.592314+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:48:11.592314+0000","last_undegraded":"2024-04-26T11:48:11.592314+0000","last_fullsized":"2024-04-26T11:48:11.592314+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":621,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469476+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:48:04.469476+0000","last_peered":"2024-04-26T11:48:04.469476+0000","last_clean":"2024-04-26T11:48:04.469476+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:48:04.469476+0000","last_undegraded":"2024-04-26T11:48:04.469476+0000","last_fullsized":"2024-04-26T11:48:04.469476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"115'265","reported_seq":387,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:54.113069+0000","last_change":"2024-04-26T11:48:54.113217+0000","last_active":"2024-04-26T11:48:54.113069+0000","last_peered":"2024-04-26T11:48:54.113069+0000","last_clean":"2024-04-26T11:48:54.113069+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:54.113069+0000","last_undegraded":"2024-04-26T11:48:54.113069+0000","last_fullsized":"2024-04-26T11:48:54.113069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'265","last_scrub_stamp":"2024-04-26T11:48:54.113037+0000","last_deep_scrub":"115'265","last_deep_scrub_stamp":"2024-04-26T11:48:54.113037+0000","last_clean_scrub_stamp":"2024-04-26T11:48:54.113037+0000","objects_scrubbed":3,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:56.229153+0000","scrub_duration":0.024456727000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":975,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.998461+0000","last_change":"2024-04-26T11:48:38.998461+0000","last_active":"2024-04-26T11:48:38.998461+0000","last_peered":"2024-04-26T11:48:38.998461+0000","last_clean":"2024-04-26T11:48:38.998461+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:38.998461+0000","last_undegraded":"2024-04-26T11:48:38.998461+0000","last_fullsized":"2024-04-26T11:48:38.998461+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.998146+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:36.290726+0000","scrub_duration":0.0044019580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":285,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592372+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:48:11.592372+0000","last_peered":"2024-04-26T11:48:11.592372+0000","last_clean":"2024-04-26T11:48:11.592372+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:48:11.592372+0000","last_undegraded":"2024-04-26T11:48:11.592372+0000","last_fullsized":"2024-04-26T11:48:11.592372+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":561,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:24.108717+0000","last_change":"2024-04-26T11:48:24.108717+0000","last_active":"2024-04-26T11:48:24.108717+0000","last_peered":"2024-04-26T11:48:24.108717+0000","last_clean":"2024-04-26T11:48:24.108717+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:24.108717+0000","last_undegraded":"2024-04-26T11:48:24.108717+0000","last_fullsized":"2024-04-26T11:48:24.108717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'403","last_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_deep_scrub":"76'403","last_deep_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_clean_scrub_stamp":"2024-04-26T11:48:24.108430+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:30.212481+0000","scrub_duration":0.0053830830000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":164,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.594270+0000","last_change":"2024-04-26T11:44:21.063385+0000","last_active":"2024-04-26T11:48:10.594270+0000","last_peered":"2024-04-26T11:48:10.594270+0000","last_clean":"2024-04-26T11:48:10.594270+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:48:10.594270+0000","last_undegraded":"2024-04-26T11:48:10.594270+0000","last_fullsized":"2024-04-26T11:48:10.594270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:56.094293+0000","last_change":"2024-04-26T11:48:56.094523+0000","last_active":"2024-04-26T11:48:56.094293+0000","last_peered":"2024-04-26T11:48:56.094293+0000","last_clean":"2024-04-26T11:48:56.094293+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:56.094293+0000","last_undegraded":"2024-04-26T11:48:56.094293+0000","last_fullsized":"2024-04-26T11:48:56.094293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:56.094222+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:56.094222+0000","last_clean_scrub_stamp":"2024-04-26T11:48:56.094222+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:23.069438+0000","scrub_duration":0.0055997750000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"115'503","reported_seq":648,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:04.703888+0000","last_change":"2024-04-26T11:49:04.704018+0000","last_active":"2024-04-26T11:49:04.703888+0000","last_peered":"2024-04-26T11:49:04.703888+0000","last_clean":"2024-04-26T11:49:04.703888+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:49:04.703888+0000","last_undegraded":"2024-04-26T11:49:04.703888+0000","last_fullsized":"2024-04-26T11:49:04.703888+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'503","last_scrub_stamp":"2024-04-26T11:49:04.703858+0000","last_deep_scrub":"115'503","last_deep_scrub_stamp":"2024-04-26T11:49:04.703858+0000","last_clean_scrub_stamp":"2024-04-26T11:49:04.703858+0000","objects_scrubbed":1,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:48.123926+0000","scrub_duration":0.021316572999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.471332+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:48:04.471332+0000","last_peered":"2024-04-26T11:48:04.471332+0000","last_clean":"2024-04-26T11:48:04.471332+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:48:04.471332+0000","last_undegraded":"2024-04-26T11:48:04.471332+0000","last_fullsized":"2024-04-26T11:48:04.471332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":312,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592075+0000","last_change":"2024-04-26T11:44:12.001766+0000","last_active":"2024-04-26T11:48:11.592075+0000","last_peered":"2024-04-26T11:48:11.592075+0000","last_clean":"2024-04-26T11:48:11.592075+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:48:11.592075+0000","last_undegraded":"2024-04-26T11:48:11.592075+0000","last_fullsized":"2024-04-26T11:48:11.592075+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:10.975511+0000","last_clean_scrub_stamp":"2024-04-26T11:44:10.975511+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":126,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592201+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:48:11.592201+0000","last_peered":"2024-04-26T11:48:11.592201+0000","last_clean":"2024-04-26T11:48:11.592201+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:48:11.592201+0000","last_undegraded":"2024-04-26T11:48:11.592201+0000","last_fullsized":"2024-04-26T11:48:11.592201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":615,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.468620+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:48:04.468620+0000","last_peered":"2024-04-26T11:48:04.468620+0000","last_clean":"2024-04-26T11:48:04.468620+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:48:04.468620+0000","last_undegraded":"2024-04-26T11:48:04.468620+0000","last_fullsized":"2024-04-26T11:48:04.468620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":587,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:50.024734+0000","last_change":"2024-04-26T11:48:50.024898+0000","last_active":"2024-04-26T11:48:50.024734+0000","last_peered":"2024-04-26T11:48:50.024734+0000","last_clean":"2024-04-26T11:48:50.024734+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:50.024734+0000","last_undegraded":"2024-04-26T11:48:50.024734+0000","last_fullsized":"2024-04-26T11:48:50.024734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'432","last_scrub_stamp":"2024-04-26T11:48:50.024692+0000","last_deep_scrub":"76'432","last_deep_scrub_stamp":"2024-04-26T11:48:50.024692+0000","last_clean_scrub_stamp":"2024-04-26T11:48:50.024692+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:46.049218+0000","scrub_duration":0.0041890069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592083+0000","last_change":"2024-04-26T11:44:17.037270+0000","last_active":"2024-04-26T11:48:11.592083+0000","last_peered":"2024-04-26T11:48:11.592083+0000","last_clean":"2024-04-26T11:48:11.592083+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:48:11.592083+0000","last_undegraded":"2024-04-26T11:48:11.592083+0000","last_fullsized":"2024-04-26T11:48:11.592083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"115'169","reported_seq":379,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:06.101706+0000","last_change":"2024-04-26T11:49:06.101923+0000","last_active":"2024-04-26T11:49:06.101706+0000","last_peered":"2024-04-26T11:49:06.101706+0000","last_clean":"2024-04-26T11:49:06.101706+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:49:06.101706+0000","last_undegraded":"2024-04-26T11:49:06.101706+0000","last_fullsized":"2024-04-26T11:49:06.101706+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'169","last_scrub_stamp":"2024-04-26T11:49:06.101670+0000","last_deep_scrub":"115'169","last_deep_scrub_stamp":"2024-04-26T11:49:06.101670+0000","last_clean_scrub_stamp":"2024-04-26T11:49:06.101670+0000","objects_scrubbed":1,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:50.555711+0000","scrub_duration":0.012551596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":1011,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:21.674829+0000","last_change":"2024-04-26T11:48:21.674829+0000","last_active":"2024-04-26T11:48:21.674829+0000","last_peered":"2024-04-26T11:48:21.674829+0000","last_clean":"2024-04-26T11:48:21.674829+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:21.674829+0000","last_undegraded":"2024-04-26T11:48:21.674829+0000","last_fullsized":"2024-04-26T11:48:21.674829+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'445","last_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_deep_scrub":"76'445","last_deep_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_clean_scrub_stamp":"2024-04-26T11:48:21.674498+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:22.562702+0000","scrub_duration":0.0044128639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.989633+0000","last_change":"2024-04-26T11:48:28.989853+0000","last_active":"2024-04-26T11:48:28.989633+0000","last_peered":"2024-04-26T11:48:28.989633+0000","last_clean":"2024-04-26T11:48:28.989633+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:28.989633+0000","last_undegraded":"2024-04-26T11:48:28.989633+0000","last_fullsized":"2024-04-26T11:48:28.989633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.989586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:35.455730+0000","scrub_duration":0.0033627959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"74'423","reported_seq":533,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.594209+0000","last_change":"2024-04-26T11:44:21.062159+0000","last_active":"2024-04-26T11:48:10.594209+0000","last_peered":"2024-04-26T11:48:10.594209+0000","last_clean":"2024-04-26T11:48:10.594209+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:48:10.594209+0000","last_undegraded":"2024-04-26T11:48:10.594209+0000","last_fullsized":"2024-04-26T11:48:10.594209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":459,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.471207+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:48:04.471207+0000","last_peered":"2024-04-26T11:48:04.471207+0000","last_clean":"2024-04-26T11:48:04.471207+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:48:04.471207+0000","last_undegraded":"2024-04-26T11:48:04.471207+0000","last_fullsized":"2024-04-26T11:48:04.471207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":126,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592592+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:48:11.592592+0000","last_peered":"2024-04-26T11:48:11.592592+0000","last_clean":"2024-04-26T11:48:11.592592+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:48:11.592592+0000","last_undegraded":"2024-04-26T11:48:11.592592+0000","last_fullsized":"2024-04-26T11:48:11.592592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":188,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592694+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:48:11.592694+0000","last_peered":"2024-04-26T11:48:11.592694+0000","last_clean":"2024-04-26T11:48:11.592694+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:48:11.592694+0000","last_undegraded":"2024-04-26T11:48:11.592694+0000","last_fullsized":"2024-04-26T11:48:11.592694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":503,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469215+0000","last_change":"2024-04-26T11:47:25.441052+0000","last_active":"2024-04-26T11:48:04.469215+0000","last_peered":"2024-04-26T11:48:04.469215+0000","last_clean":"2024-04-26T11:48:04.469215+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:48:04.469215+0000","last_undegraded":"2024-04-26T11:48:04.469215+0000","last_fullsized":"2024-04-26T11:48:04.469215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'513","reported_seq":647,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592227+0000","last_change":"2024-04-26T11:47:14.134741+0000","last_active":"2024-04-26T11:48:11.592227+0000","last_peered":"2024-04-26T11:48:11.592227+0000","last_clean":"2024-04-26T11:48:11.592227+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:48:11.592227+0000","last_undegraded":"2024-04-26T11:48:11.592227+0000","last_fullsized":"2024-04-26T11:48:11.592227+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.469160+0000","last_change":"2024-04-26T11:47:11.441418+0000","last_active":"2024-04-26T11:48:04.469160+0000","last_peered":"2024-04-26T11:48:04.469160+0000","last_clean":"2024-04-26T11:48:04.469160+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:48:04.469160+0000","last_undegraded":"2024-04-26T11:48:04.469160+0000","last_fullsized":"2024-04-26T11:48:04.469160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.714423+0000","last_change":"2024-04-26T11:48:28.714423+0000","last_active":"2024-04-26T11:48:28.714423+0000","last_peered":"2024-04-26T11:48:28.714423+0000","last_clean":"2024-04-26T11:48:28.714423+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:28.714423+0000","last_undegraded":"2024-04-26T11:48:28.714423+0000","last_fullsized":"2024-04-26T11:48:28.714423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.714119+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:28.093833+0000","scrub_duration":0.0054659280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.033438+0000","last_change":"2024-04-26T11:48:20.033773+0000","last_active":"2024-04-26T11:48:20.033438+0000","last_peered":"2024-04-26T11:48:20.033438+0000","last_clean":"2024-04-26T11:48:20.033438+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:20.033438+0000","last_undegraded":"2024-04-26T11:48:20.033438+0000","last_fullsized":"2024-04-26T11:48:20.033438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'63","last_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_deep_scrub":"74'63","last_deep_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.033325+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:48.515506+0000","scrub_duration":0.0038822000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:06.737700+0000","last_change":"2024-04-26T11:49:06.737932+0000","last_active":"2024-04-26T11:49:06.737700+0000","last_peered":"2024-04-26T11:49:06.737700+0000","last_clean":"2024-04-26T11:49:06.737700+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:49:06.737700+0000","last_undegraded":"2024-04-26T11:49:06.737700+0000","last_fullsized":"2024-04-26T11:49:06.737700+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:06.737649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:06.737649+0000","last_clean_scrub_stamp":"2024-04-26T11:49:06.737649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:41.572042+0000","scrub_duration":0.0033533780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":540,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:32.680131+0000","last_change":"2024-04-26T11:48:32.680131+0000","last_active":"2024-04-26T11:48:32.680131+0000","last_peered":"2024-04-26T11:48:32.680131+0000","last_clean":"2024-04-26T11:48:32.680131+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:32.680131+0000","last_undegraded":"2024-04-26T11:48:32.680131+0000","last_fullsized":"2024-04-26T11:48:32.680131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'387","last_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_deep_scrub":"76'387","last_deep_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_clean_scrub_stamp":"2024-04-26T11:48:32.679781+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:53.697537+0000","scrub_duration":0.0049983019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"115'59","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.993267+0000","last_change":"2024-04-26T11:48:26.993614+0000","last_active":"2024-04-26T11:48:26.993267+0000","last_peered":"2024-04-26T11:48:26.993267+0000","last_clean":"2024-04-26T11:48:26.993267+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:26.993267+0000","last_undegraded":"2024-04-26T11:48:26.993267+0000","last_fullsized":"2024-04-26T11:48:26.993267+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'59","last_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_deep_scrub":"115'59","last_deep_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.993216+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:01.847961+0000","scrub_duration":0.0066337560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:22.028121+0000","last_change":"2024-04-26T11:48:22.028330+0000","last_active":"2024-04-26T11:48:22.028121+0000","last_peered":"2024-04-26T11:48:22.028121+0000","last_clean":"2024-04-26T11:48:22.028121+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:22.028121+0000","last_undegraded":"2024-04-26T11:48:22.028121+0000","last_fullsized":"2024-04-26T11:48:22.028121+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_clean_scrub_stamp":"2024-04-26T11:48:22.028073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:50.488548+0000","scrub_duration":0.0032986119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":485,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.378509+0000","last_change":"2024-04-26T11:47:36.443734+0000","last_active":"2024-04-26T11:48:11.378509+0000","last_peered":"2024-04-26T11:48:11.378509+0000","last_clean":"2024-04-26T11:48:11.378509+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:48:11.378509+0000","last_undegraded":"2024-04-26T11:48:11.378509+0000","last_fullsized":"2024-04-26T11:48:11.378509+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"115'72","reported_seq":91,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:15.150733+0000","last_change":"2024-04-26T11:48:15.150969+0000","last_active":"2024-04-26T11:48:15.150733+0000","last_peered":"2024-04-26T11:48:15.150733+0000","last_clean":"2024-04-26T11:48:15.150733+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:15.150733+0000","last_undegraded":"2024-04-26T11:48:15.150733+0000","last_fullsized":"2024-04-26T11:48:15.150733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'72","last_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_deep_scrub":"115'72","last_deep_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_clean_scrub_stamp":"2024-04-26T11:48:15.150680+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:41.664584+0000","scrub_duration":0.021253264000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":113,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592195+0000","last_change":"2024-04-26T11:44:17.037062+0000","last_active":"2024-04-26T11:48:11.592195+0000","last_peered":"2024-04-26T11:48:11.592195+0000","last_clean":"2024-04-26T11:48:11.592195+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:48:11.592195+0000","last_undegraded":"2024-04-26T11:48:11.592195+0000","last_fullsized":"2024-04-26T11:48:11.592195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":573,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:23.712478+0000","last_change":"2024-04-26T11:48:23.712478+0000","last_active":"2024-04-26T11:48:23.712478+0000","last_peered":"2024-04-26T11:48:23.712478+0000","last_clean":"2024-04-26T11:48:23.712478+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:23.712478+0000","last_undegraded":"2024-04-26T11:48:23.712478+0000","last_fullsized":"2024-04-26T11:48:23.712478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_clean_scrub_stamp":"2024-04-26T11:48:23.712095+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:55.117125+0000","scrub_duration":0.0051007090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":574,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593103+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:48:11.593103+0000","last_peered":"2024-04-26T11:48:11.593103+0000","last_clean":"2024-04-26T11:48:11.593103+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:48:11.593103+0000","last_undegraded":"2024-04-26T11:48:11.593103+0000","last_fullsized":"2024-04-26T11:48:11.593103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"115'416","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.029976+0000","last_change":"2024-04-26T11:48:36.029976+0000","last_active":"2024-04-26T11:48:36.029976+0000","last_peered":"2024-04-26T11:48:36.029976+0000","last_clean":"2024-04-26T11:48:36.029976+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:36.029976+0000","last_undegraded":"2024-04-26T11:48:36.029976+0000","last_fullsized":"2024-04-26T11:48:36.029976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'416","last_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_deep_scrub":"115'416","last_deep_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.029835+0000","objects_scrubbed":5,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:10.864228+0000","scrub_duration":0.034626879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":558,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:37.946554+0000","last_change":"2024-04-26T11:48:37.946809+0000","last_active":"2024-04-26T11:48:37.946554+0000","last_peered":"2024-04-26T11:48:37.946554+0000","last_clean":"2024-04-26T11:48:37.946554+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:37.946554+0000","last_undegraded":"2024-04-26T11:48:37.946554+0000","last_fullsized":"2024-04-26T11:48:37.946554+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'423","last_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_deep_scrub":"76'423","last_deep_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_clean_scrub_stamp":"2024-04-26T11:48:37.946505+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:45.776669+0000","scrub_duration":0.0044478900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'103","reported_seq":212,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.244614+0000","last_change":"2024-04-26T11:44:21.061957+0000","last_active":"2024-04-26T11:48:05.244614+0000","last_peered":"2024-04-26T11:48:05.244614+0000","last_clean":"2024-04-26T11:48:05.244614+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:48:05.244614+0000","last_undegraded":"2024-04-26T11:48:05.244614+0000","last_fullsized":"2024-04-26T11:48:05.244614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"115'335","reported_seq":479,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:03.180608+0000","last_change":"2024-04-26T11:49:03.180771+0000","last_active":"2024-04-26T11:49:03.180608+0000","last_peered":"2024-04-26T11:49:03.180608+0000","last_clean":"2024-04-26T11:49:03.180608+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:49:03.180608+0000","last_undegraded":"2024-04-26T11:49:03.180608+0000","last_fullsized":"2024-04-26T11:49:03.180608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'335","last_scrub_stamp":"2024-04-26T11:49:03.180575+0000","last_deep_scrub":"115'335","last_deep_scrub_stamp":"2024-04-26T11:49:03.180575+0000","last_clean_scrub_stamp":"2024-04-26T11:49:03.180575+0000","objects_scrubbed":1,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:20.897350+0000","scrub_duration":0.020406345999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":591,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.973031+0000","last_change":"2024-04-26T11:48:30.973251+0000","last_active":"2024-04-26T11:48:30.973031+0000","last_peered":"2024-04-26T11:48:30.973031+0000","last_clean":"2024-04-26T11:48:30.973031+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:30.973031+0000","last_undegraded":"2024-04-26T11:48:30.973031+0000","last_fullsized":"2024-04-26T11:48:30.973031+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'463","last_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_deep_scrub":"76'463","last_deep_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.972981+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:34.247031+0000","scrub_duration":0.0044136920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.018812+0000","last_change":"2024-04-26T11:48:12.019177+0000","last_active":"2024-04-26T11:48:12.018812+0000","last_peered":"2024-04-26T11:48:12.018812+0000","last_clean":"2024-04-26T11:48:12.018812+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:12.018812+0000","last_undegraded":"2024-04-26T11:48:12.018812+0000","last_fullsized":"2024-04-26T11:48:12.018812+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.018689+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:01.030509+0000","scrub_duration":0.0039670319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":587,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.005209+0000","last_change":"2024-04-26T11:48:30.005500+0000","last_active":"2024-04-26T11:48:30.005209+0000","last_peered":"2024-04-26T11:48:30.005209+0000","last_clean":"2024-04-26T11:48:30.005209+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:30.005209+0000","last_undegraded":"2024-04-26T11:48:30.005209+0000","last_fullsized":"2024-04-26T11:48:30.005209+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'447","last_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_deep_scrub":"76'447","last_deep_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.005160+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:09.022128+0000","scrub_duration":0.0044822300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":531,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:41.646917+0000","last_change":"2024-04-26T11:48:41.647158+0000","last_active":"2024-04-26T11:48:41.646917+0000","last_peered":"2024-04-26T11:48:41.646917+0000","last_clean":"2024-04-26T11:48:41.646917+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:41.646917+0000","last_undegraded":"2024-04-26T11:48:41.646917+0000","last_fullsized":"2024-04-26T11:48:41.646917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'366","last_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_deep_scrub":"76'366","last_deep_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_clean_scrub_stamp":"2024-04-26T11:48:41.646862+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:47.318788+0000","scrub_duration":0.0041890690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"115'776","reported_seq":889,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:05.101594+0000","last_change":"2024-04-26T11:49:05.101753+0000","last_active":"2024-04-26T11:49:05.101594+0000","last_peered":"2024-04-26T11:49:05.101594+0000","last_clean":"2024-04-26T11:49:05.101594+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:49:05.101594+0000","last_undegraded":"2024-04-26T11:49:05.101594+0000","last_fullsized":"2024-04-26T11:49:05.101594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'776","last_scrub_stamp":"2024-04-26T11:49:05.101560+0000","last_deep_scrub":"115'776","last_deep_scrub_stamp":"2024-04-26T11:49:05.101560+0000","last_clean_scrub_stamp":"2024-04-26T11:49:05.101560+0000","objects_scrubbed":2,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:23.999436+0000","scrub_duration":0.031574363000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":500,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.378929+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:48:11.378929+0000","last_peered":"2024-04-26T11:48:11.378929+0000","last_clean":"2024-04-26T11:48:11.378929+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:48:11.378929+0000","last_undegraded":"2024-04-26T11:48:11.378929+0000","last_fullsized":"2024-04-26T11:48:11.378929+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"115'329","reported_seq":445,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.155005+0000","last_change":"2024-04-26T11:49:07.155128+0000","last_active":"2024-04-26T11:49:07.155005+0000","last_peered":"2024-04-26T11:49:07.155005+0000","last_clean":"2024-04-26T11:49:07.155005+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:49:07.155005+0000","last_undegraded":"2024-04-26T11:49:07.155005+0000","last_fullsized":"2024-04-26T11:49:07.155005+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'329","last_scrub_stamp":"2024-04-26T11:49:07.154976+0000","last_deep_scrub":"115'329","last_deep_scrub_stamp":"2024-04-26T11:49:07.154976+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.154976+0000","objects_scrubbed":1,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:50.736767+0000","scrub_duration":0.017101642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":551,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:54.739823+0000","last_change":"2024-04-26T11:48:54.740054+0000","last_active":"2024-04-26T11:48:54.739823+0000","last_peered":"2024-04-26T11:48:54.739823+0000","last_clean":"2024-04-26T11:48:54.739823+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:54.739823+0000","last_undegraded":"2024-04-26T11:48:54.739823+0000","last_fullsized":"2024-04-26T11:48:54.739823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'385","last_scrub_stamp":"2024-04-26T11:48:54.739766+0000","last_deep_scrub":"76'385","last_deep_scrub_stamp":"2024-04-26T11:48:54.739766+0000","last_clean_scrub_stamp":"2024-04-26T11:48:54.739766+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:00.843817+0000","scrub_duration":0.0056441019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"115'354","reported_seq":503,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.792053+0000","last_change":"2024-04-26T11:49:07.792341+0000","last_active":"2024-04-26T11:49:07.792053+0000","last_peered":"2024-04-26T11:49:07.792053+0000","last_clean":"2024-04-26T11:49:07.792053+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:49:07.792053+0000","last_undegraded":"2024-04-26T11:49:07.792053+0000","last_fullsized":"2024-04-26T11:49:07.792053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'354","last_scrub_stamp":"2024-04-26T11:49:07.791996+0000","last_deep_scrub":"115'354","last_deep_scrub_stamp":"2024-04-26T11:49:07.791996+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.791996+0000","objects_scrubbed":3,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:03.875875+0000","scrub_duration":0.041359689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":866,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:29.698483+0000","last_change":"2024-04-26T11:48:29.698714+0000","last_active":"2024-04-26T11:48:29.698483+0000","last_peered":"2024-04-26T11:48:29.698483+0000","last_clean":"2024-04-26T11:48:29.698483+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:29.698483+0000","last_undegraded":"2024-04-26T11:48:29.698483+0000","last_fullsized":"2024-04-26T11:48:29.698483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'369","last_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_deep_scrub":"76'369","last_deep_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_clean_scrub_stamp":"2024-04-26T11:48:29.698434+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:04.873874+0000","scrub_duration":0.004418478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"71'57","reported_seq":166,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:05.243316+0000","last_change":"2024-04-26T11:44:21.063505+0000","last_active":"2024-04-26T11:48:05.243316+0000","last_peered":"2024-04-26T11:48:05.243316+0000","last_clean":"2024-04-26T11:48:05.243316+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:48:05.243316+0000","last_undegraded":"2024-04-26T11:48:05.243316+0000","last_fullsized":"2024-04-26T11:48:05.243316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":896,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:13.226572+0000","last_change":"2024-04-26T11:48:13.226901+0000","last_active":"2024-04-26T11:48:13.226572+0000","last_peered":"2024-04-26T11:48:13.226572+0000","last_clean":"2024-04-26T11:48:13.226572+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:13.226572+0000","last_undegraded":"2024-04-26T11:48:13.226572+0000","last_fullsized":"2024-04-26T11:48:13.226572+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'377","last_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_deep_scrub":"76'377","last_deep_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_clean_scrub_stamp":"2024-04-26T11:48:13.226463+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:03.708994+0000","scrub_duration":0.0044302090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"115'277","reported_seq":422,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.109084+0000","last_change":"2024-04-26T11:48:27.109273+0000","last_active":"2024-04-26T11:48:27.109084+0000","last_peered":"2024-04-26T11:48:27.109084+0000","last_clean":"2024-04-26T11:48:27.109084+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:27.109084+0000","last_undegraded":"2024-04-26T11:48:27.109084+0000","last_fullsized":"2024-04-26T11:48:27.109084+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'277","last_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_deep_scrub":"115'277","last_deep_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.109059+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:02.122709+0000","scrub_duration":0.021146224000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":913,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:34.042758+0000","last_change":"2024-04-26T11:48:34.042997+0000","last_active":"2024-04-26T11:48:34.042758+0000","last_peered":"2024-04-26T11:48:34.042758+0000","last_clean":"2024-04-26T11:48:34.042758+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:34.042758+0000","last_undegraded":"2024-04-26T11:48:34.042758+0000","last_fullsized":"2024-04-26T11:48:34.042758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'391","last_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_deep_scrub":"76'391","last_deep_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_clean_scrub_stamp":"2024-04-26T11:48:34.042706+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:24.193868+0000","scrub_duration":0.0052922139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"115'333","reported_seq":453,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:56.810880+0000","last_change":"2024-04-26T11:48:56.811047+0000","last_active":"2024-04-26T11:48:56.810880+0000","last_peered":"2024-04-26T11:48:56.810880+0000","last_clean":"2024-04-26T11:48:56.810880+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:56.810880+0000","last_undegraded":"2024-04-26T11:48:56.810880+0000","last_fullsized":"2024-04-26T11:48:56.810880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'333","last_scrub_stamp":"2024-04-26T11:48:56.810845+0000","last_deep_scrub":"115'333","last_deep_scrub_stamp":"2024-04-26T11:48:56.810845+0000","last_clean_scrub_stamp":"2024-04-26T11:48:56.810845+0000","objects_scrubbed":4,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.341984+0000","scrub_duration":0.0403226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":964,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:50.684116+0000","last_change":"2024-04-26T11:48:50.684402+0000","last_active":"2024-04-26T11:48:50.684116+0000","last_peered":"2024-04-26T11:48:50.684116+0000","last_clean":"2024-04-26T11:48:50.684116+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:50.684116+0000","last_undegraded":"2024-04-26T11:48:50.684116+0000","last_fullsized":"2024-04-26T11:48:50.684116+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:50.684066+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:50.684066+0000","last_clean_scrub_stamp":"2024-04-26T11:48:50.684066+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:36.226053+0000","scrub_duration":0.0045709319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.378373+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:48:11.378373+0000","last_peered":"2024-04-26T11:48:11.378373+0000","last_clean":"2024-04-26T11:48:11.378373+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:48:11.378373+0000","last_undegraded":"2024-04-26T11:48:11.378373+0000","last_fullsized":"2024-04-26T11:48:11.378373+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":992,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:02.136234+0000","last_change":"2024-04-26T11:49:02.136503+0000","last_active":"2024-04-26T11:49:02.136234+0000","last_peered":"2024-04-26T11:49:02.136234+0000","last_clean":"2024-04-26T11:49:02.136234+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:49:02.136234+0000","last_undegraded":"2024-04-26T11:49:02.136234+0000","last_fullsized":"2024-04-26T11:49:02.136234+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'436","last_scrub_stamp":"2024-04-26T11:49:02.136184+0000","last_deep_scrub":"76'436","last_deep_scrub_stamp":"2024-04-26T11:49:02.136184+0000","last_clean_scrub_stamp":"2024-04-26T11:49:02.136184+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:14.675035+0000","scrub_duration":0.0045192979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"74'54","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:04.470456+0000","last_change":"2024-04-26T11:47:11.519569+0000","last_active":"2024-04-26T11:48:04.470456+0000","last_peered":"2024-04-26T11:48:04.470456+0000","last_clean":"2024-04-26T11:48:04.470456+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:48:04.470456+0000","last_undegraded":"2024-04-26T11:48:04.470456+0000","last_fullsized":"2024-04-26T11:48:04.470456+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7912,"ondisk_log_size":7912,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200496,"kb_used_data":89064,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171344,"statfs":{"total":96636764160,"available":96431456256,"internally_reserved":0,"allocated":91201536,"data_stored":90584365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69199999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77400000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.624}]},{"osd":1,"last update":"Fri Apr 26 11:48:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64900000000000002}]}]},{"osd":1,"up_from":72,"seq":309237645338,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125616,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246224,"statfs":{"total":96636764160,"available":96508133376,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.629},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.70099999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190668,"kb_used_data":83332,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181172,"statfs":{"total":96636764160,"available":96441520128,"internally_reserved":0,"allocated":85331968,"data_stored":84726408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.622},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Apr 26 11:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.64500000000000002,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66500000000000004,"15min":0.69299999999999995},"min":{"1min":0.54400000000000004,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77200000000000002,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:49:13.042 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.042 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.042 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.042 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.043 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.043 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.043 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.043 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.043 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.043 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.043 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.043 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.044 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.044 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.044 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.044 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.044 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.044 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.044 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.045 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.045 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.045 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.045 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.045 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.045 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.045 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T11:44:10.975511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.045 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.045 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.046 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.046 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.046 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.046 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.046 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.046 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.046 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.046 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.047 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.047 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.047 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.047 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.047 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.047 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.047 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.048 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:13.048 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:49:33.049 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:49:33.379 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:49:33.382 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:49:33.395 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-04-26T11:49:32.085916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34134,"ondisk_log_size":34134,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516780,"kb_used_data":252436,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598740,"statfs":{"total":289910292480,"available":289381109760,"internally_reserved":0,"allocated":258494464,"data_stored":256676283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004476"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":963,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595322+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:48:10.595322+0000","last_peered":"2024-04-26T11:48:10.595322+0000","last_clean":"2024-04-26T11:48:10.595322+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:48:10.595322+0000","last_undegraded":"2024-04-26T11:48:10.595322+0000","last_fullsized":"2024-04-26T11:48:10.595322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1020,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595346+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:48:10.595346+0000","last_peered":"2024-04-26T11:48:10.595346+0000","last_clean":"2024-04-26T11:48:10.595346+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:48:10.595346+0000","last_undegraded":"2024-04-26T11:48:10.595346+0000","last_fullsized":"2024-04-26T11:48:10.595346+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593307+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:11.593307+0000","last_peered":"2024-04-26T11:48:11.593307+0000","last_clean":"2024-04-26T11:48:11.593307+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:11.593307+0000","last_undegraded":"2024-04-26T11:48:11.593307+0000","last_fullsized":"2024-04-26T11:48:11.593307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":841,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593170+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:11.593170+0000","last_peered":"2024-04-26T11:48:11.593170+0000","last_clean":"2024-04-26T11:48:11.593170+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:11.593170+0000","last_undegraded":"2024-04-26T11:48:11.593170+0000","last_fullsized":"2024-04-26T11:48:11.593170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":919,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595308+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:48:10.595308+0000","last_peered":"2024-04-26T11:48:10.595308+0000","last_clean":"2024-04-26T11:48:10.595308+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:48:10.595308+0000","last_undegraded":"2024-04-26T11:48:10.595308+0000","last_fullsized":"2024-04-26T11:48:10.595308+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":847,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593382+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:48:11.593382+0000","last_peered":"2024-04-26T11:48:11.593382+0000","last_clean":"2024-04-26T11:48:11.593382+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:48:11.593382+0000","last_undegraded":"2024-04-26T11:48:11.593382+0000","last_fullsized":"2024-04-26T11:48:11.593382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1039,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593096+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:48:11.593096+0000","last_peered":"2024-04-26T11:48:11.593096+0000","last_clean":"2024-04-26T11:48:11.593096+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:48:11.593096+0000","last_undegraded":"2024-04-26T11:48:11.593096+0000","last_fullsized":"2024-04-26T11:48:11.593096+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":848,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593128+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:11.593128+0000","last_peered":"2024-04-26T11:48:11.593128+0000","last_clean":"2024-04-26T11:48:11.593128+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:11.593128+0000","last_undegraded":"2024-04-26T11:48:11.593128+0000","last_fullsized":"2024-04-26T11:48:11.593128+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":554,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:33.918517+0000","last_change":"2024-04-26T11:48:33.918870+0000","last_active":"2024-04-26T11:48:33.918517+0000","last_peered":"2024-04-26T11:48:33.918517+0000","last_clean":"2024-04-26T11:48:33.918517+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:33.918517+0000","last_undegraded":"2024-04-26T11:48:33.918517+0000","last_fullsized":"2024-04-26T11:48:33.918517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'421","last_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_deep_scrub":"77'421","last_deep_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:33.918413+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:33.584386+0000","scrub_duration":0.0044004430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":962,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595356+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:48:10.595356+0000","last_peered":"2024-04-26T11:48:10.595356+0000","last_clean":"2024-04-26T11:48:10.595356+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:48:10.595356+0000","last_undegraded":"2024-04-26T11:48:10.595356+0000","last_fullsized":"2024-04-26T11:48:10.595356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":875,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593069+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:48:11.593069+0000","last_peered":"2024-04-26T11:48:11.593069+0000","last_clean":"2024-04-26T11:48:11.593069+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:48:11.593069+0000","last_undegraded":"2024-04-26T11:48:11.593069+0000","last_fullsized":"2024-04-26T11:48:11.593069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":504,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.699169+0000","last_change":"2024-04-26T11:48:10.699169+0000","last_active":"2024-04-26T11:48:10.699169+0000","last_peered":"2024-04-26T11:48:10.699169+0000","last_clean":"2024-04-26T11:48:10.699169+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:10.699169+0000","last_undegraded":"2024-04-26T11:48:10.699169+0000","last_fullsized":"2024-04-26T11:48:10.699169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'345","last_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_deep_scrub":"76'345","last_deep_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_clean_scrub_stamp":"2024-04-26T11:48:10.698866+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:11.706179+0000","scrub_duration":0.0058868610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":895,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595245+0000","last_change":"2024-04-26T11:47:20.157330+0000","last_active":"2024-04-26T11:48:10.595245+0000","last_peered":"2024-04-26T11:48:10.595245+0000","last_clean":"2024-04-26T11:48:10.595245+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:48:10.595245+0000","last_undegraded":"2024-04-26T11:48:10.595245+0000","last_fullsized":"2024-04-26T11:48:10.595245+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":576,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.180736+0000","last_change":"2024-04-26T11:48:12.180736+0000","last_active":"2024-04-26T11:48:12.180736+0000","last_peered":"2024-04-26T11:48:12.180736+0000","last_clean":"2024-04-26T11:48:12.180736+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:12.180736+0000","last_undegraded":"2024-04-26T11:48:12.180736+0000","last_fullsized":"2024-04-26T11:48:12.180736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'418","last_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_deep_scrub":"76'418","last_deep_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.180413+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.283252+0000","scrub_duration":0.0053701490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":618,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.057064+0000","last_change":"2024-04-26T11:48:26.057064+0000","last_active":"2024-04-26T11:48:26.057064+0000","last_peered":"2024-04-26T11:48:26.057064+0000","last_clean":"2024-04-26T11:48:26.057064+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:26.057064+0000","last_undegraded":"2024-04-26T11:48:26.057064+0000","last_fullsized":"2024-04-26T11:48:26.057064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'428","last_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_deep_scrub":"76'428","last_deep_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.056732+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:01.294605+0000","scrub_duration":0.0057736879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1062,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592977+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:48:11.592977+0000","last_peered":"2024-04-26T11:48:11.592977+0000","last_clean":"2024-04-26T11:48:11.592977+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:48:11.592977+0000","last_undegraded":"2024-04-26T11:48:11.592977+0000","last_fullsized":"2024-04-26T11:48:11.592977+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":523,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.949389+0000","last_change":"2024-04-26T11:48:27.949389+0000","last_active":"2024-04-26T11:48:27.949389+0000","last_peered":"2024-04-26T11:48:27.949389+0000","last_clean":"2024-04-26T11:48:27.949389+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:27.949389+0000","last_undegraded":"2024-04-26T11:48:27.949389+0000","last_fullsized":"2024-04-26T11:48:27.949389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.948898+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:29.597751+0000","scrub_duration":0.0043304119999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":927,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595205+0000","last_change":"2024-04-26T11:47:38.156085+0000","last_active":"2024-04-26T11:48:10.595205+0000","last_peered":"2024-04-26T11:48:10.595205+0000","last_clean":"2024-04-26T11:48:10.595205+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:48:10.595205+0000","last_undegraded":"2024-04-26T11:48:10.595205+0000","last_fullsized":"2024-04-26T11:48:10.595205+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":544,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:01.026835+0000","last_change":"2024-04-26T11:49:01.026835+0000","last_active":"2024-04-26T11:49:01.026835+0000","last_peered":"2024-04-26T11:49:01.026835+0000","last_clean":"2024-04-26T11:49:01.026835+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:49:01.026835+0000","last_undegraded":"2024-04-26T11:49:01.026835+0000","last_fullsized":"2024-04-26T11:49:01.026835+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:49:01.026549+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:49:01.026549+0000","last_clean_scrub_stamp":"2024-04-26T11:49:01.026549+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:07.466257+0000","scrub_duration":0.0042339500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1027,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.158150+0000","last_change":"2024-04-26T11:49:07.158425+0000","last_active":"2024-04-26T11:49:07.158150+0000","last_peered":"2024-04-26T11:49:07.158150+0000","last_clean":"2024-04-26T11:49:07.158150+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:49:07.158150+0000","last_undegraded":"2024-04-26T11:49:07.158150+0000","last_fullsized":"2024-04-26T11:49:07.158150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'441","last_scrub_stamp":"2024-04-26T11:49:07.158098+0000","last_deep_scrub":"76'441","last_deep_scrub_stamp":"2024-04-26T11:49:07.158098+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.158098+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:31.523066+0000","scrub_duration":0.0045499240000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":941,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:40.997248+0000","last_change":"2024-04-26T11:48:40.997248+0000","last_active":"2024-04-26T11:48:40.997248+0000","last_peered":"2024-04-26T11:48:40.997248+0000","last_clean":"2024-04-26T11:48:40.997248+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:40.997248+0000","last_undegraded":"2024-04-26T11:48:40.997248+0000","last_fullsized":"2024-04-26T11:48:40.997248+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'404","last_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_deep_scrub":"76'404","last_deep_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_clean_scrub_stamp":"2024-04-26T11:48:40.996775+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:28.668510+0000","scrub_duration":0.0044704089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":590,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.703736+0000","last_change":"2024-04-26T11:48:16.703736+0000","last_active":"2024-04-26T11:48:16.703736+0000","last_peered":"2024-04-26T11:48:16.703736+0000","last_clean":"2024-04-26T11:48:16.703736+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:16.703736+0000","last_undegraded":"2024-04-26T11:48:16.703736+0000","last_fullsized":"2024-04-26T11:48:16.703736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.703427+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:09.548341+0000","scrub_duration":0.0060063829999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:20.145425+0000","last_change":"2024-04-26T11:49:20.145425+0000","last_active":"2024-04-26T11:49:20.145425+0000","last_peered":"2024-04-26T11:49:20.145425+0000","last_clean":"2024-04-26T11:49:20.145425+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:49:20.145425+0000","last_undegraded":"2024-04-26T11:49:20.145425+0000","last_fullsized":"2024-04-26T11:49:20.145425+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-26T11:49:20.145133+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-26T11:49:20.145133+0000","last_clean_scrub_stamp":"2024-04-26T11:49:20.145133+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:29.007352+0000","scrub_duration":0.0047260169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1034,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595090+0000","last_change":"2024-04-26T11:47:37.159075+0000","last_active":"2024-04-26T11:48:10.595090+0000","last_peered":"2024-04-26T11:48:10.595090+0000","last_clean":"2024-04-26T11:48:10.595090+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:48:10.595090+0000","last_undegraded":"2024-04-26T11:48:10.595090+0000","last_fullsized":"2024-04-26T11:48:10.595090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:27.680697+0000","last_change":"2024-04-26T11:49:27.680967+0000","last_active":"2024-04-26T11:49:27.680697+0000","last_peered":"2024-04-26T11:49:27.680697+0000","last_clean":"2024-04-26T11:49:27.680697+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:49:27.680697+0000","last_undegraded":"2024-04-26T11:49:27.680697+0000","last_fullsized":"2024-04-26T11:49:27.680697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:49:27.680647+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:49:27.680647+0000","last_clean_scrub_stamp":"2024-04-26T11:49:27.680647+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:03.491704+0000","scrub_duration":0.0047388680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":623,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.379126+0000","last_change":"2024-04-26T11:47:42.470818+0000","last_active":"2024-04-26T11:48:11.379126+0000","last_peered":"2024-04-26T11:48:11.379126+0000","last_clean":"2024-04-26T11:48:11.379126+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:48:11.379126+0000","last_undegraded":"2024-04-26T11:48:11.379126+0000","last_fullsized":"2024-04-26T11:48:11.379126+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.159519+0000","last_change":"2024-04-26T11:48:20.159519+0000","last_active":"2024-04-26T11:48:20.159519+0000","last_peered":"2024-04-26T11:48:20.159519+0000","last_clean":"2024-04-26T11:48:20.159519+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:20.159519+0000","last_undegraded":"2024-04-26T11:48:20.159519+0000","last_fullsized":"2024-04-26T11:48:20.159519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.159224+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:05.701212+0000","scrub_duration":0.0055914299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":609,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:57.742786+0000","last_change":"2024-04-26T11:48:57.743169+0000","last_active":"2024-04-26T11:48:57.742786+0000","last_peered":"2024-04-26T11:48:57.742786+0000","last_clean":"2024-04-26T11:48:57.742786+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:57.742786+0000","last_undegraded":"2024-04-26T11:48:57.742786+0000","last_fullsized":"2024-04-26T11:48:57.742786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'398","last_scrub_stamp":"2024-04-26T11:48:57.742669+0000","last_deep_scrub":"76'398","last_deep_scrub_stamp":"2024-04-26T11:48:57.742669+0000","last_clean_scrub_stamp":"2024-04-26T11:48:57.742669+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:32.756319+0000","scrub_duration":0.0055375609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":521,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:12.111381+0000","last_change":"2024-04-26T11:49:12.111381+0000","last_active":"2024-04-26T11:49:12.111381+0000","last_peered":"2024-04-26T11:49:12.111381+0000","last_clean":"2024-04-26T11:49:12.111381+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:49:12.111381+0000","last_undegraded":"2024-04-26T11:49:12.111381+0000","last_fullsized":"2024-04-26T11:49:12.111381+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'384","last_scrub_stamp":"2024-04-26T11:49:12.111081+0000","last_deep_scrub":"76'384","last_deep_scrub_stamp":"2024-04-26T11:49:12.111081+0000","last_clean_scrub_stamp":"2024-04-26T11:49:12.111081+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:26.233239+0000","scrub_duration":0.0042686479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":638,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:42.691464+0000","last_change":"2024-04-26T11:48:42.691846+0000","last_active":"2024-04-26T11:48:42.691464+0000","last_peered":"2024-04-26T11:48:42.691464+0000","last_clean":"2024-04-26T11:48:42.691464+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:42.691464+0000","last_undegraded":"2024-04-26T11:48:42.691464+0000","last_fullsized":"2024-04-26T11:48:42.691464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'467","last_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_deep_scrub":"76'467","last_deep_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_clean_scrub_stamp":"2024-04-26T11:48:42.691415+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:34.091246+0000","scrub_duration":0.0058108070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":586,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:57.122777+0000","last_change":"2024-04-26T11:48:57.122777+0000","last_active":"2024-04-26T11:48:57.122777+0000","last_peered":"2024-04-26T11:48:57.122777+0000","last_clean":"2024-04-26T11:48:57.122777+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:57.122777+0000","last_undegraded":"2024-04-26T11:48:57.122777+0000","last_fullsized":"2024-04-26T11:48:57.122777+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'429","last_scrub_stamp":"2024-04-26T11:48:57.122503+0000","last_deep_scrub":"76'429","last_deep_scrub_stamp":"2024-04-26T11:48:57.122503+0000","last_clean_scrub_stamp":"2024-04-26T11:48:57.122503+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:41.507208+0000","scrub_duration":0.0037513580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":963,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.161557+0000","last_change":"2024-04-26T11:48:16.161557+0000","last_active":"2024-04-26T11:48:16.161557+0000","last_peered":"2024-04-26T11:48:16.161557+0000","last_clean":"2024-04-26T11:48:16.161557+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:16.161557+0000","last_undegraded":"2024-04-26T11:48:16.161557+0000","last_fullsized":"2024-04-26T11:48:16.161557+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'412","last_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_deep_scrub":"76'412","last_deep_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.161259+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:19.609307+0000","scrub_duration":0.005601534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":855,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:46.658998+0000","last_change":"2024-04-26T11:48:46.658998+0000","last_active":"2024-04-26T11:48:46.658998+0000","last_peered":"2024-04-26T11:48:46.658998+0000","last_clean":"2024-04-26T11:48:46.658998+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:46.658998+0000","last_undegraded":"2024-04-26T11:48:46.658998+0000","last_fullsized":"2024-04-26T11:48:46.658998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'370","last_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_deep_scrub":"76'370","last_deep_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_clean_scrub_stamp":"2024-04-26T11:48:46.658495+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:50.106542+0000","scrub_duration":0.0045947180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"115'492","reported_seq":640,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:39.978630+0000","last_change":"2024-04-26T11:48:39.978630+0000","last_active":"2024-04-26T11:48:39.978630+0000","last_peered":"2024-04-26T11:48:39.978630+0000","last_clean":"2024-04-26T11:48:39.978630+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:39.978630+0000","last_undegraded":"2024-04-26T11:48:39.978630+0000","last_fullsized":"2024-04-26T11:48:39.978630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'492","last_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_deep_scrub":"115'492","last_deep_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_clean_scrub_stamp":"2024-04-26T11:48:39.978491+0000","objects_scrubbed":4,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:30.699411+0000","scrub_duration":0.028156690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":994,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.672399+0000","last_change":"2024-04-26T11:48:36.672399+0000","last_active":"2024-04-26T11:48:36.672399+0000","last_peered":"2024-04-26T11:48:36.672399+0000","last_clean":"2024-04-26T11:48:36.672399+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:36.672399+0000","last_undegraded":"2024-04-26T11:48:36.672399+0000","last_fullsized":"2024-04-26T11:48:36.672399+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'411","last_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_deep_scrub":"76'411","last_deep_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.672084+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:47.824742+0000","scrub_duration":0.0043867059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":77,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:55.128485+0000","last_change":"2024-04-26T11:48:55.128485+0000","last_active":"2024-04-26T11:48:55.128485+0000","last_peered":"2024-04-26T11:48:55.128485+0000","last_clean":"2024-04-26T11:48:55.128485+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:55.128485+0000","last_undegraded":"2024-04-26T11:48:55.128485+0000","last_fullsized":"2024-04-26T11:48:55.128485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:55.128180+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:55.128180+0000","last_clean_scrub_stamp":"2024-04-26T11:48:55.128180+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:20.475572+0000","scrub_duration":0.0032158289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":527,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.973329+0000","last_change":"2024-04-26T11:48:38.973582+0000","last_active":"2024-04-26T11:48:38.973329+0000","last_peered":"2024-04-26T11:48:38.973329+0000","last_clean":"2024-04-26T11:48:38.973329+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:38.973329+0000","last_undegraded":"2024-04-26T11:48:38.973329+0000","last_fullsized":"2024-04-26T11:48:38.973329+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.973282+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:59.469110+0000","scrub_duration":0.0046745279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":181,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:23.744022+0000","last_change":"2024-04-26T11:49:23.744279+0000","last_active":"2024-04-26T11:49:23.744022+0000","last_peered":"2024-04-26T11:49:23.744022+0000","last_clean":"2024-04-26T11:49:23.744022+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:49:23.744022+0000","last_undegraded":"2024-04-26T11:49:23.744022+0000","last_fullsized":"2024-04-26T11:49:23.744022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'60","last_scrub_stamp":"2024-04-26T11:49:23.743971+0000","last_deep_scrub":"71'60","last_deep_scrub_stamp":"2024-04-26T11:49:23.743971+0000","last_clean_scrub_stamp":"2024-04-26T11:49:23.743971+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:24.577731+0000","scrub_duration":0.0030668650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":562,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:51.006568+0000","last_change":"2024-04-26T11:48:51.006799+0000","last_active":"2024-04-26T11:48:51.006568+0000","last_peered":"2024-04-26T11:48:51.006568+0000","last_clean":"2024-04-26T11:48:51.006568+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:51.006568+0000","last_undegraded":"2024-04-26T11:48:51.006568+0000","last_fullsized":"2024-04-26T11:48:51.006568+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:51.006513+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:51.006513+0000","last_clean_scrub_stamp":"2024-04-26T11:48:51.006513+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:16.562657+0000","scrub_duration":0.0040201380000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"115'71","reported_seq":192,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:58.169654+0000","last_change":"2024-04-26T11:48:58.169654+0000","last_active":"2024-04-26T11:48:58.169654+0000","last_peered":"2024-04-26T11:48:58.169654+0000","last_clean":"2024-04-26T11:48:58.169654+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:58.169654+0000","last_undegraded":"2024-04-26T11:48:58.169654+0000","last_fullsized":"2024-04-26T11:48:58.169654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'71","last_scrub_stamp":"2024-04-26T11:48:58.169317+0000","last_deep_scrub":"115'71","last_deep_scrub_stamp":"2024-04-26T11:48:58.169317+0000","last_clean_scrub_stamp":"2024-04-26T11:48:58.169317+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:30.105511+0000","scrub_duration":0.010931368,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"115'216","reported_seq":337,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:52.101678+0000","last_change":"2024-04-26T11:48:52.101678+0000","last_active":"2024-04-26T11:48:52.101678+0000","last_peered":"2024-04-26T11:48:52.101678+0000","last_clean":"2024-04-26T11:48:52.101678+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:52.101678+0000","last_undegraded":"2024-04-26T11:48:52.101678+0000","last_fullsized":"2024-04-26T11:48:52.101678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'216","last_scrub_stamp":"2024-04-26T11:48:52.101470+0000","last_deep_scrub":"115'216","last_deep_scrub_stamp":"2024-04-26T11:48:52.101470+0000","last_clean_scrub_stamp":"2024-04-26T11:48:52.101470+0000","objects_scrubbed":2,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:52.935231+0000","scrub_duration":0.022234593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":553,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.700459+0000","last_change":"2024-04-26T11:48:19.700459+0000","last_active":"2024-04-26T11:48:19.700459+0000","last_peered":"2024-04-26T11:48:19.700459+0000","last_clean":"2024-04-26T11:48:19.700459+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:19.700459+0000","last_undegraded":"2024-04-26T11:48:19.700459+0000","last_fullsized":"2024-04-26T11:48:19.700459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.700054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:19.776698+0000","scrub_duration":0.0059321139999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"115'394","reported_seq":515,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:21.771172+0000","last_change":"2024-04-26T11:49:21.771295+0000","last_active":"2024-04-26T11:49:21.771172+0000","last_peered":"2024-04-26T11:49:21.771172+0000","last_clean":"2024-04-26T11:49:21.771172+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:49:21.771172+0000","last_undegraded":"2024-04-26T11:49:21.771172+0000","last_fullsized":"2024-04-26T11:49:21.771172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'394","last_scrub_stamp":"2024-04-26T11:49:21.771148+0000","last_deep_scrub":"115'394","last_deep_scrub_stamp":"2024-04-26T11:49:21.771148+0000","last_clean_scrub_stamp":"2024-04-26T11:49:21.771148+0000","objects_scrubbed":2,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:17.795675+0000","scrub_duration":0.022322965,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1044,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:49.652705+0000","last_change":"2024-04-26T11:48:49.652958+0000","last_active":"2024-04-26T11:48:49.652705+0000","last_peered":"2024-04-26T11:48:49.652705+0000","last_clean":"2024-04-26T11:48:49.652705+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:49.652705+0000","last_undegraded":"2024-04-26T11:48:49.652705+0000","last_fullsized":"2024-04-26T11:48:49.652705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'453","last_scrub_stamp":"2024-04-26T11:48:49.652654+0000","last_deep_scrub":"76'453","last_deep_scrub_stamp":"2024-04-26T11:48:49.652654+0000","last_clean_scrub_stamp":"2024-04-26T11:48:49.652654+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.485049+0000","scrub_duration":0.0048848520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"115'588","reported_seq":709,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:47.006099+0000","last_change":"2024-04-26T11:48:47.006099+0000","last_active":"2024-04-26T11:48:47.006099+0000","last_peered":"2024-04-26T11:48:47.006099+0000","last_clean":"2024-04-26T11:48:47.006099+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:47.006099+0000","last_undegraded":"2024-04-26T11:48:47.006099+0000","last_fullsized":"2024-04-26T11:48:47.006099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'588","last_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_deep_scrub":"115'588","last_deep_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_clean_scrub_stamp":"2024-04-26T11:48:47.005948+0000","objects_scrubbed":2,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:57.335372+0000","scrub_duration":0.022816893000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1028,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.113972+0000","last_change":"2024-04-26T11:48:19.113972+0000","last_active":"2024-04-26T11:48:19.113972+0000","last_peered":"2024-04-26T11:48:19.113972+0000","last_clean":"2024-04-26T11:48:19.113972+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:19.113972+0000","last_undegraded":"2024-04-26T11:48:19.113972+0000","last_fullsized":"2024-04-26T11:48:19.113972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'446","last_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_deep_scrub":"76'446","last_deep_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.113630+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:18.946024+0000","scrub_duration":0.0051973490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":185,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592314+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:48:11.592314+0000","last_peered":"2024-04-26T11:48:11.592314+0000","last_clean":"2024-04-26T11:48:11.592314+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:48:11.592314+0000","last_undegraded":"2024-04-26T11:48:11.592314+0000","last_fullsized":"2024-04-26T11:48:11.592314+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":622,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.378570+0000","last_change":"2024-04-26T11:47:22.471774+0000","last_active":"2024-04-26T11:48:11.378570+0000","last_peered":"2024-04-26T11:48:11.378570+0000","last_clean":"2024-04-26T11:48:11.378570+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:48:11.378570+0000","last_undegraded":"2024-04-26T11:48:11.378570+0000","last_fullsized":"2024-04-26T11:48:11.378570+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"115'265","reported_seq":388,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:54.113217+0000","last_change":"2024-04-26T11:48:54.113217+0000","last_active":"2024-04-26T11:48:54.113217+0000","last_peered":"2024-04-26T11:48:54.113217+0000","last_clean":"2024-04-26T11:48:54.113217+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:54.113217+0000","last_undegraded":"2024-04-26T11:48:54.113217+0000","last_fullsized":"2024-04-26T11:48:54.113217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'265","last_scrub_stamp":"2024-04-26T11:48:54.113037+0000","last_deep_scrub":"115'265","last_deep_scrub_stamp":"2024-04-26T11:48:54.113037+0000","last_clean_scrub_stamp":"2024-04-26T11:48:54.113037+0000","objects_scrubbed":3,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:56.229153+0000","scrub_duration":0.024456727000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":975,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.998461+0000","last_change":"2024-04-26T11:48:38.998461+0000","last_active":"2024-04-26T11:48:38.998461+0000","last_peered":"2024-04-26T11:48:38.998461+0000","last_clean":"2024-04-26T11:48:38.998461+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:38.998461+0000","last_undegraded":"2024-04-26T11:48:38.998461+0000","last_fullsized":"2024-04-26T11:48:38.998461+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.998146+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:36.290726+0000","scrub_duration":0.0044019580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"74'151","reported_seq":285,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592372+0000","last_change":"2024-04-26T11:47:14.138396+0000","last_active":"2024-04-26T11:48:11.592372+0000","last_peered":"2024-04-26T11:48:11.592372+0000","last_clean":"2024-04-26T11:48:11.592372+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:48:11.592372+0000","last_undegraded":"2024-04-26T11:48:11.592372+0000","last_fullsized":"2024-04-26T11:48:11.592372+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":561,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:24.108717+0000","last_change":"2024-04-26T11:48:24.108717+0000","last_active":"2024-04-26T11:48:24.108717+0000","last_peered":"2024-04-26T11:48:24.108717+0000","last_clean":"2024-04-26T11:48:24.108717+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:24.108717+0000","last_undegraded":"2024-04-26T11:48:24.108717+0000","last_fullsized":"2024-04-26T11:48:24.108717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'403","last_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_deep_scrub":"76'403","last_deep_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_clean_scrub_stamp":"2024-04-26T11:48:24.108430+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:30.212481+0000","scrub_duration":0.0053830830000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":175,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:12.648989+0000","last_change":"2024-04-26T11:49:12.649213+0000","last_active":"2024-04-26T11:49:12.648989+0000","last_peered":"2024-04-26T11:49:12.648989+0000","last_clean":"2024-04-26T11:49:12.648989+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:49:12.648989+0000","last_undegraded":"2024-04-26T11:49:12.648989+0000","last_fullsized":"2024-04-26T11:49:12.648989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'54","last_scrub_stamp":"2024-04-26T11:49:12.648939+0000","last_deep_scrub":"74'54","last_deep_scrub_stamp":"2024-04-26T11:49:12.648939+0000","last_clean_scrub_stamp":"2024-04-26T11:49:12.648939+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:47.900978+0000","scrub_duration":0.0033501189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:56.094293+0000","last_change":"2024-04-26T11:48:56.094523+0000","last_active":"2024-04-26T11:48:56.094293+0000","last_peered":"2024-04-26T11:48:56.094293+0000","last_clean":"2024-04-26T11:48:56.094293+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:56.094293+0000","last_undegraded":"2024-04-26T11:48:56.094293+0000","last_fullsized":"2024-04-26T11:48:56.094293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:56.094222+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:56.094222+0000","last_clean_scrub_stamp":"2024-04-26T11:48:56.094222+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:23.069438+0000","scrub_duration":0.0055997750000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"115'503","reported_seq":648,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:04.703888+0000","last_change":"2024-04-26T11:49:04.704018+0000","last_active":"2024-04-26T11:49:04.703888+0000","last_peered":"2024-04-26T11:49:04.703888+0000","last_clean":"2024-04-26T11:49:04.703888+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:49:04.703888+0000","last_undegraded":"2024-04-26T11:49:04.703888+0000","last_fullsized":"2024-04-26T11:49:04.703888+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'503","last_scrub_stamp":"2024-04-26T11:49:04.703858+0000","last_deep_scrub":"115'503","last_deep_scrub_stamp":"2024-04-26T11:49:04.703858+0000","last_clean_scrub_stamp":"2024-04-26T11:49:04.703858+0000","objects_scrubbed":1,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:48.123926+0000","scrub_duration":0.021316572999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":527,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.378591+0000","last_change":"2024-04-26T11:47:27.448187+0000","last_active":"2024-04-26T11:48:11.378591+0000","last_peered":"2024-04-26T11:48:11.378591+0000","last_clean":"2024-04-26T11:48:11.378591+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:48:11.378591+0000","last_undegraded":"2024-04-26T11:48:11.378591+0000","last_fullsized":"2024-04-26T11:48:11.378591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"115'159","reported_seq":325,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:20.228841+0000","last_change":"2024-04-26T11:49:20.229163+0000","last_active":"2024-04-26T11:49:20.228841+0000","last_peered":"2024-04-26T11:49:20.228841+0000","last_clean":"2024-04-26T11:49:20.228841+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:49:20.228841+0000","last_undegraded":"2024-04-26T11:49:20.228841+0000","last_fullsized":"2024-04-26T11:49:20.228841+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'159","last_scrub_stamp":"2024-04-26T11:49:20.228749+0000","last_deep_scrub":"115'159","last_deep_scrub_stamp":"2024-04-26T11:49:20.228749+0000","last_clean_scrub_stamp":"2024-04-26T11:49:20.228749+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:04.854303+0000","scrub_duration":0.010785144999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":126,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592201+0000","last_change":"2024-04-26T11:47:11.151872+0000","last_active":"2024-04-26T11:48:11.592201+0000","last_peered":"2024-04-26T11:48:11.592201+0000","last_clean":"2024-04-26T11:48:11.592201+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:48:11.592201+0000","last_undegraded":"2024-04-26T11:48:11.592201+0000","last_fullsized":"2024-04-26T11:48:11.592201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"71'507","reported_seq":616,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.378009+0000","last_change":"2024-04-26T11:47:14.427294+0000","last_active":"2024-04-26T11:48:11.378009+0000","last_peered":"2024-04-26T11:48:11.378009+0000","last_clean":"2024-04-26T11:48:11.378009+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:48:11.378009+0000","last_undegraded":"2024-04-26T11:48:11.378009+0000","last_fullsized":"2024-04-26T11:48:11.378009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":587,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:50.024734+0000","last_change":"2024-04-26T11:48:50.024898+0000","last_active":"2024-04-26T11:48:50.024734+0000","last_peered":"2024-04-26T11:48:50.024734+0000","last_clean":"2024-04-26T11:48:50.024734+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:50.024734+0000","last_undegraded":"2024-04-26T11:48:50.024734+0000","last_fullsized":"2024-04-26T11:48:50.024734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'432","last_scrub_stamp":"2024-04-26T11:48:50.024692+0000","last_deep_scrub":"76'432","last_deep_scrub_stamp":"2024-04-26T11:48:50.024692+0000","last_clean_scrub_stamp":"2024-04-26T11:48:50.024692+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:46.049218+0000","scrub_duration":0.0041890069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:21.209259+0000","last_change":"2024-04-26T11:49:21.209613+0000","last_active":"2024-04-26T11:49:21.209259+0000","last_peered":"2024-04-26T11:49:21.209259+0000","last_clean":"2024-04-26T11:49:21.209259+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:49:21.209259+0000","last_undegraded":"2024-04-26T11:49:21.209259+0000","last_fullsized":"2024-04-26T11:49:21.209259+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:21.209173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:21.209173+0000","last_clean_scrub_stamp":"2024-04-26T11:49:21.209173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:17.766301+0000","scrub_duration":0.0034167590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"115'169","reported_seq":380,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:06.101923+0000","last_change":"2024-04-26T11:49:06.101923+0000","last_active":"2024-04-26T11:49:06.101923+0000","last_peered":"2024-04-26T11:49:06.101923+0000","last_clean":"2024-04-26T11:49:06.101923+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:49:06.101923+0000","last_undegraded":"2024-04-26T11:49:06.101923+0000","last_fullsized":"2024-04-26T11:49:06.101923+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'169","last_scrub_stamp":"2024-04-26T11:49:06.101670+0000","last_deep_scrub":"115'169","last_deep_scrub_stamp":"2024-04-26T11:49:06.101670+0000","last_clean_scrub_stamp":"2024-04-26T11:49:06.101670+0000","objects_scrubbed":1,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:50.555711+0000","scrub_duration":0.012551596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":1011,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:21.674829+0000","last_change":"2024-04-26T11:48:21.674829+0000","last_active":"2024-04-26T11:48:21.674829+0000","last_peered":"2024-04-26T11:48:21.674829+0000","last_clean":"2024-04-26T11:48:21.674829+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:21.674829+0000","last_undegraded":"2024-04-26T11:48:21.674829+0000","last_fullsized":"2024-04-26T11:48:21.674829+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'445","last_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_deep_scrub":"76'445","last_deep_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_clean_scrub_stamp":"2024-04-26T11:48:21.674498+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:22.562702+0000","scrub_duration":0.0044128639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.989853+0000","last_change":"2024-04-26T11:48:28.989853+0000","last_active":"2024-04-26T11:48:28.989853+0000","last_peered":"2024-04-26T11:48:28.989853+0000","last_clean":"2024-04-26T11:48:28.989853+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:28.989853+0000","last_undegraded":"2024-04-26T11:48:28.989853+0000","last_fullsized":"2024-04-26T11:48:28.989853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.989586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:35.455730+0000","scrub_duration":0.0033627959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"115'425","reported_seq":546,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:11.690294+0000","last_change":"2024-04-26T11:49:11.690455+0000","last_active":"2024-04-26T11:49:11.690294+0000","last_peered":"2024-04-26T11:49:11.690294+0000","last_clean":"2024-04-26T11:49:11.690294+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:49:11.690294+0000","last_undegraded":"2024-04-26T11:49:11.690294+0000","last_fullsized":"2024-04-26T11:49:11.690294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'425","last_scrub_stamp":"2024-04-26T11:49:11.690257+0000","last_deep_scrub":"115'425","last_deep_scrub_stamp":"2024-04-26T11:49:11.690257+0000","last_clean_scrub_stamp":"2024-04-26T11:49:11.690257+0000","objects_scrubbed":2,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:02.411178+0000","scrub_duration":0.031295459999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":460,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.378505+0000","last_change":"2024-04-26T11:47:21.461618+0000","last_active":"2024-04-26T11:48:11.378505+0000","last_peered":"2024-04-26T11:48:11.378505+0000","last_clean":"2024-04-26T11:48:11.378505+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:48:11.378505+0000","last_undegraded":"2024-04-26T11:48:11.378505+0000","last_fullsized":"2024-04-26T11:48:11.378505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":126,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592592+0000","last_change":"2024-04-26T11:47:11.154393+0000","last_active":"2024-04-26T11:48:11.592592+0000","last_peered":"2024-04-26T11:48:11.592592+0000","last_clean":"2024-04-26T11:48:11.592592+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:48:11.592592+0000","last_undegraded":"2024-04-26T11:48:11.592592+0000","last_fullsized":"2024-04-26T11:48:11.592592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:16.004319+0000","last_clean_scrub_stamp":"2024-04-26T11:44:16.004319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":188,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592694+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:48:11.592694+0000","last_peered":"2024-04-26T11:48:11.592694+0000","last_clean":"2024-04-26T11:48:11.592694+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:48:11.592694+0000","last_undegraded":"2024-04-26T11:48:11.592694+0000","last_fullsized":"2024-04-26T11:48:11.592694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":515,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:14.131154+0000","last_change":"2024-04-26T11:49:14.131154+0000","last_active":"2024-04-26T11:49:14.131154+0000","last_peered":"2024-04-26T11:49:14.131154+0000","last_clean":"2024-04-26T11:49:14.131154+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:49:14.131154+0000","last_undegraded":"2024-04-26T11:49:14.131154+0000","last_fullsized":"2024-04-26T11:49:14.131154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'380","last_scrub_stamp":"2024-04-26T11:49:14.130850+0000","last_deep_scrub":"76'380","last_deep_scrub_stamp":"2024-04-26T11:49:14.130850+0000","last_clean_scrub_stamp":"2024-04-26T11:49:14.130850+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:24.657925+0000","scrub_duration":0.0042359490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"115'514","reported_seq":659,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:09.130437+0000","last_change":"2024-04-26T11:49:09.130554+0000","last_active":"2024-04-26T11:49:09.130437+0000","last_peered":"2024-04-26T11:49:09.130437+0000","last_clean":"2024-04-26T11:49:09.130437+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:49:09.130437+0000","last_undegraded":"2024-04-26T11:49:09.130437+0000","last_fullsized":"2024-04-26T11:49:09.130437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'514","last_scrub_stamp":"2024-04-26T11:49:09.130413+0000","last_deep_scrub":"115'514","last_deep_scrub_stamp":"2024-04-26T11:49:09.130413+0000","last_clean_scrub_stamp":"2024-04-26T11:49:09.130413+0000","objects_scrubbed":1,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:24.502839+0000","scrub_duration":0.021096667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:11.078631+0000","last_change":"2024-04-26T11:49:11.078631+0000","last_active":"2024-04-26T11:49:11.078631+0000","last_peered":"2024-04-26T11:49:11.078631+0000","last_clean":"2024-04-26T11:49:11.078631+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:49:11.078631+0000","last_undegraded":"2024-04-26T11:49:11.078631+0000","last_fullsized":"2024-04-26T11:49:11.078631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:11.078330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:11.078330+0000","last_clean_scrub_stamp":"2024-04-26T11:49:11.078330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:07.202271+0000","scrub_duration":0.0032418809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.714423+0000","last_change":"2024-04-26T11:48:28.714423+0000","last_active":"2024-04-26T11:48:28.714423+0000","last_peered":"2024-04-26T11:48:28.714423+0000","last_clean":"2024-04-26T11:48:28.714423+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:28.714423+0000","last_undegraded":"2024-04-26T11:48:28.714423+0000","last_fullsized":"2024-04-26T11:48:28.714423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.714119+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:28.093833+0000","scrub_duration":0.0054659280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.033773+0000","last_change":"2024-04-26T11:48:20.033773+0000","last_active":"2024-04-26T11:48:20.033773+0000","last_peered":"2024-04-26T11:48:20.033773+0000","last_clean":"2024-04-26T11:48:20.033773+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:20.033773+0000","last_undegraded":"2024-04-26T11:48:20.033773+0000","last_fullsized":"2024-04-26T11:48:20.033773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'63","last_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_deep_scrub":"74'63","last_deep_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.033325+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:48.515506+0000","scrub_duration":0.0038822000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:06.737700+0000","last_change":"2024-04-26T11:49:06.737932+0000","last_active":"2024-04-26T11:49:06.737700+0000","last_peered":"2024-04-26T11:49:06.737700+0000","last_clean":"2024-04-26T11:49:06.737700+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:49:06.737700+0000","last_undegraded":"2024-04-26T11:49:06.737700+0000","last_fullsized":"2024-04-26T11:49:06.737700+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:06.737649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:06.737649+0000","last_clean_scrub_stamp":"2024-04-26T11:49:06.737649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:41.572042+0000","scrub_duration":0.0033533780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":540,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:32.680131+0000","last_change":"2024-04-26T11:48:32.680131+0000","last_active":"2024-04-26T11:48:32.680131+0000","last_peered":"2024-04-26T11:48:32.680131+0000","last_clean":"2024-04-26T11:48:32.680131+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:32.680131+0000","last_undegraded":"2024-04-26T11:48:32.680131+0000","last_fullsized":"2024-04-26T11:48:32.680131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'387","last_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_deep_scrub":"76'387","last_deep_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_clean_scrub_stamp":"2024-04-26T11:48:32.679781+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:53.697537+0000","scrub_duration":0.0049983019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"115'59","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.993614+0000","last_change":"2024-04-26T11:48:26.993614+0000","last_active":"2024-04-26T11:48:26.993614+0000","last_peered":"2024-04-26T11:48:26.993614+0000","last_clean":"2024-04-26T11:48:26.993614+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:26.993614+0000","last_undegraded":"2024-04-26T11:48:26.993614+0000","last_fullsized":"2024-04-26T11:48:26.993614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'59","last_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_deep_scrub":"115'59","last_deep_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.993216+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:01.847961+0000","scrub_duration":0.0066337560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:22.028330+0000","last_change":"2024-04-26T11:48:22.028330+0000","last_active":"2024-04-26T11:48:22.028330+0000","last_peered":"2024-04-26T11:48:22.028330+0000","last_clean":"2024-04-26T11:48:22.028330+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:22.028330+0000","last_undegraded":"2024-04-26T11:48:22.028330+0000","last_fullsized":"2024-04-26T11:48:22.028330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_clean_scrub_stamp":"2024-04-26T11:48:22.028073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:50.488548+0000","scrub_duration":0.0032986119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":496,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:22.161514+0000","last_change":"2024-04-26T11:49:22.161779+0000","last_active":"2024-04-26T11:49:22.161514+0000","last_peered":"2024-04-26T11:49:22.161514+0000","last_clean":"2024-04-26T11:49:22.161514+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:49:22.161514+0000","last_undegraded":"2024-04-26T11:49:22.161514+0000","last_fullsized":"2024-04-26T11:49:22.161514+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:49:22.161465+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:49:22.161465+0000","last_clean_scrub_stamp":"2024-04-26T11:49:22.161465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:30.815987+0000","scrub_duration":0.0034889420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"115'72","reported_seq":92,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:15.150969+0000","last_change":"2024-04-26T11:48:15.150969+0000","last_active":"2024-04-26T11:48:15.150969+0000","last_peered":"2024-04-26T11:48:15.150969+0000","last_clean":"2024-04-26T11:48:15.150969+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:15.150969+0000","last_undegraded":"2024-04-26T11:48:15.150969+0000","last_fullsized":"2024-04-26T11:48:15.150969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'72","last_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_deep_scrub":"115'72","last_deep_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_clean_scrub_stamp":"2024-04-26T11:48:15.150680+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:41.664584+0000","scrub_duration":0.021253264000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:28.145442+0000","last_change":"2024-04-26T11:49:28.145667+0000","last_active":"2024-04-26T11:49:28.145442+0000","last_peered":"2024-04-26T11:49:28.145442+0000","last_clean":"2024-04-26T11:49:28.145442+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:49:28.145442+0000","last_undegraded":"2024-04-26T11:49:28.145442+0000","last_fullsized":"2024-04-26T11:49:28.145442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:28.145395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:28.145395+0000","last_clean_scrub_stamp":"2024-04-26T11:49:28.145395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:53.647454+0000","scrub_duration":0.0032670189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":573,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:23.712478+0000","last_change":"2024-04-26T11:48:23.712478+0000","last_active":"2024-04-26T11:48:23.712478+0000","last_peered":"2024-04-26T11:48:23.712478+0000","last_clean":"2024-04-26T11:48:23.712478+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:23.712478+0000","last_undegraded":"2024-04-26T11:48:23.712478+0000","last_fullsized":"2024-04-26T11:48:23.712478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_clean_scrub_stamp":"2024-04-26T11:48:23.712095+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:55.117125+0000","scrub_duration":0.0051007090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":574,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593103+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:48:11.593103+0000","last_peered":"2024-04-26T11:48:11.593103+0000","last_clean":"2024-04-26T11:48:11.593103+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:48:11.593103+0000","last_undegraded":"2024-04-26T11:48:11.593103+0000","last_fullsized":"2024-04-26T11:48:11.593103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"115'416","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.029976+0000","last_change":"2024-04-26T11:48:36.029976+0000","last_active":"2024-04-26T11:48:36.029976+0000","last_peered":"2024-04-26T11:48:36.029976+0000","last_clean":"2024-04-26T11:48:36.029976+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:36.029976+0000","last_undegraded":"2024-04-26T11:48:36.029976+0000","last_fullsized":"2024-04-26T11:48:36.029976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'416","last_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_deep_scrub":"115'416","last_deep_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.029835+0000","objects_scrubbed":5,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:10.864228+0000","scrub_duration":0.034626879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":559,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:37.946809+0000","last_change":"2024-04-26T11:48:37.946809+0000","last_active":"2024-04-26T11:48:37.946809+0000","last_peered":"2024-04-26T11:48:37.946809+0000","last_clean":"2024-04-26T11:48:37.946809+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:37.946809+0000","last_undegraded":"2024-04-26T11:48:37.946809+0000","last_fullsized":"2024-04-26T11:48:37.946809+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'423","last_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_deep_scrub":"76'423","last_deep_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_clean_scrub_stamp":"2024-04-26T11:48:37.946505+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:45.776669+0000","scrub_duration":0.0044478900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"115'105","reported_seq":226,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:13.647691+0000","last_change":"2024-04-26T11:49:13.647691+0000","last_active":"2024-04-26T11:49:13.647691+0000","last_peered":"2024-04-26T11:49:13.647691+0000","last_clean":"2024-04-26T11:49:13.647691+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:49:13.647691+0000","last_undegraded":"2024-04-26T11:49:13.647691+0000","last_fullsized":"2024-04-26T11:49:13.647691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'105","last_scrub_stamp":"2024-04-26T11:49:13.647275+0000","last_deep_scrub":"115'105","last_deep_scrub_stamp":"2024-04-26T11:49:13.647275+0000","last_clean_scrub_stamp":"2024-04-26T11:49:13.647275+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:23.912985+0000","scrub_duration":0.0077776210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"115'335","reported_seq":480,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:03.180771+0000","last_change":"2024-04-26T11:49:03.180771+0000","last_active":"2024-04-26T11:49:03.180771+0000","last_peered":"2024-04-26T11:49:03.180771+0000","last_clean":"2024-04-26T11:49:03.180771+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:49:03.180771+0000","last_undegraded":"2024-04-26T11:49:03.180771+0000","last_fullsized":"2024-04-26T11:49:03.180771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'335","last_scrub_stamp":"2024-04-26T11:49:03.180575+0000","last_deep_scrub":"115'335","last_deep_scrub_stamp":"2024-04-26T11:49:03.180575+0000","last_clean_scrub_stamp":"2024-04-26T11:49:03.180575+0000","objects_scrubbed":1,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:20.897350+0000","scrub_duration":0.020406345999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":592,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.973251+0000","last_change":"2024-04-26T11:48:30.973251+0000","last_active":"2024-04-26T11:48:30.973251+0000","last_peered":"2024-04-26T11:48:30.973251+0000","last_clean":"2024-04-26T11:48:30.973251+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:30.973251+0000","last_undegraded":"2024-04-26T11:48:30.973251+0000","last_fullsized":"2024-04-26T11:48:30.973251+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'463","last_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_deep_scrub":"76'463","last_deep_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.972981+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:34.247031+0000","scrub_duration":0.0044136920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.018812+0000","last_change":"2024-04-26T11:48:12.019177+0000","last_active":"2024-04-26T11:48:12.018812+0000","last_peered":"2024-04-26T11:48:12.018812+0000","last_clean":"2024-04-26T11:48:12.018812+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:12.018812+0000","last_undegraded":"2024-04-26T11:48:12.018812+0000","last_fullsized":"2024-04-26T11:48:12.018812+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.018689+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:01.030509+0000","scrub_duration":0.0039670319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":588,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.005500+0000","last_change":"2024-04-26T11:48:30.005500+0000","last_active":"2024-04-26T11:48:30.005500+0000","last_peered":"2024-04-26T11:48:30.005500+0000","last_clean":"2024-04-26T11:48:30.005500+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:30.005500+0000","last_undegraded":"2024-04-26T11:48:30.005500+0000","last_fullsized":"2024-04-26T11:48:30.005500+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'447","last_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_deep_scrub":"76'447","last_deep_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.005160+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:09.022128+0000","scrub_duration":0.0044822300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":531,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:41.646917+0000","last_change":"2024-04-26T11:48:41.647158+0000","last_active":"2024-04-26T11:48:41.646917+0000","last_peered":"2024-04-26T11:48:41.646917+0000","last_clean":"2024-04-26T11:48:41.646917+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:41.646917+0000","last_undegraded":"2024-04-26T11:48:41.646917+0000","last_fullsized":"2024-04-26T11:48:41.646917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'366","last_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_deep_scrub":"76'366","last_deep_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_clean_scrub_stamp":"2024-04-26T11:48:41.646862+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:47.318788+0000","scrub_duration":0.0041890690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"115'776","reported_seq":889,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:05.101594+0000","last_change":"2024-04-26T11:49:05.101753+0000","last_active":"2024-04-26T11:49:05.101594+0000","last_peered":"2024-04-26T11:49:05.101594+0000","last_clean":"2024-04-26T11:49:05.101594+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:49:05.101594+0000","last_undegraded":"2024-04-26T11:49:05.101594+0000","last_fullsized":"2024-04-26T11:49:05.101594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'776","last_scrub_stamp":"2024-04-26T11:49:05.101560+0000","last_deep_scrub":"115'776","last_deep_scrub_stamp":"2024-04-26T11:49:05.101560+0000","last_clean_scrub_stamp":"2024-04-26T11:49:05.101560+0000","objects_scrubbed":2,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:23.999436+0000","scrub_duration":0.031574363000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":500,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.378929+0000","last_change":"2024-04-26T11:47:33.461251+0000","last_active":"2024-04-26T11:48:11.378929+0000","last_peered":"2024-04-26T11:48:11.378929+0000","last_clean":"2024-04-26T11:48:11.378929+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:48:11.378929+0000","last_undegraded":"2024-04-26T11:48:11.378929+0000","last_fullsized":"2024-04-26T11:48:11.378929+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"115'329","reported_seq":445,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.155005+0000","last_change":"2024-04-26T11:49:07.155128+0000","last_active":"2024-04-26T11:49:07.155005+0000","last_peered":"2024-04-26T11:49:07.155005+0000","last_clean":"2024-04-26T11:49:07.155005+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:49:07.155005+0000","last_undegraded":"2024-04-26T11:49:07.155005+0000","last_fullsized":"2024-04-26T11:49:07.155005+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'329","last_scrub_stamp":"2024-04-26T11:49:07.154976+0000","last_deep_scrub":"115'329","last_deep_scrub_stamp":"2024-04-26T11:49:07.154976+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.154976+0000","objects_scrubbed":1,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:50.736767+0000","scrub_duration":0.017101642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":552,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:54.740054+0000","last_change":"2024-04-26T11:48:54.740054+0000","last_active":"2024-04-26T11:48:54.740054+0000","last_peered":"2024-04-26T11:48:54.740054+0000","last_clean":"2024-04-26T11:48:54.740054+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:54.740054+0000","last_undegraded":"2024-04-26T11:48:54.740054+0000","last_fullsized":"2024-04-26T11:48:54.740054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'385","last_scrub_stamp":"2024-04-26T11:48:54.739766+0000","last_deep_scrub":"76'385","last_deep_scrub_stamp":"2024-04-26T11:48:54.739766+0000","last_clean_scrub_stamp":"2024-04-26T11:48:54.739766+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:00.843817+0000","scrub_duration":0.0056441019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"115'354","reported_seq":504,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.792341+0000","last_change":"2024-04-26T11:49:07.792341+0000","last_active":"2024-04-26T11:49:07.792341+0000","last_peered":"2024-04-26T11:49:07.792341+0000","last_clean":"2024-04-26T11:49:07.792341+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:49:07.792341+0000","last_undegraded":"2024-04-26T11:49:07.792341+0000","last_fullsized":"2024-04-26T11:49:07.792341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'354","last_scrub_stamp":"2024-04-26T11:49:07.791996+0000","last_deep_scrub":"115'354","last_deep_scrub_stamp":"2024-04-26T11:49:07.791996+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.791996+0000","objects_scrubbed":3,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:03.875875+0000","scrub_duration":0.041359689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":867,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:29.698714+0000","last_change":"2024-04-26T11:48:29.698714+0000","last_active":"2024-04-26T11:48:29.698714+0000","last_peered":"2024-04-26T11:48:29.698714+0000","last_clean":"2024-04-26T11:48:29.698714+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:29.698714+0000","last_undegraded":"2024-04-26T11:48:29.698714+0000","last_fullsized":"2024-04-26T11:48:29.698714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'369","last_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_deep_scrub":"76'369","last_deep_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_clean_scrub_stamp":"2024-04-26T11:48:29.698434+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:04.873874+0000","scrub_duration":0.004418478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"115'58","reported_seq":179,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:18.727460+0000","last_change":"2024-04-26T11:49:18.727460+0000","last_active":"2024-04-26T11:49:18.727460+0000","last_peered":"2024-04-26T11:49:18.727460+0000","last_clean":"2024-04-26T11:49:18.727460+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:49:18.727460+0000","last_undegraded":"2024-04-26T11:49:18.727460+0000","last_fullsized":"2024-04-26T11:49:18.727460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'58","last_scrub_stamp":"2024-04-26T11:49:18.727169+0000","last_deep_scrub":"115'58","last_deep_scrub_stamp":"2024-04-26T11:49:18.727169+0000","last_clean_scrub_stamp":"2024-04-26T11:49:18.727169+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:29.056593+0000","scrub_duration":0.016535326999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":897,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:13.226901+0000","last_change":"2024-04-26T11:48:13.226901+0000","last_active":"2024-04-26T11:48:13.226901+0000","last_peered":"2024-04-26T11:48:13.226901+0000","last_clean":"2024-04-26T11:48:13.226901+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:13.226901+0000","last_undegraded":"2024-04-26T11:48:13.226901+0000","last_fullsized":"2024-04-26T11:48:13.226901+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'377","last_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_deep_scrub":"76'377","last_deep_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_clean_scrub_stamp":"2024-04-26T11:48:13.226463+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:03.708994+0000","scrub_duration":0.0044302090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"115'277","reported_seq":423,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.109273+0000","last_change":"2024-04-26T11:48:27.109273+0000","last_active":"2024-04-26T11:48:27.109273+0000","last_peered":"2024-04-26T11:48:27.109273+0000","last_clean":"2024-04-26T11:48:27.109273+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:27.109273+0000","last_undegraded":"2024-04-26T11:48:27.109273+0000","last_fullsized":"2024-04-26T11:48:27.109273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'277","last_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_deep_scrub":"115'277","last_deep_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.109059+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:02.122709+0000","scrub_duration":0.021146224000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":914,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:34.042997+0000","last_change":"2024-04-26T11:48:34.042997+0000","last_active":"2024-04-26T11:48:34.042997+0000","last_peered":"2024-04-26T11:48:34.042997+0000","last_clean":"2024-04-26T11:48:34.042997+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:34.042997+0000","last_undegraded":"2024-04-26T11:48:34.042997+0000","last_fullsized":"2024-04-26T11:48:34.042997+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'391","last_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_deep_scrub":"76'391","last_deep_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_clean_scrub_stamp":"2024-04-26T11:48:34.042706+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:24.193868+0000","scrub_duration":0.0052922139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"115'333","reported_seq":454,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:56.811047+0000","last_change":"2024-04-26T11:48:56.811047+0000","last_active":"2024-04-26T11:48:56.811047+0000","last_peered":"2024-04-26T11:48:56.811047+0000","last_clean":"2024-04-26T11:48:56.811047+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:56.811047+0000","last_undegraded":"2024-04-26T11:48:56.811047+0000","last_fullsized":"2024-04-26T11:48:56.811047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'333","last_scrub_stamp":"2024-04-26T11:48:56.810845+0000","last_deep_scrub":"115'333","last_deep_scrub_stamp":"2024-04-26T11:48:56.810845+0000","last_clean_scrub_stamp":"2024-04-26T11:48:56.810845+0000","objects_scrubbed":4,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.341984+0000","scrub_duration":0.0403226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":965,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:50.684402+0000","last_change":"2024-04-26T11:48:50.684402+0000","last_active":"2024-04-26T11:48:50.684402+0000","last_peered":"2024-04-26T11:48:50.684402+0000","last_clean":"2024-04-26T11:48:50.684402+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:50.684402+0000","last_undegraded":"2024-04-26T11:48:50.684402+0000","last_fullsized":"2024-04-26T11:48:50.684402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:50.684066+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:50.684066+0000","last_clean_scrub_stamp":"2024-04-26T11:48:50.684066+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:36.226053+0000","scrub_duration":0.0045709319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"74'51","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.378373+0000","last_change":"2024-04-26T11:47:11.472042+0000","last_active":"2024-04-26T11:48:11.378373+0000","last_peered":"2024-04-26T11:48:11.378373+0000","last_clean":"2024-04-26T11:48:11.378373+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:48:11.378373+0000","last_undegraded":"2024-04-26T11:48:11.378373+0000","last_fullsized":"2024-04-26T11:48:11.378373+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":993,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:02.136503+0000","last_change":"2024-04-26T11:49:02.136503+0000","last_active":"2024-04-26T11:49:02.136503+0000","last_peered":"2024-04-26T11:49:02.136503+0000","last_clean":"2024-04-26T11:49:02.136503+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:49:02.136503+0000","last_undegraded":"2024-04-26T11:49:02.136503+0000","last_fullsized":"2024-04-26T11:49:02.136503+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'436","last_scrub_stamp":"2024-04-26T11:49:02.136184+0000","last_deep_scrub":"76'436","last_deep_scrub_stamp":"2024-04-26T11:49:02.136184+0000","last_clean_scrub_stamp":"2024-04-26T11:49:02.136184+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:14.675035+0000","scrub_duration":0.0045192979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"115'57","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:19.159861+0000","last_change":"2024-04-26T11:49:19.160126+0000","last_active":"2024-04-26T11:49:19.159861+0000","last_peered":"2024-04-26T11:49:19.159861+0000","last_clean":"2024-04-26T11:49:19.159861+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:49:19.159861+0000","last_undegraded":"2024-04-26T11:49:19.159861+0000","last_fullsized":"2024-04-26T11:49:19.159861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'57","last_scrub_stamp":"2024-04-26T11:49:19.159801+0000","last_deep_scrub":"115'57","last_deep_scrub_stamp":"2024-04-26T11:49:19.159801+0000","last_clean_scrub_stamp":"2024-04-26T11:49:19.159801+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:43.568000+0000","scrub_duration":0.018090722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7923,"ondisk_log_size":7923,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738437,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200496,"kb_used_data":89064,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171344,"statfs":{"total":96636764160,"available":96431456256,"internally_reserved":0,"allocated":91201536,"data_stored":90584365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.56999999999999995,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73699999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.52400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77000000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.61299999999999999}]},{"osd":1,"last update":"Fri Apr 26 11:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66800000000000004,"15min":0.66000000000000003},"min":{"1min":0.625,"5min":0.505,"15min":0.505},"max":{"1min":0.77700000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.73799999999999999}]}]},{"osd":1,"up_from":72,"seq":309237645342,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125616,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246224,"statfs":{"total":96636764160,"available":96508133376,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.49399999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.55100000000000005,"5min":0.379,"15min":0.379},"max":{"1min":0.75,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Apr 26 11:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.69699999999999995},"min":{"1min":0.60099999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.55800000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.73099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190668,"kb_used_data":83332,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181172,"statfs":{"total":96636764160,"available":96441520128,"internally_reserved":0,"allocated":85331968,"data_stored":84726408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.53900000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Apr 26 11:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63800000000000001,"15min":0.68600000000000005},"min":{"1min":0.58899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.69199999999999995},"min":{"1min":0.59899999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:49:33.401 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.401 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.402 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.402 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.402 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.402 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.402 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.402 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.402 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.402 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.403 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.403 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.403 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.403 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.403 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.404 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.404 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.404 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.404 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.404 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.404 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.404 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.404 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:44:16.004319+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.405 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.405 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.405 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.405 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:33.405 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:49:53.406 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:49:53.732 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:49:53.734 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:49:53.747 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-04-26T11:49:52.092752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34138,"ondisk_log_size":34138,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516780,"kb_used_data":252436,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598740,"statfs":{"total":289910292480,"available":289381109760,"internally_reserved":0,"allocated":258494464,"data_stored":256676283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004148"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":963,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595322+0000","last_change":"2024-04-26T11:47:16.143293+0000","last_active":"2024-04-26T11:48:10.595322+0000","last_peered":"2024-04-26T11:48:10.595322+0000","last_clean":"2024-04-26T11:48:10.595322+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:48:10.595322+0000","last_undegraded":"2024-04-26T11:48:10.595322+0000","last_fullsized":"2024-04-26T11:48:10.595322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1020,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595346+0000","last_change":"2024-04-26T11:47:39.146123+0000","last_active":"2024-04-26T11:48:10.595346+0000","last_peered":"2024-04-26T11:48:10.595346+0000","last_clean":"2024-04-26T11:48:10.595346+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:48:10.595346+0000","last_undegraded":"2024-04-26T11:48:10.595346+0000","last_fullsized":"2024-04-26T11:48:10.595346+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593307+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:11.593307+0000","last_peered":"2024-04-26T11:48:11.593307+0000","last_clean":"2024-04-26T11:48:11.593307+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:11.593307+0000","last_undegraded":"2024-04-26T11:48:11.593307+0000","last_fullsized":"2024-04-26T11:48:11.593307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":841,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593170+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:11.593170+0000","last_peered":"2024-04-26T11:48:11.593170+0000","last_clean":"2024-04-26T11:48:11.593170+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:11.593170+0000","last_undegraded":"2024-04-26T11:48:11.593170+0000","last_fullsized":"2024-04-26T11:48:11.593170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":919,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595308+0000","last_change":"2024-04-26T11:47:29.145033+0000","last_active":"2024-04-26T11:48:10.595308+0000","last_peered":"2024-04-26T11:48:10.595308+0000","last_clean":"2024-04-26T11:48:10.595308+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:48:10.595308+0000","last_undegraded":"2024-04-26T11:48:10.595308+0000","last_fullsized":"2024-04-26T11:48:10.595308+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":847,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593382+0000","last_change":"2024-04-26T11:47:15.142071+0000","last_active":"2024-04-26T11:48:11.593382+0000","last_peered":"2024-04-26T11:48:11.593382+0000","last_clean":"2024-04-26T11:48:11.593382+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:48:11.593382+0000","last_undegraded":"2024-04-26T11:48:11.593382+0000","last_fullsized":"2024-04-26T11:48:11.593382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1039,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593096+0000","last_change":"2024-04-26T11:47:43.186603+0000","last_active":"2024-04-26T11:48:11.593096+0000","last_peered":"2024-04-26T11:48:11.593096+0000","last_clean":"2024-04-26T11:48:11.593096+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:48:11.593096+0000","last_undegraded":"2024-04-26T11:48:11.593096+0000","last_fullsized":"2024-04-26T11:48:11.593096+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":848,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593128+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:11.593128+0000","last_peered":"2024-04-26T11:48:11.593128+0000","last_clean":"2024-04-26T11:48:11.593128+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:11.593128+0000","last_undegraded":"2024-04-26T11:48:11.593128+0000","last_fullsized":"2024-04-26T11:48:11.593128+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":555,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:33.918870+0000","last_change":"2024-04-26T11:48:33.918870+0000","last_active":"2024-04-26T11:48:33.918870+0000","last_peered":"2024-04-26T11:48:33.918870+0000","last_clean":"2024-04-26T11:48:33.918870+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:33.918870+0000","last_undegraded":"2024-04-26T11:48:33.918870+0000","last_fullsized":"2024-04-26T11:48:33.918870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'421","last_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_deep_scrub":"77'421","last_deep_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:33.918413+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:33.584386+0000","scrub_duration":0.0044004430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":962,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.595356+0000","last_change":"2024-04-26T11:47:35.150650+0000","last_active":"2024-04-26T11:48:10.595356+0000","last_peered":"2024-04-26T11:48:10.595356+0000","last_clean":"2024-04-26T11:48:10.595356+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:48:10.595356+0000","last_undegraded":"2024-04-26T11:48:10.595356+0000","last_fullsized":"2024-04-26T11:48:10.595356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":875,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593069+0000","last_change":"2024-04-26T11:47:17.144435+0000","last_active":"2024-04-26T11:48:11.593069+0000","last_peered":"2024-04-26T11:48:11.593069+0000","last_clean":"2024-04-26T11:48:11.593069+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:48:11.593069+0000","last_undegraded":"2024-04-26T11:48:11.593069+0000","last_fullsized":"2024-04-26T11:48:11.593069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":504,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.699169+0000","last_change":"2024-04-26T11:48:10.699169+0000","last_active":"2024-04-26T11:48:10.699169+0000","last_peered":"2024-04-26T11:48:10.699169+0000","last_clean":"2024-04-26T11:48:10.699169+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:10.699169+0000","last_undegraded":"2024-04-26T11:48:10.699169+0000","last_fullsized":"2024-04-26T11:48:10.699169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'345","last_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_deep_scrub":"76'345","last_deep_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_clean_scrub_stamp":"2024-04-26T11:48:10.698866+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:11.706179+0000","scrub_duration":0.0058868610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":906,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:35.635628+0000","last_change":"2024-04-26T11:49:35.635852+0000","last_active":"2024-04-26T11:49:35.635628+0000","last_peered":"2024-04-26T11:49:35.635628+0000","last_clean":"2024-04-26T11:49:35.635628+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:49:35.635628+0000","last_undegraded":"2024-04-26T11:49:35.635628+0000","last_fullsized":"2024-04-26T11:49:35.635628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'388","last_scrub_stamp":"2024-04-26T11:49:35.635578+0000","last_deep_scrub":"76'388","last_deep_scrub_stamp":"2024-04-26T11:49:35.635578+0000","last_clean_scrub_stamp":"2024-04-26T11:49:35.635578+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:47.567173+0000","scrub_duration":0.0042458319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":576,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.180736+0000","last_change":"2024-04-26T11:48:12.180736+0000","last_active":"2024-04-26T11:48:12.180736+0000","last_peered":"2024-04-26T11:48:12.180736+0000","last_clean":"2024-04-26T11:48:12.180736+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:12.180736+0000","last_undegraded":"2024-04-26T11:48:12.180736+0000","last_fullsized":"2024-04-26T11:48:12.180736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'418","last_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_deep_scrub":"76'418","last_deep_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.180413+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.283252+0000","scrub_duration":0.0053701490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":618,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.057064+0000","last_change":"2024-04-26T11:48:26.057064+0000","last_active":"2024-04-26T11:48:26.057064+0000","last_peered":"2024-04-26T11:48:26.057064+0000","last_clean":"2024-04-26T11:48:26.057064+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:26.057064+0000","last_undegraded":"2024-04-26T11:48:26.057064+0000","last_fullsized":"2024-04-26T11:48:26.057064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'428","last_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_deep_scrub":"76'428","last_deep_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.056732+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:01.294605+0000","scrub_duration":0.0057736879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1062,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592977+0000","last_change":"2024-04-26T11:47:40.160607+0000","last_active":"2024-04-26T11:48:11.592977+0000","last_peered":"2024-04-26T11:48:11.592977+0000","last_clean":"2024-04-26T11:48:11.592977+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:48:11.592977+0000","last_undegraded":"2024-04-26T11:48:11.592977+0000","last_fullsized":"2024-04-26T11:48:11.592977+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":523,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.949389+0000","last_change":"2024-04-26T11:48:27.949389+0000","last_active":"2024-04-26T11:48:27.949389+0000","last_peered":"2024-04-26T11:48:27.949389+0000","last_clean":"2024-04-26T11:48:27.949389+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:27.949389+0000","last_undegraded":"2024-04-26T11:48:27.949389+0000","last_fullsized":"2024-04-26T11:48:27.949389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.948898+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:29.597751+0000","scrub_duration":0.0043304119999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":938,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:34.643935+0000","last_change":"2024-04-26T11:49:34.644187+0000","last_active":"2024-04-26T11:49:34.643935+0000","last_peered":"2024-04-26T11:49:34.643935+0000","last_clean":"2024-04-26T11:49:34.643935+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:49:34.643935+0000","last_undegraded":"2024-04-26T11:49:34.643935+0000","last_fullsized":"2024-04-26T11:49:34.643935+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:49:34.643882+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:49:34.643882+0000","last_clean_scrub_stamp":"2024-04-26T11:49:34.643882+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:47.182733+0000","scrub_duration":0.0051839850000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":544,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:01.026835+0000","last_change":"2024-04-26T11:49:01.026835+0000","last_active":"2024-04-26T11:49:01.026835+0000","last_peered":"2024-04-26T11:49:01.026835+0000","last_clean":"2024-04-26T11:49:01.026835+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:49:01.026835+0000","last_undegraded":"2024-04-26T11:49:01.026835+0000","last_fullsized":"2024-04-26T11:49:01.026835+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:49:01.026549+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:49:01.026549+0000","last_clean_scrub_stamp":"2024-04-26T11:49:01.026549+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:07.466257+0000","scrub_duration":0.0042339500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1027,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.158150+0000","last_change":"2024-04-26T11:49:07.158425+0000","last_active":"2024-04-26T11:49:07.158150+0000","last_peered":"2024-04-26T11:49:07.158150+0000","last_clean":"2024-04-26T11:49:07.158150+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:49:07.158150+0000","last_undegraded":"2024-04-26T11:49:07.158150+0000","last_fullsized":"2024-04-26T11:49:07.158150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'441","last_scrub_stamp":"2024-04-26T11:49:07.158098+0000","last_deep_scrub":"76'441","last_deep_scrub_stamp":"2024-04-26T11:49:07.158098+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.158098+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:31.523066+0000","scrub_duration":0.0045499240000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":941,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:40.997248+0000","last_change":"2024-04-26T11:48:40.997248+0000","last_active":"2024-04-26T11:48:40.997248+0000","last_peered":"2024-04-26T11:48:40.997248+0000","last_clean":"2024-04-26T11:48:40.997248+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:40.997248+0000","last_undegraded":"2024-04-26T11:48:40.997248+0000","last_fullsized":"2024-04-26T11:48:40.997248+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'404","last_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_deep_scrub":"76'404","last_deep_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_clean_scrub_stamp":"2024-04-26T11:48:40.996775+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:28.668510+0000","scrub_duration":0.0044704089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":590,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.703736+0000","last_change":"2024-04-26T11:48:16.703736+0000","last_active":"2024-04-26T11:48:16.703736+0000","last_peered":"2024-04-26T11:48:16.703736+0000","last_clean":"2024-04-26T11:48:16.703736+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:16.703736+0000","last_undegraded":"2024-04-26T11:48:16.703736+0000","last_fullsized":"2024-04-26T11:48:16.703736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.703427+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:09.548341+0000","scrub_duration":0.0060063829999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:20.145425+0000","last_change":"2024-04-26T11:49:20.145425+0000","last_active":"2024-04-26T11:49:20.145425+0000","last_peered":"2024-04-26T11:49:20.145425+0000","last_clean":"2024-04-26T11:49:20.145425+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:49:20.145425+0000","last_undegraded":"2024-04-26T11:49:20.145425+0000","last_fullsized":"2024-04-26T11:49:20.145425+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-26T11:49:20.145133+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-26T11:49:20.145133+0000","last_clean_scrub_stamp":"2024-04-26T11:49:20.145133+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:29.007352+0000","scrub_duration":0.0047260169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1045,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:39.639525+0000","last_change":"2024-04-26T11:49:39.639789+0000","last_active":"2024-04-26T11:49:39.639525+0000","last_peered":"2024-04-26T11:49:39.639525+0000","last_clean":"2024-04-26T11:49:39.639525+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:49:39.639525+0000","last_undegraded":"2024-04-26T11:49:39.639525+0000","last_fullsized":"2024-04-26T11:49:39.639525+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'439","last_scrub_stamp":"2024-04-26T11:49:39.639474+0000","last_deep_scrub":"76'439","last_deep_scrub_stamp":"2024-04-26T11:49:39.639474+0000","last_clean_scrub_stamp":"2024-04-26T11:49:39.639474+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:04.004442+0000","scrub_duration":0.0045361359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:27.680697+0000","last_change":"2024-04-26T11:49:27.680967+0000","last_active":"2024-04-26T11:49:27.680697+0000","last_peered":"2024-04-26T11:49:27.680697+0000","last_clean":"2024-04-26T11:49:27.680697+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:49:27.680697+0000","last_undegraded":"2024-04-26T11:49:27.680697+0000","last_fullsized":"2024-04-26T11:49:27.680697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:49:27.680647+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:49:27.680647+0000","last_clean_scrub_stamp":"2024-04-26T11:49:27.680647+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:03.491704+0000","scrub_duration":0.0047388680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":634,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:43.442657+0000","last_change":"2024-04-26T11:49:43.442897+0000","last_active":"2024-04-26T11:49:43.442657+0000","last_peered":"2024-04-26T11:49:43.442657+0000","last_clean":"2024-04-26T11:49:43.442657+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:49:43.442657+0000","last_undegraded":"2024-04-26T11:49:43.442657+0000","last_fullsized":"2024-04-26T11:49:43.442657+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'492","last_scrub_stamp":"2024-04-26T11:49:43.442597+0000","last_deep_scrub":"76'492","last_deep_scrub_stamp":"2024-04-26T11:49:43.442597+0000","last_clean_scrub_stamp":"2024-04-26T11:49:43.442597+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:24.726836+0000","scrub_duration":0.0051693030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.159519+0000","last_change":"2024-04-26T11:48:20.159519+0000","last_active":"2024-04-26T11:48:20.159519+0000","last_peered":"2024-04-26T11:48:20.159519+0000","last_clean":"2024-04-26T11:48:20.159519+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:20.159519+0000","last_undegraded":"2024-04-26T11:48:20.159519+0000","last_fullsized":"2024-04-26T11:48:20.159519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.159224+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:05.701212+0000","scrub_duration":0.0055914299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":609,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:57.742786+0000","last_change":"2024-04-26T11:48:57.743169+0000","last_active":"2024-04-26T11:48:57.742786+0000","last_peered":"2024-04-26T11:48:57.742786+0000","last_clean":"2024-04-26T11:48:57.742786+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:57.742786+0000","last_undegraded":"2024-04-26T11:48:57.742786+0000","last_fullsized":"2024-04-26T11:48:57.742786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'398","last_scrub_stamp":"2024-04-26T11:48:57.742669+0000","last_deep_scrub":"76'398","last_deep_scrub_stamp":"2024-04-26T11:48:57.742669+0000","last_clean_scrub_stamp":"2024-04-26T11:48:57.742669+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:32.756319+0000","scrub_duration":0.0055375609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":521,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:12.111381+0000","last_change":"2024-04-26T11:49:12.111381+0000","last_active":"2024-04-26T11:49:12.111381+0000","last_peered":"2024-04-26T11:49:12.111381+0000","last_clean":"2024-04-26T11:49:12.111381+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:49:12.111381+0000","last_undegraded":"2024-04-26T11:49:12.111381+0000","last_fullsized":"2024-04-26T11:49:12.111381+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'384","last_scrub_stamp":"2024-04-26T11:49:12.111081+0000","last_deep_scrub":"76'384","last_deep_scrub_stamp":"2024-04-26T11:49:12.111081+0000","last_clean_scrub_stamp":"2024-04-26T11:49:12.111081+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:26.233239+0000","scrub_duration":0.0042686479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":638,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:42.691464+0000","last_change":"2024-04-26T11:48:42.691846+0000","last_active":"2024-04-26T11:48:42.691464+0000","last_peered":"2024-04-26T11:48:42.691464+0000","last_clean":"2024-04-26T11:48:42.691464+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:42.691464+0000","last_undegraded":"2024-04-26T11:48:42.691464+0000","last_fullsized":"2024-04-26T11:48:42.691464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'467","last_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_deep_scrub":"76'467","last_deep_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_clean_scrub_stamp":"2024-04-26T11:48:42.691415+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:34.091246+0000","scrub_duration":0.0058108070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":586,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:57.122777+0000","last_change":"2024-04-26T11:48:57.122777+0000","last_active":"2024-04-26T11:48:57.122777+0000","last_peered":"2024-04-26T11:48:57.122777+0000","last_clean":"2024-04-26T11:48:57.122777+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:57.122777+0000","last_undegraded":"2024-04-26T11:48:57.122777+0000","last_fullsized":"2024-04-26T11:48:57.122777+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'429","last_scrub_stamp":"2024-04-26T11:48:57.122503+0000","last_deep_scrub":"76'429","last_deep_scrub_stamp":"2024-04-26T11:48:57.122503+0000","last_clean_scrub_stamp":"2024-04-26T11:48:57.122503+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:41.507208+0000","scrub_duration":0.0037513580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":963,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.161557+0000","last_change":"2024-04-26T11:48:16.161557+0000","last_active":"2024-04-26T11:48:16.161557+0000","last_peered":"2024-04-26T11:48:16.161557+0000","last_clean":"2024-04-26T11:48:16.161557+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:16.161557+0000","last_undegraded":"2024-04-26T11:48:16.161557+0000","last_fullsized":"2024-04-26T11:48:16.161557+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'412","last_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_deep_scrub":"76'412","last_deep_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.161259+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:19.609307+0000","scrub_duration":0.005601534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":855,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:46.658998+0000","last_change":"2024-04-26T11:48:46.658998+0000","last_active":"2024-04-26T11:48:46.658998+0000","last_peered":"2024-04-26T11:48:46.658998+0000","last_clean":"2024-04-26T11:48:46.658998+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:46.658998+0000","last_undegraded":"2024-04-26T11:48:46.658998+0000","last_fullsized":"2024-04-26T11:48:46.658998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'370","last_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_deep_scrub":"76'370","last_deep_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_clean_scrub_stamp":"2024-04-26T11:48:46.658495+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:50.106542+0000","scrub_duration":0.0045947180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"115'492","reported_seq":640,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:39.978630+0000","last_change":"2024-04-26T11:48:39.978630+0000","last_active":"2024-04-26T11:48:39.978630+0000","last_peered":"2024-04-26T11:48:39.978630+0000","last_clean":"2024-04-26T11:48:39.978630+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:39.978630+0000","last_undegraded":"2024-04-26T11:48:39.978630+0000","last_fullsized":"2024-04-26T11:48:39.978630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'492","last_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_deep_scrub":"115'492","last_deep_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_clean_scrub_stamp":"2024-04-26T11:48:39.978491+0000","objects_scrubbed":4,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:30.699411+0000","scrub_duration":0.028156690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":994,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.672399+0000","last_change":"2024-04-26T11:48:36.672399+0000","last_active":"2024-04-26T11:48:36.672399+0000","last_peered":"2024-04-26T11:48:36.672399+0000","last_clean":"2024-04-26T11:48:36.672399+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:36.672399+0000","last_undegraded":"2024-04-26T11:48:36.672399+0000","last_fullsized":"2024-04-26T11:48:36.672399+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'411","last_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_deep_scrub":"76'411","last_deep_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.672084+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:47.824742+0000","scrub_duration":0.0043867059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":77,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:55.128485+0000","last_change":"2024-04-26T11:48:55.128485+0000","last_active":"2024-04-26T11:48:55.128485+0000","last_peered":"2024-04-26T11:48:55.128485+0000","last_clean":"2024-04-26T11:48:55.128485+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:55.128485+0000","last_undegraded":"2024-04-26T11:48:55.128485+0000","last_fullsized":"2024-04-26T11:48:55.128485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:55.128180+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:55.128180+0000","last_clean_scrub_stamp":"2024-04-26T11:48:55.128180+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:20.475572+0000","scrub_duration":0.0032158289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.973582+0000","last_change":"2024-04-26T11:48:38.973582+0000","last_active":"2024-04-26T11:48:38.973582+0000","last_peered":"2024-04-26T11:48:38.973582+0000","last_clean":"2024-04-26T11:48:38.973582+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:38.973582+0000","last_undegraded":"2024-04-26T11:48:38.973582+0000","last_fullsized":"2024-04-26T11:48:38.973582+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.973282+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:59.469110+0000","scrub_duration":0.0046745279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":181,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:23.744022+0000","last_change":"2024-04-26T11:49:23.744279+0000","last_active":"2024-04-26T11:49:23.744022+0000","last_peered":"2024-04-26T11:49:23.744022+0000","last_clean":"2024-04-26T11:49:23.744022+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:49:23.744022+0000","last_undegraded":"2024-04-26T11:49:23.744022+0000","last_fullsized":"2024-04-26T11:49:23.744022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'60","last_scrub_stamp":"2024-04-26T11:49:23.743971+0000","last_deep_scrub":"71'60","last_deep_scrub_stamp":"2024-04-26T11:49:23.743971+0000","last_clean_scrub_stamp":"2024-04-26T11:49:23.743971+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:24.577731+0000","scrub_duration":0.0030668650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":563,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:51.006799+0000","last_change":"2024-04-26T11:48:51.006799+0000","last_active":"2024-04-26T11:48:51.006799+0000","last_peered":"2024-04-26T11:48:51.006799+0000","last_clean":"2024-04-26T11:48:51.006799+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:51.006799+0000","last_undegraded":"2024-04-26T11:48:51.006799+0000","last_fullsized":"2024-04-26T11:48:51.006799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:51.006513+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:51.006513+0000","last_clean_scrub_stamp":"2024-04-26T11:48:51.006513+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:16.562657+0000","scrub_duration":0.0040201380000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"115'71","reported_seq":192,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:58.169654+0000","last_change":"2024-04-26T11:48:58.169654+0000","last_active":"2024-04-26T11:48:58.169654+0000","last_peered":"2024-04-26T11:48:58.169654+0000","last_clean":"2024-04-26T11:48:58.169654+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:58.169654+0000","last_undegraded":"2024-04-26T11:48:58.169654+0000","last_fullsized":"2024-04-26T11:48:58.169654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'71","last_scrub_stamp":"2024-04-26T11:48:58.169317+0000","last_deep_scrub":"115'71","last_deep_scrub_stamp":"2024-04-26T11:48:58.169317+0000","last_clean_scrub_stamp":"2024-04-26T11:48:58.169317+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:30.105511+0000","scrub_duration":0.010931368,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"115'216","reported_seq":337,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:52.101678+0000","last_change":"2024-04-26T11:48:52.101678+0000","last_active":"2024-04-26T11:48:52.101678+0000","last_peered":"2024-04-26T11:48:52.101678+0000","last_clean":"2024-04-26T11:48:52.101678+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:52.101678+0000","last_undegraded":"2024-04-26T11:48:52.101678+0000","last_fullsized":"2024-04-26T11:48:52.101678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'216","last_scrub_stamp":"2024-04-26T11:48:52.101470+0000","last_deep_scrub":"115'216","last_deep_scrub_stamp":"2024-04-26T11:48:52.101470+0000","last_clean_scrub_stamp":"2024-04-26T11:48:52.101470+0000","objects_scrubbed":2,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:52.935231+0000","scrub_duration":0.022234593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":553,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.700459+0000","last_change":"2024-04-26T11:48:19.700459+0000","last_active":"2024-04-26T11:48:19.700459+0000","last_peered":"2024-04-26T11:48:19.700459+0000","last_clean":"2024-04-26T11:48:19.700459+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:19.700459+0000","last_undegraded":"2024-04-26T11:48:19.700459+0000","last_fullsized":"2024-04-26T11:48:19.700459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.700054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:19.776698+0000","scrub_duration":0.0059321139999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"115'394","reported_seq":515,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:21.771172+0000","last_change":"2024-04-26T11:49:21.771295+0000","last_active":"2024-04-26T11:49:21.771172+0000","last_peered":"2024-04-26T11:49:21.771172+0000","last_clean":"2024-04-26T11:49:21.771172+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:49:21.771172+0000","last_undegraded":"2024-04-26T11:49:21.771172+0000","last_fullsized":"2024-04-26T11:49:21.771172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'394","last_scrub_stamp":"2024-04-26T11:49:21.771148+0000","last_deep_scrub":"115'394","last_deep_scrub_stamp":"2024-04-26T11:49:21.771148+0000","last_clean_scrub_stamp":"2024-04-26T11:49:21.771148+0000","objects_scrubbed":2,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:17.795675+0000","scrub_duration":0.022322965,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1044,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:49.652705+0000","last_change":"2024-04-26T11:48:49.652958+0000","last_active":"2024-04-26T11:48:49.652705+0000","last_peered":"2024-04-26T11:48:49.652705+0000","last_clean":"2024-04-26T11:48:49.652705+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:49.652705+0000","last_undegraded":"2024-04-26T11:48:49.652705+0000","last_fullsized":"2024-04-26T11:48:49.652705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'453","last_scrub_stamp":"2024-04-26T11:48:49.652654+0000","last_deep_scrub":"76'453","last_deep_scrub_stamp":"2024-04-26T11:48:49.652654+0000","last_clean_scrub_stamp":"2024-04-26T11:48:49.652654+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.485049+0000","scrub_duration":0.0048848520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"115'588","reported_seq":709,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:47.006099+0000","last_change":"2024-04-26T11:48:47.006099+0000","last_active":"2024-04-26T11:48:47.006099+0000","last_peered":"2024-04-26T11:48:47.006099+0000","last_clean":"2024-04-26T11:48:47.006099+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:47.006099+0000","last_undegraded":"2024-04-26T11:48:47.006099+0000","last_fullsized":"2024-04-26T11:48:47.006099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'588","last_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_deep_scrub":"115'588","last_deep_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_clean_scrub_stamp":"2024-04-26T11:48:47.005948+0000","objects_scrubbed":2,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:57.335372+0000","scrub_duration":0.022816893000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1028,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.113972+0000","last_change":"2024-04-26T11:48:19.113972+0000","last_active":"2024-04-26T11:48:19.113972+0000","last_peered":"2024-04-26T11:48:19.113972+0000","last_clean":"2024-04-26T11:48:19.113972+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:19.113972+0000","last_undegraded":"2024-04-26T11:48:19.113972+0000","last_fullsized":"2024-04-26T11:48:19.113972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'446","last_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_deep_scrub":"76'446","last_deep_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.113630+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:18.946024+0000","scrub_duration":0.0051973490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":185,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592314+0000","last_change":"2024-04-26T11:47:11.155860+0000","last_active":"2024-04-26T11:48:11.592314+0000","last_peered":"2024-04-26T11:48:11.592314+0000","last_clean":"2024-04-26T11:48:11.592314+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:48:11.592314+0000","last_undegraded":"2024-04-26T11:48:11.592314+0000","last_fullsized":"2024-04-26T11:48:11.592314+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":633,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:47.489963+0000","last_change":"2024-04-26T11:49:47.490262+0000","last_active":"2024-04-26T11:49:47.489963+0000","last_peered":"2024-04-26T11:49:47.489963+0000","last_clean":"2024-04-26T11:49:47.489963+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:49:47.489963+0000","last_undegraded":"2024-04-26T11:49:47.489963+0000","last_fullsized":"2024-04-26T11:49:47.489963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'449","last_scrub_stamp":"2024-04-26T11:49:47.489914+0000","last_deep_scrub":"76'449","last_deep_scrub_stamp":"2024-04-26T11:49:47.489914+0000","last_clean_scrub_stamp":"2024-04-26T11:49:47.489914+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:21.262807+0000","scrub_duration":0.004081182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"115'265","reported_seq":388,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:54.113217+0000","last_change":"2024-04-26T11:48:54.113217+0000","last_active":"2024-04-26T11:48:54.113217+0000","last_peered":"2024-04-26T11:48:54.113217+0000","last_clean":"2024-04-26T11:48:54.113217+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:54.113217+0000","last_undegraded":"2024-04-26T11:48:54.113217+0000","last_fullsized":"2024-04-26T11:48:54.113217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'265","last_scrub_stamp":"2024-04-26T11:48:54.113037+0000","last_deep_scrub":"115'265","last_deep_scrub_stamp":"2024-04-26T11:48:54.113037+0000","last_clean_scrub_stamp":"2024-04-26T11:48:54.113037+0000","objects_scrubbed":3,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:56.229153+0000","scrub_duration":0.024456727000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":975,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.998461+0000","last_change":"2024-04-26T11:48:38.998461+0000","last_active":"2024-04-26T11:48:38.998461+0000","last_peered":"2024-04-26T11:48:38.998461+0000","last_clean":"2024-04-26T11:48:38.998461+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:38.998461+0000","last_undegraded":"2024-04-26T11:48:38.998461+0000","last_fullsized":"2024-04-26T11:48:38.998461+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.998146+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:36.290726+0000","scrub_duration":0.0044019580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"115'152","reported_seq":297,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:48.398010+0000","last_change":"2024-04-26T11:49:48.398259+0000","last_active":"2024-04-26T11:49:48.398010+0000","last_peered":"2024-04-26T11:49:48.398010+0000","last_clean":"2024-04-26T11:49:48.398010+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:49:48.398010+0000","last_undegraded":"2024-04-26T11:49:48.398010+0000","last_fullsized":"2024-04-26T11:49:48.398010+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'152","last_scrub_stamp":"2024-04-26T11:49:48.397929+0000","last_deep_scrub":"115'152","last_deep_scrub_stamp":"2024-04-26T11:49:48.397929+0000","last_clean_scrub_stamp":"2024-04-26T11:49:48.397929+0000","objects_scrubbed":1,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:15.911193+0000","scrub_duration":0.020051243,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":561,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:24.108717+0000","last_change":"2024-04-26T11:48:24.108717+0000","last_active":"2024-04-26T11:48:24.108717+0000","last_peered":"2024-04-26T11:48:24.108717+0000","last_clean":"2024-04-26T11:48:24.108717+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:24.108717+0000","last_undegraded":"2024-04-26T11:48:24.108717+0000","last_fullsized":"2024-04-26T11:48:24.108717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'403","last_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_deep_scrub":"76'403","last_deep_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_clean_scrub_stamp":"2024-04-26T11:48:24.108430+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:30.212481+0000","scrub_duration":0.0053830830000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":175,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:12.648989+0000","last_change":"2024-04-26T11:49:12.649213+0000","last_active":"2024-04-26T11:49:12.648989+0000","last_peered":"2024-04-26T11:49:12.648989+0000","last_clean":"2024-04-26T11:49:12.648989+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:49:12.648989+0000","last_undegraded":"2024-04-26T11:49:12.648989+0000","last_fullsized":"2024-04-26T11:49:12.648989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'54","last_scrub_stamp":"2024-04-26T11:49:12.648939+0000","last_deep_scrub":"74'54","last_deep_scrub_stamp":"2024-04-26T11:49:12.648939+0000","last_clean_scrub_stamp":"2024-04-26T11:49:12.648939+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:47.900978+0000","scrub_duration":0.0033501189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:56.094293+0000","last_change":"2024-04-26T11:48:56.094523+0000","last_active":"2024-04-26T11:48:56.094293+0000","last_peered":"2024-04-26T11:48:56.094293+0000","last_clean":"2024-04-26T11:48:56.094293+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:56.094293+0000","last_undegraded":"2024-04-26T11:48:56.094293+0000","last_fullsized":"2024-04-26T11:48:56.094293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:56.094222+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:56.094222+0000","last_clean_scrub_stamp":"2024-04-26T11:48:56.094222+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:23.069438+0000","scrub_duration":0.0055997750000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"115'503","reported_seq":648,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:04.703888+0000","last_change":"2024-04-26T11:49:04.704018+0000","last_active":"2024-04-26T11:49:04.703888+0000","last_peered":"2024-04-26T11:49:04.703888+0000","last_clean":"2024-04-26T11:49:04.703888+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:49:04.703888+0000","last_undegraded":"2024-04-26T11:49:04.703888+0000","last_fullsized":"2024-04-26T11:49:04.703888+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'503","last_scrub_stamp":"2024-04-26T11:49:04.703858+0000","last_deep_scrub":"115'503","last_deep_scrub_stamp":"2024-04-26T11:49:04.703858+0000","last_clean_scrub_stamp":"2024-04-26T11:49:04.703858+0000","objects_scrubbed":1,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:48.123926+0000","scrub_duration":0.021316572999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":538,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:38.308609+0000","last_change":"2024-04-26T11:49:38.308874+0000","last_active":"2024-04-26T11:49:38.308609+0000","last_peered":"2024-04-26T11:49:38.308609+0000","last_clean":"2024-04-26T11:49:38.308609+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:49:38.308609+0000","last_undegraded":"2024-04-26T11:49:38.308609+0000","last_fullsized":"2024-04-26T11:49:38.308609+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'388","last_scrub_stamp":"2024-04-26T11:49:38.308559+0000","last_deep_scrub":"76'388","last_deep_scrub_stamp":"2024-04-26T11:49:38.308559+0000","last_clean_scrub_stamp":"2024-04-26T11:49:38.308559+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:07.288901+0000","scrub_duration":0.0041200669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"115'159","reported_seq":325,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:20.228841+0000","last_change":"2024-04-26T11:49:20.229163+0000","last_active":"2024-04-26T11:49:20.228841+0000","last_peered":"2024-04-26T11:49:20.228841+0000","last_clean":"2024-04-26T11:49:20.228841+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:49:20.228841+0000","last_undegraded":"2024-04-26T11:49:20.228841+0000","last_fullsized":"2024-04-26T11:49:20.228841+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'159","last_scrub_stamp":"2024-04-26T11:49:20.228749+0000","last_deep_scrub":"115'159","last_deep_scrub_stamp":"2024-04-26T11:49:20.228749+0000","last_clean_scrub_stamp":"2024-04-26T11:49:20.228749+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:04.854303+0000","scrub_duration":0.010785144999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:31.092341+0000","last_change":"2024-04-26T11:49:31.092687+0000","last_active":"2024-04-26T11:49:31.092341+0000","last_peered":"2024-04-26T11:49:31.092341+0000","last_clean":"2024-04-26T11:49:31.092341+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:49:31.092341+0000","last_undegraded":"2024-04-26T11:49:31.092341+0000","last_fullsized":"2024-04-26T11:49:31.092341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:31.092255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:31.092255+0000","last_clean_scrub_stamp":"2024-04-26T11:49:31.092255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:29.747617+0000","scrub_duration":0.0035673219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"115'509","reported_seq":629,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:32.226314+0000","last_change":"2024-04-26T11:49:32.226552+0000","last_active":"2024-04-26T11:49:32.226314+0000","last_peered":"2024-04-26T11:49:32.226314+0000","last_clean":"2024-04-26T11:49:32.226314+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:49:32.226314+0000","last_undegraded":"2024-04-26T11:49:32.226314+0000","last_fullsized":"2024-04-26T11:49:32.226314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'509","last_scrub_stamp":"2024-04-26T11:49:32.226256+0000","last_deep_scrub":"115'509","last_deep_scrub_stamp":"2024-04-26T11:49:32.226256+0000","last_clean_scrub_stamp":"2024-04-26T11:49:32.226256+0000","objects_scrubbed":2,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.167376+0000","scrub_duration":0.030837725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":587,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:50.024734+0000","last_change":"2024-04-26T11:48:50.024898+0000","last_active":"2024-04-26T11:48:50.024734+0000","last_peered":"2024-04-26T11:48:50.024734+0000","last_clean":"2024-04-26T11:48:50.024734+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:50.024734+0000","last_undegraded":"2024-04-26T11:48:50.024734+0000","last_fullsized":"2024-04-26T11:48:50.024734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'432","last_scrub_stamp":"2024-04-26T11:48:50.024692+0000","last_deep_scrub":"76'432","last_deep_scrub_stamp":"2024-04-26T11:48:50.024692+0000","last_clean_scrub_stamp":"2024-04-26T11:48:50.024692+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:46.049218+0000","scrub_duration":0.0041890069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:21.209259+0000","last_change":"2024-04-26T11:49:21.209613+0000","last_active":"2024-04-26T11:49:21.209259+0000","last_peered":"2024-04-26T11:49:21.209259+0000","last_clean":"2024-04-26T11:49:21.209259+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:49:21.209259+0000","last_undegraded":"2024-04-26T11:49:21.209259+0000","last_fullsized":"2024-04-26T11:49:21.209259+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:21.209173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:21.209173+0000","last_clean_scrub_stamp":"2024-04-26T11:49:21.209173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:17.766301+0000","scrub_duration":0.0034167590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"115'169","reported_seq":380,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:06.101923+0000","last_change":"2024-04-26T11:49:06.101923+0000","last_active":"2024-04-26T11:49:06.101923+0000","last_peered":"2024-04-26T11:49:06.101923+0000","last_clean":"2024-04-26T11:49:06.101923+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:49:06.101923+0000","last_undegraded":"2024-04-26T11:49:06.101923+0000","last_fullsized":"2024-04-26T11:49:06.101923+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'169","last_scrub_stamp":"2024-04-26T11:49:06.101670+0000","last_deep_scrub":"115'169","last_deep_scrub_stamp":"2024-04-26T11:49:06.101670+0000","last_clean_scrub_stamp":"2024-04-26T11:49:06.101670+0000","objects_scrubbed":1,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:50.555711+0000","scrub_duration":0.012551596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":1011,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:21.674829+0000","last_change":"2024-04-26T11:48:21.674829+0000","last_active":"2024-04-26T11:48:21.674829+0000","last_peered":"2024-04-26T11:48:21.674829+0000","last_clean":"2024-04-26T11:48:21.674829+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:21.674829+0000","last_undegraded":"2024-04-26T11:48:21.674829+0000","last_fullsized":"2024-04-26T11:48:21.674829+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'445","last_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_deep_scrub":"76'445","last_deep_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_clean_scrub_stamp":"2024-04-26T11:48:21.674498+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:22.562702+0000","scrub_duration":0.0044128639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.989853+0000","last_change":"2024-04-26T11:48:28.989853+0000","last_active":"2024-04-26T11:48:28.989853+0000","last_peered":"2024-04-26T11:48:28.989853+0000","last_clean":"2024-04-26T11:48:28.989853+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:28.989853+0000","last_undegraded":"2024-04-26T11:48:28.989853+0000","last_fullsized":"2024-04-26T11:48:28.989853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.989586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:35.455730+0000","scrub_duration":0.0033627959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"115'425","reported_seq":546,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:11.690294+0000","last_change":"2024-04-26T11:49:11.690455+0000","last_active":"2024-04-26T11:49:11.690294+0000","last_peered":"2024-04-26T11:49:11.690294+0000","last_clean":"2024-04-26T11:49:11.690294+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:49:11.690294+0000","last_undegraded":"2024-04-26T11:49:11.690294+0000","last_fullsized":"2024-04-26T11:49:11.690294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'425","last_scrub_stamp":"2024-04-26T11:49:11.690257+0000","last_deep_scrub":"115'425","last_deep_scrub_stamp":"2024-04-26T11:49:11.690257+0000","last_clean_scrub_stamp":"2024-04-26T11:49:11.690257+0000","objects_scrubbed":2,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:02.411178+0000","scrub_duration":0.031295459999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":471,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:40.373758+0000","last_change":"2024-04-26T11:49:40.374050+0000","last_active":"2024-04-26T11:49:40.373758+0000","last_peered":"2024-04-26T11:49:40.373758+0000","last_clean":"2024-04-26T11:49:40.373758+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:49:40.373758+0000","last_undegraded":"2024-04-26T11:49:40.373758+0000","last_fullsized":"2024-04-26T11:49:40.373758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'336","last_scrub_stamp":"2024-04-26T11:49:40.373707+0000","last_deep_scrub":"76'336","last_deep_scrub_stamp":"2024-04-26T11:49:40.373707+0000","last_clean_scrub_stamp":"2024-04-26T11:49:40.373707+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:52.185575+0000","scrub_duration":0.0039503760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:44.349314+0000","last_change":"2024-04-26T11:49:44.349584+0000","last_active":"2024-04-26T11:49:44.349314+0000","last_peered":"2024-04-26T11:49:44.349314+0000","last_clean":"2024-04-26T11:49:44.349314+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:49:44.349314+0000","last_undegraded":"2024-04-26T11:49:44.349314+0000","last_fullsized":"2024-04-26T11:49:44.349314+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:44.349270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:44.349270+0000","last_clean_scrub_stamp":"2024-04-26T11:49:44.349270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:39.945148+0000","scrub_duration":0.0033297729999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":188,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.592694+0000","last_change":"2024-04-26T11:47:11.155456+0000","last_active":"2024-04-26T11:48:11.592694+0000","last_peered":"2024-04-26T11:48:11.592694+0000","last_clean":"2024-04-26T11:48:11.592694+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:48:11.592694+0000","last_undegraded":"2024-04-26T11:48:11.592694+0000","last_fullsized":"2024-04-26T11:48:11.592694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:20.031920+0000","last_clean_scrub_stamp":"2024-04-26T11:44:20.031920+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":515,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:14.131154+0000","last_change":"2024-04-26T11:49:14.131154+0000","last_active":"2024-04-26T11:49:14.131154+0000","last_peered":"2024-04-26T11:49:14.131154+0000","last_clean":"2024-04-26T11:49:14.131154+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:49:14.131154+0000","last_undegraded":"2024-04-26T11:49:14.131154+0000","last_fullsized":"2024-04-26T11:49:14.131154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'380","last_scrub_stamp":"2024-04-26T11:49:14.130850+0000","last_deep_scrub":"76'380","last_deep_scrub_stamp":"2024-04-26T11:49:14.130850+0000","last_clean_scrub_stamp":"2024-04-26T11:49:14.130850+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:24.657925+0000","scrub_duration":0.0042359490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"115'514","reported_seq":659,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:09.130437+0000","last_change":"2024-04-26T11:49:09.130554+0000","last_active":"2024-04-26T11:49:09.130437+0000","last_peered":"2024-04-26T11:49:09.130437+0000","last_clean":"2024-04-26T11:49:09.130437+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:49:09.130437+0000","last_undegraded":"2024-04-26T11:49:09.130437+0000","last_fullsized":"2024-04-26T11:49:09.130437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'514","last_scrub_stamp":"2024-04-26T11:49:09.130413+0000","last_deep_scrub":"115'514","last_deep_scrub_stamp":"2024-04-26T11:49:09.130413+0000","last_clean_scrub_stamp":"2024-04-26T11:49:09.130413+0000","objects_scrubbed":1,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:24.502839+0000","scrub_duration":0.021096667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:11.078631+0000","last_change":"2024-04-26T11:49:11.078631+0000","last_active":"2024-04-26T11:49:11.078631+0000","last_peered":"2024-04-26T11:49:11.078631+0000","last_clean":"2024-04-26T11:49:11.078631+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:49:11.078631+0000","last_undegraded":"2024-04-26T11:49:11.078631+0000","last_fullsized":"2024-04-26T11:49:11.078631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:11.078330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:11.078330+0000","last_clean_scrub_stamp":"2024-04-26T11:49:11.078330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:07.202271+0000","scrub_duration":0.0032418809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.714423+0000","last_change":"2024-04-26T11:48:28.714423+0000","last_active":"2024-04-26T11:48:28.714423+0000","last_peered":"2024-04-26T11:48:28.714423+0000","last_clean":"2024-04-26T11:48:28.714423+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:28.714423+0000","last_undegraded":"2024-04-26T11:48:28.714423+0000","last_fullsized":"2024-04-26T11:48:28.714423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.714119+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:28.093833+0000","scrub_duration":0.0054659280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.033773+0000","last_change":"2024-04-26T11:48:20.033773+0000","last_active":"2024-04-26T11:48:20.033773+0000","last_peered":"2024-04-26T11:48:20.033773+0000","last_clean":"2024-04-26T11:48:20.033773+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:20.033773+0000","last_undegraded":"2024-04-26T11:48:20.033773+0000","last_fullsized":"2024-04-26T11:48:20.033773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'63","last_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_deep_scrub":"74'63","last_deep_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.033325+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:48.515506+0000","scrub_duration":0.0038822000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:06.737700+0000","last_change":"2024-04-26T11:49:06.737932+0000","last_active":"2024-04-26T11:49:06.737700+0000","last_peered":"2024-04-26T11:49:06.737700+0000","last_clean":"2024-04-26T11:49:06.737700+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:49:06.737700+0000","last_undegraded":"2024-04-26T11:49:06.737700+0000","last_fullsized":"2024-04-26T11:49:06.737700+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:06.737649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:06.737649+0000","last_clean_scrub_stamp":"2024-04-26T11:49:06.737649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:41.572042+0000","scrub_duration":0.0033533780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":540,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:32.680131+0000","last_change":"2024-04-26T11:48:32.680131+0000","last_active":"2024-04-26T11:48:32.680131+0000","last_peered":"2024-04-26T11:48:32.680131+0000","last_clean":"2024-04-26T11:48:32.680131+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:32.680131+0000","last_undegraded":"2024-04-26T11:48:32.680131+0000","last_fullsized":"2024-04-26T11:48:32.680131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'387","last_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_deep_scrub":"76'387","last_deep_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_clean_scrub_stamp":"2024-04-26T11:48:32.679781+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:53.697537+0000","scrub_duration":0.0049983019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"115'59","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.993614+0000","last_change":"2024-04-26T11:48:26.993614+0000","last_active":"2024-04-26T11:48:26.993614+0000","last_peered":"2024-04-26T11:48:26.993614+0000","last_clean":"2024-04-26T11:48:26.993614+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:26.993614+0000","last_undegraded":"2024-04-26T11:48:26.993614+0000","last_fullsized":"2024-04-26T11:48:26.993614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'59","last_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_deep_scrub":"115'59","last_deep_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.993216+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:01.847961+0000","scrub_duration":0.0066337560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:22.028330+0000","last_change":"2024-04-26T11:48:22.028330+0000","last_active":"2024-04-26T11:48:22.028330+0000","last_peered":"2024-04-26T11:48:22.028330+0000","last_clean":"2024-04-26T11:48:22.028330+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:22.028330+0000","last_undegraded":"2024-04-26T11:48:22.028330+0000","last_fullsized":"2024-04-26T11:48:22.028330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_clean_scrub_stamp":"2024-04-26T11:48:22.028073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:50.488548+0000","scrub_duration":0.0032986119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":496,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:22.161514+0000","last_change":"2024-04-26T11:49:22.161779+0000","last_active":"2024-04-26T11:49:22.161514+0000","last_peered":"2024-04-26T11:49:22.161514+0000","last_clean":"2024-04-26T11:49:22.161514+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:49:22.161514+0000","last_undegraded":"2024-04-26T11:49:22.161514+0000","last_fullsized":"2024-04-26T11:49:22.161514+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:49:22.161465+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:49:22.161465+0000","last_clean_scrub_stamp":"2024-04-26T11:49:22.161465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:30.815987+0000","scrub_duration":0.0034889420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"115'72","reported_seq":92,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:15.150969+0000","last_change":"2024-04-26T11:48:15.150969+0000","last_active":"2024-04-26T11:48:15.150969+0000","last_peered":"2024-04-26T11:48:15.150969+0000","last_clean":"2024-04-26T11:48:15.150969+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:15.150969+0000","last_undegraded":"2024-04-26T11:48:15.150969+0000","last_fullsized":"2024-04-26T11:48:15.150969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'72","last_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_deep_scrub":"115'72","last_deep_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_clean_scrub_stamp":"2024-04-26T11:48:15.150680+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:41.664584+0000","scrub_duration":0.021253264000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:28.145442+0000","last_change":"2024-04-26T11:49:28.145667+0000","last_active":"2024-04-26T11:49:28.145442+0000","last_peered":"2024-04-26T11:49:28.145442+0000","last_clean":"2024-04-26T11:49:28.145442+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:49:28.145442+0000","last_undegraded":"2024-04-26T11:49:28.145442+0000","last_fullsized":"2024-04-26T11:49:28.145442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:28.145395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:28.145395+0000","last_clean_scrub_stamp":"2024-04-26T11:49:28.145395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:53.647454+0000","scrub_duration":0.0032670189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":573,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:23.712478+0000","last_change":"2024-04-26T11:48:23.712478+0000","last_active":"2024-04-26T11:48:23.712478+0000","last_peered":"2024-04-26T11:48:23.712478+0000","last_clean":"2024-04-26T11:48:23.712478+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:23.712478+0000","last_undegraded":"2024-04-26T11:48:23.712478+0000","last_fullsized":"2024-04-26T11:48:23.712478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_clean_scrub_stamp":"2024-04-26T11:48:23.712095+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:55.117125+0000","scrub_duration":0.0051007090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":574,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593103+0000","last_change":"2024-04-26T11:44:21.450243+0000","last_active":"2024-04-26T11:48:11.593103+0000","last_peered":"2024-04-26T11:48:11.593103+0000","last_clean":"2024-04-26T11:48:11.593103+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:48:11.593103+0000","last_undegraded":"2024-04-26T11:48:11.593103+0000","last_fullsized":"2024-04-26T11:48:11.593103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"115'416","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.029976+0000","last_change":"2024-04-26T11:48:36.029976+0000","last_active":"2024-04-26T11:48:36.029976+0000","last_peered":"2024-04-26T11:48:36.029976+0000","last_clean":"2024-04-26T11:48:36.029976+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:36.029976+0000","last_undegraded":"2024-04-26T11:48:36.029976+0000","last_fullsized":"2024-04-26T11:48:36.029976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'416","last_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_deep_scrub":"115'416","last_deep_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.029835+0000","objects_scrubbed":5,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:10.864228+0000","scrub_duration":0.034626879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":559,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:37.946809+0000","last_change":"2024-04-26T11:48:37.946809+0000","last_active":"2024-04-26T11:48:37.946809+0000","last_peered":"2024-04-26T11:48:37.946809+0000","last_clean":"2024-04-26T11:48:37.946809+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:37.946809+0000","last_undegraded":"2024-04-26T11:48:37.946809+0000","last_fullsized":"2024-04-26T11:48:37.946809+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'423","last_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_deep_scrub":"76'423","last_deep_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_clean_scrub_stamp":"2024-04-26T11:48:37.946505+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:45.776669+0000","scrub_duration":0.0044478900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"115'105","reported_seq":226,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:13.647691+0000","last_change":"2024-04-26T11:49:13.647691+0000","last_active":"2024-04-26T11:49:13.647691+0000","last_peered":"2024-04-26T11:49:13.647691+0000","last_clean":"2024-04-26T11:49:13.647691+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:49:13.647691+0000","last_undegraded":"2024-04-26T11:49:13.647691+0000","last_fullsized":"2024-04-26T11:49:13.647691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'105","last_scrub_stamp":"2024-04-26T11:49:13.647275+0000","last_deep_scrub":"115'105","last_deep_scrub_stamp":"2024-04-26T11:49:13.647275+0000","last_clean_scrub_stamp":"2024-04-26T11:49:13.647275+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:23.912985+0000","scrub_duration":0.0077776210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"115'335","reported_seq":480,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:03.180771+0000","last_change":"2024-04-26T11:49:03.180771+0000","last_active":"2024-04-26T11:49:03.180771+0000","last_peered":"2024-04-26T11:49:03.180771+0000","last_clean":"2024-04-26T11:49:03.180771+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:49:03.180771+0000","last_undegraded":"2024-04-26T11:49:03.180771+0000","last_fullsized":"2024-04-26T11:49:03.180771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'335","last_scrub_stamp":"2024-04-26T11:49:03.180575+0000","last_deep_scrub":"115'335","last_deep_scrub_stamp":"2024-04-26T11:49:03.180575+0000","last_clean_scrub_stamp":"2024-04-26T11:49:03.180575+0000","objects_scrubbed":1,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:20.897350+0000","scrub_duration":0.020406345999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":592,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.973251+0000","last_change":"2024-04-26T11:48:30.973251+0000","last_active":"2024-04-26T11:48:30.973251+0000","last_peered":"2024-04-26T11:48:30.973251+0000","last_clean":"2024-04-26T11:48:30.973251+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:30.973251+0000","last_undegraded":"2024-04-26T11:48:30.973251+0000","last_fullsized":"2024-04-26T11:48:30.973251+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'463","last_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_deep_scrub":"76'463","last_deep_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.972981+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:34.247031+0000","scrub_duration":0.0044136920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.019177+0000","last_change":"2024-04-26T11:48:12.019177+0000","last_active":"2024-04-26T11:48:12.019177+0000","last_peered":"2024-04-26T11:48:12.019177+0000","last_clean":"2024-04-26T11:48:12.019177+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:12.019177+0000","last_undegraded":"2024-04-26T11:48:12.019177+0000","last_fullsized":"2024-04-26T11:48:12.019177+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.018689+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:01.030509+0000","scrub_duration":0.0039670319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":588,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.005500+0000","last_change":"2024-04-26T11:48:30.005500+0000","last_active":"2024-04-26T11:48:30.005500+0000","last_peered":"2024-04-26T11:48:30.005500+0000","last_clean":"2024-04-26T11:48:30.005500+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:30.005500+0000","last_undegraded":"2024-04-26T11:48:30.005500+0000","last_fullsized":"2024-04-26T11:48:30.005500+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'447","last_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_deep_scrub":"76'447","last_deep_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.005160+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:09.022128+0000","scrub_duration":0.0044822300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":531,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:41.646917+0000","last_change":"2024-04-26T11:48:41.647158+0000","last_active":"2024-04-26T11:48:41.646917+0000","last_peered":"2024-04-26T11:48:41.646917+0000","last_clean":"2024-04-26T11:48:41.646917+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:41.646917+0000","last_undegraded":"2024-04-26T11:48:41.646917+0000","last_fullsized":"2024-04-26T11:48:41.646917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'366","last_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_deep_scrub":"76'366","last_deep_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_clean_scrub_stamp":"2024-04-26T11:48:41.646862+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:47.318788+0000","scrub_duration":0.0041890690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"115'776","reported_seq":890,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:05.101753+0000","last_change":"2024-04-26T11:49:05.101753+0000","last_active":"2024-04-26T11:49:05.101753+0000","last_peered":"2024-04-26T11:49:05.101753+0000","last_clean":"2024-04-26T11:49:05.101753+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:49:05.101753+0000","last_undegraded":"2024-04-26T11:49:05.101753+0000","last_fullsized":"2024-04-26T11:49:05.101753+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'776","last_scrub_stamp":"2024-04-26T11:49:05.101560+0000","last_deep_scrub":"115'776","last_deep_scrub_stamp":"2024-04-26T11:49:05.101560+0000","last_clean_scrub_stamp":"2024-04-26T11:49:05.101560+0000","objects_scrubbed":2,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:23.999436+0000","scrub_duration":0.031574363000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":511,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:37.260007+0000","last_change":"2024-04-26T11:49:37.260243+0000","last_active":"2024-04-26T11:49:37.260007+0000","last_peered":"2024-04-26T11:49:37.260007+0000","last_clean":"2024-04-26T11:49:37.260007+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:49:37.260007+0000","last_undegraded":"2024-04-26T11:49:37.260007+0000","last_fullsized":"2024-04-26T11:49:37.260007+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'385","last_scrub_stamp":"2024-04-26T11:49:37.259956+0000","last_deep_scrub":"76'385","last_deep_scrub_stamp":"2024-04-26T11:49:37.259956+0000","last_clean_scrub_stamp":"2024-04-26T11:49:37.259956+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:11.538341+0000","scrub_duration":0.0042895069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"115'329","reported_seq":446,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.155128+0000","last_change":"2024-04-26T11:49:07.155128+0000","last_active":"2024-04-26T11:49:07.155128+0000","last_peered":"2024-04-26T11:49:07.155128+0000","last_clean":"2024-04-26T11:49:07.155128+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:49:07.155128+0000","last_undegraded":"2024-04-26T11:49:07.155128+0000","last_fullsized":"2024-04-26T11:49:07.155128+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'329","last_scrub_stamp":"2024-04-26T11:49:07.154976+0000","last_deep_scrub":"115'329","last_deep_scrub_stamp":"2024-04-26T11:49:07.154976+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.154976+0000","objects_scrubbed":1,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:50.736767+0000","scrub_duration":0.017101642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":552,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:54.740054+0000","last_change":"2024-04-26T11:48:54.740054+0000","last_active":"2024-04-26T11:48:54.740054+0000","last_peered":"2024-04-26T11:48:54.740054+0000","last_clean":"2024-04-26T11:48:54.740054+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:54.740054+0000","last_undegraded":"2024-04-26T11:48:54.740054+0000","last_fullsized":"2024-04-26T11:48:54.740054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'385","last_scrub_stamp":"2024-04-26T11:48:54.739766+0000","last_deep_scrub":"76'385","last_deep_scrub_stamp":"2024-04-26T11:48:54.739766+0000","last_clean_scrub_stamp":"2024-04-26T11:48:54.739766+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:00.843817+0000","scrub_duration":0.0056441019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"115'354","reported_seq":504,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.792341+0000","last_change":"2024-04-26T11:49:07.792341+0000","last_active":"2024-04-26T11:49:07.792341+0000","last_peered":"2024-04-26T11:49:07.792341+0000","last_clean":"2024-04-26T11:49:07.792341+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:49:07.792341+0000","last_undegraded":"2024-04-26T11:49:07.792341+0000","last_fullsized":"2024-04-26T11:49:07.792341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'354","last_scrub_stamp":"2024-04-26T11:49:07.791996+0000","last_deep_scrub":"115'354","last_deep_scrub_stamp":"2024-04-26T11:49:07.791996+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.791996+0000","objects_scrubbed":3,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:03.875875+0000","scrub_duration":0.041359689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":867,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:29.698714+0000","last_change":"2024-04-26T11:48:29.698714+0000","last_active":"2024-04-26T11:48:29.698714+0000","last_peered":"2024-04-26T11:48:29.698714+0000","last_clean":"2024-04-26T11:48:29.698714+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:29.698714+0000","last_undegraded":"2024-04-26T11:48:29.698714+0000","last_fullsized":"2024-04-26T11:48:29.698714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'369","last_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_deep_scrub":"76'369","last_deep_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_clean_scrub_stamp":"2024-04-26T11:48:29.698434+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:04.873874+0000","scrub_duration":0.004418478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"115'58","reported_seq":179,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:18.727460+0000","last_change":"2024-04-26T11:49:18.727460+0000","last_active":"2024-04-26T11:49:18.727460+0000","last_peered":"2024-04-26T11:49:18.727460+0000","last_clean":"2024-04-26T11:49:18.727460+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:49:18.727460+0000","last_undegraded":"2024-04-26T11:49:18.727460+0000","last_fullsized":"2024-04-26T11:49:18.727460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'58","last_scrub_stamp":"2024-04-26T11:49:18.727169+0000","last_deep_scrub":"115'58","last_deep_scrub_stamp":"2024-04-26T11:49:18.727169+0000","last_clean_scrub_stamp":"2024-04-26T11:49:18.727169+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:29.056593+0000","scrub_duration":0.016535326999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":897,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:13.226901+0000","last_change":"2024-04-26T11:48:13.226901+0000","last_active":"2024-04-26T11:48:13.226901+0000","last_peered":"2024-04-26T11:48:13.226901+0000","last_clean":"2024-04-26T11:48:13.226901+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:13.226901+0000","last_undegraded":"2024-04-26T11:48:13.226901+0000","last_fullsized":"2024-04-26T11:48:13.226901+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'377","last_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_deep_scrub":"76'377","last_deep_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_clean_scrub_stamp":"2024-04-26T11:48:13.226463+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:03.708994+0000","scrub_duration":0.0044302090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"115'277","reported_seq":423,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.109273+0000","last_change":"2024-04-26T11:48:27.109273+0000","last_active":"2024-04-26T11:48:27.109273+0000","last_peered":"2024-04-26T11:48:27.109273+0000","last_clean":"2024-04-26T11:48:27.109273+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:27.109273+0000","last_undegraded":"2024-04-26T11:48:27.109273+0000","last_fullsized":"2024-04-26T11:48:27.109273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'277","last_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_deep_scrub":"115'277","last_deep_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.109059+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:02.122709+0000","scrub_duration":0.021146224000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":914,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:34.042997+0000","last_change":"2024-04-26T11:48:34.042997+0000","last_active":"2024-04-26T11:48:34.042997+0000","last_peered":"2024-04-26T11:48:34.042997+0000","last_clean":"2024-04-26T11:48:34.042997+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:34.042997+0000","last_undegraded":"2024-04-26T11:48:34.042997+0000","last_fullsized":"2024-04-26T11:48:34.042997+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'391","last_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_deep_scrub":"76'391","last_deep_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_clean_scrub_stamp":"2024-04-26T11:48:34.042706+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:24.193868+0000","scrub_duration":0.0052922139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"115'333","reported_seq":454,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:56.811047+0000","last_change":"2024-04-26T11:48:56.811047+0000","last_active":"2024-04-26T11:48:56.811047+0000","last_peered":"2024-04-26T11:48:56.811047+0000","last_clean":"2024-04-26T11:48:56.811047+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:56.811047+0000","last_undegraded":"2024-04-26T11:48:56.811047+0000","last_fullsized":"2024-04-26T11:48:56.811047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'333","last_scrub_stamp":"2024-04-26T11:48:56.810845+0000","last_deep_scrub":"115'333","last_deep_scrub_stamp":"2024-04-26T11:48:56.810845+0000","last_clean_scrub_stamp":"2024-04-26T11:48:56.810845+0000","objects_scrubbed":4,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.341984+0000","scrub_duration":0.0403226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":965,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:50.684402+0000","last_change":"2024-04-26T11:48:50.684402+0000","last_active":"2024-04-26T11:48:50.684402+0000","last_peered":"2024-04-26T11:48:50.684402+0000","last_clean":"2024-04-26T11:48:50.684402+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:50.684402+0000","last_undegraded":"2024-04-26T11:48:50.684402+0000","last_fullsized":"2024-04-26T11:48:50.684402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:50.684066+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:50.684066+0000","last_clean_scrub_stamp":"2024-04-26T11:48:50.684066+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:36.226053+0000","scrub_duration":0.0045709319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"115'52","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:48.474657+0000","last_change":"2024-04-26T11:49:48.474820+0000","last_active":"2024-04-26T11:49:48.474657+0000","last_peered":"2024-04-26T11:49:48.474657+0000","last_clean":"2024-04-26T11:49:48.474657+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:49:48.474657+0000","last_undegraded":"2024-04-26T11:49:48.474657+0000","last_fullsized":"2024-04-26T11:49:48.474657+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'52","last_scrub_stamp":"2024-04-26T11:49:48.474634+0000","last_deep_scrub":"115'52","last_deep_scrub_stamp":"2024-04-26T11:49:48.474634+0000","last_clean_scrub_stamp":"2024-04-26T11:49:48.474634+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:14.618369+0000","scrub_duration":0.015001399,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":993,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:02.136503+0000","last_change":"2024-04-26T11:49:02.136503+0000","last_active":"2024-04-26T11:49:02.136503+0000","last_peered":"2024-04-26T11:49:02.136503+0000","last_clean":"2024-04-26T11:49:02.136503+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:49:02.136503+0000","last_undegraded":"2024-04-26T11:49:02.136503+0000","last_fullsized":"2024-04-26T11:49:02.136503+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'436","last_scrub_stamp":"2024-04-26T11:49:02.136184+0000","last_deep_scrub":"76'436","last_deep_scrub_stamp":"2024-04-26T11:49:02.136184+0000","last_clean_scrub_stamp":"2024-04-26T11:49:02.136184+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:14.675035+0000","scrub_duration":0.0045192979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"115'57","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:19.159861+0000","last_change":"2024-04-26T11:49:19.160126+0000","last_active":"2024-04-26T11:49:19.159861+0000","last_peered":"2024-04-26T11:49:19.159861+0000","last_clean":"2024-04-26T11:49:19.159861+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:49:19.159861+0000","last_undegraded":"2024-04-26T11:49:19.159861+0000","last_fullsized":"2024-04-26T11:49:19.159861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'57","last_scrub_stamp":"2024-04-26T11:49:19.159801+0000","last_deep_scrub":"115'57","last_deep_scrub_stamp":"2024-04-26T11:49:19.159801+0000","last_clean_scrub_stamp":"2024-04-26T11:49:19.159801+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:43.568000+0000","scrub_duration":0.018090722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7927,"ondisk_log_size":7927,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738441,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200496,"kb_used_data":89064,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171344,"statfs":{"total":96636764160,"available":96431456256,"internally_reserved":0,"allocated":91201536,"data_stored":90584365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.56999999999999995,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73699999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.52400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77000000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66800000000000004,"15min":0.66000000000000003},"min":{"1min":0.625,"5min":0.505,"15min":0.505},"max":{"1min":0.77700000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.66200000000000003}]}]},{"osd":1,"up_from":72,"seq":309237645346,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125616,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246224,"statfs":{"total":96636764160,"available":96508133376,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.49399999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.55100000000000005,"5min":0.379,"15min":0.379},"max":{"1min":0.75,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Apr 26 11:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.69699999999999995},"min":{"1min":0.60099999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.55800000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.65400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190668,"kb_used_data":83332,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181172,"statfs":{"total":96636764160,"available":96441520128,"internally_reserved":0,"allocated":85331968,"data_stored":84726408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.53900000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63800000000000001,"15min":0.68600000000000005},"min":{"1min":0.58899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.69199999999999995},"min":{"1min":0.59899999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.76200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:49:53.752 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.753 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.753 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.753 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.753 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.753 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.753 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.753 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.753 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.754 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.754 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.754 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.755 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:44:20.031920+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.755 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:49:53.755 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:50:13.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:50:14.089 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:50:14.092 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:50:14.111 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-04-26T11:50:12.099869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34138,"ondisk_log_size":34138,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516780,"kb_used_data":252436,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598740,"statfs":{"total":289910292480,"available":289381109760,"internally_reserved":0,"allocated":258494464,"data_stored":256676283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004441"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":974,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:03.597562+0000","last_change":"2024-04-26T11:50:03.597797+0000","last_active":"2024-04-26T11:50:03.597562+0000","last_peered":"2024-04-26T11:50:03.597562+0000","last_clean":"2024-04-26T11:50:03.597562+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:50:03.597562+0000","last_undegraded":"2024-04-26T11:50:03.597562+0000","last_fullsized":"2024-04-26T11:50:03.597562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:50:03.597510+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:50:03.597510+0000","last_clean_scrub_stamp":"2024-04-26T11:50:03.597510+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:02.252872+0000","scrub_duration":0.003742418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1031,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:00.601261+0000","last_change":"2024-04-26T11:50:00.601655+0000","last_active":"2024-04-26T11:50:00.601261+0000","last_peered":"2024-04-26T11:50:00.601261+0000","last_clean":"2024-04-26T11:50:00.601261+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:50:00.601261+0000","last_undegraded":"2024-04-26T11:50:00.601261+0000","last_fullsized":"2024-04-26T11:50:00.601261+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'438","last_scrub_stamp":"2024-04-26T11:50:00.601211+0000","last_deep_scrub":"76'438","last_deep_scrub_stamp":"2024-04-26T11:50:00.601211+0000","last_clean_scrub_stamp":"2024-04-26T11:50:00.601211+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:26.103271+0000","scrub_duration":0.0046834570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593307+0000","last_change":"2024-04-26T11:44:21.451334+0000","last_active":"2024-04-26T11:48:11.593307+0000","last_peered":"2024-04-26T11:48:11.593307+0000","last_clean":"2024-04-26T11:48:11.593307+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:48:11.593307+0000","last_undegraded":"2024-04-26T11:48:11.593307+0000","last_fullsized":"2024-04-26T11:48:11.593307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":841,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593170+0000","last_change":"2024-04-26T11:47:21.169350+0000","last_active":"2024-04-26T11:48:11.593170+0000","last_peered":"2024-04-26T11:48:11.593170+0000","last_clean":"2024-04-26T11:48:11.593170+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:48:11.593170+0000","last_undegraded":"2024-04-26T11:48:11.593170+0000","last_fullsized":"2024-04-26T11:48:11.593170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":930,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:53.624611+0000","last_change":"2024-04-26T11:49:53.624846+0000","last_active":"2024-04-26T11:49:53.624611+0000","last_peered":"2024-04-26T11:49:53.624611+0000","last_clean":"2024-04-26T11:49:53.624611+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:49:53.624611+0000","last_undegraded":"2024-04-26T11:49:53.624611+0000","last_fullsized":"2024-04-26T11:49:53.624611+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'403","last_scrub_stamp":"2024-04-26T11:49:53.624559+0000","last_deep_scrub":"76'403","last_deep_scrub_stamp":"2024-04-26T11:49:53.624559+0000","last_clean_scrub_stamp":"2024-04-26T11:49:53.624559+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:50.181687+0000","scrub_duration":0.0039870950000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":858,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:08.591762+0000","last_change":"2024-04-26T11:50:08.592013+0000","last_active":"2024-04-26T11:50:08.591762+0000","last_peered":"2024-04-26T11:50:08.591762+0000","last_clean":"2024-04-26T11:50:08.591762+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:50:08.591762+0000","last_undegraded":"2024-04-26T11:50:08.591762+0000","last_fullsized":"2024-04-26T11:50:08.591762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'364","last_scrub_stamp":"2024-04-26T11:50:08.591711+0000","last_deep_scrub":"77'364","last_deep_scrub_stamp":"2024-04-26T11:50:08.591711+0000","last_clean_scrub_stamp":"2024-04-26T11:50:08.591711+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:02.855134+0000","scrub_duration":0.0049684559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1050,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:01.384887+0000","last_change":"2024-04-26T11:50:01.385139+0000","last_active":"2024-04-26T11:50:01.384887+0000","last_peered":"2024-04-26T11:50:01.384887+0000","last_clean":"2024-04-26T11:50:01.384887+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:50:01.384887+0000","last_undegraded":"2024-04-26T11:50:01.384887+0000","last_fullsized":"2024-04-26T11:50:01.384887+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'454","last_scrub_stamp":"2024-04-26T11:50:01.384830+0000","last_deep_scrub":"76'454","last_deep_scrub_stamp":"2024-04-26T11:50:01.384830+0000","last_clean_scrub_stamp":"2024-04-26T11:50:01.384830+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:34.002746+0000","scrub_duration":0.0049391590000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":848,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:11.593128+0000","last_change":"2024-04-26T11:47:39.143066+0000","last_active":"2024-04-26T11:48:11.593128+0000","last_peered":"2024-04-26T11:48:11.593128+0000","last_clean":"2024-04-26T11:48:11.593128+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:48:11.593128+0000","last_undegraded":"2024-04-26T11:48:11.593128+0000","last_fullsized":"2024-04-26T11:48:11.593128+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:44:21.039002+0000","last_clean_scrub_stamp":"2024-04-26T11:44:21.039002+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":555,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:33.918870+0000","last_change":"2024-04-26T11:48:33.918870+0000","last_active":"2024-04-26T11:48:33.918870+0000","last_peered":"2024-04-26T11:48:33.918870+0000","last_clean":"2024-04-26T11:48:33.918870+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:33.918870+0000","last_undegraded":"2024-04-26T11:48:33.918870+0000","last_fullsized":"2024-04-26T11:48:33.918870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'421","last_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_deep_scrub":"77'421","last_deep_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:33.918413+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:33.584386+0000","scrub_duration":0.0044004430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":973,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:52.593161+0000","last_change":"2024-04-26T11:49:52.593434+0000","last_active":"2024-04-26T11:49:52.593161+0000","last_peered":"2024-04-26T11:49:52.593161+0000","last_clean":"2024-04-26T11:49:52.593161+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:49:52.593161+0000","last_undegraded":"2024-04-26T11:49:52.593161+0000","last_fullsized":"2024-04-26T11:49:52.593161+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:49:52.593110+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:49:52.593110+0000","last_clean_scrub_stamp":"2024-04-26T11:49:52.593110+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:37.218663+0000","scrub_duration":0.0041492619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":886,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:05.550433+0000","last_change":"2024-04-26T11:50:05.550691+0000","last_active":"2024-04-26T11:50:05.550433+0000","last_peered":"2024-04-26T11:50:05.550433+0000","last_clean":"2024-04-26T11:50:05.550433+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:50:05.550433+0000","last_undegraded":"2024-04-26T11:50:05.550433+0000","last_fullsized":"2024-04-26T11:50:05.550433+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'372","last_scrub_stamp":"2024-04-26T11:50:05.550384+0000","last_deep_scrub":"76'372","last_deep_scrub_stamp":"2024-04-26T11:50:05.550384+0000","last_clean_scrub_stamp":"2024-04-26T11:50:05.550384+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:07.523072+0000","scrub_duration":0.0046840040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":504,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.699169+0000","last_change":"2024-04-26T11:48:10.699169+0000","last_active":"2024-04-26T11:48:10.699169+0000","last_peered":"2024-04-26T11:48:10.699169+0000","last_clean":"2024-04-26T11:48:10.699169+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:10.699169+0000","last_undegraded":"2024-04-26T11:48:10.699169+0000","last_fullsized":"2024-04-26T11:48:10.699169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'345","last_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_deep_scrub":"76'345","last_deep_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_clean_scrub_stamp":"2024-04-26T11:48:10.698866+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:11.706179+0000","scrub_duration":0.0058868610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":906,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:35.635628+0000","last_change":"2024-04-26T11:49:35.635852+0000","last_active":"2024-04-26T11:49:35.635628+0000","last_peered":"2024-04-26T11:49:35.635628+0000","last_clean":"2024-04-26T11:49:35.635628+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:49:35.635628+0000","last_undegraded":"2024-04-26T11:49:35.635628+0000","last_fullsized":"2024-04-26T11:49:35.635628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'388","last_scrub_stamp":"2024-04-26T11:49:35.635578+0000","last_deep_scrub":"76'388","last_deep_scrub_stamp":"2024-04-26T11:49:35.635578+0000","last_clean_scrub_stamp":"2024-04-26T11:49:35.635578+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:47.567173+0000","scrub_duration":0.0042458319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":576,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.180736+0000","last_change":"2024-04-26T11:48:12.180736+0000","last_active":"2024-04-26T11:48:12.180736+0000","last_peered":"2024-04-26T11:48:12.180736+0000","last_clean":"2024-04-26T11:48:12.180736+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:12.180736+0000","last_undegraded":"2024-04-26T11:48:12.180736+0000","last_fullsized":"2024-04-26T11:48:12.180736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'418","last_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_deep_scrub":"76'418","last_deep_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.180413+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.283252+0000","scrub_duration":0.0053701490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":618,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.057064+0000","last_change":"2024-04-26T11:48:26.057064+0000","last_active":"2024-04-26T11:48:26.057064+0000","last_peered":"2024-04-26T11:48:26.057064+0000","last_clean":"2024-04-26T11:48:26.057064+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:26.057064+0000","last_undegraded":"2024-04-26T11:48:26.057064+0000","last_fullsized":"2024-04-26T11:48:26.057064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'428","last_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_deep_scrub":"76'428","last_deep_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.056732+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:01.294605+0000","scrub_duration":0.0057736879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1073,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:56.432370+0000","last_change":"2024-04-26T11:49:56.432619+0000","last_active":"2024-04-26T11:49:56.432370+0000","last_peered":"2024-04-26T11:49:56.432370+0000","last_clean":"2024-04-26T11:49:56.432370+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:49:56.432370+0000","last_undegraded":"2024-04-26T11:49:56.432370+0000","last_fullsized":"2024-04-26T11:49:56.432370+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'457","last_scrub_stamp":"2024-04-26T11:49:56.432311+0000","last_deep_scrub":"76'457","last_deep_scrub_stamp":"2024-04-26T11:49:56.432311+0000","last_clean_scrub_stamp":"2024-04-26T11:49:56.432311+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:13.475676+0000","scrub_duration":0.0047086180000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":523,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.949389+0000","last_change":"2024-04-26T11:48:27.949389+0000","last_active":"2024-04-26T11:48:27.949389+0000","last_peered":"2024-04-26T11:48:27.949389+0000","last_clean":"2024-04-26T11:48:27.949389+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:27.949389+0000","last_undegraded":"2024-04-26T11:48:27.949389+0000","last_fullsized":"2024-04-26T11:48:27.949389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.948898+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:29.597751+0000","scrub_duration":0.0043304119999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":938,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:34.643935+0000","last_change":"2024-04-26T11:49:34.644187+0000","last_active":"2024-04-26T11:49:34.643935+0000","last_peered":"2024-04-26T11:49:34.643935+0000","last_clean":"2024-04-26T11:49:34.643935+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:49:34.643935+0000","last_undegraded":"2024-04-26T11:49:34.643935+0000","last_fullsized":"2024-04-26T11:49:34.643935+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:49:34.643882+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:49:34.643882+0000","last_clean_scrub_stamp":"2024-04-26T11:49:34.643882+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:47.182733+0000","scrub_duration":0.0051839850000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":544,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:01.026835+0000","last_change":"2024-04-26T11:49:01.026835+0000","last_active":"2024-04-26T11:49:01.026835+0000","last_peered":"2024-04-26T11:49:01.026835+0000","last_clean":"2024-04-26T11:49:01.026835+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:49:01.026835+0000","last_undegraded":"2024-04-26T11:49:01.026835+0000","last_fullsized":"2024-04-26T11:49:01.026835+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:49:01.026549+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:49:01.026549+0000","last_clean_scrub_stamp":"2024-04-26T11:49:01.026549+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:07.466257+0000","scrub_duration":0.0042339500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1027,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.158150+0000","last_change":"2024-04-26T11:49:07.158425+0000","last_active":"2024-04-26T11:49:07.158150+0000","last_peered":"2024-04-26T11:49:07.158150+0000","last_clean":"2024-04-26T11:49:07.158150+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:49:07.158150+0000","last_undegraded":"2024-04-26T11:49:07.158150+0000","last_fullsized":"2024-04-26T11:49:07.158150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'441","last_scrub_stamp":"2024-04-26T11:49:07.158098+0000","last_deep_scrub":"76'441","last_deep_scrub_stamp":"2024-04-26T11:49:07.158098+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.158098+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:31.523066+0000","scrub_duration":0.0045499240000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":941,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:40.997248+0000","last_change":"2024-04-26T11:48:40.997248+0000","last_active":"2024-04-26T11:48:40.997248+0000","last_peered":"2024-04-26T11:48:40.997248+0000","last_clean":"2024-04-26T11:48:40.997248+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:40.997248+0000","last_undegraded":"2024-04-26T11:48:40.997248+0000","last_fullsized":"2024-04-26T11:48:40.997248+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'404","last_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_deep_scrub":"76'404","last_deep_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_clean_scrub_stamp":"2024-04-26T11:48:40.996775+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:28.668510+0000","scrub_duration":0.0044704089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":590,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.703736+0000","last_change":"2024-04-26T11:48:16.703736+0000","last_active":"2024-04-26T11:48:16.703736+0000","last_peered":"2024-04-26T11:48:16.703736+0000","last_clean":"2024-04-26T11:48:16.703736+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:16.703736+0000","last_undegraded":"2024-04-26T11:48:16.703736+0000","last_fullsized":"2024-04-26T11:48:16.703736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.703427+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:09.548341+0000","scrub_duration":0.0060063829999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:20.145425+0000","last_change":"2024-04-26T11:49:20.145425+0000","last_active":"2024-04-26T11:49:20.145425+0000","last_peered":"2024-04-26T11:49:20.145425+0000","last_clean":"2024-04-26T11:49:20.145425+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:49:20.145425+0000","last_undegraded":"2024-04-26T11:49:20.145425+0000","last_fullsized":"2024-04-26T11:49:20.145425+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-26T11:49:20.145133+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-26T11:49:20.145133+0000","last_clean_scrub_stamp":"2024-04-26T11:49:20.145133+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:29.007352+0000","scrub_duration":0.0047260169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1045,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:39.639525+0000","last_change":"2024-04-26T11:49:39.639789+0000","last_active":"2024-04-26T11:49:39.639525+0000","last_peered":"2024-04-26T11:49:39.639525+0000","last_clean":"2024-04-26T11:49:39.639525+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:49:39.639525+0000","last_undegraded":"2024-04-26T11:49:39.639525+0000","last_fullsized":"2024-04-26T11:49:39.639525+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'439","last_scrub_stamp":"2024-04-26T11:49:39.639474+0000","last_deep_scrub":"76'439","last_deep_scrub_stamp":"2024-04-26T11:49:39.639474+0000","last_clean_scrub_stamp":"2024-04-26T11:49:39.639474+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:04.004442+0000","scrub_duration":0.0045361359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:27.680697+0000","last_change":"2024-04-26T11:49:27.680967+0000","last_active":"2024-04-26T11:49:27.680697+0000","last_peered":"2024-04-26T11:49:27.680697+0000","last_clean":"2024-04-26T11:49:27.680697+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:49:27.680697+0000","last_undegraded":"2024-04-26T11:49:27.680697+0000","last_fullsized":"2024-04-26T11:49:27.680697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:49:27.680647+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:49:27.680647+0000","last_clean_scrub_stamp":"2024-04-26T11:49:27.680647+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:03.491704+0000","scrub_duration":0.0047388680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":634,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:43.442657+0000","last_change":"2024-04-26T11:49:43.442897+0000","last_active":"2024-04-26T11:49:43.442657+0000","last_peered":"2024-04-26T11:49:43.442657+0000","last_clean":"2024-04-26T11:49:43.442657+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:49:43.442657+0000","last_undegraded":"2024-04-26T11:49:43.442657+0000","last_fullsized":"2024-04-26T11:49:43.442657+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'492","last_scrub_stamp":"2024-04-26T11:49:43.442597+0000","last_deep_scrub":"76'492","last_deep_scrub_stamp":"2024-04-26T11:49:43.442597+0000","last_clean_scrub_stamp":"2024-04-26T11:49:43.442597+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:24.726836+0000","scrub_duration":0.0051693030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.159519+0000","last_change":"2024-04-26T11:48:20.159519+0000","last_active":"2024-04-26T11:48:20.159519+0000","last_peered":"2024-04-26T11:48:20.159519+0000","last_clean":"2024-04-26T11:48:20.159519+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:20.159519+0000","last_undegraded":"2024-04-26T11:48:20.159519+0000","last_fullsized":"2024-04-26T11:48:20.159519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.159224+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:05.701212+0000","scrub_duration":0.0055914299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":609,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:57.742786+0000","last_change":"2024-04-26T11:48:57.743169+0000","last_active":"2024-04-26T11:48:57.742786+0000","last_peered":"2024-04-26T11:48:57.742786+0000","last_clean":"2024-04-26T11:48:57.742786+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:57.742786+0000","last_undegraded":"2024-04-26T11:48:57.742786+0000","last_fullsized":"2024-04-26T11:48:57.742786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'398","last_scrub_stamp":"2024-04-26T11:48:57.742669+0000","last_deep_scrub":"76'398","last_deep_scrub_stamp":"2024-04-26T11:48:57.742669+0000","last_clean_scrub_stamp":"2024-04-26T11:48:57.742669+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:32.756319+0000","scrub_duration":0.0055375609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":521,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:12.111381+0000","last_change":"2024-04-26T11:49:12.111381+0000","last_active":"2024-04-26T11:49:12.111381+0000","last_peered":"2024-04-26T11:49:12.111381+0000","last_clean":"2024-04-26T11:49:12.111381+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:49:12.111381+0000","last_undegraded":"2024-04-26T11:49:12.111381+0000","last_fullsized":"2024-04-26T11:49:12.111381+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'384","last_scrub_stamp":"2024-04-26T11:49:12.111081+0000","last_deep_scrub":"76'384","last_deep_scrub_stamp":"2024-04-26T11:49:12.111081+0000","last_clean_scrub_stamp":"2024-04-26T11:49:12.111081+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:26.233239+0000","scrub_duration":0.0042686479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":638,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:42.691464+0000","last_change":"2024-04-26T11:48:42.691846+0000","last_active":"2024-04-26T11:48:42.691464+0000","last_peered":"2024-04-26T11:48:42.691464+0000","last_clean":"2024-04-26T11:48:42.691464+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:42.691464+0000","last_undegraded":"2024-04-26T11:48:42.691464+0000","last_fullsized":"2024-04-26T11:48:42.691464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'467","last_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_deep_scrub":"76'467","last_deep_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_clean_scrub_stamp":"2024-04-26T11:48:42.691415+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:34.091246+0000","scrub_duration":0.0058108070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":586,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:57.122777+0000","last_change":"2024-04-26T11:48:57.122777+0000","last_active":"2024-04-26T11:48:57.122777+0000","last_peered":"2024-04-26T11:48:57.122777+0000","last_clean":"2024-04-26T11:48:57.122777+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:57.122777+0000","last_undegraded":"2024-04-26T11:48:57.122777+0000","last_fullsized":"2024-04-26T11:48:57.122777+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'429","last_scrub_stamp":"2024-04-26T11:48:57.122503+0000","last_deep_scrub":"76'429","last_deep_scrub_stamp":"2024-04-26T11:48:57.122503+0000","last_clean_scrub_stamp":"2024-04-26T11:48:57.122503+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:41.507208+0000","scrub_duration":0.0037513580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":963,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.161557+0000","last_change":"2024-04-26T11:48:16.161557+0000","last_active":"2024-04-26T11:48:16.161557+0000","last_peered":"2024-04-26T11:48:16.161557+0000","last_clean":"2024-04-26T11:48:16.161557+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:16.161557+0000","last_undegraded":"2024-04-26T11:48:16.161557+0000","last_fullsized":"2024-04-26T11:48:16.161557+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'412","last_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_deep_scrub":"76'412","last_deep_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.161259+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:19.609307+0000","scrub_duration":0.005601534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":855,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:46.658998+0000","last_change":"2024-04-26T11:48:46.658998+0000","last_active":"2024-04-26T11:48:46.658998+0000","last_peered":"2024-04-26T11:48:46.658998+0000","last_clean":"2024-04-26T11:48:46.658998+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:46.658998+0000","last_undegraded":"2024-04-26T11:48:46.658998+0000","last_fullsized":"2024-04-26T11:48:46.658998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'370","last_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_deep_scrub":"76'370","last_deep_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_clean_scrub_stamp":"2024-04-26T11:48:46.658495+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:50.106542+0000","scrub_duration":0.0045947180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"115'492","reported_seq":640,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:39.978630+0000","last_change":"2024-04-26T11:48:39.978630+0000","last_active":"2024-04-26T11:48:39.978630+0000","last_peered":"2024-04-26T11:48:39.978630+0000","last_clean":"2024-04-26T11:48:39.978630+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:39.978630+0000","last_undegraded":"2024-04-26T11:48:39.978630+0000","last_fullsized":"2024-04-26T11:48:39.978630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'492","last_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_deep_scrub":"115'492","last_deep_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_clean_scrub_stamp":"2024-04-26T11:48:39.978491+0000","objects_scrubbed":4,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:30.699411+0000","scrub_duration":0.028156690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":994,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.672399+0000","last_change":"2024-04-26T11:48:36.672399+0000","last_active":"2024-04-26T11:48:36.672399+0000","last_peered":"2024-04-26T11:48:36.672399+0000","last_clean":"2024-04-26T11:48:36.672399+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:36.672399+0000","last_undegraded":"2024-04-26T11:48:36.672399+0000","last_fullsized":"2024-04-26T11:48:36.672399+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'411","last_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_deep_scrub":"76'411","last_deep_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.672084+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:47.824742+0000","scrub_duration":0.0043867059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":77,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:55.128485+0000","last_change":"2024-04-26T11:48:55.128485+0000","last_active":"2024-04-26T11:48:55.128485+0000","last_peered":"2024-04-26T11:48:55.128485+0000","last_clean":"2024-04-26T11:48:55.128485+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:55.128485+0000","last_undegraded":"2024-04-26T11:48:55.128485+0000","last_fullsized":"2024-04-26T11:48:55.128485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:55.128180+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:55.128180+0000","last_clean_scrub_stamp":"2024-04-26T11:48:55.128180+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:20.475572+0000","scrub_duration":0.0032158289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.973582+0000","last_change":"2024-04-26T11:48:38.973582+0000","last_active":"2024-04-26T11:48:38.973582+0000","last_peered":"2024-04-26T11:48:38.973582+0000","last_clean":"2024-04-26T11:48:38.973582+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:38.973582+0000","last_undegraded":"2024-04-26T11:48:38.973582+0000","last_fullsized":"2024-04-26T11:48:38.973582+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.973282+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:59.469110+0000","scrub_duration":0.0046745279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":181,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:23.744022+0000","last_change":"2024-04-26T11:49:23.744279+0000","last_active":"2024-04-26T11:49:23.744022+0000","last_peered":"2024-04-26T11:49:23.744022+0000","last_clean":"2024-04-26T11:49:23.744022+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:49:23.744022+0000","last_undegraded":"2024-04-26T11:49:23.744022+0000","last_fullsized":"2024-04-26T11:49:23.744022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'60","last_scrub_stamp":"2024-04-26T11:49:23.743971+0000","last_deep_scrub":"71'60","last_deep_scrub_stamp":"2024-04-26T11:49:23.743971+0000","last_clean_scrub_stamp":"2024-04-26T11:49:23.743971+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:24.577731+0000","scrub_duration":0.0030668650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":563,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:51.006799+0000","last_change":"2024-04-26T11:48:51.006799+0000","last_active":"2024-04-26T11:48:51.006799+0000","last_peered":"2024-04-26T11:48:51.006799+0000","last_clean":"2024-04-26T11:48:51.006799+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:51.006799+0000","last_undegraded":"2024-04-26T11:48:51.006799+0000","last_fullsized":"2024-04-26T11:48:51.006799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:51.006513+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:51.006513+0000","last_clean_scrub_stamp":"2024-04-26T11:48:51.006513+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:16.562657+0000","scrub_duration":0.0040201380000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"115'71","reported_seq":192,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:58.169654+0000","last_change":"2024-04-26T11:48:58.169654+0000","last_active":"2024-04-26T11:48:58.169654+0000","last_peered":"2024-04-26T11:48:58.169654+0000","last_clean":"2024-04-26T11:48:58.169654+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:58.169654+0000","last_undegraded":"2024-04-26T11:48:58.169654+0000","last_fullsized":"2024-04-26T11:48:58.169654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'71","last_scrub_stamp":"2024-04-26T11:48:58.169317+0000","last_deep_scrub":"115'71","last_deep_scrub_stamp":"2024-04-26T11:48:58.169317+0000","last_clean_scrub_stamp":"2024-04-26T11:48:58.169317+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:30.105511+0000","scrub_duration":0.010931368,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"115'216","reported_seq":337,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:52.101678+0000","last_change":"2024-04-26T11:48:52.101678+0000","last_active":"2024-04-26T11:48:52.101678+0000","last_peered":"2024-04-26T11:48:52.101678+0000","last_clean":"2024-04-26T11:48:52.101678+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:52.101678+0000","last_undegraded":"2024-04-26T11:48:52.101678+0000","last_fullsized":"2024-04-26T11:48:52.101678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'216","last_scrub_stamp":"2024-04-26T11:48:52.101470+0000","last_deep_scrub":"115'216","last_deep_scrub_stamp":"2024-04-26T11:48:52.101470+0000","last_clean_scrub_stamp":"2024-04-26T11:48:52.101470+0000","objects_scrubbed":2,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:52.935231+0000","scrub_duration":0.022234593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":553,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.700459+0000","last_change":"2024-04-26T11:48:19.700459+0000","last_active":"2024-04-26T11:48:19.700459+0000","last_peered":"2024-04-26T11:48:19.700459+0000","last_clean":"2024-04-26T11:48:19.700459+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:19.700459+0000","last_undegraded":"2024-04-26T11:48:19.700459+0000","last_fullsized":"2024-04-26T11:48:19.700459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.700054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:19.776698+0000","scrub_duration":0.0059321139999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"115'394","reported_seq":515,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:21.771172+0000","last_change":"2024-04-26T11:49:21.771295+0000","last_active":"2024-04-26T11:49:21.771172+0000","last_peered":"2024-04-26T11:49:21.771172+0000","last_clean":"2024-04-26T11:49:21.771172+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:49:21.771172+0000","last_undegraded":"2024-04-26T11:49:21.771172+0000","last_fullsized":"2024-04-26T11:49:21.771172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'394","last_scrub_stamp":"2024-04-26T11:49:21.771148+0000","last_deep_scrub":"115'394","last_deep_scrub_stamp":"2024-04-26T11:49:21.771148+0000","last_clean_scrub_stamp":"2024-04-26T11:49:21.771148+0000","objects_scrubbed":2,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:17.795675+0000","scrub_duration":0.022322965,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1044,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:49.652705+0000","last_change":"2024-04-26T11:48:49.652958+0000","last_active":"2024-04-26T11:48:49.652705+0000","last_peered":"2024-04-26T11:48:49.652705+0000","last_clean":"2024-04-26T11:48:49.652705+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:49.652705+0000","last_undegraded":"2024-04-26T11:48:49.652705+0000","last_fullsized":"2024-04-26T11:48:49.652705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'453","last_scrub_stamp":"2024-04-26T11:48:49.652654+0000","last_deep_scrub":"76'453","last_deep_scrub_stamp":"2024-04-26T11:48:49.652654+0000","last_clean_scrub_stamp":"2024-04-26T11:48:49.652654+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.485049+0000","scrub_duration":0.0048848520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"115'588","reported_seq":709,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:47.006099+0000","last_change":"2024-04-26T11:48:47.006099+0000","last_active":"2024-04-26T11:48:47.006099+0000","last_peered":"2024-04-26T11:48:47.006099+0000","last_clean":"2024-04-26T11:48:47.006099+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:47.006099+0000","last_undegraded":"2024-04-26T11:48:47.006099+0000","last_fullsized":"2024-04-26T11:48:47.006099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'588","last_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_deep_scrub":"115'588","last_deep_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_clean_scrub_stamp":"2024-04-26T11:48:47.005948+0000","objects_scrubbed":2,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:57.335372+0000","scrub_duration":0.022816893000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1028,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.113972+0000","last_change":"2024-04-26T11:48:19.113972+0000","last_active":"2024-04-26T11:48:19.113972+0000","last_peered":"2024-04-26T11:48:19.113972+0000","last_clean":"2024-04-26T11:48:19.113972+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:19.113972+0000","last_undegraded":"2024-04-26T11:48:19.113972+0000","last_fullsized":"2024-04-26T11:48:19.113972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'446","last_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_deep_scrub":"76'446","last_deep_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.113630+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:18.946024+0000","scrub_duration":0.0051973490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":196,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:52.452971+0000","last_change":"2024-04-26T11:49:52.453221+0000","last_active":"2024-04-26T11:49:52.452971+0000","last_peered":"2024-04-26T11:49:52.452971+0000","last_clean":"2024-04-26T11:49:52.452971+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:49:52.452971+0000","last_undegraded":"2024-04-26T11:49:52.452971+0000","last_fullsized":"2024-04-26T11:49:52.452971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'62","last_scrub_stamp":"2024-04-26T11:49:52.452922+0000","last_deep_scrub":"74'62","last_deep_scrub_stamp":"2024-04-26T11:49:52.452922+0000","last_clean_scrub_stamp":"2024-04-26T11:49:52.452922+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:56.551494+0000","scrub_duration":0.0032149769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":633,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:47.489963+0000","last_change":"2024-04-26T11:49:47.490262+0000","last_active":"2024-04-26T11:49:47.489963+0000","last_peered":"2024-04-26T11:49:47.489963+0000","last_clean":"2024-04-26T11:49:47.489963+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:49:47.489963+0000","last_undegraded":"2024-04-26T11:49:47.489963+0000","last_fullsized":"2024-04-26T11:49:47.489963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'449","last_scrub_stamp":"2024-04-26T11:49:47.489914+0000","last_deep_scrub":"76'449","last_deep_scrub_stamp":"2024-04-26T11:49:47.489914+0000","last_clean_scrub_stamp":"2024-04-26T11:49:47.489914+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:21.262807+0000","scrub_duration":0.004081182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"115'265","reported_seq":388,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:54.113217+0000","last_change":"2024-04-26T11:48:54.113217+0000","last_active":"2024-04-26T11:48:54.113217+0000","last_peered":"2024-04-26T11:48:54.113217+0000","last_clean":"2024-04-26T11:48:54.113217+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:54.113217+0000","last_undegraded":"2024-04-26T11:48:54.113217+0000","last_fullsized":"2024-04-26T11:48:54.113217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'265","last_scrub_stamp":"2024-04-26T11:48:54.113037+0000","last_deep_scrub":"115'265","last_deep_scrub_stamp":"2024-04-26T11:48:54.113037+0000","last_clean_scrub_stamp":"2024-04-26T11:48:54.113037+0000","objects_scrubbed":3,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:56.229153+0000","scrub_duration":0.024456727000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":975,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.998461+0000","last_change":"2024-04-26T11:48:38.998461+0000","last_active":"2024-04-26T11:48:38.998461+0000","last_peered":"2024-04-26T11:48:38.998461+0000","last_clean":"2024-04-26T11:48:38.998461+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:38.998461+0000","last_undegraded":"2024-04-26T11:48:38.998461+0000","last_fullsized":"2024-04-26T11:48:38.998461+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.998146+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:36.290726+0000","scrub_duration":0.0044019580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"115'152","reported_seq":297,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:48.398010+0000","last_change":"2024-04-26T11:49:48.398259+0000","last_active":"2024-04-26T11:49:48.398010+0000","last_peered":"2024-04-26T11:49:48.398010+0000","last_clean":"2024-04-26T11:49:48.398010+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:49:48.398010+0000","last_undegraded":"2024-04-26T11:49:48.398010+0000","last_fullsized":"2024-04-26T11:49:48.398010+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'152","last_scrub_stamp":"2024-04-26T11:49:48.397929+0000","last_deep_scrub":"115'152","last_deep_scrub_stamp":"2024-04-26T11:49:48.397929+0000","last_clean_scrub_stamp":"2024-04-26T11:49:48.397929+0000","objects_scrubbed":1,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:15.911193+0000","scrub_duration":0.020051243,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":561,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:24.108717+0000","last_change":"2024-04-26T11:48:24.108717+0000","last_active":"2024-04-26T11:48:24.108717+0000","last_peered":"2024-04-26T11:48:24.108717+0000","last_clean":"2024-04-26T11:48:24.108717+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:24.108717+0000","last_undegraded":"2024-04-26T11:48:24.108717+0000","last_fullsized":"2024-04-26T11:48:24.108717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'403","last_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_deep_scrub":"76'403","last_deep_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_clean_scrub_stamp":"2024-04-26T11:48:24.108430+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:30.212481+0000","scrub_duration":0.0053830830000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":175,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:12.648989+0000","last_change":"2024-04-26T11:49:12.649213+0000","last_active":"2024-04-26T11:49:12.648989+0000","last_peered":"2024-04-26T11:49:12.648989+0000","last_clean":"2024-04-26T11:49:12.648989+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:49:12.648989+0000","last_undegraded":"2024-04-26T11:49:12.648989+0000","last_fullsized":"2024-04-26T11:49:12.648989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'54","last_scrub_stamp":"2024-04-26T11:49:12.648939+0000","last_deep_scrub":"74'54","last_deep_scrub_stamp":"2024-04-26T11:49:12.648939+0000","last_clean_scrub_stamp":"2024-04-26T11:49:12.648939+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:47.900978+0000","scrub_duration":0.0033501189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:56.094293+0000","last_change":"2024-04-26T11:48:56.094523+0000","last_active":"2024-04-26T11:48:56.094293+0000","last_peered":"2024-04-26T11:48:56.094293+0000","last_clean":"2024-04-26T11:48:56.094293+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:56.094293+0000","last_undegraded":"2024-04-26T11:48:56.094293+0000","last_fullsized":"2024-04-26T11:48:56.094293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:56.094222+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:56.094222+0000","last_clean_scrub_stamp":"2024-04-26T11:48:56.094222+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:23.069438+0000","scrub_duration":0.0055997750000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"115'503","reported_seq":648,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:04.703888+0000","last_change":"2024-04-26T11:49:04.704018+0000","last_active":"2024-04-26T11:49:04.703888+0000","last_peered":"2024-04-26T11:49:04.703888+0000","last_clean":"2024-04-26T11:49:04.703888+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:49:04.703888+0000","last_undegraded":"2024-04-26T11:49:04.703888+0000","last_fullsized":"2024-04-26T11:49:04.703888+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'503","last_scrub_stamp":"2024-04-26T11:49:04.703858+0000","last_deep_scrub":"115'503","last_deep_scrub_stamp":"2024-04-26T11:49:04.703858+0000","last_clean_scrub_stamp":"2024-04-26T11:49:04.703858+0000","objects_scrubbed":1,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:48.123926+0000","scrub_duration":0.021316572999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":538,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:38.308609+0000","last_change":"2024-04-26T11:49:38.308874+0000","last_active":"2024-04-26T11:49:38.308609+0000","last_peered":"2024-04-26T11:49:38.308609+0000","last_clean":"2024-04-26T11:49:38.308609+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:49:38.308609+0000","last_undegraded":"2024-04-26T11:49:38.308609+0000","last_fullsized":"2024-04-26T11:49:38.308609+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'388","last_scrub_stamp":"2024-04-26T11:49:38.308559+0000","last_deep_scrub":"76'388","last_deep_scrub_stamp":"2024-04-26T11:49:38.308559+0000","last_clean_scrub_stamp":"2024-04-26T11:49:38.308559+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:07.288901+0000","scrub_duration":0.0041200669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"115'159","reported_seq":325,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:20.228841+0000","last_change":"2024-04-26T11:49:20.229163+0000","last_active":"2024-04-26T11:49:20.228841+0000","last_peered":"2024-04-26T11:49:20.228841+0000","last_clean":"2024-04-26T11:49:20.228841+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:49:20.228841+0000","last_undegraded":"2024-04-26T11:49:20.228841+0000","last_fullsized":"2024-04-26T11:49:20.228841+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'159","last_scrub_stamp":"2024-04-26T11:49:20.228749+0000","last_deep_scrub":"115'159","last_deep_scrub_stamp":"2024-04-26T11:49:20.228749+0000","last_clean_scrub_stamp":"2024-04-26T11:49:20.228749+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:04.854303+0000","scrub_duration":0.010785144999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:31.092341+0000","last_change":"2024-04-26T11:49:31.092687+0000","last_active":"2024-04-26T11:49:31.092341+0000","last_peered":"2024-04-26T11:49:31.092341+0000","last_clean":"2024-04-26T11:49:31.092341+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:49:31.092341+0000","last_undegraded":"2024-04-26T11:49:31.092341+0000","last_fullsized":"2024-04-26T11:49:31.092341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:31.092255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:31.092255+0000","last_clean_scrub_stamp":"2024-04-26T11:49:31.092255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:29.747617+0000","scrub_duration":0.0035673219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"115'509","reported_seq":629,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:32.226314+0000","last_change":"2024-04-26T11:49:32.226552+0000","last_active":"2024-04-26T11:49:32.226314+0000","last_peered":"2024-04-26T11:49:32.226314+0000","last_clean":"2024-04-26T11:49:32.226314+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:49:32.226314+0000","last_undegraded":"2024-04-26T11:49:32.226314+0000","last_fullsized":"2024-04-26T11:49:32.226314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'509","last_scrub_stamp":"2024-04-26T11:49:32.226256+0000","last_deep_scrub":"115'509","last_deep_scrub_stamp":"2024-04-26T11:49:32.226256+0000","last_clean_scrub_stamp":"2024-04-26T11:49:32.226256+0000","objects_scrubbed":2,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.167376+0000","scrub_duration":0.030837725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":587,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:50.024734+0000","last_change":"2024-04-26T11:48:50.024898+0000","last_active":"2024-04-26T11:48:50.024734+0000","last_peered":"2024-04-26T11:48:50.024734+0000","last_clean":"2024-04-26T11:48:50.024734+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:50.024734+0000","last_undegraded":"2024-04-26T11:48:50.024734+0000","last_fullsized":"2024-04-26T11:48:50.024734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'432","last_scrub_stamp":"2024-04-26T11:48:50.024692+0000","last_deep_scrub":"76'432","last_deep_scrub_stamp":"2024-04-26T11:48:50.024692+0000","last_clean_scrub_stamp":"2024-04-26T11:48:50.024692+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:46.049218+0000","scrub_duration":0.0041890069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:21.209259+0000","last_change":"2024-04-26T11:49:21.209613+0000","last_active":"2024-04-26T11:49:21.209259+0000","last_peered":"2024-04-26T11:49:21.209259+0000","last_clean":"2024-04-26T11:49:21.209259+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:49:21.209259+0000","last_undegraded":"2024-04-26T11:49:21.209259+0000","last_fullsized":"2024-04-26T11:49:21.209259+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:21.209173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:21.209173+0000","last_clean_scrub_stamp":"2024-04-26T11:49:21.209173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:17.766301+0000","scrub_duration":0.0034167590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"115'169","reported_seq":380,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:06.101923+0000","last_change":"2024-04-26T11:49:06.101923+0000","last_active":"2024-04-26T11:49:06.101923+0000","last_peered":"2024-04-26T11:49:06.101923+0000","last_clean":"2024-04-26T11:49:06.101923+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:49:06.101923+0000","last_undegraded":"2024-04-26T11:49:06.101923+0000","last_fullsized":"2024-04-26T11:49:06.101923+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'169","last_scrub_stamp":"2024-04-26T11:49:06.101670+0000","last_deep_scrub":"115'169","last_deep_scrub_stamp":"2024-04-26T11:49:06.101670+0000","last_clean_scrub_stamp":"2024-04-26T11:49:06.101670+0000","objects_scrubbed":1,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:50.555711+0000","scrub_duration":0.012551596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":1011,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:21.674829+0000","last_change":"2024-04-26T11:48:21.674829+0000","last_active":"2024-04-26T11:48:21.674829+0000","last_peered":"2024-04-26T11:48:21.674829+0000","last_clean":"2024-04-26T11:48:21.674829+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:21.674829+0000","last_undegraded":"2024-04-26T11:48:21.674829+0000","last_fullsized":"2024-04-26T11:48:21.674829+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'445","last_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_deep_scrub":"76'445","last_deep_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_clean_scrub_stamp":"2024-04-26T11:48:21.674498+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:22.562702+0000","scrub_duration":0.0044128639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.989853+0000","last_change":"2024-04-26T11:48:28.989853+0000","last_active":"2024-04-26T11:48:28.989853+0000","last_peered":"2024-04-26T11:48:28.989853+0000","last_clean":"2024-04-26T11:48:28.989853+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:28.989853+0000","last_undegraded":"2024-04-26T11:48:28.989853+0000","last_fullsized":"2024-04-26T11:48:28.989853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.989586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:35.455730+0000","scrub_duration":0.0033627959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"115'425","reported_seq":546,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:11.690294+0000","last_change":"2024-04-26T11:49:11.690455+0000","last_active":"2024-04-26T11:49:11.690294+0000","last_peered":"2024-04-26T11:49:11.690294+0000","last_clean":"2024-04-26T11:49:11.690294+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:49:11.690294+0000","last_undegraded":"2024-04-26T11:49:11.690294+0000","last_fullsized":"2024-04-26T11:49:11.690294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'425","last_scrub_stamp":"2024-04-26T11:49:11.690257+0000","last_deep_scrub":"115'425","last_deep_scrub_stamp":"2024-04-26T11:49:11.690257+0000","last_clean_scrub_stamp":"2024-04-26T11:49:11.690257+0000","objects_scrubbed":2,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:02.411178+0000","scrub_duration":0.031295459999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":471,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:40.373758+0000","last_change":"2024-04-26T11:49:40.374050+0000","last_active":"2024-04-26T11:49:40.373758+0000","last_peered":"2024-04-26T11:49:40.373758+0000","last_clean":"2024-04-26T11:49:40.373758+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:49:40.373758+0000","last_undegraded":"2024-04-26T11:49:40.373758+0000","last_fullsized":"2024-04-26T11:49:40.373758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'336","last_scrub_stamp":"2024-04-26T11:49:40.373707+0000","last_deep_scrub":"76'336","last_deep_scrub_stamp":"2024-04-26T11:49:40.373707+0000","last_clean_scrub_stamp":"2024-04-26T11:49:40.373707+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:52.185575+0000","scrub_duration":0.0039503760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:44.349314+0000","last_change":"2024-04-26T11:49:44.349584+0000","last_active":"2024-04-26T11:49:44.349314+0000","last_peered":"2024-04-26T11:49:44.349314+0000","last_clean":"2024-04-26T11:49:44.349314+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:49:44.349314+0000","last_undegraded":"2024-04-26T11:49:44.349314+0000","last_fullsized":"2024-04-26T11:49:44.349314+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:44.349270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:44.349270+0000","last_clean_scrub_stamp":"2024-04-26T11:49:44.349270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:39.945148+0000","scrub_duration":0.0033297729999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":199,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:50.471768+0000","last_change":"2024-04-26T11:49:50.472038+0000","last_active":"2024-04-26T11:49:50.471768+0000","last_peered":"2024-04-26T11:49:50.471768+0000","last_clean":"2024-04-26T11:49:50.471768+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:49:50.471768+0000","last_undegraded":"2024-04-26T11:49:50.471768+0000","last_fullsized":"2024-04-26T11:49:50.471768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'65","last_scrub_stamp":"2024-04-26T11:49:50.471716+0000","last_deep_scrub":"74'65","last_deep_scrub_stamp":"2024-04-26T11:49:50.471716+0000","last_clean_scrub_stamp":"2024-04-26T11:49:50.471716+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:57.582659+0000","scrub_duration":0.0033302789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":515,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:14.131154+0000","last_change":"2024-04-26T11:49:14.131154+0000","last_active":"2024-04-26T11:49:14.131154+0000","last_peered":"2024-04-26T11:49:14.131154+0000","last_clean":"2024-04-26T11:49:14.131154+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:49:14.131154+0000","last_undegraded":"2024-04-26T11:49:14.131154+0000","last_fullsized":"2024-04-26T11:49:14.131154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'380","last_scrub_stamp":"2024-04-26T11:49:14.130850+0000","last_deep_scrub":"76'380","last_deep_scrub_stamp":"2024-04-26T11:49:14.130850+0000","last_clean_scrub_stamp":"2024-04-26T11:49:14.130850+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:24.657925+0000","scrub_duration":0.0042359490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"115'514","reported_seq":659,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:09.130437+0000","last_change":"2024-04-26T11:49:09.130554+0000","last_active":"2024-04-26T11:49:09.130437+0000","last_peered":"2024-04-26T11:49:09.130437+0000","last_clean":"2024-04-26T11:49:09.130437+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:49:09.130437+0000","last_undegraded":"2024-04-26T11:49:09.130437+0000","last_fullsized":"2024-04-26T11:49:09.130437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'514","last_scrub_stamp":"2024-04-26T11:49:09.130413+0000","last_deep_scrub":"115'514","last_deep_scrub_stamp":"2024-04-26T11:49:09.130413+0000","last_clean_scrub_stamp":"2024-04-26T11:49:09.130413+0000","objects_scrubbed":1,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:24.502839+0000","scrub_duration":0.021096667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:11.078631+0000","last_change":"2024-04-26T11:49:11.078631+0000","last_active":"2024-04-26T11:49:11.078631+0000","last_peered":"2024-04-26T11:49:11.078631+0000","last_clean":"2024-04-26T11:49:11.078631+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:49:11.078631+0000","last_undegraded":"2024-04-26T11:49:11.078631+0000","last_fullsized":"2024-04-26T11:49:11.078631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:11.078330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:11.078330+0000","last_clean_scrub_stamp":"2024-04-26T11:49:11.078330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:07.202271+0000","scrub_duration":0.0032418809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.714423+0000","last_change":"2024-04-26T11:48:28.714423+0000","last_active":"2024-04-26T11:48:28.714423+0000","last_peered":"2024-04-26T11:48:28.714423+0000","last_clean":"2024-04-26T11:48:28.714423+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:28.714423+0000","last_undegraded":"2024-04-26T11:48:28.714423+0000","last_fullsized":"2024-04-26T11:48:28.714423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.714119+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:28.093833+0000","scrub_duration":0.0054659280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.033773+0000","last_change":"2024-04-26T11:48:20.033773+0000","last_active":"2024-04-26T11:48:20.033773+0000","last_peered":"2024-04-26T11:48:20.033773+0000","last_clean":"2024-04-26T11:48:20.033773+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:20.033773+0000","last_undegraded":"2024-04-26T11:48:20.033773+0000","last_fullsized":"2024-04-26T11:48:20.033773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'63","last_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_deep_scrub":"74'63","last_deep_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.033325+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:48.515506+0000","scrub_duration":0.0038822000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:06.737700+0000","last_change":"2024-04-26T11:49:06.737932+0000","last_active":"2024-04-26T11:49:06.737700+0000","last_peered":"2024-04-26T11:49:06.737700+0000","last_clean":"2024-04-26T11:49:06.737700+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:49:06.737700+0000","last_undegraded":"2024-04-26T11:49:06.737700+0000","last_fullsized":"2024-04-26T11:49:06.737700+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:06.737649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:06.737649+0000","last_clean_scrub_stamp":"2024-04-26T11:49:06.737649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:41.572042+0000","scrub_duration":0.0033533780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":540,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:32.680131+0000","last_change":"2024-04-26T11:48:32.680131+0000","last_active":"2024-04-26T11:48:32.680131+0000","last_peered":"2024-04-26T11:48:32.680131+0000","last_clean":"2024-04-26T11:48:32.680131+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:32.680131+0000","last_undegraded":"2024-04-26T11:48:32.680131+0000","last_fullsized":"2024-04-26T11:48:32.680131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'387","last_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_deep_scrub":"76'387","last_deep_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_clean_scrub_stamp":"2024-04-26T11:48:32.679781+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:53.697537+0000","scrub_duration":0.0049983019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"115'59","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.993614+0000","last_change":"2024-04-26T11:48:26.993614+0000","last_active":"2024-04-26T11:48:26.993614+0000","last_peered":"2024-04-26T11:48:26.993614+0000","last_clean":"2024-04-26T11:48:26.993614+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:26.993614+0000","last_undegraded":"2024-04-26T11:48:26.993614+0000","last_fullsized":"2024-04-26T11:48:26.993614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'59","last_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_deep_scrub":"115'59","last_deep_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.993216+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:01.847961+0000","scrub_duration":0.0066337560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:22.028330+0000","last_change":"2024-04-26T11:48:22.028330+0000","last_active":"2024-04-26T11:48:22.028330+0000","last_peered":"2024-04-26T11:48:22.028330+0000","last_clean":"2024-04-26T11:48:22.028330+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:22.028330+0000","last_undegraded":"2024-04-26T11:48:22.028330+0000","last_fullsized":"2024-04-26T11:48:22.028330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_clean_scrub_stamp":"2024-04-26T11:48:22.028073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:50.488548+0000","scrub_duration":0.0032986119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":496,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:22.161514+0000","last_change":"2024-04-26T11:49:22.161779+0000","last_active":"2024-04-26T11:49:22.161514+0000","last_peered":"2024-04-26T11:49:22.161514+0000","last_clean":"2024-04-26T11:49:22.161514+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:49:22.161514+0000","last_undegraded":"2024-04-26T11:49:22.161514+0000","last_fullsized":"2024-04-26T11:49:22.161514+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:49:22.161465+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:49:22.161465+0000","last_clean_scrub_stamp":"2024-04-26T11:49:22.161465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:30.815987+0000","scrub_duration":0.0034889420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"115'72","reported_seq":92,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:15.150969+0000","last_change":"2024-04-26T11:48:15.150969+0000","last_active":"2024-04-26T11:48:15.150969+0000","last_peered":"2024-04-26T11:48:15.150969+0000","last_clean":"2024-04-26T11:48:15.150969+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:15.150969+0000","last_undegraded":"2024-04-26T11:48:15.150969+0000","last_fullsized":"2024-04-26T11:48:15.150969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'72","last_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_deep_scrub":"115'72","last_deep_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_clean_scrub_stamp":"2024-04-26T11:48:15.150680+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:41.664584+0000","scrub_duration":0.021253264000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:28.145442+0000","last_change":"2024-04-26T11:49:28.145667+0000","last_active":"2024-04-26T11:49:28.145442+0000","last_peered":"2024-04-26T11:49:28.145442+0000","last_clean":"2024-04-26T11:49:28.145442+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:49:28.145442+0000","last_undegraded":"2024-04-26T11:49:28.145442+0000","last_fullsized":"2024-04-26T11:49:28.145442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:28.145395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:28.145395+0000","last_clean_scrub_stamp":"2024-04-26T11:49:28.145395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:53.647454+0000","scrub_duration":0.0032670189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":573,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:23.712478+0000","last_change":"2024-04-26T11:48:23.712478+0000","last_active":"2024-04-26T11:48:23.712478+0000","last_peered":"2024-04-26T11:48:23.712478+0000","last_clean":"2024-04-26T11:48:23.712478+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:23.712478+0000","last_undegraded":"2024-04-26T11:48:23.712478+0000","last_fullsized":"2024-04-26T11:48:23.712478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_clean_scrub_stamp":"2024-04-26T11:48:23.712095+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:55.117125+0000","scrub_duration":0.0051007090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":585,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:54.516001+0000","last_change":"2024-04-26T11:49:54.516250+0000","last_active":"2024-04-26T11:49:54.516001+0000","last_peered":"2024-04-26T11:49:54.516001+0000","last_clean":"2024-04-26T11:49:54.516001+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:49:54.516001+0000","last_undegraded":"2024-04-26T11:49:54.516001+0000","last_fullsized":"2024-04-26T11:49:54.516001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'427","last_scrub_stamp":"2024-04-26T11:49:54.515946+0000","last_deep_scrub":"76'427","last_deep_scrub_stamp":"2024-04-26T11:49:54.515946+0000","last_clean_scrub_stamp":"2024-04-26T11:49:54.515946+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:12.998646+0000","scrub_duration":0.0050120340000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"115'416","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.029976+0000","last_change":"2024-04-26T11:48:36.029976+0000","last_active":"2024-04-26T11:48:36.029976+0000","last_peered":"2024-04-26T11:48:36.029976+0000","last_clean":"2024-04-26T11:48:36.029976+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:36.029976+0000","last_undegraded":"2024-04-26T11:48:36.029976+0000","last_fullsized":"2024-04-26T11:48:36.029976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'416","last_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_deep_scrub":"115'416","last_deep_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.029835+0000","objects_scrubbed":5,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:10.864228+0000","scrub_duration":0.034626879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":559,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:37.946809+0000","last_change":"2024-04-26T11:48:37.946809+0000","last_active":"2024-04-26T11:48:37.946809+0000","last_peered":"2024-04-26T11:48:37.946809+0000","last_clean":"2024-04-26T11:48:37.946809+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:37.946809+0000","last_undegraded":"2024-04-26T11:48:37.946809+0000","last_fullsized":"2024-04-26T11:48:37.946809+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'423","last_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_deep_scrub":"76'423","last_deep_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_clean_scrub_stamp":"2024-04-26T11:48:37.946505+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:45.776669+0000","scrub_duration":0.0044478900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"115'105","reported_seq":226,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:13.647691+0000","last_change":"2024-04-26T11:49:13.647691+0000","last_active":"2024-04-26T11:49:13.647691+0000","last_peered":"2024-04-26T11:49:13.647691+0000","last_clean":"2024-04-26T11:49:13.647691+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:49:13.647691+0000","last_undegraded":"2024-04-26T11:49:13.647691+0000","last_fullsized":"2024-04-26T11:49:13.647691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'105","last_scrub_stamp":"2024-04-26T11:49:13.647275+0000","last_deep_scrub":"115'105","last_deep_scrub_stamp":"2024-04-26T11:49:13.647275+0000","last_clean_scrub_stamp":"2024-04-26T11:49:13.647275+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:23.912985+0000","scrub_duration":0.0077776210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"115'335","reported_seq":480,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:03.180771+0000","last_change":"2024-04-26T11:49:03.180771+0000","last_active":"2024-04-26T11:49:03.180771+0000","last_peered":"2024-04-26T11:49:03.180771+0000","last_clean":"2024-04-26T11:49:03.180771+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:49:03.180771+0000","last_undegraded":"2024-04-26T11:49:03.180771+0000","last_fullsized":"2024-04-26T11:49:03.180771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'335","last_scrub_stamp":"2024-04-26T11:49:03.180575+0000","last_deep_scrub":"115'335","last_deep_scrub_stamp":"2024-04-26T11:49:03.180575+0000","last_clean_scrub_stamp":"2024-04-26T11:49:03.180575+0000","objects_scrubbed":1,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:20.897350+0000","scrub_duration":0.020406345999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":592,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.973251+0000","last_change":"2024-04-26T11:48:30.973251+0000","last_active":"2024-04-26T11:48:30.973251+0000","last_peered":"2024-04-26T11:48:30.973251+0000","last_clean":"2024-04-26T11:48:30.973251+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:30.973251+0000","last_undegraded":"2024-04-26T11:48:30.973251+0000","last_fullsized":"2024-04-26T11:48:30.973251+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'463","last_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_deep_scrub":"76'463","last_deep_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.972981+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:34.247031+0000","scrub_duration":0.0044136920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.019177+0000","last_change":"2024-04-26T11:48:12.019177+0000","last_active":"2024-04-26T11:48:12.019177+0000","last_peered":"2024-04-26T11:48:12.019177+0000","last_clean":"2024-04-26T11:48:12.019177+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:12.019177+0000","last_undegraded":"2024-04-26T11:48:12.019177+0000","last_fullsized":"2024-04-26T11:48:12.019177+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.018689+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:01.030509+0000","scrub_duration":0.0039670319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":588,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.005500+0000","last_change":"2024-04-26T11:48:30.005500+0000","last_active":"2024-04-26T11:48:30.005500+0000","last_peered":"2024-04-26T11:48:30.005500+0000","last_clean":"2024-04-26T11:48:30.005500+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:30.005500+0000","last_undegraded":"2024-04-26T11:48:30.005500+0000","last_fullsized":"2024-04-26T11:48:30.005500+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'447","last_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_deep_scrub":"76'447","last_deep_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.005160+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:09.022128+0000","scrub_duration":0.0044822300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":531,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:41.646917+0000","last_change":"2024-04-26T11:48:41.647158+0000","last_active":"2024-04-26T11:48:41.646917+0000","last_peered":"2024-04-26T11:48:41.646917+0000","last_clean":"2024-04-26T11:48:41.646917+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:41.646917+0000","last_undegraded":"2024-04-26T11:48:41.646917+0000","last_fullsized":"2024-04-26T11:48:41.646917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'366","last_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_deep_scrub":"76'366","last_deep_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_clean_scrub_stamp":"2024-04-26T11:48:41.646862+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:47.318788+0000","scrub_duration":0.0041890690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"115'776","reported_seq":890,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:05.101753+0000","last_change":"2024-04-26T11:49:05.101753+0000","last_active":"2024-04-26T11:49:05.101753+0000","last_peered":"2024-04-26T11:49:05.101753+0000","last_clean":"2024-04-26T11:49:05.101753+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:49:05.101753+0000","last_undegraded":"2024-04-26T11:49:05.101753+0000","last_fullsized":"2024-04-26T11:49:05.101753+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'776","last_scrub_stamp":"2024-04-26T11:49:05.101560+0000","last_deep_scrub":"115'776","last_deep_scrub_stamp":"2024-04-26T11:49:05.101560+0000","last_clean_scrub_stamp":"2024-04-26T11:49:05.101560+0000","objects_scrubbed":2,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:23.999436+0000","scrub_duration":0.031574363000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":511,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:37.260007+0000","last_change":"2024-04-26T11:49:37.260243+0000","last_active":"2024-04-26T11:49:37.260007+0000","last_peered":"2024-04-26T11:49:37.260007+0000","last_clean":"2024-04-26T11:49:37.260007+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:49:37.260007+0000","last_undegraded":"2024-04-26T11:49:37.260007+0000","last_fullsized":"2024-04-26T11:49:37.260007+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'385","last_scrub_stamp":"2024-04-26T11:49:37.259956+0000","last_deep_scrub":"76'385","last_deep_scrub_stamp":"2024-04-26T11:49:37.259956+0000","last_clean_scrub_stamp":"2024-04-26T11:49:37.259956+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:11.538341+0000","scrub_duration":0.0042895069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"115'329","reported_seq":446,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.155128+0000","last_change":"2024-04-26T11:49:07.155128+0000","last_active":"2024-04-26T11:49:07.155128+0000","last_peered":"2024-04-26T11:49:07.155128+0000","last_clean":"2024-04-26T11:49:07.155128+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:49:07.155128+0000","last_undegraded":"2024-04-26T11:49:07.155128+0000","last_fullsized":"2024-04-26T11:49:07.155128+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'329","last_scrub_stamp":"2024-04-26T11:49:07.154976+0000","last_deep_scrub":"115'329","last_deep_scrub_stamp":"2024-04-26T11:49:07.154976+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.154976+0000","objects_scrubbed":1,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:50.736767+0000","scrub_duration":0.017101642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":552,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:54.740054+0000","last_change":"2024-04-26T11:48:54.740054+0000","last_active":"2024-04-26T11:48:54.740054+0000","last_peered":"2024-04-26T11:48:54.740054+0000","last_clean":"2024-04-26T11:48:54.740054+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:54.740054+0000","last_undegraded":"2024-04-26T11:48:54.740054+0000","last_fullsized":"2024-04-26T11:48:54.740054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'385","last_scrub_stamp":"2024-04-26T11:48:54.739766+0000","last_deep_scrub":"76'385","last_deep_scrub_stamp":"2024-04-26T11:48:54.739766+0000","last_clean_scrub_stamp":"2024-04-26T11:48:54.739766+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:00.843817+0000","scrub_duration":0.0056441019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"115'354","reported_seq":504,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.792341+0000","last_change":"2024-04-26T11:49:07.792341+0000","last_active":"2024-04-26T11:49:07.792341+0000","last_peered":"2024-04-26T11:49:07.792341+0000","last_clean":"2024-04-26T11:49:07.792341+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:49:07.792341+0000","last_undegraded":"2024-04-26T11:49:07.792341+0000","last_fullsized":"2024-04-26T11:49:07.792341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'354","last_scrub_stamp":"2024-04-26T11:49:07.791996+0000","last_deep_scrub":"115'354","last_deep_scrub_stamp":"2024-04-26T11:49:07.791996+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.791996+0000","objects_scrubbed":3,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:03.875875+0000","scrub_duration":0.041359689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":867,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:29.698714+0000","last_change":"2024-04-26T11:48:29.698714+0000","last_active":"2024-04-26T11:48:29.698714+0000","last_peered":"2024-04-26T11:48:29.698714+0000","last_clean":"2024-04-26T11:48:29.698714+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:29.698714+0000","last_undegraded":"2024-04-26T11:48:29.698714+0000","last_fullsized":"2024-04-26T11:48:29.698714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'369","last_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_deep_scrub":"76'369","last_deep_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_clean_scrub_stamp":"2024-04-26T11:48:29.698434+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:04.873874+0000","scrub_duration":0.004418478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"115'58","reported_seq":179,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:18.727460+0000","last_change":"2024-04-26T11:49:18.727460+0000","last_active":"2024-04-26T11:49:18.727460+0000","last_peered":"2024-04-26T11:49:18.727460+0000","last_clean":"2024-04-26T11:49:18.727460+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:49:18.727460+0000","last_undegraded":"2024-04-26T11:49:18.727460+0000","last_fullsized":"2024-04-26T11:49:18.727460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'58","last_scrub_stamp":"2024-04-26T11:49:18.727169+0000","last_deep_scrub":"115'58","last_deep_scrub_stamp":"2024-04-26T11:49:18.727169+0000","last_clean_scrub_stamp":"2024-04-26T11:49:18.727169+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:29.056593+0000","scrub_duration":0.016535326999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":897,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:13.226901+0000","last_change":"2024-04-26T11:48:13.226901+0000","last_active":"2024-04-26T11:48:13.226901+0000","last_peered":"2024-04-26T11:48:13.226901+0000","last_clean":"2024-04-26T11:48:13.226901+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:13.226901+0000","last_undegraded":"2024-04-26T11:48:13.226901+0000","last_fullsized":"2024-04-26T11:48:13.226901+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'377","last_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_deep_scrub":"76'377","last_deep_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_clean_scrub_stamp":"2024-04-26T11:48:13.226463+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:03.708994+0000","scrub_duration":0.0044302090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"115'277","reported_seq":423,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.109273+0000","last_change":"2024-04-26T11:48:27.109273+0000","last_active":"2024-04-26T11:48:27.109273+0000","last_peered":"2024-04-26T11:48:27.109273+0000","last_clean":"2024-04-26T11:48:27.109273+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:27.109273+0000","last_undegraded":"2024-04-26T11:48:27.109273+0000","last_fullsized":"2024-04-26T11:48:27.109273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'277","last_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_deep_scrub":"115'277","last_deep_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.109059+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:02.122709+0000","scrub_duration":0.021146224000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":914,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:34.042997+0000","last_change":"2024-04-26T11:48:34.042997+0000","last_active":"2024-04-26T11:48:34.042997+0000","last_peered":"2024-04-26T11:48:34.042997+0000","last_clean":"2024-04-26T11:48:34.042997+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:34.042997+0000","last_undegraded":"2024-04-26T11:48:34.042997+0000","last_fullsized":"2024-04-26T11:48:34.042997+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'391","last_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_deep_scrub":"76'391","last_deep_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_clean_scrub_stamp":"2024-04-26T11:48:34.042706+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:24.193868+0000","scrub_duration":0.0052922139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"115'333","reported_seq":454,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:56.811047+0000","last_change":"2024-04-26T11:48:56.811047+0000","last_active":"2024-04-26T11:48:56.811047+0000","last_peered":"2024-04-26T11:48:56.811047+0000","last_clean":"2024-04-26T11:48:56.811047+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:56.811047+0000","last_undegraded":"2024-04-26T11:48:56.811047+0000","last_fullsized":"2024-04-26T11:48:56.811047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'333","last_scrub_stamp":"2024-04-26T11:48:56.810845+0000","last_deep_scrub":"115'333","last_deep_scrub_stamp":"2024-04-26T11:48:56.810845+0000","last_clean_scrub_stamp":"2024-04-26T11:48:56.810845+0000","objects_scrubbed":4,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.341984+0000","scrub_duration":0.0403226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":965,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:50.684402+0000","last_change":"2024-04-26T11:48:50.684402+0000","last_active":"2024-04-26T11:48:50.684402+0000","last_peered":"2024-04-26T11:48:50.684402+0000","last_clean":"2024-04-26T11:48:50.684402+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:50.684402+0000","last_undegraded":"2024-04-26T11:48:50.684402+0000","last_fullsized":"2024-04-26T11:48:50.684402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:50.684066+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:50.684066+0000","last_clean_scrub_stamp":"2024-04-26T11:48:50.684066+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:36.226053+0000","scrub_duration":0.0045709319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"115'52","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:48.474657+0000","last_change":"2024-04-26T11:49:48.474820+0000","last_active":"2024-04-26T11:49:48.474657+0000","last_peered":"2024-04-26T11:49:48.474657+0000","last_clean":"2024-04-26T11:49:48.474657+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:49:48.474657+0000","last_undegraded":"2024-04-26T11:49:48.474657+0000","last_fullsized":"2024-04-26T11:49:48.474657+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'52","last_scrub_stamp":"2024-04-26T11:49:48.474634+0000","last_deep_scrub":"115'52","last_deep_scrub_stamp":"2024-04-26T11:49:48.474634+0000","last_clean_scrub_stamp":"2024-04-26T11:49:48.474634+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:14.618369+0000","scrub_duration":0.015001399,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":993,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:02.136503+0000","last_change":"2024-04-26T11:49:02.136503+0000","last_active":"2024-04-26T11:49:02.136503+0000","last_peered":"2024-04-26T11:49:02.136503+0000","last_clean":"2024-04-26T11:49:02.136503+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:49:02.136503+0000","last_undegraded":"2024-04-26T11:49:02.136503+0000","last_fullsized":"2024-04-26T11:49:02.136503+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'436","last_scrub_stamp":"2024-04-26T11:49:02.136184+0000","last_deep_scrub":"76'436","last_deep_scrub_stamp":"2024-04-26T11:49:02.136184+0000","last_clean_scrub_stamp":"2024-04-26T11:49:02.136184+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:14.675035+0000","scrub_duration":0.0045192979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"115'57","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:19.159861+0000","last_change":"2024-04-26T11:49:19.160126+0000","last_active":"2024-04-26T11:49:19.159861+0000","last_peered":"2024-04-26T11:49:19.159861+0000","last_clean":"2024-04-26T11:49:19.159861+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:49:19.159861+0000","last_undegraded":"2024-04-26T11:49:19.159861+0000","last_fullsized":"2024-04-26T11:49:19.159861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'57","last_scrub_stamp":"2024-04-26T11:49:19.159801+0000","last_deep_scrub":"115'57","last_deep_scrub_stamp":"2024-04-26T11:49:19.159801+0000","last_clean_scrub_stamp":"2024-04-26T11:49:19.159801+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:43.568000+0000","scrub_duration":0.018090722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7927,"ondisk_log_size":7927,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738445,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200496,"kb_used_data":89064,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171344,"statfs":{"total":96636764160,"available":96431456256,"internally_reserved":0,"allocated":91201536,"data_stored":90584365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.56999999999999995,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73699999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.628},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.52400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77000000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66800000000000004,"15min":0.66000000000000003},"min":{"1min":0.625,"5min":0.505,"15min":0.505},"max":{"1min":0.77700000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.755}]}]},{"osd":1,"up_from":72,"seq":309237645350,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125616,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246224,"statfs":{"total":96636764160,"available":96508133376,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.49399999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.55100000000000005,"5min":0.379,"15min":0.379},"max":{"1min":0.75,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.70999999999999996}]},{"osd":2,"last update":"Fri Apr 26 11:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.69699999999999995},"min":{"1min":0.60099999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.55800000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66900000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190668,"kb_used_data":83332,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181172,"statfs":{"total":96636764160,"available":96441520128,"internally_reserved":0,"allocated":85331968,"data_stored":84726408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.53900000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Apr 26 11:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63800000000000001,"15min":0.68600000000000005},"min":{"1min":0.58899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.69199999999999995},"min":{"1min":0.59899999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:50:14.117 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:50:14.117 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:50:14.117 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:44:21.039002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=44, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=48, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:50:14.118 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:50:34.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:50:34.447 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:50:34.449 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:50:34.461 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-04-26T11:50:34.107647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127603811,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2806,"num_read_kb":1335941,"num_write":30674,"num_write_kb":4175271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":80434283,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34138,"ondisk_log_size":34138,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516780,"kb_used_data":252436,"kb_used_omap":9,"kb_used_meta":264310,"kb_avail":282598740,"statfs":{"total":289910292480,"available":289381109760,"internally_reserved":0,"allocated":258494464,"data_stored":256676283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10100,"internal_metadata":270653580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004158"},"pg_stats":[{"pgid":"4.3f","version":"76'413","reported_seq":974,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:03.597562+0000","last_change":"2024-04-26T11:50:03.597797+0000","last_active":"2024-04-26T11:50:03.597562+0000","last_peered":"2024-04-26T11:50:03.597562+0000","last_clean":"2024-04-26T11:50:03.597562+0000","last_became_active":"2024-04-26T11:47:16.140586+0000","last_became_peered":"2024-04-26T11:47:16.140586+0000","last_unstale":"2024-04-26T11:50:03.597562+0000","last_undegraded":"2024-04-26T11:50:03.597562+0000","last_fullsized":"2024-04-26T11:50:03.597562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:50:03.597510+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:50:03.597510+0000","last_clean_scrub_stamp":"2024-04-26T11:50:03.597510+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:02.252872+0000","scrub_duration":0.003742418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":25986,"num_write":389,"num_write_kb":67993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"76'438","reported_seq":1031,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:00.601261+0000","last_change":"2024-04-26T11:50:00.601655+0000","last_active":"2024-04-26T11:50:00.601261+0000","last_peered":"2024-04-26T11:50:00.601261+0000","last_clean":"2024-04-26T11:50:00.601261+0000","last_became_active":"2024-04-26T11:47:39.143796+0000","last_became_peered":"2024-04-26T11:47:39.143796+0000","last_unstale":"2024-04-26T11:50:00.601261+0000","last_undegraded":"2024-04-26T11:50:00.601261+0000","last_fullsized":"2024-04-26T11:50:00.601261+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'438","last_scrub_stamp":"2024-04-26T11:50:00.601211+0000","last_deep_scrub":"76'438","last_deep_scrub_stamp":"2024-04-26T11:50:00.601211+0000","last_clean_scrub_stamp":"2024-04-26T11:50:00.601211+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:26.103271+0000","scrub_duration":0.0046834570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":26947,"num_write":417,"num_write_kb":64286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"76'390","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:12.558934+0000","last_change":"2024-04-26T11:50:12.559179+0000","last_active":"2024-04-26T11:50:12.558934+0000","last_peered":"2024-04-26T11:50:12.558934+0000","last_clean":"2024-04-26T11:50:12.558934+0000","last_became_active":"2024-04-26T11:44:21.450277+0000","last_became_peered":"2024-04-26T11:44:21.450277+0000","last_unstale":"2024-04-26T11:50:12.558934+0000","last_undegraded":"2024-04-26T11:50:12.558934+0000","last_fullsized":"2024-04-26T11:50:12.558934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'390","last_scrub_stamp":"2024-04-26T11:50:12.558885+0000","last_deep_scrub":"76'390","last_deep_scrub_stamp":"2024-04-26T11:50:12.558885+0000","last_clean_scrub_stamp":"2024-04-26T11:50:12.558885+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:09.376749+0000","scrub_duration":0.0051698209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":8530,"num_write":365,"num_write_kb":96329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'364","reported_seq":853,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:10.554822+0000","last_change":"2024-04-26T11:50:10.554822+0000","last_active":"2024-04-26T11:50:10.554822+0000","last_peered":"2024-04-26T11:50:10.554822+0000","last_clean":"2024-04-26T11:50:10.554822+0000","last_became_active":"2024-04-26T11:47:21.167158+0000","last_became_peered":"2024-04-26T11:47:21.167158+0000","last_unstale":"2024-04-26T11:50:10.554822+0000","last_undegraded":"2024-04-26T11:50:10.554822+0000","last_fullsized":"2024-04-26T11:50:10.554822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'364","last_scrub_stamp":"2024-04-26T11:50:10.554531+0000","last_deep_scrub":"76'364","last_deep_scrub_stamp":"2024-04-26T11:50:10.554531+0000","last_clean_scrub_stamp":"2024-04-26T11:50:10.554531+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:50.624720+0000","scrub_duration":0.0041726419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5901,"num_write":342,"num_write_kb":26230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"76'403","reported_seq":930,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:53.624611+0000","last_change":"2024-04-26T11:49:53.624846+0000","last_active":"2024-04-26T11:49:53.624611+0000","last_peered":"2024-04-26T11:49:53.624611+0000","last_clean":"2024-04-26T11:49:53.624611+0000","last_became_active":"2024-04-26T11:47:29.142872+0000","last_became_peered":"2024-04-26T11:47:29.142872+0000","last_unstale":"2024-04-26T11:49:53.624611+0000","last_undegraded":"2024-04-26T11:49:53.624611+0000","last_fullsized":"2024-04-26T11:49:53.624611+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'403","last_scrub_stamp":"2024-04-26T11:49:53.624559+0000","last_deep_scrub":"76'403","last_deep_scrub_stamp":"2024-04-26T11:49:53.624559+0000","last_clean_scrub_stamp":"2024-04-26T11:49:53.624559+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:50.181687+0000","scrub_duration":0.0039870950000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12926,"num_write":381,"num_write_kb":42762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'364","reported_seq":858,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:08.591762+0000","last_change":"2024-04-26T11:50:08.592013+0000","last_active":"2024-04-26T11:50:08.591762+0000","last_peered":"2024-04-26T11:50:08.591762+0000","last_clean":"2024-04-26T11:50:08.591762+0000","last_became_active":"2024-04-26T11:47:15.138849+0000","last_became_peered":"2024-04-26T11:47:15.138849+0000","last_unstale":"2024-04-26T11:50:08.591762+0000","last_undegraded":"2024-04-26T11:50:08.591762+0000","last_fullsized":"2024-04-26T11:50:08.591762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'364","last_scrub_stamp":"2024-04-26T11:50:08.591711+0000","last_deep_scrub":"77'364","last_deep_scrub_stamp":"2024-04-26T11:50:08.591711+0000","last_clean_scrub_stamp":"2024-04-26T11:50:08.591711+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:02.855134+0000","scrub_duration":0.0049684559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9231,"num_write":344,"num_write_kb":38421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"76'454","reported_seq":1050,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:01.384887+0000","last_change":"2024-04-26T11:50:01.385139+0000","last_active":"2024-04-26T11:50:01.384887+0000","last_peered":"2024-04-26T11:50:01.384887+0000","last_clean":"2024-04-26T11:50:01.384887+0000","last_became_active":"2024-04-26T11:47:43.182872+0000","last_became_peered":"2024-04-26T11:47:43.182872+0000","last_unstale":"2024-04-26T11:50:01.384887+0000","last_undegraded":"2024-04-26T11:50:01.384887+0000","last_fullsized":"2024-04-26T11:50:01.384887+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'454","last_scrub_stamp":"2024-04-26T11:50:01.384830+0000","last_deep_scrub":"76'454","last_deep_scrub_stamp":"2024-04-26T11:50:01.384830+0000","last_clean_scrub_stamp":"2024-04-26T11:50:01.384830+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:34.002746+0000","scrub_duration":0.0049391590000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":23189,"num_write":436,"num_write_kb":113865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"76'367","reported_seq":859,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:15.684684+0000","last_change":"2024-04-26T11:50:15.684954+0000","last_active":"2024-04-26T11:50:15.684684+0000","last_peered":"2024-04-26T11:50:15.684684+0000","last_clean":"2024-04-26T11:50:15.684684+0000","last_became_active":"2024-04-26T11:47:39.140648+0000","last_became_peered":"2024-04-26T11:47:39.140648+0000","last_unstale":"2024-04-26T11:50:15.684684+0000","last_undegraded":"2024-04-26T11:50:15.684684+0000","last_fullsized":"2024-04-26T11:50:15.684684+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'367","last_scrub_stamp":"2024-04-26T11:50:15.684633+0000","last_deep_scrub":"76'367","last_deep_scrub_stamp":"2024-04-26T11:50:15.684633+0000","last_clean_scrub_stamp":"2024-04-26T11:50:15.684633+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:35.317049+0000","scrub_duration":0.0042148560000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19198,"num_write":340,"num_write_kb":59259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"77'421","reported_seq":555,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:33.918870+0000","last_change":"2024-04-26T11:48:33.918870+0000","last_active":"2024-04-26T11:48:33.918870+0000","last_peered":"2024-04-26T11:48:33.918870+0000","last_clean":"2024-04-26T11:48:33.918870+0000","last_became_active":"2024-04-26T11:47:15.433393+0000","last_became_peered":"2024-04-26T11:47:15.433393+0000","last_unstale":"2024-04-26T11:48:33.918870+0000","last_undegraded":"2024-04-26T11:48:33.918870+0000","last_fullsized":"2024-04-26T11:48:33.918870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'421","last_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_deep_scrub":"77'421","last_deep_scrub_stamp":"2024-04-26T11:48:33.918413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:33.918413+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:33.584386+0000","scrub_duration":0.0044004430000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":2332,"num_write":384,"num_write_kb":38917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'424","reported_seq":973,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:52.593161+0000","last_change":"2024-04-26T11:49:52.593434+0000","last_active":"2024-04-26T11:49:52.593161+0000","last_peered":"2024-04-26T11:49:52.593161+0000","last_clean":"2024-04-26T11:49:52.593161+0000","last_became_active":"2024-04-26T11:47:35.147325+0000","last_became_peered":"2024-04-26T11:47:35.147325+0000","last_unstale":"2024-04-26T11:49:52.593161+0000","last_undegraded":"2024-04-26T11:49:52.593161+0000","last_fullsized":"2024-04-26T11:49:52.593161+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:49:52.593110+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:49:52.593110+0000","last_clean_scrub_stamp":"2024-04-26T11:49:52.593110+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:37.218663+0000","scrub_duration":0.0041492619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":40004,"num_write":393,"num_write_kb":124632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'372","reported_seq":886,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:50:05.550433+0000","last_change":"2024-04-26T11:50:05.550691+0000","last_active":"2024-04-26T11:50:05.550433+0000","last_peered":"2024-04-26T11:50:05.550433+0000","last_clean":"2024-04-26T11:50:05.550433+0000","last_became_active":"2024-04-26T11:47:17.142242+0000","last_became_peered":"2024-04-26T11:47:17.142242+0000","last_unstale":"2024-04-26T11:50:05.550433+0000","last_undegraded":"2024-04-26T11:50:05.550433+0000","last_fullsized":"2024-04-26T11:50:05.550433+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'372","last_scrub_stamp":"2024-04-26T11:50:05.550384+0000","last_deep_scrub":"76'372","last_deep_scrub_stamp":"2024-04-26T11:50:05.550384+0000","last_clean_scrub_stamp":"2024-04-26T11:50:05.550384+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:07.523072+0000","scrub_duration":0.0046840040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20700,"num_write":354,"num_write_kb":59124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"76'345","reported_seq":504,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:10.699169+0000","last_change":"2024-04-26T11:48:10.699169+0000","last_active":"2024-04-26T11:48:10.699169+0000","last_peered":"2024-04-26T11:48:10.699169+0000","last_clean":"2024-04-26T11:48:10.699169+0000","last_became_active":"2024-04-26T11:44:21.443099+0000","last_became_peered":"2024-04-26T11:44:21.443099+0000","last_unstale":"2024-04-26T11:48:10.699169+0000","last_undegraded":"2024-04-26T11:48:10.699169+0000","last_fullsized":"2024-04-26T11:48:10.699169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'345","last_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_deep_scrub":"76'345","last_deep_scrub_stamp":"2024-04-26T11:48:10.698866+0000","last_clean_scrub_stamp":"2024-04-26T11:48:10.698866+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:11.706179+0000","scrub_duration":0.0058868610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21661,"num_write":317,"num_write_kb":50312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'388","reported_seq":906,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:35.635628+0000","last_change":"2024-04-26T11:49:35.635852+0000","last_active":"2024-04-26T11:49:35.635628+0000","last_peered":"2024-04-26T11:49:35.635628+0000","last_clean":"2024-04-26T11:49:35.635628+0000","last_became_active":"2024-04-26T11:47:20.155019+0000","last_became_peered":"2024-04-26T11:47:20.155019+0000","last_unstale":"2024-04-26T11:49:35.635628+0000","last_undegraded":"2024-04-26T11:49:35.635628+0000","last_fullsized":"2024-04-26T11:49:35.635628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'388","last_scrub_stamp":"2024-04-26T11:49:35.635578+0000","last_deep_scrub":"76'388","last_deep_scrub_stamp":"2024-04-26T11:49:35.635578+0000","last_clean_scrub_stamp":"2024-04-26T11:49:35.635578+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:47.567173+0000","scrub_duration":0.0042458319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18279,"num_write":358,"num_write_kb":46473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"76'418","reported_seq":576,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.180736+0000","last_change":"2024-04-26T11:48:12.180736+0000","last_active":"2024-04-26T11:48:12.180736+0000","last_peered":"2024-04-26T11:48:12.180736+0000","last_clean":"2024-04-26T11:48:12.180736+0000","last_became_active":"2024-04-26T11:44:21.450051+0000","last_became_peered":"2024-04-26T11:44:21.450051+0000","last_unstale":"2024-04-26T11:48:12.180736+0000","last_undegraded":"2024-04-26T11:48:12.180736+0000","last_fullsized":"2024-04-26T11:48:12.180736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'418","last_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_deep_scrub":"76'418","last_deep_scrub_stamp":"2024-04-26T11:48:12.180413+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.180413+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.283252+0000","scrub_duration":0.0053701490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21288,"num_write":390,"num_write_kb":50937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"76'428","reported_seq":618,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.057064+0000","last_change":"2024-04-26T11:48:26.057064+0000","last_active":"2024-04-26T11:48:26.057064+0000","last_peered":"2024-04-26T11:48:26.057064+0000","last_clean":"2024-04-26T11:48:26.057064+0000","last_became_active":"2024-04-26T11:44:21.449125+0000","last_became_peered":"2024-04-26T11:44:21.449125+0000","last_unstale":"2024-04-26T11:48:26.057064+0000","last_undegraded":"2024-04-26T11:48:26.057064+0000","last_fullsized":"2024-04-26T11:48:26.057064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'428","last_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_deep_scrub":"76'428","last_deep_scrub_stamp":"2024-04-26T11:48:26.056732+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.056732+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:01.294605+0000","scrub_duration":0.0057736879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44022,"num_write":399,"num_write_kb":104942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'457","reported_seq":1073,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:56.432370+0000","last_change":"2024-04-26T11:49:56.432619+0000","last_active":"2024-04-26T11:49:56.432370+0000","last_peered":"2024-04-26T11:49:56.432370+0000","last_clean":"2024-04-26T11:49:56.432370+0000","last_became_active":"2024-04-26T11:47:40.157660+0000","last_became_peered":"2024-04-26T11:47:40.157660+0000","last_unstale":"2024-04-26T11:49:56.432370+0000","last_undegraded":"2024-04-26T11:49:56.432370+0000","last_fullsized":"2024-04-26T11:49:56.432370+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'457","last_scrub_stamp":"2024-04-26T11:49:56.432311+0000","last_deep_scrub":"76'457","last_deep_scrub_stamp":"2024-04-26T11:49:56.432311+0000","last_clean_scrub_stamp":"2024-04-26T11:49:56.432311+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:13.475676+0000","scrub_duration":0.0047086180000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47496,"num_write":432,"num_write_kb":96517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"76'392","reported_seq":523,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.949389+0000","last_change":"2024-04-26T11:48:27.949389+0000","last_active":"2024-04-26T11:48:27.949389+0000","last_peered":"2024-04-26T11:48:27.949389+0000","last_clean":"2024-04-26T11:48:27.949389+0000","last_became_active":"2024-04-26T11:47:17.434294+0000","last_became_peered":"2024-04-26T11:47:17.434294+0000","last_unstale":"2024-04-26T11:48:27.949389+0000","last_undegraded":"2024-04-26T11:48:27.949389+0000","last_fullsized":"2024-04-26T11:48:27.949389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:48:27.948898+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.948898+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:29.597751+0000","scrub_duration":0.0043304119999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8979,"num_write":369,"num_write_kb":46723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'413","reported_seq":938,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:34.643935+0000","last_change":"2024-04-26T11:49:34.644187+0000","last_active":"2024-04-26T11:49:34.643935+0000","last_peered":"2024-04-26T11:49:34.643935+0000","last_clean":"2024-04-26T11:49:34.643935+0000","last_became_active":"2024-04-26T11:47:38.154440+0000","last_became_peered":"2024-04-26T11:47:38.154440+0000","last_unstale":"2024-04-26T11:49:34.643935+0000","last_undegraded":"2024-04-26T11:49:34.643935+0000","last_fullsized":"2024-04-26T11:49:34.643935+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:49:34.643882+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:49:34.643882+0000","last_clean_scrub_stamp":"2024-04-26T11:49:34.643882+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:47.182733+0000","scrub_duration":0.0051839850000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14530,"num_write":390,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"76'413","reported_seq":544,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:01.026835+0000","last_change":"2024-04-26T11:49:01.026835+0000","last_active":"2024-04-26T11:49:01.026835+0000","last_peered":"2024-04-26T11:49:01.026835+0000","last_clean":"2024-04-26T11:49:01.026835+0000","last_became_active":"2024-04-26T11:47:42.464878+0000","last_became_peered":"2024-04-26T11:47:42.464878+0000","last_unstale":"2024-04-26T11:49:01.026835+0000","last_undegraded":"2024-04-26T11:49:01.026835+0000","last_fullsized":"2024-04-26T11:49:01.026835+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:49:01.026549+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:49:01.026549+0000","last_clean_scrub_stamp":"2024-04-26T11:49:01.026549+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:07.466257+0000","scrub_duration":0.0042339500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":23818,"num_write":389,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'441","reported_seq":1027,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.158150+0000","last_change":"2024-04-26T11:49:07.158425+0000","last_active":"2024-04-26T11:49:07.158150+0000","last_peered":"2024-04-26T11:49:07.158150+0000","last_clean":"2024-04-26T11:49:07.158150+0000","last_became_active":"2024-04-26T11:47:19.138139+0000","last_became_peered":"2024-04-26T11:47:19.138139+0000","last_unstale":"2024-04-26T11:49:07.158150+0000","last_undegraded":"2024-04-26T11:49:07.158150+0000","last_fullsized":"2024-04-26T11:49:07.158150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'441","last_scrub_stamp":"2024-04-26T11:49:07.158098+0000","last_deep_scrub":"76'441","last_deep_scrub_stamp":"2024-04-26T11:49:07.158098+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.158098+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:31.523066+0000","scrub_duration":0.0045499240000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26673,"num_write":419,"num_write_kb":67396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":941,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:40.997248+0000","last_change":"2024-04-26T11:48:40.997248+0000","last_active":"2024-04-26T11:48:40.997248+0000","last_peered":"2024-04-26T11:48:40.997248+0000","last_clean":"2024-04-26T11:48:40.997248+0000","last_became_active":"2024-04-26T11:47:34.139731+0000","last_became_peered":"2024-04-26T11:47:34.139731+0000","last_unstale":"2024-04-26T11:48:40.997248+0000","last_undegraded":"2024-04-26T11:48:40.997248+0000","last_fullsized":"2024-04-26T11:48:40.997248+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'404","last_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_deep_scrub":"76'404","last_deep_scrub_stamp":"2024-04-26T11:48:40.996775+0000","last_clean_scrub_stamp":"2024-04-26T11:48:40.996775+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:28.668510+0000","scrub_duration":0.0044704089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":31067,"num_write":364,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"76'424","reported_seq":590,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.703736+0000","last_change":"2024-04-26T11:48:16.703736+0000","last_active":"2024-04-26T11:48:16.703736+0000","last_peered":"2024-04-26T11:48:16.703736+0000","last_clean":"2024-04-26T11:48:16.703736+0000","last_became_active":"2024-04-26T11:44:21.444875+0000","last_became_peered":"2024-04-26T11:44:21.444875+0000","last_unstale":"2024-04-26T11:48:16.703736+0000","last_undegraded":"2024-04-26T11:48:16.703736+0000","last_fullsized":"2024-04-26T11:48:16.703736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:16.703427+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.703427+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:09.548341+0000","scrub_duration":0.0060063829999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22553,"num_write":403,"num_write_kb":84018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'406","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:20.145425+0000","last_change":"2024-04-26T11:49:20.145425+0000","last_active":"2024-04-26T11:49:20.145425+0000","last_peered":"2024-04-26T11:49:20.145425+0000","last_clean":"2024-04-26T11:49:20.145425+0000","last_became_active":"2024-04-26T11:47:27.442408+0000","last_became_peered":"2024-04-26T11:47:27.442408+0000","last_unstale":"2024-04-26T11:49:20.145425+0000","last_undegraded":"2024-04-26T11:49:20.145425+0000","last_fullsized":"2024-04-26T11:49:20.145425+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-26T11:49:20.145133+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-26T11:49:20.145133+0000","last_clean_scrub_stamp":"2024-04-26T11:49:20.145133+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:29.007352+0000","scrub_duration":0.0047260169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3931,"num_write":375,"num_write_kb":26841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'439","reported_seq":1045,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:39.639525+0000","last_change":"2024-04-26T11:49:39.639789+0000","last_active":"2024-04-26T11:49:39.639525+0000","last_peered":"2024-04-26T11:49:39.639525+0000","last_clean":"2024-04-26T11:49:39.639525+0000","last_became_active":"2024-04-26T11:47:37.156025+0000","last_became_peered":"2024-04-26T11:47:37.156025+0000","last_unstale":"2024-04-26T11:49:39.639525+0000","last_undegraded":"2024-04-26T11:49:39.639525+0000","last_fullsized":"2024-04-26T11:49:39.639525+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'439","last_scrub_stamp":"2024-04-26T11:49:39.639474+0000","last_deep_scrub":"76'439","last_deep_scrub_stamp":"2024-04-26T11:49:39.639474+0000","last_clean_scrub_stamp":"2024-04-26T11:49:39.639474+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:04.004442+0000","scrub_duration":0.0045361359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34139,"num_write":416,"num_write_kb":51274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"76'392","reported_seq":526,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:27.680697+0000","last_change":"2024-04-26T11:49:27.680967+0000","last_active":"2024-04-26T11:49:27.680697+0000","last_peered":"2024-04-26T11:49:27.680697+0000","last_clean":"2024-04-26T11:49:27.680697+0000","last_became_active":"2024-04-26T11:44:21.443356+0000","last_became_peered":"2024-04-26T11:44:21.443356+0000","last_unstale":"2024-04-26T11:49:27.680697+0000","last_undegraded":"2024-04-26T11:49:27.680697+0000","last_fullsized":"2024-04-26T11:49:27.680697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:49:27.680647+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:49:27.680647+0000","last_clean_scrub_stamp":"2024-04-26T11:49:27.680647+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:03.491704+0000","scrub_duration":0.0047388680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8257,"num_write":374,"num_write_kb":17155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"76'492","reported_seq":634,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:43.442657+0000","last_change":"2024-04-26T11:49:43.442897+0000","last_active":"2024-04-26T11:49:43.442657+0000","last_peered":"2024-04-26T11:49:43.442657+0000","last_clean":"2024-04-26T11:49:43.442657+0000","last_became_active":"2024-04-26T11:47:42.464251+0000","last_became_peered":"2024-04-26T11:47:42.464251+0000","last_unstale":"2024-04-26T11:49:43.442657+0000","last_undegraded":"2024-04-26T11:49:43.442657+0000","last_fullsized":"2024-04-26T11:49:43.442657+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'492","last_scrub_stamp":"2024-04-26T11:49:43.442597+0000","last_deep_scrub":"76'492","last_deep_scrub_stamp":"2024-04-26T11:49:43.442597+0000","last_clean_scrub_stamp":"2024-04-26T11:49:43.442597+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:24.726836+0000","scrub_duration":0.0051693030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":33968,"num_write":469,"num_write_kb":89306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'394","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.159519+0000","last_change":"2024-04-26T11:48:20.159519+0000","last_active":"2024-04-26T11:48:20.159519+0000","last_peered":"2024-04-26T11:48:20.159519+0000","last_clean":"2024-04-26T11:48:20.159519+0000","last_became_active":"2024-04-26T11:44:21.450756+0000","last_became_peered":"2024-04-26T11:44:21.450756+0000","last_unstale":"2024-04-26T11:48:20.159519+0000","last_undegraded":"2024-04-26T11:48:20.159519+0000","last_fullsized":"2024-04-26T11:48:20.159519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:20.159224+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.159224+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:05.701212+0000","scrub_duration":0.0055914299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5728,"num_write":375,"num_write_kb":55335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"76'398","reported_seq":609,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:57.742786+0000","last_change":"2024-04-26T11:48:57.743169+0000","last_active":"2024-04-26T11:48:57.742786+0000","last_peered":"2024-04-26T11:48:57.742786+0000","last_clean":"2024-04-26T11:48:57.742786+0000","last_became_active":"2024-04-26T11:44:21.442660+0000","last_became_peered":"2024-04-26T11:44:21.442660+0000","last_unstale":"2024-04-26T11:48:57.742786+0000","last_undegraded":"2024-04-26T11:48:57.742786+0000","last_fullsized":"2024-04-26T11:48:57.742786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'398","last_scrub_stamp":"2024-04-26T11:48:57.742669+0000","last_deep_scrub":"76'398","last_deep_scrub_stamp":"2024-04-26T11:48:57.742669+0000","last_clean_scrub_stamp":"2024-04-26T11:48:57.742669+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:32.756319+0000","scrub_duration":0.0055375609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46155,"num_write":381,"num_write_kb":116794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'384","reported_seq":521,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:12.111381+0000","last_change":"2024-04-26T11:49:12.111381+0000","last_active":"2024-04-26T11:49:12.111381+0000","last_peered":"2024-04-26T11:49:12.111381+0000","last_clean":"2024-04-26T11:49:12.111381+0000","last_became_active":"2024-04-26T11:47:28.461795+0000","last_became_peered":"2024-04-26T11:47:28.461795+0000","last_unstale":"2024-04-26T11:49:12.111381+0000","last_undegraded":"2024-04-26T11:49:12.111381+0000","last_fullsized":"2024-04-26T11:49:12.111381+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'384","last_scrub_stamp":"2024-04-26T11:49:12.111081+0000","last_deep_scrub":"76'384","last_deep_scrub_stamp":"2024-04-26T11:49:12.111081+0000","last_clean_scrub_stamp":"2024-04-26T11:49:12.111081+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:26.233239+0000","scrub_duration":0.0042686479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19049,"num_write":355,"num_write_kb":33894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":638,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:42.691464+0000","last_change":"2024-04-26T11:48:42.691846+0000","last_active":"2024-04-26T11:48:42.691464+0000","last_peered":"2024-04-26T11:48:42.691464+0000","last_clean":"2024-04-26T11:48:42.691464+0000","last_became_active":"2024-04-26T11:44:21.444451+0000","last_became_peered":"2024-04-26T11:44:21.444451+0000","last_unstale":"2024-04-26T11:48:42.691464+0000","last_undegraded":"2024-04-26T11:48:42.691464+0000","last_fullsized":"2024-04-26T11:48:42.691464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'467","last_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_deep_scrub":"76'467","last_deep_scrub_stamp":"2024-04-26T11:48:42.691415+0000","last_clean_scrub_stamp":"2024-04-26T11:48:42.691415+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:34.091246+0000","scrub_duration":0.0058108070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33088,"num_write":437,"num_write_kb":51194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"76'429","reported_seq":586,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:57.122777+0000","last_change":"2024-04-26T11:48:57.122777+0000","last_active":"2024-04-26T11:48:57.122777+0000","last_peered":"2024-04-26T11:48:57.122777+0000","last_clean":"2024-04-26T11:48:57.122777+0000","last_became_active":"2024-04-26T11:47:32.447456+0000","last_became_peered":"2024-04-26T11:47:32.447456+0000","last_unstale":"2024-04-26T11:48:57.122777+0000","last_undegraded":"2024-04-26T11:48:57.122777+0000","last_fullsized":"2024-04-26T11:48:57.122777+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'429","last_scrub_stamp":"2024-04-26T11:48:57.122503+0000","last_deep_scrub":"76'429","last_deep_scrub_stamp":"2024-04-26T11:48:57.122503+0000","last_clean_scrub_stamp":"2024-04-26T11:48:57.122503+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:41.507208+0000","scrub_duration":0.0037513580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22774,"num_write":404,"num_write_kb":57564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'412","reported_seq":963,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:16.161557+0000","last_change":"2024-04-26T11:48:16.161557+0000","last_active":"2024-04-26T11:48:16.161557+0000","last_peered":"2024-04-26T11:48:16.161557+0000","last_clean":"2024-04-26T11:48:16.161557+0000","last_became_active":"2024-04-26T11:47:45.144760+0000","last_became_peered":"2024-04-26T11:47:45.144760+0000","last_unstale":"2024-04-26T11:48:16.161557+0000","last_undegraded":"2024-04-26T11:48:16.161557+0000","last_fullsized":"2024-04-26T11:48:16.161557+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'412","last_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_deep_scrub":"76'412","last_deep_scrub_stamp":"2024-04-26T11:48:16.161259+0000","last_clean_scrub_stamp":"2024-04-26T11:48:16.161259+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:19.609307+0000","scrub_duration":0.005601534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16892,"num_write":391,"num_write_kb":38110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"76'370","reported_seq":855,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:46.658998+0000","last_change":"2024-04-26T11:48:46.658998+0000","last_active":"2024-04-26T11:48:46.658998+0000","last_peered":"2024-04-26T11:48:46.658998+0000","last_clean":"2024-04-26T11:48:46.658998+0000","last_became_active":"2024-04-26T11:47:45.153547+0000","last_became_peered":"2024-04-26T11:47:45.153547+0000","last_unstale":"2024-04-26T11:48:46.658998+0000","last_undegraded":"2024-04-26T11:48:46.658998+0000","last_fullsized":"2024-04-26T11:48:46.658998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'370","last_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_deep_scrub":"76'370","last_deep_scrub_stamp":"2024-04-26T11:48:46.658495+0000","last_clean_scrub_stamp":"2024-04-26T11:48:46.658495+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:50.106542+0000","scrub_duration":0.0045947180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":339,"num_write_kb":30483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"115'492","reported_seq":640,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:39.978630+0000","last_change":"2024-04-26T11:48:39.978630+0000","last_active":"2024-04-26T11:48:39.978630+0000","last_peered":"2024-04-26T11:48:39.978630+0000","last_clean":"2024-04-26T11:48:39.978630+0000","last_became_active":"2024-04-26T11:47:14.133901+0000","last_became_peered":"2024-04-26T11:47:14.133901+0000","last_unstale":"2024-04-26T11:48:39.978630+0000","last_undegraded":"2024-04-26T11:48:39.978630+0000","last_fullsized":"2024-04-26T11:48:39.978630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'492","last_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_deep_scrub":"115'492","last_deep_scrub_stamp":"2024-04-26T11:48:39.978491+0000","last_clean_scrub_stamp":"2024-04-26T11:48:39.978491+0000","objects_scrubbed":4,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:30.699411+0000","scrub_duration":0.028156690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":8376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"76'411","reported_seq":994,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.672399+0000","last_change":"2024-04-26T11:48:36.672399+0000","last_active":"2024-04-26T11:48:36.672399+0000","last_peered":"2024-04-26T11:48:36.672399+0000","last_clean":"2024-04-26T11:48:36.672399+0000","last_became_active":"2024-04-26T11:47:44.151588+0000","last_became_peered":"2024-04-26T11:47:44.151588+0000","last_unstale":"2024-04-26T11:48:36.672399+0000","last_undegraded":"2024-04-26T11:48:36.672399+0000","last_fullsized":"2024-04-26T11:48:36.672399+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'411","last_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_deep_scrub":"76'411","last_deep_scrub_stamp":"2024-04-26T11:48:36.672084+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.672084+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:47.824742+0000","scrub_duration":0.0043867059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":32863,"num_write":387,"num_write_kb":51959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"74'51","reported_seq":77,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:55.128485+0000","last_change":"2024-04-26T11:48:55.128485+0000","last_active":"2024-04-26T11:48:55.128485+0000","last_peered":"2024-04-26T11:48:55.128485+0000","last_clean":"2024-04-26T11:48:55.128485+0000","last_became_active":"2024-04-26T11:47:11.445112+0000","last_became_peered":"2024-04-26T11:47:11.445112+0000","last_unstale":"2024-04-26T11:48:55.128485+0000","last_undegraded":"2024-04-26T11:48:55.128485+0000","last_fullsized":"2024-04-26T11:48:55.128485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:55.128180+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:55.128180+0000","last_clean_scrub_stamp":"2024-04-26T11:48:55.128180+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:20.475572+0000","scrub_duration":0.0032158289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'413","reported_seq":528,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.973582+0000","last_change":"2024-04-26T11:48:38.973582+0000","last_active":"2024-04-26T11:48:38.973582+0000","last_peered":"2024-04-26T11:48:38.973582+0000","last_clean":"2024-04-26T11:48:38.973582+0000","last_became_active":"2024-04-26T11:47:32.443435+0000","last_became_peered":"2024-04-26T11:47:32.443435+0000","last_unstale":"2024-04-26T11:48:38.973582+0000","last_undegraded":"2024-04-26T11:48:38.973582+0000","last_fullsized":"2024-04-26T11:48:38.973582+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-26T11:48:38.973282+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.973282+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:59.469110+0000","scrub_duration":0.0046745279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16384,"num_write":379,"num_write_kb":34295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'60","reported_seq":181,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:23.744022+0000","last_change":"2024-04-26T11:49:23.744279+0000","last_active":"2024-04-26T11:49:23.744022+0000","last_peered":"2024-04-26T11:49:23.744022+0000","last_clean":"2024-04-26T11:49:23.744022+0000","last_became_active":"2024-04-26T11:44:21.063056+0000","last_became_peered":"2024-04-26T11:44:21.063056+0000","last_unstale":"2024-04-26T11:49:23.744022+0000","last_undegraded":"2024-04-26T11:49:23.744022+0000","last_fullsized":"2024-04-26T11:49:23.744022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'60","last_scrub_stamp":"2024-04-26T11:49:23.743971+0000","last_deep_scrub":"71'60","last_deep_scrub_stamp":"2024-04-26T11:49:23.743971+0000","last_clean_scrub_stamp":"2024-04-26T11:49:23.743971+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:24.577731+0000","scrub_duration":0.0030668650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"76'394","reported_seq":563,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:51.006799+0000","last_change":"2024-04-26T11:48:51.006799+0000","last_active":"2024-04-26T11:48:51.006799+0000","last_peered":"2024-04-26T11:48:51.006799+0000","last_clean":"2024-04-26T11:48:51.006799+0000","last_became_active":"2024-04-26T11:47:18.433191+0000","last_became_peered":"2024-04-26T11:47:18.433191+0000","last_unstale":"2024-04-26T11:48:51.006799+0000","last_undegraded":"2024-04-26T11:48:51.006799+0000","last_fullsized":"2024-04-26T11:48:51.006799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-26T11:48:51.006513+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-26T11:48:51.006513+0000","last_clean_scrub_stamp":"2024-04-26T11:48:51.006513+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:16.562657+0000","scrub_duration":0.0040201380000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25315,"num_write":369,"num_write_kb":68554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"115'71","reported_seq":192,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:58.169654+0000","last_change":"2024-04-26T11:48:58.169654+0000","last_active":"2024-04-26T11:48:58.169654+0000","last_peered":"2024-04-26T11:48:58.169654+0000","last_clean":"2024-04-26T11:48:58.169654+0000","last_became_active":"2024-04-26T11:44:21.066576+0000","last_became_peered":"2024-04-26T11:44:21.066576+0000","last_unstale":"2024-04-26T11:48:58.169654+0000","last_undegraded":"2024-04-26T11:48:58.169654+0000","last_fullsized":"2024-04-26T11:48:58.169654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'71","last_scrub_stamp":"2024-04-26T11:48:58.169317+0000","last_deep_scrub":"115'71","last_deep_scrub_stamp":"2024-04-26T11:48:58.169317+0000","last_clean_scrub_stamp":"2024-04-26T11:48:58.169317+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:30.105511+0000","scrub_duration":0.010931368,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"115'216","reported_seq":337,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:52.101678+0000","last_change":"2024-04-26T11:48:52.101678+0000","last_active":"2024-04-26T11:48:52.101678+0000","last_peered":"2024-04-26T11:48:52.101678+0000","last_clean":"2024-04-26T11:48:52.101678+0000","last_became_active":"2024-04-26T11:44:21.066946+0000","last_became_peered":"2024-04-26T11:44:21.066946+0000","last_unstale":"2024-04-26T11:48:52.101678+0000","last_undegraded":"2024-04-26T11:48:52.101678+0000","last_fullsized":"2024-04-26T11:48:52.101678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'216","last_scrub_stamp":"2024-04-26T11:48:52.101470+0000","last_deep_scrub":"115'216","last_deep_scrub_stamp":"2024-04-26T11:48:52.101470+0000","last_clean_scrub_stamp":"2024-04-26T11:48:52.101470+0000","objects_scrubbed":2,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:52.935231+0000","scrub_duration":0.022234593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"76'406","reported_seq":553,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.700459+0000","last_change":"2024-04-26T11:48:19.700459+0000","last_active":"2024-04-26T11:48:19.700459+0000","last_peered":"2024-04-26T11:48:19.700459+0000","last_clean":"2024-04-26T11:48:19.700459+0000","last_became_active":"2024-04-26T11:44:21.446378+0000","last_became_peered":"2024-04-26T11:44:21.446378+0000","last_unstale":"2024-04-26T11:48:19.700459+0000","last_undegraded":"2024-04-26T11:48:19.700459+0000","last_fullsized":"2024-04-26T11:48:19.700459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-26T11:48:19.700054+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.700054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:19.776698+0000","scrub_duration":0.0059321139999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13726,"num_write":376,"num_write_kb":50653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"115'394","reported_seq":515,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:21.771172+0000","last_change":"2024-04-26T11:49:21.771295+0000","last_active":"2024-04-26T11:49:21.771172+0000","last_peered":"2024-04-26T11:49:21.771172+0000","last_clean":"2024-04-26T11:49:21.771172+0000","last_became_active":"2024-04-26T11:44:21.063094+0000","last_became_peered":"2024-04-26T11:44:21.063094+0000","last_unstale":"2024-04-26T11:49:21.771172+0000","last_undegraded":"2024-04-26T11:49:21.771172+0000","last_fullsized":"2024-04-26T11:49:21.771172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'394","last_scrub_stamp":"2024-04-26T11:49:21.771148+0000","last_deep_scrub":"115'394","last_deep_scrub_stamp":"2024-04-26T11:49:21.771148+0000","last_clean_scrub_stamp":"2024-04-26T11:49:21.771148+0000","objects_scrubbed":2,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:17.795675+0000","scrub_duration":0.022322965,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"76'453","reported_seq":1044,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:49.652705+0000","last_change":"2024-04-26T11:48:49.652958+0000","last_active":"2024-04-26T11:48:49.652705+0000","last_peered":"2024-04-26T11:48:49.652705+0000","last_clean":"2024-04-26T11:48:49.652705+0000","last_became_active":"2024-04-26T11:47:24.142443+0000","last_became_peered":"2024-04-26T11:47:24.142443+0000","last_unstale":"2024-04-26T11:48:49.652705+0000","last_undegraded":"2024-04-26T11:48:49.652705+0000","last_fullsized":"2024-04-26T11:48:49.652705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'453","last_scrub_stamp":"2024-04-26T11:48:49.652654+0000","last_deep_scrub":"76'453","last_deep_scrub_stamp":"2024-04-26T11:48:49.652654+0000","last_clean_scrub_stamp":"2024-04-26T11:48:49.652654+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.485049+0000","scrub_duration":0.0048848520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":19356,"num_write":437,"num_write_kb":75642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"115'588","reported_seq":709,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:47.006099+0000","last_change":"2024-04-26T11:48:47.006099+0000","last_active":"2024-04-26T11:48:47.006099+0000","last_peered":"2024-04-26T11:48:47.006099+0000","last_clean":"2024-04-26T11:48:47.006099+0000","last_became_active":"2024-04-26T11:44:21.067076+0000","last_became_peered":"2024-04-26T11:44:21.067076+0000","last_unstale":"2024-04-26T11:48:47.006099+0000","last_undegraded":"2024-04-26T11:48:47.006099+0000","last_fullsized":"2024-04-26T11:48:47.006099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'588","last_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_deep_scrub":"115'588","last_deep_scrub_stamp":"2024-04-26T11:48:47.005948+0000","last_clean_scrub_stamp":"2024-04-26T11:48:47.005948+0000","objects_scrubbed":2,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:57.335372+0000","scrub_duration":0.022816893000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"76'446","reported_seq":1028,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:19.113972+0000","last_change":"2024-04-26T11:48:19.113972+0000","last_active":"2024-04-26T11:48:19.113972+0000","last_peered":"2024-04-26T11:48:19.113972+0000","last_clean":"2024-04-26T11:48:19.113972+0000","last_became_active":"2024-04-26T11:47:23.178411+0000","last_became_peered":"2024-04-26T11:47:23.178411+0000","last_unstale":"2024-04-26T11:48:19.113972+0000","last_undegraded":"2024-04-26T11:48:19.113972+0000","last_fullsized":"2024-04-26T11:48:19.113972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'446","last_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_deep_scrub":"76'446","last_deep_scrub_stamp":"2024-04-26T11:48:19.113630+0000","last_clean_scrub_stamp":"2024-04-26T11:48:19.113630+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:18.946024+0000","scrub_duration":0.0051973490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":19557,"num_write":426,"num_write_kb":88579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"74'62","reported_seq":196,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:52.452971+0000","last_change":"2024-04-26T11:49:52.453221+0000","last_active":"2024-04-26T11:49:52.452971+0000","last_peered":"2024-04-26T11:49:52.452971+0000","last_clean":"2024-04-26T11:49:52.452971+0000","last_became_active":"2024-04-26T11:47:11.155612+0000","last_became_peered":"2024-04-26T11:47:11.155612+0000","last_unstale":"2024-04-26T11:49:52.452971+0000","last_undegraded":"2024-04-26T11:49:52.452971+0000","last_fullsized":"2024-04-26T11:49:52.452971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'62","last_scrub_stamp":"2024-04-26T11:49:52.452922+0000","last_deep_scrub":"74'62","last_deep_scrub_stamp":"2024-04-26T11:49:52.452922+0000","last_clean_scrub_stamp":"2024-04-26T11:49:52.452922+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:56.551494+0000","scrub_duration":0.0032149769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"76'449","reported_seq":633,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:47.489963+0000","last_change":"2024-04-26T11:49:47.490262+0000","last_active":"2024-04-26T11:49:47.489963+0000","last_peered":"2024-04-26T11:49:47.489963+0000","last_clean":"2024-04-26T11:49:47.489963+0000","last_became_active":"2024-04-26T11:47:22.467109+0000","last_became_peered":"2024-04-26T11:47:22.467109+0000","last_unstale":"2024-04-26T11:49:47.489963+0000","last_undegraded":"2024-04-26T11:49:47.489963+0000","last_fullsized":"2024-04-26T11:49:47.489963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'449","last_scrub_stamp":"2024-04-26T11:49:47.489914+0000","last_deep_scrub":"76'449","last_deep_scrub_stamp":"2024-04-26T11:49:47.489914+0000","last_clean_scrub_stamp":"2024-04-26T11:49:47.489914+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:21.262807+0000","scrub_duration":0.004081182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39177,"num_write":419,"num_write_kb":80042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"115'265","reported_seq":388,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:54.113217+0000","last_change":"2024-04-26T11:48:54.113217+0000","last_active":"2024-04-26T11:48:54.113217+0000","last_peered":"2024-04-26T11:48:54.113217+0000","last_clean":"2024-04-26T11:48:54.113217+0000","last_became_active":"2024-04-26T11:47:14.430293+0000","last_became_peered":"2024-04-26T11:47:14.430293+0000","last_unstale":"2024-04-26T11:48:54.113217+0000","last_undegraded":"2024-04-26T11:48:54.113217+0000","last_fullsized":"2024-04-26T11:48:54.113217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'265","last_scrub_stamp":"2024-04-26T11:48:54.113037+0000","last_deep_scrub":"115'265","last_deep_scrub_stamp":"2024-04-26T11:48:54.113037+0000","last_clean_scrub_stamp":"2024-04-26T11:48:54.113037+0000","objects_scrubbed":3,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:56.229153+0000","scrub_duration":0.024456727000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":8323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'424","reported_seq":975,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:38.998461+0000","last_change":"2024-04-26T11:48:38.998461+0000","last_active":"2024-04-26T11:48:38.998461+0000","last_peered":"2024-04-26T11:48:38.998461+0000","last_clean":"2024-04-26T11:48:38.998461+0000","last_became_active":"2024-04-26T11:47:29.142980+0000","last_became_peered":"2024-04-26T11:47:29.142980+0000","last_unstale":"2024-04-26T11:48:38.998461+0000","last_undegraded":"2024-04-26T11:48:38.998461+0000","last_fullsized":"2024-04-26T11:48:38.998461+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:38.998146+0000","last_clean_scrub_stamp":"2024-04-26T11:48:38.998146+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:36.290726+0000","scrub_duration":0.0044019580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12434,"num_write":400,"num_write_kb":58653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"115'152","reported_seq":297,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:48.398010+0000","last_change":"2024-04-26T11:49:48.398259+0000","last_active":"2024-04-26T11:49:48.398010+0000","last_peered":"2024-04-26T11:49:48.398010+0000","last_clean":"2024-04-26T11:49:48.398010+0000","last_became_active":"2024-04-26T11:47:14.137974+0000","last_became_peered":"2024-04-26T11:47:14.137974+0000","last_unstale":"2024-04-26T11:49:48.398010+0000","last_undegraded":"2024-04-26T11:49:48.398010+0000","last_fullsized":"2024-04-26T11:49:48.398010+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'152","last_scrub_stamp":"2024-04-26T11:49:48.397929+0000","last_deep_scrub":"115'152","last_deep_scrub_stamp":"2024-04-26T11:49:48.397929+0000","last_clean_scrub_stamp":"2024-04-26T11:49:48.397929+0000","objects_scrubbed":1,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:15.911193+0000","scrub_duration":0.020051243,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"76'403","reported_seq":561,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:24.108717+0000","last_change":"2024-04-26T11:48:24.108717+0000","last_active":"2024-04-26T11:48:24.108717+0000","last_peered":"2024-04-26T11:48:24.108717+0000","last_clean":"2024-04-26T11:48:24.108717+0000","last_became_active":"2024-04-26T11:44:21.451353+0000","last_became_peered":"2024-04-26T11:44:21.451353+0000","last_unstale":"2024-04-26T11:48:24.108717+0000","last_undegraded":"2024-04-26T11:48:24.108717+0000","last_fullsized":"2024-04-26T11:48:24.108717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'403","last_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_deep_scrub":"76'403","last_deep_scrub_stamp":"2024-04-26T11:48:24.108430+0000","last_clean_scrub_stamp":"2024-04-26T11:48:24.108430+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:30.212481+0000","scrub_duration":0.0053830830000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20558,"num_write":379,"num_write_kb":51019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"74'54","reported_seq":175,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:12.648989+0000","last_change":"2024-04-26T11:49:12.649213+0000","last_active":"2024-04-26T11:49:12.648989+0000","last_peered":"2024-04-26T11:49:12.648989+0000","last_clean":"2024-04-26T11:49:12.648989+0000","last_became_active":"2024-04-26T11:44:21.063003+0000","last_became_peered":"2024-04-26T11:44:21.063003+0000","last_unstale":"2024-04-26T11:49:12.648989+0000","last_undegraded":"2024-04-26T11:49:12.648989+0000","last_fullsized":"2024-04-26T11:49:12.648989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'54","last_scrub_stamp":"2024-04-26T11:49:12.648939+0000","last_deep_scrub":"74'54","last_deep_scrub_stamp":"2024-04-26T11:49:12.648939+0000","last_clean_scrub_stamp":"2024-04-26T11:49:12.648939+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:47.900978+0000","scrub_duration":0.0033501189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"76'344","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:56.094293+0000","last_change":"2024-04-26T11:48:56.094523+0000","last_active":"2024-04-26T11:48:56.094293+0000","last_peered":"2024-04-26T11:48:56.094293+0000","last_clean":"2024-04-26T11:48:56.094293+0000","last_became_active":"2024-04-26T11:44:21.449801+0000","last_became_peered":"2024-04-26T11:44:21.449801+0000","last_unstale":"2024-04-26T11:48:56.094293+0000","last_undegraded":"2024-04-26T11:48:56.094293+0000","last_fullsized":"2024-04-26T11:48:56.094293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:56.094222+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:56.094222+0000","last_clean_scrub_stamp":"2024-04-26T11:48:56.094222+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:23.069438+0000","scrub_duration":0.0055997750000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21564,"num_write":320,"num_write_kb":38031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"115'503","reported_seq":648,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:04.703888+0000","last_change":"2024-04-26T11:49:04.704018+0000","last_active":"2024-04-26T11:49:04.703888+0000","last_peered":"2024-04-26T11:49:04.703888+0000","last_clean":"2024-04-26T11:49:04.703888+0000","last_became_active":"2024-04-26T11:47:14.135567+0000","last_became_peered":"2024-04-26T11:47:14.135567+0000","last_unstale":"2024-04-26T11:49:04.703888+0000","last_undegraded":"2024-04-26T11:49:04.703888+0000","last_fullsized":"2024-04-26T11:49:04.703888+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'503","last_scrub_stamp":"2024-04-26T11:49:04.703858+0000","last_deep_scrub":"115'503","last_deep_scrub_stamp":"2024-04-26T11:49:04.703858+0000","last_clean_scrub_stamp":"2024-04-26T11:49:04.703858+0000","objects_scrubbed":1,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:48.123926+0000","scrub_duration":0.021316572999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"76'388","reported_seq":538,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:38.308609+0000","last_change":"2024-04-26T11:49:38.308874+0000","last_active":"2024-04-26T11:49:38.308609+0000","last_peered":"2024-04-26T11:49:38.308609+0000","last_clean":"2024-04-26T11:49:38.308609+0000","last_became_active":"2024-04-26T11:47:27.442350+0000","last_became_peered":"2024-04-26T11:47:27.442350+0000","last_unstale":"2024-04-26T11:49:38.308609+0000","last_undegraded":"2024-04-26T11:49:38.308609+0000","last_fullsized":"2024-04-26T11:49:38.308609+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'388","last_scrub_stamp":"2024-04-26T11:49:38.308559+0000","last_deep_scrub":"76'388","last_deep_scrub_stamp":"2024-04-26T11:49:38.308559+0000","last_clean_scrub_stamp":"2024-04-26T11:49:38.308559+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:07.288901+0000","scrub_duration":0.0041200669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30227,"num_write":360,"num_write_kb":54719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"115'159","reported_seq":326,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:20.229163+0000","last_change":"2024-04-26T11:49:20.229163+0000","last_active":"2024-04-26T11:49:20.229163+0000","last_peered":"2024-04-26T11:49:20.229163+0000","last_clean":"2024-04-26T11:49:20.229163+0000","last_became_active":"2024-04-26T11:44:12.000853+0000","last_became_peered":"2024-04-26T11:44:12.000853+0000","last_unstale":"2024-04-26T11:49:20.229163+0000","last_undegraded":"2024-04-26T11:49:20.229163+0000","last_fullsized":"2024-04-26T11:49:20.229163+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'159","last_scrub_stamp":"2024-04-26T11:49:20.228749+0000","last_deep_scrub":"115'159","last_deep_scrub_stamp":"2024-04-26T11:49:20.228749+0000","last_clean_scrub_stamp":"2024-04-26T11:49:20.228749+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:04.854303+0000","scrub_duration":0.010785144999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":138,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:31.092687+0000","last_change":"2024-04-26T11:49:31.092687+0000","last_active":"2024-04-26T11:49:31.092687+0000","last_peered":"2024-04-26T11:49:31.092687+0000","last_clean":"2024-04-26T11:49:31.092687+0000","last_became_active":"2024-04-26T11:47:11.151652+0000","last_became_peered":"2024-04-26T11:47:11.151652+0000","last_unstale":"2024-04-26T11:49:31.092687+0000","last_undegraded":"2024-04-26T11:49:31.092687+0000","last_fullsized":"2024-04-26T11:49:31.092687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:31.092255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:31.092255+0000","last_clean_scrub_stamp":"2024-04-26T11:49:31.092255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:29.747617+0000","scrub_duration":0.0035673219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"115'509","reported_seq":629,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:32.226314+0000","last_change":"2024-04-26T11:49:32.226552+0000","last_active":"2024-04-26T11:49:32.226314+0000","last_peered":"2024-04-26T11:49:32.226314+0000","last_clean":"2024-04-26T11:49:32.226314+0000","last_became_active":"2024-04-26T11:47:14.426899+0000","last_became_peered":"2024-04-26T11:47:14.426899+0000","last_unstale":"2024-04-26T11:49:32.226314+0000","last_undegraded":"2024-04-26T11:49:32.226314+0000","last_fullsized":"2024-04-26T11:49:32.226314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'509","last_scrub_stamp":"2024-04-26T11:49:32.226256+0000","last_deep_scrub":"115'509","last_deep_scrub_stamp":"2024-04-26T11:49:32.226256+0000","last_clean_scrub_stamp":"2024-04-26T11:49:32.226256+0000","objects_scrubbed":2,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.167376+0000","scrub_duration":0.030837725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'432","reported_seq":587,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:50.024734+0000","last_change":"2024-04-26T11:48:50.024898+0000","last_active":"2024-04-26T11:48:50.024734+0000","last_peered":"2024-04-26T11:48:50.024734+0000","last_clean":"2024-04-26T11:48:50.024734+0000","last_became_active":"2024-04-26T11:44:21.451719+0000","last_became_peered":"2024-04-26T11:44:21.451719+0000","last_unstale":"2024-04-26T11:48:50.024734+0000","last_undegraded":"2024-04-26T11:48:50.024734+0000","last_fullsized":"2024-04-26T11:48:50.024734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'432","last_scrub_stamp":"2024-04-26T11:48:50.024692+0000","last_deep_scrub":"76'432","last_deep_scrub_stamp":"2024-04-26T11:48:50.024692+0000","last_clean_scrub_stamp":"2024-04-26T11:48:50.024692+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:46.049218+0000","scrub_duration":0.0041890069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19556,"num_write":400,"num_write_kb":84655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":125,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:21.209613+0000","last_change":"2024-04-26T11:49:21.209613+0000","last_active":"2024-04-26T11:49:21.209613+0000","last_peered":"2024-04-26T11:49:21.209613+0000","last_clean":"2024-04-26T11:49:21.209613+0000","last_became_active":"2024-04-26T11:44:17.036232+0000","last_became_peered":"2024-04-26T11:44:17.036232+0000","last_unstale":"2024-04-26T11:49:21.209613+0000","last_undegraded":"2024-04-26T11:49:21.209613+0000","last_fullsized":"2024-04-26T11:49:21.209613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:21.209173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:21.209173+0000","last_clean_scrub_stamp":"2024-04-26T11:49:21.209173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:17.766301+0000","scrub_duration":0.0034167590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"115'169","reported_seq":380,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:06.101923+0000","last_change":"2024-04-26T11:49:06.101923+0000","last_active":"2024-04-26T11:49:06.101923+0000","last_peered":"2024-04-26T11:49:06.101923+0000","last_clean":"2024-04-26T11:49:06.101923+0000","last_became_active":"2024-04-26T11:47:14.430203+0000","last_became_peered":"2024-04-26T11:47:14.430203+0000","last_unstale":"2024-04-26T11:49:06.101923+0000","last_undegraded":"2024-04-26T11:49:06.101923+0000","last_fullsized":"2024-04-26T11:49:06.101923+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'169","last_scrub_stamp":"2024-04-26T11:49:06.101670+0000","last_deep_scrub":"115'169","last_deep_scrub_stamp":"2024-04-26T11:49:06.101670+0000","last_clean_scrub_stamp":"2024-04-26T11:49:06.101670+0000","objects_scrubbed":1,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:50.555711+0000","scrub_duration":0.012551596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421878,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":94,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1421777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'445","reported_seq":1011,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:21.674829+0000","last_change":"2024-04-26T11:48:21.674829+0000","last_active":"2024-04-26T11:48:21.674829+0000","last_peered":"2024-04-26T11:48:21.674829+0000","last_clean":"2024-04-26T11:48:21.674829+0000","last_became_active":"2024-04-26T11:47:34.142697+0000","last_became_peered":"2024-04-26T11:47:34.142697+0000","last_unstale":"2024-04-26T11:48:21.674829+0000","last_undegraded":"2024-04-26T11:48:21.674829+0000","last_fullsized":"2024-04-26T11:48:21.674829+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'445","last_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_deep_scrub":"76'445","last_deep_scrub_stamp":"2024-04-26T11:48:21.674498+0000","last_clean_scrub_stamp":"2024-04-26T11:48:21.674498+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:22.562702+0000","scrub_duration":0.0044128639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":9922,"num_write":416,"num_write_kb":89827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.989853+0000","last_change":"2024-04-26T11:48:28.989853+0000","last_active":"2024-04-26T11:48:28.989853+0000","last_peered":"2024-04-26T11:48:28.989853+0000","last_clean":"2024-04-26T11:48:28.989853+0000","last_became_active":"2024-04-26T11:47:11.442236+0000","last_became_peered":"2024-04-26T11:47:11.442236+0000","last_unstale":"2024-04-26T11:48:28.989853+0000","last_undegraded":"2024-04-26T11:48:28.989853+0000","last_fullsized":"2024-04-26T11:48:28.989853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:28.989586+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.989586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:35.455730+0000","scrub_duration":0.0033627959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"115'425","reported_seq":547,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:11.690455+0000","last_change":"2024-04-26T11:49:11.690455+0000","last_active":"2024-04-26T11:49:11.690455+0000","last_peered":"2024-04-26T11:49:11.690455+0000","last_clean":"2024-04-26T11:49:11.690455+0000","last_became_active":"2024-04-26T11:44:21.061699+0000","last_became_peered":"2024-04-26T11:44:21.061699+0000","last_unstale":"2024-04-26T11:49:11.690455+0000","last_undegraded":"2024-04-26T11:49:11.690455+0000","last_fullsized":"2024-04-26T11:49:11.690455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'425","last_scrub_stamp":"2024-04-26T11:49:11.690257+0000","last_deep_scrub":"115'425","last_deep_scrub_stamp":"2024-04-26T11:49:11.690257+0000","last_clean_scrub_stamp":"2024-04-26T11:49:11.690257+0000","objects_scrubbed":2,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:02.411178+0000","scrub_duration":0.031295459999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"76'336","reported_seq":471,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:40.373758+0000","last_change":"2024-04-26T11:49:40.374050+0000","last_active":"2024-04-26T11:49:40.373758+0000","last_peered":"2024-04-26T11:49:40.373758+0000","last_clean":"2024-04-26T11:49:40.373758+0000","last_became_active":"2024-04-26T11:47:21.457478+0000","last_became_peered":"2024-04-26T11:47:21.457478+0000","last_unstale":"2024-04-26T11:49:40.373758+0000","last_undegraded":"2024-04-26T11:49:40.373758+0000","last_fullsized":"2024-04-26T11:49:40.373758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'336","last_scrub_stamp":"2024-04-26T11:49:40.373707+0000","last_deep_scrub":"76'336","last_deep_scrub_stamp":"2024-04-26T11:49:40.373707+0000","last_clean_scrub_stamp":"2024-04-26T11:49:40.373707+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:52.185575+0000","scrub_duration":0.0039503760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9502,"num_write":316,"num_write_kb":33800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":138,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:44.349584+0000","last_change":"2024-04-26T11:49:44.349584+0000","last_active":"2024-04-26T11:49:44.349584+0000","last_peered":"2024-04-26T11:49:44.349584+0000","last_clean":"2024-04-26T11:49:44.349584+0000","last_became_active":"2024-04-26T11:47:11.154000+0000","last_became_peered":"2024-04-26T11:47:11.154000+0000","last_unstale":"2024-04-26T11:49:44.349584+0000","last_undegraded":"2024-04-26T11:49:44.349584+0000","last_fullsized":"2024-04-26T11:49:44.349584+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:44.349270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:44.349270+0000","last_clean_scrub_stamp":"2024-04-26T11:49:44.349270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:39.945148+0000","scrub_duration":0.0033297729999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"74'65","reported_seq":199,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:50.471768+0000","last_change":"2024-04-26T11:49:50.472038+0000","last_active":"2024-04-26T11:49:50.471768+0000","last_peered":"2024-04-26T11:49:50.471768+0000","last_clean":"2024-04-26T11:49:50.471768+0000","last_became_active":"2024-04-26T11:47:11.155172+0000","last_became_peered":"2024-04-26T11:47:11.155172+0000","last_unstale":"2024-04-26T11:49:50.471768+0000","last_undegraded":"2024-04-26T11:49:50.471768+0000","last_fullsized":"2024-04-26T11:49:50.471768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'65","last_scrub_stamp":"2024-04-26T11:49:50.471716+0000","last_deep_scrub":"74'65","last_deep_scrub_stamp":"2024-04-26T11:49:50.471716+0000","last_clean_scrub_stamp":"2024-04-26T11:49:50.471716+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:57.582659+0000","scrub_duration":0.0033302789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"76'380","reported_seq":515,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:14.131154+0000","last_change":"2024-04-26T11:49:14.131154+0000","last_active":"2024-04-26T11:49:14.131154+0000","last_peered":"2024-04-26T11:49:14.131154+0000","last_clean":"2024-04-26T11:49:14.131154+0000","last_became_active":"2024-04-26T11:47:25.436648+0000","last_became_peered":"2024-04-26T11:47:25.436648+0000","last_unstale":"2024-04-26T11:49:14.131154+0000","last_undegraded":"2024-04-26T11:49:14.131154+0000","last_fullsized":"2024-04-26T11:49:14.131154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'380","last_scrub_stamp":"2024-04-26T11:49:14.130850+0000","last_deep_scrub":"76'380","last_deep_scrub_stamp":"2024-04-26T11:49:14.130850+0000","last_clean_scrub_stamp":"2024-04-26T11:49:14.130850+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:24.657925+0000","scrub_duration":0.0042359490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13598,"num_write":349,"num_write_kb":63556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"115'514","reported_seq":659,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:09.130437+0000","last_change":"2024-04-26T11:49:09.130554+0000","last_active":"2024-04-26T11:49:09.130437+0000","last_peered":"2024-04-26T11:49:09.130437+0000","last_clean":"2024-04-26T11:49:09.130437+0000","last_became_active":"2024-04-26T11:47:14.134007+0000","last_became_peered":"2024-04-26T11:47:14.134007+0000","last_unstale":"2024-04-26T11:49:09.130437+0000","last_undegraded":"2024-04-26T11:49:09.130437+0000","last_fullsized":"2024-04-26T11:49:09.130437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'514","last_scrub_stamp":"2024-04-26T11:49:09.130413+0000","last_deep_scrub":"115'514","last_deep_scrub_stamp":"2024-04-26T11:49:09.130413+0000","last_clean_scrub_stamp":"2024-04-26T11:49:09.130413+0000","objects_scrubbed":1,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:24.502839+0000","scrub_duration":0.021096667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:11.078631+0000","last_change":"2024-04-26T11:49:11.078631+0000","last_active":"2024-04-26T11:49:11.078631+0000","last_peered":"2024-04-26T11:49:11.078631+0000","last_clean":"2024-04-26T11:49:11.078631+0000","last_became_active":"2024-04-26T11:47:11.440439+0000","last_became_peered":"2024-04-26T11:47:11.440439+0000","last_unstale":"2024-04-26T11:49:11.078631+0000","last_undegraded":"2024-04-26T11:49:11.078631+0000","last_fullsized":"2024-04-26T11:49:11.078631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:11.078330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:11.078330+0000","last_clean_scrub_stamp":"2024-04-26T11:49:11.078330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:07.202271+0000","scrub_duration":0.0032418809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'344","reported_seq":499,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:28.714423+0000","last_change":"2024-04-26T11:48:28.714423+0000","last_active":"2024-04-26T11:48:28.714423+0000","last_peered":"2024-04-26T11:48:28.714423+0000","last_clean":"2024-04-26T11:48:28.714423+0000","last_became_active":"2024-04-26T11:44:21.444222+0000","last_became_peered":"2024-04-26T11:44:21.444222+0000","last_unstale":"2024-04-26T11:48:28.714423+0000","last_undegraded":"2024-04-26T11:48:28.714423+0000","last_fullsized":"2024-04-26T11:48:28.714423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'344","last_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_deep_scrub":"76'344","last_deep_scrub_stamp":"2024-04-26T11:48:28.714119+0000","last_clean_scrub_stamp":"2024-04-26T11:48:28.714119+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:28.093833+0000","scrub_duration":0.0054659280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17750,"num_write":317,"num_write_kb":21777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'63","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:20.033773+0000","last_change":"2024-04-26T11:48:20.033773+0000","last_active":"2024-04-26T11:48:20.033773+0000","last_peered":"2024-04-26T11:48:20.033773+0000","last_clean":"2024-04-26T11:48:20.033773+0000","last_became_active":"2024-04-26T11:47:11.440423+0000","last_became_peered":"2024-04-26T11:47:11.440423+0000","last_unstale":"2024-04-26T11:48:20.033773+0000","last_undegraded":"2024-04-26T11:48:20.033773+0000","last_fullsized":"2024-04-26T11:48:20.033773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'63","last_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_deep_scrub":"74'63","last_deep_scrub_stamp":"2024-04-26T11:48:20.033325+0000","last_clean_scrub_stamp":"2024-04-26T11:48:20.033325+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:48.515506+0000","scrub_duration":0.0038822000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":138,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:06.737932+0000","last_change":"2024-04-26T11:49:06.737932+0000","last_active":"2024-04-26T11:49:06.737932+0000","last_peered":"2024-04-26T11:49:06.737932+0000","last_clean":"2024-04-26T11:49:06.737932+0000","last_became_active":"2024-04-26T11:47:11.149315+0000","last_became_peered":"2024-04-26T11:47:11.149315+0000","last_unstale":"2024-04-26T11:49:06.737932+0000","last_undegraded":"2024-04-26T11:49:06.737932+0000","last_fullsized":"2024-04-26T11:49:06.737932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:06.737649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:06.737649+0000","last_clean_scrub_stamp":"2024-04-26T11:49:06.737649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:41.572042+0000","scrub_duration":0.0033533780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"76'387","reported_seq":540,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:32.680131+0000","last_change":"2024-04-26T11:48:32.680131+0000","last_active":"2024-04-26T11:48:32.680131+0000","last_peered":"2024-04-26T11:48:32.680131+0000","last_clean":"2024-04-26T11:48:32.680131+0000","last_became_active":"2024-04-26T11:44:21.445501+0000","last_became_peered":"2024-04-26T11:44:21.445501+0000","last_unstale":"2024-04-26T11:48:32.680131+0000","last_undegraded":"2024-04-26T11:48:32.680131+0000","last_fullsized":"2024-04-26T11:48:32.680131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'387","last_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_deep_scrub":"76'387","last_deep_scrub_stamp":"2024-04-26T11:48:32.679781+0000","last_clean_scrub_stamp":"2024-04-26T11:48:32.679781+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:53.697537+0000","scrub_duration":0.0049983019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21065,"num_write":364,"num_write_kb":70758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"115'59","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:26.993614+0000","last_change":"2024-04-26T11:48:26.993614+0000","last_active":"2024-04-26T11:48:26.993614+0000","last_peered":"2024-04-26T11:48:26.993614+0000","last_clean":"2024-04-26T11:48:26.993614+0000","last_became_active":"2024-04-26T11:47:11.443837+0000","last_became_peered":"2024-04-26T11:47:11.443837+0000","last_unstale":"2024-04-26T11:48:26.993614+0000","last_undegraded":"2024-04-26T11:48:26.993614+0000","last_fullsized":"2024-04-26T11:48:26.993614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'59","last_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_deep_scrub":"115'59","last_deep_scrub_stamp":"2024-04-26T11:48:26.993216+0000","last_clean_scrub_stamp":"2024-04-26T11:48:26.993216+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:01.847961+0000","scrub_duration":0.0066337560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:22.028330+0000","last_change":"2024-04-26T11:48:22.028330+0000","last_active":"2024-04-26T11:48:22.028330+0000","last_peered":"2024-04-26T11:48:22.028330+0000","last_clean":"2024-04-26T11:48:22.028330+0000","last_became_active":"2024-04-26T11:47:11.443143+0000","last_became_peered":"2024-04-26T11:47:11.443143+0000","last_unstale":"2024-04-26T11:48:22.028330+0000","last_undegraded":"2024-04-26T11:48:22.028330+0000","last_fullsized":"2024-04-26T11:48:22.028330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:48:22.028073+0000","last_clean_scrub_stamp":"2024-04-26T11:48:22.028073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:50.488548+0000","scrub_duration":0.0032986119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'392","reported_seq":496,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:22.161514+0000","last_change":"2024-04-26T11:49:22.161779+0000","last_active":"2024-04-26T11:49:22.161514+0000","last_peered":"2024-04-26T11:49:22.161514+0000","last_clean":"2024-04-26T11:49:22.161514+0000","last_became_active":"2024-04-26T11:47:36.439435+0000","last_became_peered":"2024-04-26T11:47:36.439435+0000","last_unstale":"2024-04-26T11:49:22.161514+0000","last_undegraded":"2024-04-26T11:49:22.161514+0000","last_fullsized":"2024-04-26T11:49:22.161514+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-26T11:49:22.161465+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-26T11:49:22.161465+0000","last_clean_scrub_stamp":"2024-04-26T11:49:22.161465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:30.815987+0000","scrub_duration":0.0034889420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4438,"num_write":367,"num_write_kb":50276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"115'72","reported_seq":92,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:15.150969+0000","last_change":"2024-04-26T11:48:15.150969+0000","last_active":"2024-04-26T11:48:15.150969+0000","last_peered":"2024-04-26T11:48:15.150969+0000","last_clean":"2024-04-26T11:48:15.150969+0000","last_became_active":"2024-04-26T11:47:11.445683+0000","last_became_peered":"2024-04-26T11:47:11.445683+0000","last_unstale":"2024-04-26T11:48:15.150969+0000","last_undegraded":"2024-04-26T11:48:15.150969+0000","last_fullsized":"2024-04-26T11:48:15.150969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'72","last_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_deep_scrub":"115'72","last_deep_scrub_stamp":"2024-04-26T11:48:15.150680+0000","last_clean_scrub_stamp":"2024-04-26T11:48:15.150680+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:41.664584+0000","scrub_duration":0.021253264000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":255,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:28.145442+0000","last_change":"2024-04-26T11:49:28.145667+0000","last_active":"2024-04-26T11:49:28.145442+0000","last_peered":"2024-04-26T11:49:28.145442+0000","last_clean":"2024-04-26T11:49:28.145442+0000","last_became_active":"2024-04-26T11:44:17.036048+0000","last_became_peered":"2024-04-26T11:44:17.036048+0000","last_unstale":"2024-04-26T11:49:28.145442+0000","last_undegraded":"2024-04-26T11:49:28.145442+0000","last_fullsized":"2024-04-26T11:49:28.145442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:49:28.145395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:49:28.145395+0000","last_clean_scrub_stamp":"2024-04-26T11:49:28.145395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:53.647454+0000","scrub_duration":0.0032670189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"76'396","reported_seq":573,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:23.712478+0000","last_change":"2024-04-26T11:48:23.712478+0000","last_active":"2024-04-26T11:48:23.712478+0000","last_peered":"2024-04-26T11:48:23.712478+0000","last_clean":"2024-04-26T11:48:23.712478+0000","last_became_active":"2024-04-26T11:44:21.434556+0000","last_became_peered":"2024-04-26T11:44:21.434556+0000","last_unstale":"2024-04-26T11:48:23.712478+0000","last_undegraded":"2024-04-26T11:48:23.712478+0000","last_fullsized":"2024-04-26T11:48:23.712478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-26T11:48:23.712095+0000","last_clean_scrub_stamp":"2024-04-26T11:48:23.712095+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:55.117125+0000","scrub_duration":0.0051007090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30271,"num_write":367,"num_write_kb":87840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'427","reported_seq":585,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:54.516001+0000","last_change":"2024-04-26T11:49:54.516250+0000","last_active":"2024-04-26T11:49:54.516001+0000","last_peered":"2024-04-26T11:49:54.516001+0000","last_clean":"2024-04-26T11:49:54.516001+0000","last_became_active":"2024-04-26T11:44:21.449729+0000","last_became_peered":"2024-04-26T11:44:21.449729+0000","last_unstale":"2024-04-26T11:49:54.516001+0000","last_undegraded":"2024-04-26T11:49:54.516001+0000","last_fullsized":"2024-04-26T11:49:54.516001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'427","last_scrub_stamp":"2024-04-26T11:49:54.515946+0000","last_deep_scrub":"76'427","last_deep_scrub_stamp":"2024-04-26T11:49:54.515946+0000","last_clean_scrub_stamp":"2024-04-26T11:49:54.515946+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:12.998646+0000","scrub_duration":0.0050120340000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23507,"num_write":393,"num_write_kb":61004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"115'416","reported_seq":537,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:36.029976+0000","last_change":"2024-04-26T11:48:36.029976+0000","last_active":"2024-04-26T11:48:36.029976+0000","last_peered":"2024-04-26T11:48:36.029976+0000","last_clean":"2024-04-26T11:48:36.029976+0000","last_became_active":"2024-04-26T11:44:21.066972+0000","last_became_peered":"2024-04-26T11:44:21.066972+0000","last_unstale":"2024-04-26T11:48:36.029976+0000","last_undegraded":"2024-04-26T11:48:36.029976+0000","last_fullsized":"2024-04-26T11:48:36.029976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'416","last_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_deep_scrub":"115'416","last_deep_scrub_stamp":"2024-04-26T11:48:36.029835+0000","last_clean_scrub_stamp":"2024-04-26T11:48:36.029835+0000","objects_scrubbed":5,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:10.864228+0000","scrub_duration":0.034626879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":8412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"76'423","reported_seq":559,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:37.946809+0000","last_change":"2024-04-26T11:48:37.946809+0000","last_active":"2024-04-26T11:48:37.946809+0000","last_peered":"2024-04-26T11:48:37.946809+0000","last_clean":"2024-04-26T11:48:37.946809+0000","last_became_active":"2024-04-26T11:47:31.441363+0000","last_became_peered":"2024-04-26T11:47:31.441363+0000","last_unstale":"2024-04-26T11:48:37.946809+0000","last_undegraded":"2024-04-26T11:48:37.946809+0000","last_fullsized":"2024-04-26T11:48:37.946809+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'423","last_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_deep_scrub":"76'423","last_deep_scrub_stamp":"2024-04-26T11:48:37.946505+0000","last_clean_scrub_stamp":"2024-04-26T11:48:37.946505+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:45.776669+0000","scrub_duration":0.0044478900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17694,"num_write":400,"num_write_kb":79512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"115'105","reported_seq":226,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:13.647691+0000","last_change":"2024-04-26T11:49:13.647691+0000","last_active":"2024-04-26T11:49:13.647691+0000","last_peered":"2024-04-26T11:49:13.647691+0000","last_clean":"2024-04-26T11:49:13.647691+0000","last_became_active":"2024-04-26T11:44:21.061563+0000","last_became_peered":"2024-04-26T11:44:21.061563+0000","last_unstale":"2024-04-26T11:49:13.647691+0000","last_undegraded":"2024-04-26T11:49:13.647691+0000","last_fullsized":"2024-04-26T11:49:13.647691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'105","last_scrub_stamp":"2024-04-26T11:49:13.647275+0000","last_deep_scrub":"115'105","last_deep_scrub_stamp":"2024-04-26T11:49:13.647275+0000","last_clean_scrub_stamp":"2024-04-26T11:49:13.647275+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:23.912985+0000","scrub_duration":0.0077776210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"115'335","reported_seq":480,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:03.180771+0000","last_change":"2024-04-26T11:49:03.180771+0000","last_active":"2024-04-26T11:49:03.180771+0000","last_peered":"2024-04-26T11:49:03.180771+0000","last_clean":"2024-04-26T11:49:03.180771+0000","last_became_active":"2024-04-26T11:47:14.137936+0000","last_became_peered":"2024-04-26T11:47:14.137936+0000","last_unstale":"2024-04-26T11:49:03.180771+0000","last_undegraded":"2024-04-26T11:49:03.180771+0000","last_fullsized":"2024-04-26T11:49:03.180771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'335","last_scrub_stamp":"2024-04-26T11:49:03.180575+0000","last_deep_scrub":"115'335","last_deep_scrub_stamp":"2024-04-26T11:49:03.180575+0000","last_clean_scrub_stamp":"2024-04-26T11:49:03.180575+0000","objects_scrubbed":1,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:20.897350+0000","scrub_duration":0.020406345999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"76'463","reported_seq":592,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.973251+0000","last_change":"2024-04-26T11:48:30.973251+0000","last_active":"2024-04-26T11:48:30.973251+0000","last_peered":"2024-04-26T11:48:30.973251+0000","last_clean":"2024-04-26T11:48:30.973251+0000","last_became_active":"2024-04-26T11:47:26.448235+0000","last_became_peered":"2024-04-26T11:47:26.448235+0000","last_unstale":"2024-04-26T11:48:30.973251+0000","last_undegraded":"2024-04-26T11:48:30.973251+0000","last_fullsized":"2024-04-26T11:48:30.973251+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'463","last_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_deep_scrub":"76'463","last_deep_scrub_stamp":"2024-04-26T11:48:30.972981+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.972981+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:34.247031+0000","scrub_duration":0.0044136920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17794,"num_write":446,"num_write_kb":68083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"74'51","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:12.019177+0000","last_change":"2024-04-26T11:48:12.019177+0000","last_active":"2024-04-26T11:48:12.019177+0000","last_peered":"2024-04-26T11:48:12.019177+0000","last_clean":"2024-04-26T11:48:12.019177+0000","last_became_active":"2024-04-26T11:47:11.446046+0000","last_became_peered":"2024-04-26T11:47:11.446046+0000","last_unstale":"2024-04-26T11:48:12.019177+0000","last_undegraded":"2024-04-26T11:48:12.019177+0000","last_fullsized":"2024-04-26T11:48:12.019177+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'51","last_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_deep_scrub":"74'51","last_deep_scrub_stamp":"2024-04-26T11:48:12.018689+0000","last_clean_scrub_stamp":"2024-04-26T11:48:12.018689+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:01.030509+0000","scrub_duration":0.0039670319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'447","reported_seq":588,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:30.005500+0000","last_change":"2024-04-26T11:48:30.005500+0000","last_active":"2024-04-26T11:48:30.005500+0000","last_peered":"2024-04-26T11:48:30.005500+0000","last_clean":"2024-04-26T11:48:30.005500+0000","last_became_active":"2024-04-26T11:47:41.461379+0000","last_became_peered":"2024-04-26T11:47:41.461379+0000","last_unstale":"2024-04-26T11:48:30.005500+0000","last_undegraded":"2024-04-26T11:48:30.005500+0000","last_fullsized":"2024-04-26T11:48:30.005500+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'447","last_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_deep_scrub":"76'447","last_deep_scrub_stamp":"2024-04-26T11:48:30.005160+0000","last_clean_scrub_stamp":"2024-04-26T11:48:30.005160+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:09.022128+0000","scrub_duration":0.0044822300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30529,"num_write":430,"num_write_kb":108384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'366","reported_seq":531,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:41.646917+0000","last_change":"2024-04-26T11:48:41.647158+0000","last_active":"2024-04-26T11:48:41.646917+0000","last_peered":"2024-04-26T11:48:41.646917+0000","last_clean":"2024-04-26T11:48:41.646917+0000","last_became_active":"2024-04-26T11:44:21.436661+0000","last_became_peered":"2024-04-26T11:44:21.436661+0000","last_unstale":"2024-04-26T11:48:41.646917+0000","last_undegraded":"2024-04-26T11:48:41.646917+0000","last_fullsized":"2024-04-26T11:48:41.646917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'366","last_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_deep_scrub":"76'366","last_deep_scrub_stamp":"2024-04-26T11:48:41.646862+0000","last_clean_scrub_stamp":"2024-04-26T11:48:41.646862+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:47.318788+0000","scrub_duration":0.0041890690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25621,"num_write":345,"num_write_kb":63246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"115'776","reported_seq":890,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:05.101753+0000","last_change":"2024-04-26T11:49:05.101753+0000","last_active":"2024-04-26T11:49:05.101753+0000","last_peered":"2024-04-26T11:49:05.101753+0000","last_clean":"2024-04-26T11:49:05.101753+0000","last_became_active":"2024-04-26T11:47:14.430719+0000","last_became_peered":"2024-04-26T11:47:14.430719+0000","last_unstale":"2024-04-26T11:49:05.101753+0000","last_undegraded":"2024-04-26T11:49:05.101753+0000","last_fullsized":"2024-04-26T11:49:05.101753+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'776","last_scrub_stamp":"2024-04-26T11:49:05.101560+0000","last_deep_scrub":"115'776","last_deep_scrub_stamp":"2024-04-26T11:49:05.101560+0000","last_clean_scrub_stamp":"2024-04-26T11:49:05.101560+0000","objects_scrubbed":2,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:23.999436+0000","scrub_duration":0.031574363000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":8520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'385","reported_seq":511,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:37.260007+0000","last_change":"2024-04-26T11:49:37.260243+0000","last_active":"2024-04-26T11:49:37.260007+0000","last_peered":"2024-04-26T11:49:37.260007+0000","last_clean":"2024-04-26T11:49:37.260007+0000","last_became_active":"2024-04-26T11:47:33.456542+0000","last_became_peered":"2024-04-26T11:47:33.456542+0000","last_unstale":"2024-04-26T11:49:37.260007+0000","last_undegraded":"2024-04-26T11:49:37.260007+0000","last_fullsized":"2024-04-26T11:49:37.260007+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'385","last_scrub_stamp":"2024-04-26T11:49:37.259956+0000","last_deep_scrub":"76'385","last_deep_scrub_stamp":"2024-04-26T11:49:37.259956+0000","last_clean_scrub_stamp":"2024-04-26T11:49:37.259956+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:11.538341+0000","scrub_duration":0.0042895069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14048,"num_write":361,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"115'329","reported_seq":446,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.155128+0000","last_change":"2024-04-26T11:49:07.155128+0000","last_active":"2024-04-26T11:49:07.155128+0000","last_peered":"2024-04-26T11:49:07.155128+0000","last_clean":"2024-04-26T11:49:07.155128+0000","last_became_active":"2024-04-26T11:47:14.430015+0000","last_became_peered":"2024-04-26T11:47:14.430015+0000","last_unstale":"2024-04-26T11:49:07.155128+0000","last_undegraded":"2024-04-26T11:49:07.155128+0000","last_fullsized":"2024-04-26T11:49:07.155128+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'329","last_scrub_stamp":"2024-04-26T11:49:07.154976+0000","last_deep_scrub":"115'329","last_deep_scrub_stamp":"2024-04-26T11:49:07.154976+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.154976+0000","objects_scrubbed":1,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:50.736767+0000","scrub_duration":0.017101642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'385","reported_seq":552,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:54.740054+0000","last_change":"2024-04-26T11:48:54.740054+0000","last_active":"2024-04-26T11:48:54.740054+0000","last_peered":"2024-04-26T11:48:54.740054+0000","last_clean":"2024-04-26T11:48:54.740054+0000","last_became_active":"2024-04-26T11:44:21.446573+0000","last_became_peered":"2024-04-26T11:44:21.446573+0000","last_unstale":"2024-04-26T11:48:54.740054+0000","last_undegraded":"2024-04-26T11:48:54.740054+0000","last_fullsized":"2024-04-26T11:48:54.740054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'385","last_scrub_stamp":"2024-04-26T11:48:54.739766+0000","last_deep_scrub":"76'385","last_deep_scrub_stamp":"2024-04-26T11:48:54.739766+0000","last_clean_scrub_stamp":"2024-04-26T11:48:54.739766+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:00.843817+0000","scrub_duration":0.0056441019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30536,"num_write":351,"num_write_kb":64337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"115'354","reported_seq":504,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:07.792341+0000","last_change":"2024-04-26T11:49:07.792341+0000","last_active":"2024-04-26T11:49:07.792341+0000","last_peered":"2024-04-26T11:49:07.792341+0000","last_clean":"2024-04-26T11:49:07.792341+0000","last_became_active":"2024-04-26T11:47:14.139525+0000","last_became_peered":"2024-04-26T11:47:14.139525+0000","last_unstale":"2024-04-26T11:49:07.792341+0000","last_undegraded":"2024-04-26T11:49:07.792341+0000","last_fullsized":"2024-04-26T11:49:07.792341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'354","last_scrub_stamp":"2024-04-26T11:49:07.791996+0000","last_deep_scrub":"115'354","last_deep_scrub_stamp":"2024-04-26T11:49:07.791996+0000","last_clean_scrub_stamp":"2024-04-26T11:49:07.791996+0000","objects_scrubbed":3,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:03.875875+0000","scrub_duration":0.041359689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12343887,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":12225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11895685,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"76'369","reported_seq":867,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:29.698714+0000","last_change":"2024-04-26T11:48:29.698714+0000","last_active":"2024-04-26T11:48:29.698714+0000","last_peered":"2024-04-26T11:48:29.698714+0000","last_clean":"2024-04-26T11:48:29.698714+0000","last_became_active":"2024-04-26T11:47:19.138724+0000","last_became_peered":"2024-04-26T11:47:19.138724+0000","last_unstale":"2024-04-26T11:48:29.698714+0000","last_undegraded":"2024-04-26T11:48:29.698714+0000","last_fullsized":"2024-04-26T11:48:29.698714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'369","last_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_deep_scrub":"76'369","last_deep_scrub_stamp":"2024-04-26T11:48:29.698434+0000","last_clean_scrub_stamp":"2024-04-26T11:48:29.698434+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:04.873874+0000","scrub_duration":0.004418478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14629,"num_write":342,"num_write_kb":46731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"115'58","reported_seq":179,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:18.727460+0000","last_change":"2024-04-26T11:49:18.727460+0000","last_active":"2024-04-26T11:49:18.727460+0000","last_peered":"2024-04-26T11:49:18.727460+0000","last_clean":"2024-04-26T11:49:18.727460+0000","last_became_active":"2024-04-26T11:44:21.063111+0000","last_became_peered":"2024-04-26T11:44:21.063111+0000","last_unstale":"2024-04-26T11:49:18.727460+0000","last_undegraded":"2024-04-26T11:49:18.727460+0000","last_fullsized":"2024-04-26T11:49:18.727460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'58","last_scrub_stamp":"2024-04-26T11:49:18.727169+0000","last_deep_scrub":"115'58","last_deep_scrub_stamp":"2024-04-26T11:49:18.727169+0000","last_clean_scrub_stamp":"2024-04-26T11:49:18.727169+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:29.056593+0000","scrub_duration":0.016535326999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"76'377","reported_seq":897,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:13.226901+0000","last_change":"2024-04-26T11:48:13.226901+0000","last_active":"2024-04-26T11:48:13.226901+0000","last_peered":"2024-04-26T11:48:13.226901+0000","last_clean":"2024-04-26T11:48:13.226901+0000","last_became_active":"2024-04-26T11:47:30.144411+0000","last_became_peered":"2024-04-26T11:47:30.144411+0000","last_unstale":"2024-04-26T11:48:13.226901+0000","last_undegraded":"2024-04-26T11:48:13.226901+0000","last_fullsized":"2024-04-26T11:48:13.226901+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'377","last_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_deep_scrub":"76'377","last_deep_scrub_stamp":"2024-04-26T11:48:13.226463+0000","last_clean_scrub_stamp":"2024-04-26T11:48:13.226463+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:03.708994+0000","scrub_duration":0.0044302090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25430,"num_write":354,"num_write_kb":58705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"115'277","reported_seq":423,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:27.109273+0000","last_change":"2024-04-26T11:48:27.109273+0000","last_active":"2024-04-26T11:48:27.109273+0000","last_peered":"2024-04-26T11:48:27.109273+0000","last_clean":"2024-04-26T11:48:27.109273+0000","last_became_active":"2024-04-26T11:47:14.133830+0000","last_became_peered":"2024-04-26T11:47:14.133830+0000","last_unstale":"2024-04-26T11:48:27.109273+0000","last_undegraded":"2024-04-26T11:48:27.109273+0000","last_fullsized":"2024-04-26T11:48:27.109273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'277","last_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_deep_scrub":"115'277","last_deep_scrub_stamp":"2024-04-26T11:48:27.109059+0000","last_clean_scrub_stamp":"2024-04-26T11:48:27.109059+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:02.122709+0000","scrub_duration":0.021146224000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"76'391","reported_seq":914,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:34.042997+0000","last_change":"2024-04-26T11:48:34.042997+0000","last_active":"2024-04-26T11:48:34.042997+0000","last_peered":"2024-04-26T11:48:34.042997+0000","last_clean":"2024-04-26T11:48:34.042997+0000","last_became_active":"2024-04-26T11:47:25.143790+0000","last_became_peered":"2024-04-26T11:47:25.143790+0000","last_unstale":"2024-04-26T11:48:34.042997+0000","last_undegraded":"2024-04-26T11:48:34.042997+0000","last_fullsized":"2024-04-26T11:48:34.042997+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'391","last_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_deep_scrub":"76'391","last_deep_scrub_stamp":"2024-04-26T11:48:34.042706+0000","last_clean_scrub_stamp":"2024-04-26T11:48:34.042706+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:24.193868+0000","scrub_duration":0.0052922139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17805,"num_write":373,"num_write_kb":79176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"115'333","reported_seq":454,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:56.811047+0000","last_change":"2024-04-26T11:48:56.811047+0000","last_active":"2024-04-26T11:48:56.811047+0000","last_peered":"2024-04-26T11:48:56.811047+0000","last_clean":"2024-04-26T11:48:56.811047+0000","last_became_active":"2024-04-26T11:44:21.062917+0000","last_became_peered":"2024-04-26T11:44:21.062917+0000","last_unstale":"2024-04-26T11:48:56.811047+0000","last_undegraded":"2024-04-26T11:48:56.811047+0000","last_fullsized":"2024-04-26T11:48:56.811047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'333","last_scrub_stamp":"2024-04-26T11:48:56.810845+0000","last_deep_scrub":"115'333","last_deep_scrub_stamp":"2024-04-26T11:48:56.810845+0000","last_clean_scrub_stamp":"2024-04-26T11:48:56.810845+0000","objects_scrubbed":4,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.341984+0000","scrub_duration":0.0403226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"76'424","reported_seq":965,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:48:50.684402+0000","last_change":"2024-04-26T11:48:50.684402+0000","last_active":"2024-04-26T11:48:50.684402+0000","last_peered":"2024-04-26T11:48:50.684402+0000","last_clean":"2024-04-26T11:48:50.684402+0000","last_became_active":"2024-04-26T11:47:23.181456+0000","last_became_peered":"2024-04-26T11:47:23.181456+0000","last_unstale":"2024-04-26T11:48:50.684402+0000","last_undegraded":"2024-04-26T11:48:50.684402+0000","last_fullsized":"2024-04-26T11:48:50.684402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'424","last_scrub_stamp":"2024-04-26T11:48:50.684066+0000","last_deep_scrub":"76'424","last_deep_scrub_stamp":"2024-04-26T11:48:50.684066+0000","last_clean_scrub_stamp":"2024-04-26T11:48:50.684066+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:36.226053+0000","scrub_duration":0.0045709319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10292,"num_write":401,"num_write_kb":91548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"115'52","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:48.474657+0000","last_change":"2024-04-26T11:49:48.474820+0000","last_active":"2024-04-26T11:49:48.474657+0000","last_peered":"2024-04-26T11:49:48.474657+0000","last_clean":"2024-04-26T11:49:48.474657+0000","last_became_active":"2024-04-26T11:47:11.443439+0000","last_became_peered":"2024-04-26T11:47:11.443439+0000","last_unstale":"2024-04-26T11:49:48.474657+0000","last_undegraded":"2024-04-26T11:49:48.474657+0000","last_fullsized":"2024-04-26T11:49:48.474657+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'52","last_scrub_stamp":"2024-04-26T11:49:48.474634+0000","last_deep_scrub":"115'52","last_deep_scrub_stamp":"2024-04-26T11:49:48.474634+0000","last_clean_scrub_stamp":"2024-04-26T11:49:48.474634+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:14.618369+0000","scrub_duration":0.015001399,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'436","reported_seq":993,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:02.136503+0000","last_change":"2024-04-26T11:49:02.136503+0000","last_active":"2024-04-26T11:49:02.136503+0000","last_peered":"2024-04-26T11:49:02.136503+0000","last_clean":"2024-04-26T11:49:02.136503+0000","last_became_active":"2024-04-26T11:47:37.155979+0000","last_became_peered":"2024-04-26T11:47:37.155979+0000","last_unstale":"2024-04-26T11:49:02.136503+0000","last_undegraded":"2024-04-26T11:49:02.136503+0000","last_fullsized":"2024-04-26T11:49:02.136503+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'436","last_scrub_stamp":"2024-04-26T11:49:02.136184+0000","last_deep_scrub":"76'436","last_deep_scrub_stamp":"2024-04-26T11:49:02.136184+0000","last_clean_scrub_stamp":"2024-04-26T11:49:02.136184+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:14.675035+0000","scrub_duration":0.0045192979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21746,"num_write":409,"num_write_kb":79826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"115'57","reported_seq":86,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-26T11:49:19.159861+0000","last_change":"2024-04-26T11:49:19.160126+0000","last_active":"2024-04-26T11:49:19.159861+0000","last_peered":"2024-04-26T11:49:19.159861+0000","last_clean":"2024-04-26T11:49:19.159861+0000","last_became_active":"2024-04-26T11:47:11.446135+0000","last_became_peered":"2024-04-26T11:47:11.446135+0000","last_unstale":"2024-04-26T11:49:19.159861+0000","last_undegraded":"2024-04-26T11:49:19.159861+0000","last_fullsized":"2024-04-26T11:49:19.159861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'57","last_scrub_stamp":"2024-04-26T11:49:19.159801+0000","last_deep_scrub":"115'57","last_deep_scrub_stamp":"2024-04-26T11:49:19.159801+0000","last_clean_scrub_stamp":"2024-04-26T11:49:19.159801+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:43.568000+0000","scrub_duration":0.018090722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2577,"num_read_kb":1334377,"num_write":24444,"num_write_kb":4043624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8151,"num_bytes_recovered":7957,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26052,"ondisk_log_size":26052,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127013443,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":93,"num_read_kb":1446,"num_write":6027,"num_write_kb":128187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":80426326,"num_keys_recovered":255,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254091264,"data_stored":254026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},"log_size":7927,"ondisk_log_size":7927,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738450,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200496,"kb_used_data":89064,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94171344,"statfs":{"total":96636764160,"available":96431456256,"internally_reserved":0,"allocated":91201536,"data_stored":90584365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:50:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78100000000000003,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.42999999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80400000000000005,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Apr 26 11:50:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65000000000000002,"15min":0.63400000000000001},"min":{"1min":0.59799999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.69299999999999995}]}]},{"osd":1,"up_from":72,"seq":309237645354,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125616,"kb_used_data":80040,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94246224,"statfs":{"total":96636764160,"available":96508133376,"internally_reserved":0,"allocated":81960960,"data_stored":81365510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6912,"internal_metadata":46654720},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.54200000000000004,"5min":0.379,"15min":0.379},"max":{"1min":0.70999999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Apr 26 11:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.52500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.73199999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.52700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.73099999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.77300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190668,"kb_used_data":83332,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94181172,"statfs":{"total":96636764160,"available":96441520128,"internally_reserved":0,"allocated":85331968,"data_stored":84726408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:50:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.48799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75700000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.73099999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri Apr 26 11:50:15 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.63600000000000001,"15min":0.68500000000000005},"min":{"1min":0.59899999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80300000000000005,"5min":0.90900000000000003,"15min":0.93400000000000005},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65300000000000002,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76200000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83668992,"data_stored":83647909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":80887808,"data_stored":80875245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5318,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89534464,"data_stored":89503732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:50:34.468 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T11:50:34.836 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T11:50:34.836 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:50:35.166 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:50:35.166 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:44:21.418355+0000","modified":"2024-04-26T11:44:24.430416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4213":{"gid":4213,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/3774122357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3774122357},{"type":"v1","addr":"172.21.15.29:6803","nonce":3774122357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:50:35.169 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:50:35.181 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:50:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:50:35.516 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:44:21.418355+0000","modified":"2024-04-26T11:44:24.430416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4213":{"gid":4213,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/3774122357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3774122357},{"type":"v1","addr":"172.21.15.29:6803","nonce":3774122357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:50:35.519 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:50:35.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:50:35.835 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:50:35.836 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":115,"fsid":"6589dbc2-8d04-4af3-b2ff-9d9b928d2ff7","created":"2024-04-26T11:43:59.327999+0000","modified":"2024-04-26T11:48:04.159996+0000","last_up_change":"2024-04-26T11:47:10.111142+0000","last_in_change":"2024-04-26T11:44:00.980949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:44:10.024928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:44:15.295362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:44:19.992912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:44:20.415578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a044aa1-7704-498d-af77-565f6fdb2bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":18212},{"type":"v1","addr":"172.21.15.72:6801","nonce":18212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":18212},{"type":"v1","addr":"172.21.15.72:6803","nonce":18212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":18212},{"type":"v1","addr":"172.21.15.72:6807","nonce":18212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":18212},{"type":"v1","addr":"172.21.15.72:6805","nonce":18212}]},"public_addr":"172.21.15.72:6801/18212","cluster_addr":"172.21.15.72:6803/18212","heartbeat_back_addr":"172.21.15.72:6807/18212","heartbeat_front_addr":"172.21.15.72:6805/18212","state":["exists","up"]},{"osd":1,"uuid":"6aad0623-0085-42f2-873e-766474c95e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":72,"up_thru":103,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1425},{"type":"v1","addr":"172.21.15.82:6801","nonce":1425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1425},{"type":"v1","addr":"172.21.15.82:6803","nonce":1425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1425},{"type":"v1","addr":"172.21.15.82:6807","nonce":1425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1425},{"type":"v1","addr":"172.21.15.82:6805","nonce":1425}]},"public_addr":"172.21.15.82:6801/1425","cluster_addr":"172.21.15.82:6803/1425","heartbeat_back_addr":"172.21.15.82:6807/1425","heartbeat_front_addr":"172.21.15.82:6805/1425","state":["exists","up"]},{"osd":2,"uuid":"1367cc49-5228-4e11-96fc-ffb092dc8397","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":18323},{"type":"v1","addr":"172.21.15.122:6801","nonce":18323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":18323},{"type":"v1","addr":"172.21.15.122:6803","nonce":18323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":18323},{"type":"v1","addr":"172.21.15.122:6807","nonce":18323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":18323},{"type":"v1","addr":"172.21.15.122:6805","nonce":18323}]},"public_addr":"172.21.15.122:6801/18323","cluster_addr":"172.21.15.122:6803/18323","heartbeat_back_addr":"172.21.15.122:6807/18323","heartbeat_front_addr":"172.21.15.122:6805/18323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.307476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.324325+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:44:06.354056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:50:35.851 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T11:50:36.212 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T11:50:36.227 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T11:50:36.247 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-04-26T11:50:37.233 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T11:50:38.226 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-04-26T11:50:38.240 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T11:50:39.232 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-04-26T11:50:39.244 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T11:50:39.244 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T11:50:39.244 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:50:39.256 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T11:50:39.256 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T11:50:39.257 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T11:50:39.257 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:50:39.347 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T11:50:39.347 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T11:50:39.347 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:50:39.440 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T11:50:39.441 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T11:50:39.441 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:50:39.528 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T11:50:39.529 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T11:50:39.529 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T11:50:39.529 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:50:39.561 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T11:50:39.561 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T11:50:39.561 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:50:39.594 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T11:50:39.594 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T11:50:39.594 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T11:50:39.594 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:50:39.649 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T11:50:39.650 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T11:50:39.650 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:50:39.703 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T11:50:39.704 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T11:50:39.704 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:50:39.753 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T11:50:39.753 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T11:50:39.754 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-26T11:50:39.775 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:50:39.775 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T11:50:40.016 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:50:40.017 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T11:50:40.183 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-26T11:50:40.184 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T11:50:40.422 INFO:tasks.ceph:Archiving mon data... 2024-04-26T11:50:40.523 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/data/mon.a.tgz 2024-04-26T11:50:40.524 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-26T11:50:40.531 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.jboE88chPk 2024-04-26T11:50:40.532 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jboE88chPk 2024-04-26T11:50:40.643 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.jboE88chPk 2024-04-26T11:50:40.717 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.jboE88chPk is 437KB 2024-04-26T11:50:40.787 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.jboE88chPk 2024-04-26T11:50:40.796 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/data/mon.b.tgz 2024-04-26T11:50:40.796 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-26T11:50:40.803 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.SsdgMPaYnA 2024-04-26T11:50:40.804 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SsdgMPaYnA 2024-04-26T11:50:40.949 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.SsdgMPaYnA 2024-04-26T11:50:40.975 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.SsdgMPaYnA is 601KB 2024-04-26T11:50:41.046 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.SsdgMPaYnA 2024-04-26T11:50:41.053 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/data/mon.c.tgz 2024-04-26T11:50:41.053 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-26T11:50:41.060 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.3RW8f9QePb 2024-04-26T11:50:41.060 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3RW8f9QePb 2024-04-26T11:50:41.248 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.3RW8f9QePb 2024-04-26T11:50:41.269 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.3RW8f9QePb is 601KB 2024-04-26T11:50:41.293 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.3RW8f9QePb 2024-04-26T11:50:41.298 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T11:50:41.298 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:50:41.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:50:41.343 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:50:41.345 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:50:41.367 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T11:50:41.367 DEBUG:teuthology.orchestra.run.smithi029:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:50:41.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:50:41.371 DEBUG:teuthology.orchestra.run.smithi082:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:50:41.391 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:50:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:50:41.411 DEBUG:teuthology.orchestra.run.smithi122:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:50:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:50:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:50:41.472 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T11:50:41.474 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi029/crash 2024-04-26T11:50:41.475 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:50:41.491 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi072/crash 2024-04-26T11:50:41.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:50:41.510 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi082/crash 2024-04-26T11:50:41.511 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:50:41.539 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi122/crash 2024-04-26T11:50:41.540 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:50:41.557 INFO:tasks.ceph:Compressing logs... 2024-04-26T11:50:41.557 DEBUG:teuthology.orchestra.run.smithi029:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:50:41.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:50:41.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:50:41.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:50:47.209 INFO:tasks.ceph:Archiving logs... 2024-04-26T11:50:47.209 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi029/log 2024-04-26T11:50:47.210 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:50:47.569 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi072/log 2024-04-26T11:50:47.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:50:48.345 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi082/log 2024-04-26T11:50:48.346 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:50:48.496 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi122/log 2024-04-26T11:50:48.497 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:50:49.207 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T11:50:49.216 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T11:50:49.217 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:50:49.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:50:49.221 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:50:49.224 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:50:49.314 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T11:50:49.323 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T11:50:49.323 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:50:49.325 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:50:49.327 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:50:49.329 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:50:49.347 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:50:49.347 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2024-04-26T11:50:49.347 INFO:teuthology.orchestra.run.smithi072.stdout:+hv01.front.sepi 67.205.162.81 3 u - 64 377 0.064 -2.070 0.600 2024-04-26T11:50:49.347 INFO:teuthology.orchestra.run.smithi072.stdout:*hv02.front.sepi 63.231.80.2 3 u 7 64 377 0.081 0.418 0.428 2024-04-26T11:50:49.347 INFO:teuthology.orchestra.run.smithi072.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 64 377 0.092 -0.204 0.315 2024-04-26T11:50:49.348 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-26T11:50:49.348 INFO:teuthology.orchestra.run.smithi029.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:50:49.348 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================== 2024-04-26T11:50:49.348 INFO:teuthology.orchestra.run.smithi029.stdout:+hv01.front.sepi 67.205.162.81 3 u 6 64 377 0.067 0.270 0.852 2024-04-26T11:50:49.348 INFO:teuthology.orchestra.run.smithi029.stdout:+hv02.front.sepi 63.231.80.2 3 u 9 64 377 0.075 2.085 0.718 2024-04-26T11:50:49.348 INFO:teuthology.orchestra.run.smithi029.stdout:*hv03.front.sepi 74.6.168.72 3 u 5 64 377 0.078 2.113 1.105 2024-04-26T11:50:49.348 INFO:teuthology.orchestra.run.smithi029.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-26T11:50:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:50:49.352 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================== 2024-04-26T11:50:49.352 INFO:teuthology.orchestra.run.smithi122.stdout:+hv01.front.sepi 67.205.162.81 3 u 8 64 377 0.063 -1.587 0.047 2024-04-26T11:50:49.352 INFO:teuthology.orchestra.run.smithi122.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 377 0.083 0.694 0.043 2024-04-26T11:50:49.352 INFO:teuthology.orchestra.run.smithi122.stdout:*hv03.front.sepi 74.6.168.72 3 u 4 64 377 0.082 -0.182 0.061 2024-04-26T11:50:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-26T11:50:49.372 INFO:teuthology.orchestra.run.smithi082.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:50:49.372 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================== 2024-04-26T11:50:49.372 INFO:teuthology.orchestra.run.smithi082.stdout: hv01.front.sepi 67.205.162.81 3 u 31 64 1 0.137 -1.223 0.000 2024-04-26T11:50:49.372 INFO:teuthology.orchestra.run.smithi082.stdout: hv02.front.sepi 63.231.80.2 3 u 33 64 1 0.091 1.006 0.000 2024-04-26T11:50:49.372 INFO:teuthology.orchestra.run.smithi082.stdout: hv03.front.sepi 74.6.168.72 3 u 34 64 1 0.126 0.040 0.000 2024-04-26T11:50:49.372 INFO:teuthology.orchestra.run.smithi082.stdout: hv04.front.sepi .STEP. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T11:50:49.373 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T11:50:49.382 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T11:50:49.383 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T11:50:49.392 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T11:50:49.401 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T11:50:49.410 INFO:teuthology.task.internal:Duration was 956.246472 seconds 2024-04-26T11:50:49.410 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T11:50:49.420 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T11:50:49.420 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:50:49.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:50:49.424 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:50:49.426 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:50:49.486 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T11:50:49.486 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T11:50:49.486 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:50:49.500 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:50:49.501 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:50:49.515 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:50:49.516 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:50:49.531 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-04-26T11:50:49.532 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:50:49.548 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T11:50:49.548 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:50:49.550 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:50:49.553 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:50:49.555 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:50:49.632 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T11:50:49.632 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:50:49.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:50:49.638 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:50:49.641 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:50:49.736 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T11:50:49.748 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T11:50:49.748 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:50:49.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:50:49.780 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:50:49.796 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:50:49.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T11:50:49.823 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:50:49.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:50:49.827 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:50:49.829 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:50:49.837 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-04-26T11:50:49.840 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2024-04-26T11:50:49.843 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-04-26T11:50:49.857 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-04-26T11:50:49.890 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:50:49.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:50:49.900 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:50:49.914 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:50:49.914 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:50:49.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:50:49.939 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:50:49.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:50:49.945 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T11:50:49.956 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T11:50:49.957 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi029 2024-04-26T11:50:49.957 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:50:49.984 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi072 2024-04-26T11:50:49.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:50:50.010 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi082 2024-04-26T11:50:50.010 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:50:50.034 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674172/remote/smithi122 2024-04-26T11:50:50.034 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:50:50.060 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T11:50:50.060 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:50:50.062 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:50:50.065 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:50:50.067 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:50:50.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T11:50:50.117 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T11:50:50.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T11:50:50.128 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T11:50:50.128 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:50:50.130 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:50:50.132 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:50:50.135 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:50:50.136 INFO:teuthology.orchestra.run.smithi029.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:50 /home/ubuntu/cephtest 2024-04-26T11:50:50.138 INFO:teuthology.orchestra.run.smithi072.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:50 /home/ubuntu/cephtest 2024-04-26T11:50:50.140 INFO:teuthology.orchestra.run.smithi082.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:50 /home/ubuntu/cephtest 2024-04-26T11:50:50.141 INFO:teuthology.orchestra.run.smithi122.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:50 /home/ubuntu/cephtest 2024-04-26T11:50:50.144 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T11:50:50.155 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T11:50:50.179 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_20.04 tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 956.2464718818665 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T11:50:50.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T11:50:50.257 INFO:teuthology.run:pass